-- Logs begin at Mon 2022-10-17 12:30:58 UTC, end at Mon 2022-10-17 15:15:44 UTC. -- Oct 17 13:04:18.455723 n-d-854121-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 13:04:18.465876 n-d-854121-14 devstack@n-api.service[104831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 13:04:18 2022] *** Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: nodename: n-d-854121-14 Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: machine: x86_64 Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: clock source: unix Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: pcre jit disabled Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: detected number of CPU cores: 4 Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: current working directory: / Oct 17 13:04:18.468371 n-d-854121-14 devstack@n-api.service[104831]: detected binary path: /usr/bin/uwsgi-core Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: your processes number limit is 47680 Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: your memory page size is 4096 bytes Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: detected max file descriptor number: 2048 Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: lock engine: pthread robust mutexes Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: thunder lock: enabled Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 13:04:18.469108 n-d-854121-14 devstack@n-api.service[104831]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 13:04:18.509831 n-d-854121-14 devstack@n-api.service[104831]: Python main interpreter initialized at 0x564603d609c0 Oct 17 13:04:18.509831 n-d-854121-14 devstack@n-api.service[104831]: python threads support enabled Oct 17 13:04:18.509831 n-d-854121-14 devstack@n-api.service[104831]: your server socket listen backlog is limited to 100 connections Oct 17 13:04:18.509831 n-d-854121-14 devstack@n-api.service[104831]: your mercy for graceful operations on workers is 90 seconds Oct 17 13:04:18.510239 n-d-854121-14 devstack@n-api.service[104831]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 13:04:18.510318 n-d-854121-14 devstack@n-api.service[104831]: *** Operational MODE: preforking *** Oct 17 13:04:18.510560 n-d-854121-14 devstack@n-api.service[104831]: *** uWSGI is running in multiple interpreter mode *** Oct 17 13:04:18.510560 n-d-854121-14 devstack@n-api.service[104831]: spawned uWSGI master process (pid: 104831) Oct 17 13:04:18.511699 n-d-854121-14 devstack@n-api.service[104831]: spawned uWSGI worker 1 (pid: 104832, cores: 1) Oct 17 13:04:18.511553 n-d-854121-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 13:04:18.511903 n-d-854121-14 devstack@n-api.service[104831]: spawned uWSGI worker 2 (pid: 104833, cores: 1) Oct 17 13:04:18.511903 n-d-854121-14 devstack@n-api.service[104831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 13:04:19.172786 n-d-854121-14 devstack@n-api.service[104832]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:04:19.196285 n-d-854121-14 devstack@n-api.service[104833]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:04:20.251425 n-d-854121-14 devstack@n-api.service[104832]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:04:20.251425 n-d-854121-14 devstack@n-api.service[104832]: from cryptography.utils import int_from_bytes Oct 17 13:04:20.252577 n-d-854121-14 devstack@n-api.service[104832]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:04:20.252577 n-d-854121-14 devstack@n-api.service[104832]: from cryptography.utils import int_from_bytes Oct 17 13:04:20.309633 n-d-854121-14 devstack@n-api.service[104833]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:04:20.309633 n-d-854121-14 devstack@n-api.service[104833]: from cryptography.utils import int_from_bytes Oct 17 13:04:20.310228 n-d-854121-14 devstack@n-api.service[104833]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:04:20.310228 n-d-854121-14 devstack@n-api.service[104833]: from cryptography.utils import int_from_bytes Oct 17 13:04:22.734856 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:04:22.735415 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:04:22.735627 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:04:22.736516 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:04:22.736765 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:04:22.737141 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.737484 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.737800 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.738110 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:04:22.738471 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.738542 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:04:22.738695 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.738767 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.738941 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:04:22.739046 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.739305 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:04:22.739404 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.739596 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:04:22.739694 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.739873 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.740020 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.740181 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.740347 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.740501 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-14 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.740709 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.740838 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.741069 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.741240 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.741425 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.741555 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.741735 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.741898 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742033 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742168 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742332 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742461 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742629 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742768 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.742932 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.743121 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.743575 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.743714 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.743822 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-14 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.743933 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744119 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744312 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744441 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744551 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744678 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744804 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.744986 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745124 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745273 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745391 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745516 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745654 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745798 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.745972 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.746191 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.746333 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.746502 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.746640 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-14 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.746809 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.746938 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.747119 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.747256 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.747455 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.747592 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.747770 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.747927 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748076 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748234 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748372 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748537 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748674 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748852 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.748987 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.749198 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.749346 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.749497 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.749702 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-14 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.749831 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750117 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750262 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750399 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750532 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750657 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750781 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.750974 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.751103 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.751276 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.751407 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.751609 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.752364 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.752560 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.752751 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.752927 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.753055 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.753205 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.753345 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.753480 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.753660 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.753841 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754029 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754216 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754351 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754476 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754611 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754741 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754865 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.754980 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755103 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755237 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755364 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755501 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755650 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755795 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.755954 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.756094 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.756256 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.756386 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.756557 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.756685 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.756857 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757000 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757182 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757331 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757459 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757584 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757766 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.757905 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758068 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758197 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758320 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758446 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758624 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758762 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.758946 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759077 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759254 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759379 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759562 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759679 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759868 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.759999 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.760175 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.760336 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.760464 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.760588 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.760772 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.760907 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.761077 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.761239 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.761403 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.761532 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.761718 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.761856 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762030 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762167 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762330 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762449 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762630 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762761 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.762931 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.763073 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.763244 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.763374 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.763572 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.763703 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.763871 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764002 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764138 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764264 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764399 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764524 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764724 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764864 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.764991 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.765114 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.765311 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.765437 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.765579 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.765739 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.765870 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.766046 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.766176 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.766353 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.766496 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.766672 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.766810 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.767003 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.767133 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.767335 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.767554 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.767748 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.767880 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768015 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768141 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768275 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768402 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768526 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768658 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768826 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.768956 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.769140 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.769296 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.769437 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.769563 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.769737 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.769877 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770044 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770175 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770348 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770485 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770648 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770777 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.770948 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771086 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771252 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771380 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771549 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771677 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771847 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.771985 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.772156 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.772284 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.772453 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.772580 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.772751 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.772882 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773063 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773239 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773368 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773506 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773673 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773803 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.773985 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.774115 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.774281 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.774413 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.774580 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.774711 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.774890 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775022 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775190 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775329 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775494 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775621 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775816 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.775944 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.776121 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.776261 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.776425 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.776554 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.776721 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.776850 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777019 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777180 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777344 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777468 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777639 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777774 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.777951 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778089 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778258 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778388 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778563 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778690 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778863 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.778993 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.779163 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.779292 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.779464 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.779591 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.779769 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.779914 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.780073 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.780210 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.780377 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.780525 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.780714 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.780843 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.781047 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.781217 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.781370 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.781499 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.781694 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.781825 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.782000 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.782136 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.782309 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.782449 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.782613 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.782742 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.782944 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.783073 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.783266 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:04:22.783500 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.783682 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.783910 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.784038 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.784230 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.784357 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.784546 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.784676 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.784872 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785001 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785211 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785357 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785529 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785657 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785841 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.785969 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.786145 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.786356 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.786497 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.786623 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.786747 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.786868 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787063 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787192 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787365 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787499 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787680 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787819 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.787998 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.788135 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.788319 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.788446 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.788633 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.788760 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.788948 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.789085 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.789275 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.789419 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.789584 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.789719 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.789889 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790033 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790216 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790343 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790521 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790648 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790829 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.790967 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.791186 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.791324 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.791499 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.791635 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.791819 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.791947 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.792127 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.792255 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.792432 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.792569 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.792739 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.792876 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.793045 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.793193 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.793370 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.793501 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.793701 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.793831 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794013 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794140 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794326 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794455 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794634 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794769 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.794944 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.795073 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.795260 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.795401 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.795566 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.795694 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.795874 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796008 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796180 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796316 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796479 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796607 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796778 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.796906 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.797075 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.797265 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.797398 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.797523 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.797691 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.797819 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.798004 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.798141 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.798326 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.798955 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.799190 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.799317 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.799506 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.799644 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.799876 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800010 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800184 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800312 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800490 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800620 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800797 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.800933 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.801099 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.801318 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.801458 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.801583 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.801729 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.801857 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802029 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802166 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802348 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802479 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802653 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802790 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.802954 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.803084 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.803272 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.803402 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.803593 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.803719 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.803906 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.804201 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.804330 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.804513 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.804757 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.804884 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.805127 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.805301 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.805457 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.805588 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.805781 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.805910 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.806091 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.806230 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.806397 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.806534 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.806713 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.806842 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807018 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807159 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807326 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807464 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807641 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807771 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.807954 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.808086 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.808268 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.808397 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.808580 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.808718 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.808878 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809051 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809197 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809325 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809495 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809626 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809799 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.809931 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.810100 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.810229 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.810399 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.810539 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.810706 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.810846 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811006 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811135 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811306 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811444 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811605 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811743 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.811904 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812035 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812203 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812341 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812520 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812651 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812825 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.812956 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.813121 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.813288 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.813449 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.813579 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.813754 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.813885 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.814105 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.814790 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.814953 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.815095 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.815262 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.815440 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.815643 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.815779 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.815912 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.816078 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.816208 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.816400 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.816540 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.816713 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.816843 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817026 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817216 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817361 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817499 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817656 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817793 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.817963 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.818105 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.818271 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.818410 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.818588 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.818719 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.818895 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819024 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819212 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819335 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819517 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819607 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819837 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.819972 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.820143 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.820274 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.820452 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.820580 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.820751 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.820879 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.821064 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.821217 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.821399 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.821539 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.821722 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.821851 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822033 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822163 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822350 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822478 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822659 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822796 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.822969 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.823096 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.823270 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.823398 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.823575 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.823712 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.823883 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824014 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824191 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824327 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824507 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824645 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824813 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.824950 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.825133 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.825297 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.825465 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.825606 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.825778 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.825905 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826081 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826208 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826391 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826531 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826689 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826825 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.826998 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.827126 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.827307 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.827435 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.827627 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.827757 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.827930 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828057 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828239 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828371 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828547 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828676 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828851 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.828980 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.829171 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.829304 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.829486 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.829617 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.829836 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.829963 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.830174 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.830361 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.830492 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.830616 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.830780 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.830919 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.831104 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.831233 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.831411 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.831540 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.831711 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.831856 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832022 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832149 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832323 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832451 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832624 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832763 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.832924 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.833053 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.833252 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.833396 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.833569 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.833708 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.833876 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.834014 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.834193 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.834322 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.834510 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.834674 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.834811 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835019 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835157 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835358 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835496 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835694 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835841 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.835994 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.836124 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.836291 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.836429 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.836589 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.836720 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.836924 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.837097 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.837246 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.837487 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.837618 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.837794 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.837923 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.838101 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.838231 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.838426 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.838557 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.838735 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.838870 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839041 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839183 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839344 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839471 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839648 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839782 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.839957 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.840093 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.840262 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.840392 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.840570 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.840700 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.840877 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841019 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841204 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841340 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841516 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841645 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841830 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.841971 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.842133 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.842264 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.842440 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.842569 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.842746 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.842876 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843047 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843176 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843352 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843482 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843662 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843790 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.843976 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.844228 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.844359 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.844557 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.844766 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.844896 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.845021 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.845192 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.845360 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.845582 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.845758 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.845904 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846031 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846209 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846339 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846531 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846661 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846841 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.846973 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.847143 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.847448 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.847577 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.847746 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.847877 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848046 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848175 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848352 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848483 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848651 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848790 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.848952 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.849092 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.849283 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.849415 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.849645 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.849798 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.849927 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850052 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850177 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850319 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850449 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850632 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850772 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.850946 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.851084 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.851255 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.851384 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.851567 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.851698 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.851872 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852002 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852180 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852302 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852488 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852618 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852784 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.852912 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.853084 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.853244 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.853407 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.853541 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.853709 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.853845 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854014 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854158 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854327 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854465 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854632 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854763 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.854946 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.855085 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.855276 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.855419 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.855546 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.855672 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.855869 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.856001 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.856168 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.856298 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.856466 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.856857 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857026 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857186 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857352 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857483 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857657 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857787 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.857954 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858088 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858259 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858389 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858562 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858683 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858868 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.858998 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.859170 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.859309 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.859466 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.859605 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.859816 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.859954 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.860080 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.860205 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.860359 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.860499 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.860664 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.860793 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.861495 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.861628 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.861796 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.861947 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.862102 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.862234 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.862453 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.862582 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.862766 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.862905 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.863077 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.863207 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.863383 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.863512 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.863695 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.863834 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864001 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864130 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864306 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864436 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864606 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864737 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.864907 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865035 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865214 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865342 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865524 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865661 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865833 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.865960 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.866138 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.866266 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.866439 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.866571 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.866739 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.866875 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867044 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867184 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867344 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867475 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867644 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867771 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.867947 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.868085 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.868255 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.868384 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.868563 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.868691 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.868865 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.869083 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.869263 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.869390 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.869513 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.869650 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.869781 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870025 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870165 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870299 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870408 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870539 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870676 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870802 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.870926 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871051 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871182 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871308 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871478 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871617 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871775 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.871915 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872092 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872222 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872397 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872521 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872695 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872825 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.872995 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.873125 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.873320 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.873456 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.873646 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.873778 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.873945 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.874084 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.874250 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.874380 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.874555 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.874691 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.874859 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875001 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875162 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875292 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875473 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875600 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875777 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.875919 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.876077 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.876205 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.876373 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.877279 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.877279 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.877548 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.877676 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.877802 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.877926 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.878052 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.878285 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.878425 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.878591 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.878722 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.878906 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879036 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879227 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879358 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879535 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879663 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879845 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.879995 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.880199 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.880329 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.880454 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.880578 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.880753 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.880883 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.881059 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.881226 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.881394 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.881522 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.881695 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.881824 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882021 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882161 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882323 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882452 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882630 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882769 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.882936 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.883066 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.883241 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.883370 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.883544 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.883752 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.883887 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.884110 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.884240 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.884427 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.884556 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.884730 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.884907 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885051 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885211 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885362 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885492 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885667 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885799 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.885965 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.886103 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.886270 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.886410 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.886570 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.886702 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.886875 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887003 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887173 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887311 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887483 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887611 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887790 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.887919 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.888102 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.888242 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.888412 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.888542 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.888717 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.888846 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889044 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889213 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889375 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889505 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889681 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889808 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.889977 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.890109 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.890292 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.890421 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.890604 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.890734 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.890909 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.891040 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.891270 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.891397 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.891570 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.891700 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.891869 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892000 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892207 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892386 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892515 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892642 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892811 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.892943 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.893110 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.893265 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.893504 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.893648 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.893824 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.893955 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.894123 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.894263 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.894437 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.894577 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.894836 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.894965 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.895136 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.895267 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.895440 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.895587 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.895746 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.895885 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896055 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896206 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896380 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896521 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896684 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896814 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.896989 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.897119 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.897307 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.897437 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.897628 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.897759 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.897935 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.898067 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.898256 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.898393 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.898581 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.898718 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.898899 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899038 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899208 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899338 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899520 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899652 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899820 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.899949 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.900208 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.900342 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.900483 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.900618 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.900744 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.900869 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.901049 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.901256 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.901488 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.901621 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.901799 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.901927 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.902104 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.902242 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.902425 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.902555 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.902742 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.902872 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903044 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903184 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903344 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903475 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903647 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903761 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.903945 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.904070 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.904246 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.904376 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.904562 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.904700 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.904861 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.905001 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.905183 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.905425 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.905559 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.905786 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.905925 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.906084 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.906213 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.906384 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.906514 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.906703 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.906843 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907003 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907133 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907319 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907457 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907626 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907804 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.907956 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.908083 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.908275 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.908416 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.908576 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.908782 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.908912 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.909042 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.909207 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.909325 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.909511 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.909712 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.909842 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910035 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910166 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910390 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910539 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910667 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910794 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.910962 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.911094 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.911272 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.911413 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.911598 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.911736 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.911912 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912044 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912239 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912378 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912560 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912690 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912866 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.912995 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.913214 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.913347 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.913486 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.913614 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.913807 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.913935 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.914103 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.914233 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.914403 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.914534 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.914706 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.914836 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915003 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915142 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915302 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915441 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915602 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915734 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.915904 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.916035 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.916198 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.916337 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.916497 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.916640 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.916899 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917030 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917242 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917376 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917545 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917688 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917862 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.917991 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.918164 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.918293 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.918462 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.918602 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.918763 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.918895 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919060 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919190 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919363 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919504 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919675 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919805 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.919979 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.920113 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.920289 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.920439 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.920592 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.920723 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.920897 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921029 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921208 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921353 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921524 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921653 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921826 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.921957 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.922135 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.922272 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.922446 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.922574 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.922750 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.922880 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.923050 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.923180 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.923878 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.924015 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.924236 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.924503 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.924640 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.924767 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.924936 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.925088 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.925271 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.925444 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.925598 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.925754 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.925919 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.926049 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.926238 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.926378 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.926556 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.926686 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.926872 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927002 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927190 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927331 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927548 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927678 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927868 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.927997 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.928175 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.928309 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.928489 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.928618 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.928802 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.928931 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.929118 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.929304 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.929467 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.929693 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.929825 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930031 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930171 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930347 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930480 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930662 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930794 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.930975 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.931108 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.931289 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.931429 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.931601 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.931732 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.931910 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932048 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932216 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932345 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932526 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932666 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932835 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.932977 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.933138 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.933291 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.933468 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.933612 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.933777 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.933908 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.934084 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.934214 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.934389 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.934529 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.934699 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.934830 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935008 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935139 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935330 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935470 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935657 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935789 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.935973 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.936104 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.936284 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.936417 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.936594 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.936725 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.936903 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.937034 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.937224 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.937440 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.937571 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.937749 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.937881 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.938088 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.938220 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.938383 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.938514 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.938703 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.938836 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.939040 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.939805 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.939979 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.940106 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.940241 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.940408 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.940549 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.940797 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.940940 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.941067 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.941217 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.941410 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.941544 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.941723 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.941863 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.942039 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.942170 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.942345 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.942477 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.942644 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.942865 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.943000 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.943184 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.943323 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.943522 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.943758 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.943889 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.944104 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.944234 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.944413 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.944545 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.944734 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.944865 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.945056 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.945233 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.945395 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.945526 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.945698 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.945831 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946009 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946148 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946308 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946437 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946610 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946739 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.946919 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947058 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947227 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947357 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947526 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947656 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947825 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.947965 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.948130 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.948263 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.948434 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.948660 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.948800 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949013 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949143 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949333 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949462 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949655 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949798 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.949957 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.950087 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.950256 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.950453 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.950584 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.950719 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.950855 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951049 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951180 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951305 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951431 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951575 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951703 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951835 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.951985 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.952115 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.952288 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.952422 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.952586 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.952718 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.952890 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953028 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953208 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953330 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953498 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953630 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953847 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.953977 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.954150 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.954282 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.954449 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.954589 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.954828 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.954960 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.955137 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.955271 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.955443 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.955576 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.955755 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.955894 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956062 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956193 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956366 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956497 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956673 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956813 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.956977 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.957108 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.957311 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.957443 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.957617 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.957762 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.957928 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.958234 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.958365 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.958543 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.958680 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.958870 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959000 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959200 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959329 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959507 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959646 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959814 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.959942 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.960115 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.960252 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.960417 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.960556 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.960734 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.960871 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961094 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961266 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961396 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961531 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961659 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961784 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.961959 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.962088 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.962267 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.962399 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.962574 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.962704 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.962879 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.963149 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.963288 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.963475 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.963610 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.963781 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.963911 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964086 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964226 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964390 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964520 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964694 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964824 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.964997 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.965138 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.965317 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.965447 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.965654 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.965785 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.965968 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.966100 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.966277 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.966406 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.966586 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.966723 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.966898 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967027 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967200 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967330 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967504 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967641 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967843 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.967973 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.968098 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.968224 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.968389 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.968528 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.968710 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.968830 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.969045 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.969197 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.969327 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.969467 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.969665 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.969978 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.970107 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.970829 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.970979 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.971203 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.971345 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.971472 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.971694 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.971825 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972014 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972145 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972340 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972471 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972664 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972795 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.972978 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.973119 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.973317 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.973448 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.973628 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.973756 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.973944 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.974074 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.974275 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.974407 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.974590 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.974734 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.974898 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.975028 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.975202 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.975503 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.975632 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.975803 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.975935 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.976113 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.976243 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.976428 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.976559 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.976735 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.976867 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977033 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977149 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977355 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977478 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977661 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977779 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.977962 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.978085 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.978263 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.978388 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.978563 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.978679 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.978863 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.979022 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.979168 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.979355 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.979481 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.979685 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.979802 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980001 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980117 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980309 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980426 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980603 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980679 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980901 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.980992 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.981224 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.981335 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.981777 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.981875 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.982076 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.982165 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.982374 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.982451 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.983234 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.983395 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.983515 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.984876 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.984876 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.985175 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.985325 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.985456 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.985592 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.985728 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.985893 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.986550 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.986680 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.986805 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.986805 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987090 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987218 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987343 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987476 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987602 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987736 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987863 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.987863 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988101 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988101 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988336 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988469 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988597 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988730 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988863 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.988989 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989115 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989322 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989451 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989576 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989700 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989825 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.989958 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990086 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990201 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990324 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990449 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990577 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990577 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990825 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.990825 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991069 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991069 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991307 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991441 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991583 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991793 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.991923 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992048 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992183 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992321 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992446 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992571 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992695 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992828 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.992964 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993080 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993229 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993360 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993485 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993610 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993744 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.993871 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994006 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994140 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994267 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994393 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994531 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994658 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994784 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.994916 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995043 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995177 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995304 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995502 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995634 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995808 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.995946 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.996133 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.996265 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.996456 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.996596 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.996800 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.996939 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.997109 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.997299 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.997473 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.997568 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.997787 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.997960 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998095 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998227 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998404 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998490 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998704 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998803 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.998943 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104832) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:04:22.999040 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.999323 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:22.999704 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.000093 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.000419 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.000750 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.001079 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.001422 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.001945 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.002278 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.002632 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.002949 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.003299 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.003628 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.003945 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.004263 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.004570 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:04:23.004817 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104833) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:04:23.152769 n-d-854121-14 devstack@n-api.service[104832]: INFO dbcounter [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Registered counter for database nova_api Oct 17 13:04:23.159235 n-d-854121-14 devstack@n-api.service[104833]: INFO dbcounter [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Registered counter for database nova_api Oct 17 13:04:23.174557 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_db.sqlalchemy.engines [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.179900 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_db.sqlalchemy.engines [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.181541 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writer thread running {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.186633 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writer thread running {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.238242 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.context [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=104832) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:04:23.242108 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_concurrency.lockutils [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:23.242579 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_concurrency.lockutils [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:23.244180 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_concurrency.lockutils [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:23.244916 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_concurrency.lockutils [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:23.245392 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_concurrency.lockutils [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:23.247340 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.context [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=104833) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:04:23.247512 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_concurrency.lockutils [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:23.249347 n-d-854121-14 devstack@n-api.service[104832]: INFO dbcounter [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Registered counter for database nova_cell0 Oct 17 13:04:23.251242 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:23.252006 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:23.253442 n-d-854121-14 devstack@n-api.service[104832]: INFO dbcounter [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Registered counter for database nova_cell1 Oct 17 13:04:23.253617 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:23.254356 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:04:23.254804 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:04:23.256800 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:04:23.258851 n-d-854121-14 devstack@n-api.service[104833]: INFO dbcounter [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Registered counter for database nova_cell0 Oct 17 13:04:23.260940 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_db.sqlalchemy.engines [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.262525 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_db.sqlalchemy.engines [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.263493 n-d-854121-14 devstack@n-api.service[104833]: INFO dbcounter [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Registered counter for database nova_cell1 Oct 17 13:04:23.267826 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writer thread running {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.271134 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_db.sqlalchemy.engines [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.274705 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_db.sqlalchemy.engines [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.276765 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writer thread running {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.406551 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writer thread running {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.417194 n-d-854121-14 devstack@n-api.service[104832]: INFO dbcounter [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Registered counter for database nova_cell0 Oct 17 13:04:23.422684 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writer thread running {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.426205 n-d-854121-14 devstack@n-api.service[104832]: DEBUG oslo_db.sqlalchemy.engines [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104832) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.430863 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writer thread running {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.431782 n-d-854121-14 devstack@n-api.service[104833]: INFO dbcounter [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Registered counter for database nova_cell0 Oct 17 13:04:23.440646 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_db.sqlalchemy.engines [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104833) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:04:23.445686 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writer thread running {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:04:23.778290 n-d-854121-14 devstack@n-api.service[104833]: WARNING keystonemiddleware.auth_token [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:04:23.779242 n-d-854121-14 devstack@n-api.service[104832]: WARNING keystonemiddleware.auth_token [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:04:23.786070 n-d-854121-14 devstack@n-api.service[104833]: WARNING keystonemiddleware.auth_token [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:04:23.786239 n-d-854121-14 devstack@n-api.service[104832]: WARNING keystonemiddleware.auth_token [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:04:24.130768 n-d-854121-14 devstack@n-api.service[104833]: WARNING keystonemiddleware.auth_token [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:04:24.134364 n-d-854121-14 devstack@n-api.service[104832]: WARNING keystonemiddleware.auth_token [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:04:24.136655 n-d-854121-14 devstack@n-api.service[104833]: WARNING keystonemiddleware.auth_token [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:04:24.140310 n-d-854121-14 devstack@n-api.service[104832]: WARNING keystonemiddleware.auth_token [None req-9397a68f-ee2c-4c10-beae-1d9dc7308747 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:04:24.142073 n-d-854121-14 devstack@n-api.service[104833]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564603d609c0 pid: 104833 (default app) Oct 17 13:04:24.144205 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:04:24.145393 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Oct 17 13:04:24.145814 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Mon Oct 17 13:04:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:04:24.145967 n-d-854121-14 devstack@n-api.service[104832]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564603d609c0 pid: 104832 (default app) Oct 17 13:05:47.070455 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:47.071443 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 17 13:05:47.072010 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:05:47.084972 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_api:SELECT=3 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:47.086268 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_cell0:SELECT=3 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:47.087106 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_cell1:SELECT=3 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:47.087843 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:47.984026 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-d366021c-30c4-424e-b07d-1368e1c390ee admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:48.017534 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-d366021c-30c4-424e-b07d-1368e1c390ee admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938064 Oct 17 13:05:48.018358 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:05:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:50.660895 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:50.661944 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-25071594-7ca0-45d2-b3bc-2e880577b866 None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 17 13:05:50.662495 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:51.117264 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-64640bd6-b9f9-45ca-8329-f37399a89845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:51.164986 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-64640bd6-b9f9-45ca-8329-f37399a89845 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496474 Oct 17 13:05:51.165573 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:05:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:05:51.179406 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_api:SELECT=3 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:51.180220 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_cell0:SELECT=3 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:51.181241 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_cell1:SELECT=3 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:51.181964 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:05:51.395725 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-b4cac40e-96e7-4ad4-a8ea-e56b35a23faf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:51.466305 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-b4cac40e-96e7-4ad4-a8ea-e56b35a23faf admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291941 Oct 17 13:05:51.466902 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Oct 17 13:05:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:54.187587 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-64640bd6-b9f9-45ca-8329-f37399a89845 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:54.188587 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-64640bd6-b9f9-45ca-8329-f37399a89845 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 17 13:05:54.188983 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:54.977251 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-8bd67a2e-3691-450d-af5a-7972c25eccae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:55.028412 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-8bd67a2e-3691-450d-af5a-7972c25eccae admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.832562 Oct 17 13:05:55.028657 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:05:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:05:55.046376 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-2ae5c034-a82a-4dea-abb5-bc171d00cc0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:55.100144 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-2ae5c034-a82a-4dea-abb5-bc171d00cc0b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.058928 Oct 17 13:05:55.100970 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Oct 17 13:05:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:05:57.905222 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-8bd67a2e-3691-450d-af5a-7972c25eccae admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:05:57.907527 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-8bd67a2e-3691-450d-af5a-7972c25eccae admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Oct 17 13:05:57.918619 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:05:58.564680 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-b4fb9b0a-77e0-4911-83c6-3fb798907564 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:58.588056 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-b4fb9b0a-77e0-4911-83c6-3fb798907564 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.672399 Oct 17 13:05:58.588619 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:05:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:05:58.601601 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-47e5535d-ad5d-404e-addc-ef9a84f53b3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:05:58.640044 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-47e5535d-ad5d-404e-addc-ef9a84f53b3a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041992 Oct 17 13:05:58.645210 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Oct 17 13:05:58 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:01.295008 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-b4fb9b0a-77e0-4911-83c6-3fb798907564 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:01.295949 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-b4fb9b0a-77e0-4911-83c6-3fb798907564 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 17 13:06:01.296713 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:01.773347 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-66c43fc6-cacf-4edf-b694-927e104c4767 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:01.795250 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-66c43fc6-cacf-4edf-b694-927e104c4767 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490804 Oct 17 13:06:01.796253 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:01.810247 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-26b1c69c-503d-4b0f-ad26-84065016c64f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:01.841382 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-26b1c69c-503d-4b0f-ad26-84065016c64f admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034700 Oct 17 13:06:01.842167 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Oct 17 13:06:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:04.795191 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-66c43fc6-cacf-4edf-b694-927e104c4767 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:04.796104 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-66c43fc6-cacf-4edf-b694-927e104c4767 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Oct 17 13:06:04.797027 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:05.266069 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-31825681-6d7b-4dca-b30c-d12a95b6b749 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:05.290105 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-31825681-6d7b-4dca-b30c-d12a95b6b749 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485593 Oct 17 13:06:05.300421 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:05.303818 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-0e63f988-15bd-4ed4-ac5e-f16b9b739078 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:05.330409 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-0e63f988-15bd-4ed4-ac5e-f16b9b739078 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030160 Oct 17 13:06:05.331636 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1336 bytes} [Mon Oct 17 13:06:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:08.039971 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-31825681-6d7b-4dca-b30c-d12a95b6b749 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:08.040846 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-31825681-6d7b-4dca-b30c-d12a95b6b749 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 17 13:06:08.052226 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:08.538128 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-9fca0286-630e-41a4-9e24-367ae239886e admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:08.564596 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-9fca0286-630e-41a4-9e24-367ae239886e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.517071 Oct 17 13:06:08.565431 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:06:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:11.309429 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-31825681-6d7b-4dca-b30c-d12a95b6b749 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:11.310436 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-31825681-6d7b-4dca-b30c-d12a95b6b749 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Oct 17 13:06:11.310839 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:11.765429 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-699d7246-2796-4325-814e-dcf7127d154d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "name": "m1.tiny", "swap": 0}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:11.786452 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-699d7246-2796-4325-814e-dcf7127d154d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468932 Oct 17 13:06:11.786939 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:06:11.799342 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-07f88837-6f94-44dc-8a11-ebd6bcc6ca12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:11.831590 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-07f88837-6f94-44dc-8a11-ebd6bcc6ca12 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036172 Oct 17 13:06:11.832190 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Oct 17 13:06:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:14.515922 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-699d7246-2796-4325-814e-dcf7127d154d admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:14.518155 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-699d7246-2796-4325-814e-dcf7127d154d admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002660 Oct 17 13:06:14.518642 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:14.932189 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-8a94a0d6-9bc1-4cf4-91b7-6d8a60aea6ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "id": "2"}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:14.951795 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-8a94a0d6-9bc1-4cf4-91b7-6d8a60aea6ec admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426628 Oct 17 13:06:14.952356 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:14.964540 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-5fb44509-1724-432d-9202-7ce485d4ffcf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:14.990223 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-5fb44509-1724-432d-9202-7ce485d4ffcf admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029371 Oct 17 13:06:14.990953 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Oct 17 13:06:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:17.637507 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-8a94a0d6-9bc1-4cf4-91b7-6d8a60aea6ec admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:17.638601 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-8a94a0d6-9bc1-4cf4-91b7-6d8a60aea6ec admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 17 13:06:17.639025 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:18.035572 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-c17b7115-717f-4878-8314-0f03efdf1196 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "vcpus": 2, "name": "m1.medium", "id": "3"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:18.060058 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-c17b7115-717f-4878-8314-0f03efdf1196 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.413326 Oct 17 13:06:18.060824 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:18.073896 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-a5842e68-9005-4513-b30d-9b2d364b525b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:18.079300 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:18.104652 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-a5842e68-9005-4513-b30d-9b2d364b525b admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034764 Oct 17 13:06:18.105300 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Oct 17 13:06:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:20.814538 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-c17b7115-717f-4878-8314-0f03efdf1196 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:20.815545 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-c17b7115-717f-4878-8314-0f03efdf1196 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 17 13:06:20.815951 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:21.262568 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-319ad01e-fab1-4d0d-a856-aa11253057f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:21.288692 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-319ad01e-fab1-4d0d-a856-aa11253057f4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466478 Oct 17 13:06:21.289439 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:06:21.301978 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-3eb6da3b-2375-43a8-9dc6-b3a9cdae60a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:21.331688 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-3eb6da3b-2375-43a8-9dc6-b3a9cdae60a9 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034132 Oct 17 13:06:21.332598 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Oct 17 13:06:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:06:24.027654 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-319ad01e-fab1-4d0d-a856-aa11253057f4 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:24.028663 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-319ad01e-fab1-4d0d-a856-aa11253057f4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 17 13:06:24.033245 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:24.536943 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-cb1aa81f-4f70-4732-b1a8-aa017d37f197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "vcpus": 8}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:24.543720 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:24.559489 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-cb1aa81f-4f70-4732-b1a8-aa017d37f197 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.523327 Oct 17 13:06:24.567906 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1283 bytes} [Mon Oct 17 13:06:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:24.572721 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-569c60f8-2300-4525-9446-5f4fd7145938 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:24.600069 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-569c60f8-2300-4525-9446-5f4fd7145938 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031083 Oct 17 13:06:24.601472 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1333 bytes} [Mon Oct 17 13:06:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:06:46.245737 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-cb1aa81f-4f70-4732-b1a8-aa017d37f197 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:46.246753 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-cb1aa81f-4f70-4732-b1a8-aa017d37f197 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 17 13:06:46.247152 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:46.257911 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:06:46.640318 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-97bccfe9-ff37-4fd2-adb0-233253b57416 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:46.659228 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-97bccfe9-ff37-4fd2-adb0-233253b57416 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405875 Oct 17 13:06:46.659771 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:06:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:47.985385 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-cb1aa81f-4f70-4732-b1a8-aa017d37f197 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:47.986627 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-cb1aa81f-4f70-4732-b1a8-aa017d37f197 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Oct 17 13:06:47.987032 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:48.550885 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-430c11f1-1352-4f80-a033-c11ed23eb248 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.556164 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.wsgi [None req-430c11f1-1352-4f80-a033-c11ed23eb248 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-430c11f1-1352-4f80-a033-c11ed23eb248 admin admin] Request method failure captured: Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Accept: application/json Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Accept-Encoding: gzip, deflate Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Connection: keep-alive Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Content-Length: 0 Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Host: 10.222.0.65 Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Openstack-Api-Version: compute 2.92 Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: Openstack-System-Scope: None Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: User-Agent: python-novaclient Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Auth-Token: gAAAAABjTVNnxgNbdsZNw2OVRFhgRIE8FARZSPhR1Mml5WYf7cznhhM46Y6bZEsrvurQ5JaVDZtpue5POUH_JNbqVUHLYmrwVordKXYAxiJCJBJittPB43Ir0p0KWOIY5ujZbmpP2jUoTfYzJWblwVj4qp0IQQWUq_UwXNd1sfLSPn84Uf8T7ik Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Domain-Id: None Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Domain-Name: None Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Identity-Status: Confirmed Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Is-Admin-Project: True Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Domain-Id: default Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Domain-Name: Default Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Name: admin Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Role: reader,member,admin Oct 17 13:06:48.559443 n-d-854121-14 devstack@n-api.service[104832]: X-Roles: reader,member,admin Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_daed6b75615c448f87ba39b9f6795250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant: admin Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant-Name: admin Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-User: admin Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-User-Domain-Id: default Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-User-Domain-Name: Default Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-User-Id: 81c9061105844ca48e7fbc9b449d1cfe Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: X-User-Name: admin Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: method: > Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: exception: Flavor 42 could not be found. Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: action_args: {'id': '42'} Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:48.561446 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:48.562455 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.563723 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-430c11f1-1352-4f80-a033-c11ed23eb248 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:48.564891 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-430c11f1-1352-4f80-a033-c11ed23eb248 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.401984 Oct 17 13:06:48.564891 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:06:48.571561 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-75b98dcb-df76-4403-a779-0a39757bc694 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.596208 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-75b98dcb-df76-4403-a779-0a39757bc694 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028787 Oct 17 13:06:48.596776 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:48.614561 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-b4fea01a-88b8-4208-9422-3e0aa4d4fc10 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.637110 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-b4fea01a-88b8-4208-9422-3e0aa4d4fc10 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027675 Oct 17 13:06:48.637737 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:48.649704 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-f9f06e5d-810c-40eb-ad49-586f6a56443e admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:48.655165 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.wsgi [None req-f9f06e5d-810c-40eb-ad49-586f6a56443e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-f9f06e5d-810c-40eb-ad49-586f6a56443e admin admin] Request method failure captured: Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Accept: application/json Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Accept-Encoding: gzip, deflate Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Connection: keep-alive Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Content-Length: 0 Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Host: 10.222.0.65 Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Openstack-Api-Version: compute 2.92 Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: Openstack-System-Scope: None Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: User-Agent: python-novaclient Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Auth-Token: gAAAAABjTVNnxgNbdsZNw2OVRFhgRIE8FARZSPhR1Mml5WYf7cznhhM46Y6bZEsrvurQ5JaVDZtpue5POUH_JNbqVUHLYmrwVordKXYAxiJCJBJittPB43Ir0p0KWOIY5ujZbmpP2jUoTfYzJWblwVj4qp0IQQWUq_UwXNd1sfLSPn84Uf8T7ik Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Domain-Id: None Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Domain-Name: None Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Identity-Status: Confirmed Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Is-Admin-Project: True Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Domain-Id: default Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Domain-Name: Default Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Name: admin Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Role: reader,member,admin Oct 17 13:06:48.659047 n-d-854121-14 devstack@n-api.service[104833]: X-Roles: reader,member,admin Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_daed6b75615c448f87ba39b9f6795250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant: admin Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant-Name: admin Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-User: admin Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-User-Domain-Id: default Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-User-Domain-Name: Default Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-User-Id: 81c9061105844ca48e7fbc9b449d1cfe Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: X-User-Name: admin Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: method: > Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: exception: Flavor 42 could not be found. Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: action_args: {'id': '42'} Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:48.660619 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:48.661689 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:48.662992 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-f9f06e5d-810c-40eb-ad49-586f6a56443e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:48.664181 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-f9f06e5d-810c-40eb-ad49-586f6a56443e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015656 Oct 17 13:06:48.664181 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:06:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:06:49.895430 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-b4fea01a-88b8-4208-9422-3e0aa4d4fc10 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:49.896444 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-b4fea01a-88b8-4208-9422-3e0aa4d4fc10 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 17 13:06:49.896851 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:50.424549 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-b969b36f-1a52-4866-97a3-ac53897a7060 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.429578 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.wsgi [None req-b969b36f-1a52-4866-97a3-ac53897a7060 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-b969b36f-1a52-4866-97a3-ac53897a7060 admin admin] Request method failure captured: Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Accept: application/json Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Accept-Encoding: gzip, deflate Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Connection: keep-alive Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Content-Length: 0 Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Host: 10.222.0.65 Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Openstack-Api-Version: compute 2.92 Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: Openstack-System-Scope: None Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: User-Agent: python-novaclient Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Auth-Token: gAAAAABjTVNpMaHHXAXHm1dlKz-HcY1v2D9UOxln6VFW952bYfl8A6FFfOAB72_WxeZrsnX0_FKjx2SaZzS5yDkwFhx2c5x9J1eobap4IkaA43Bg6PxALkR0j4ZpJOPZZVEYFdhC3pansWqnjVgzVYySO3OPSQtQbwRxoBtOUj1Xi8nEO1r3KCI Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Domain-Id: None Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Domain-Name: None Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Identity-Status: Confirmed Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Is-Admin-Project: True Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Domain-Id: default Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Domain-Name: Default Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Name: admin Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Role: reader,member,admin Oct 17 13:06:50.431063 n-d-854121-14 devstack@n-api.service[104833]: X-Roles: reader,member,admin Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_daed6b75615c448f87ba39b9f6795250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant: admin Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant-Name: admin Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-User: admin Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-User-Domain-Id: default Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-User-Domain-Name: Default Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-User-Id: 81c9061105844ca48e7fbc9b449d1cfe Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: X-User-Name: admin Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: method: > Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: exception: Flavor 84 could not be found. Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: action_args: {'id': '84'} Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:50.432597 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:50.433521 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.434605 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-b969b36f-1a52-4866-97a3-ac53897a7060 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:50.435956 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-b969b36f-1a52-4866-97a3-ac53897a7060 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.394022 Oct 17 13:06:50.435956 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:06:50.442780 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-44964334-91e5-4154-bb8b-e822d41675da admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.458092 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-44964334-91e5-4154-bb8b-e822d41675da admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018940 Oct 17 13:06:50.458630 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:06:50.468333 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-673befbc-9b47-4e20-9094-b963b589eda2 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.483897 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-673befbc-9b47-4e20-9094-b963b589eda2 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019264 Oct 17 13:06:50.484506 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:50.494272 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-3a37eef2-6bbe-48af-8367-86dee53fe737 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:50.499330 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.wsgi [None req-3a37eef2-6bbe-48af-8367-86dee53fe737 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-3a37eef2-6bbe-48af-8367-86dee53fe737 admin admin] Request method failure captured: Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Accept: application/json Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Accept-Encoding: gzip, deflate Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Connection: keep-alive Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Content-Length: 0 Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Host: 10.222.0.65 Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Openstack-Api-Version: compute 2.92 Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: Openstack-System-Scope: None Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: User-Agent: python-novaclient Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Auth-Token: gAAAAABjTVNpMaHHXAXHm1dlKz-HcY1v2D9UOxln6VFW952bYfl8A6FFfOAB72_WxeZrsnX0_FKjx2SaZzS5yDkwFhx2c5x9J1eobap4IkaA43Bg6PxALkR0j4ZpJOPZZVEYFdhC3pansWqnjVgzVYySO3OPSQtQbwRxoBtOUj1Xi8nEO1r3KCI Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Domain-Id: None Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Domain-Name: None Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Identity-Status: Confirmed Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Is-Admin-Project: True Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Domain-Id: default Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Domain-Name: Default Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Name: admin Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Role: reader,member,admin Oct 17 13:06:50.501357 n-d-854121-14 devstack@n-api.service[104832]: X-Roles: reader,member,admin Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_daed6b75615c448f87ba39b9f6795250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant: admin Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant-Name: admin Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-User: admin Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-User-Domain-Id: default Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-User-Domain-Name: Default Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-User-Id: 81c9061105844ca48e7fbc9b449d1cfe Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: X-User-Name: admin Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: method: > Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: exception: Flavor 84 could not be found. Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: action_args: {'id': '84'} Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:50.502899 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:50.504139 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:50.505514 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-3a37eef2-6bbe-48af-8367-86dee53fe737 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:50.506777 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-3a37eef2-6bbe-48af-8367-86dee53fe737 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012003 Oct 17 13:06:50.506777 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:06:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:06:51.739588 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-673befbc-9b47-4e20-9094-b963b589eda2 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:51.740597 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-673befbc-9b47-4e20-9094-b963b589eda2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 17 13:06:51.741003 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:52.268330 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-abdcf15b-c024-4863-9b8d-00ceebbb2ab7 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.274286 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.wsgi [None req-abdcf15b-c024-4863-9b8d-00ceebbb2ab7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-abdcf15b-c024-4863-9b8d-00ceebbb2ab7 admin admin] Request method failure captured: Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Accept: application/json Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Accept-Encoding: gzip, deflate Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Connection: keep-alive Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Content-Length: 0 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Host: 10.222.0.65 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Openstack-Api-Version: compute 2.92 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: Openstack-System-Scope: None Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: User-Agent: python-novaclient Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Auth-Token: gAAAAABjTVNrc2BpmC2A908CINWTUYXr-ReEHggZEHEEgdc7GA6IUOkaRv0uow7TxMB5WHqwEf7096S8OP_3iT8nHGYlfrcdVphj_oVZqBzQPVoqApeOt01Sj0f7g4MDo-cS32BdnD1XmbW5LXY3jGNKcmXWIdMrhvbCWfwOIVTmKv7prW4gzY4 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Domain-Id: None Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Domain-Name: None Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Identity-Status: Confirmed Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Is-Admin-Project: True Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Domain-Id: default Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Domain-Name: Default Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Project-Name: admin Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Role: reader,member,admin Oct 17 13:06:52.275759 n-d-854121-14 devstack@n-api.service[104832]: X-Roles: reader,member,admin Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_daed6b75615c448f87ba39b9f6795250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant: admin Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-Tenant-Name: admin Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-User: admin Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-User-Domain-Id: default Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-User-Domain-Name: Default Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-User-Id: 81c9061105844ca48e7fbc9b449d1cfe Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: X-User-Name: admin Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: method: > Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: exception: Flavor 451 could not be found. Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: action_args: {'id': '451'} Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:52.277400 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:52.278306 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.279439 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-abdcf15b-c024-4863-9b8d-00ceebbb2ab7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104832) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:52.280456 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-abdcf15b-c024-4863-9b8d-00ceebbb2ab7 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398539 Oct 17 13:06:52.280456 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:06:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:06:52.287761 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-509bc1a8-7fc0-459d-88eb-1fceb56af53d admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.304493 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-509bc1a8-7fc0-459d-88eb-1fceb56af53d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020349 Oct 17 13:06:52.305062 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Oct 17 13:06:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:52.314979 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.330808 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019668 Oct 17 13:06:52.331358 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Mon Oct 17 13:06:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:06:52.340761 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-c0c8a7e4-ccda-4cd7-ba50-10a70241eda4 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:52.347397 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.wsgi [None req-c0c8a7e4-ccda-4cd7-ba50-10a70241eda4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-c0c8a7e4-ccda-4cd7-ba50-10a70241eda4 admin admin] Request method failure captured: Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Accept: application/json Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Accept-Encoding: gzip, deflate Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Connection: keep-alive Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Content-Length: 0 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Host: 10.222.0.65 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Openstack-Api-Version: compute 2.92 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: Openstack-System-Scope: None Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: User-Agent: python-novaclient Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Auth-Token: gAAAAABjTVNrc2BpmC2A908CINWTUYXr-ReEHggZEHEEgdc7GA6IUOkaRv0uow7TxMB5WHqwEf7096S8OP_3iT8nHGYlfrcdVphj_oVZqBzQPVoqApeOt01Sj0f7g4MDo-cS32BdnD1XmbW5LXY3jGNKcmXWIdMrhvbCWfwOIVTmKv7prW4gzY4 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Domain-Id: None Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Domain-Name: None Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Identity-Status: Confirmed Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Is-Admin-Project: True Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Openstack-Nova-Api-Version: 2.92 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Domain-Id: default Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Domain-Name: Default Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Project-Name: admin Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Role: reader,member,admin Oct 17 13:06:52.348916 n-d-854121-14 devstack@n-api.service[104833]: X-Roles: reader,member,admin Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/daed6b75615c448f87ba39b9f6795250"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_daed6b75615c448f87ba39b9f6795250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant: admin Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant-Id: daed6b75615c448f87ba39b9f6795250 Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-Tenant-Name: admin Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-User: admin Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-User-Domain-Id: default Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-User-Domain-Name: Default Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-User-Id: 81c9061105844ca48e7fbc9b449d1cfe Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: X-User-Name: admin Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: method: > Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: exception: Flavor 451 could not be found. Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: action_args: {'id': '451'} Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:06:52.350567 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:52.351617 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: ERROR nova.api.openstack.wsgi Oct 17 13:06:52.353065 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-c0c8a7e4-ccda-4cd7-ba50-10a70241eda4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104833) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:06:52.354401 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-c0c8a7e4-ccda-4cd7-ba50-10a70241eda4 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013172 Oct 17 13:06:52.354401 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:06:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:06:53.585762 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:53.586764 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 17 13:06:53.587158 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:54.127374 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-957b4e3a-e2c8-439f-bfce-dba4e216a7ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:54.147451 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-957b4e3a-e2c8-439f-bfce-dba4e216a7ca admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.422125 Oct 17 13:06:54.147995 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Oct 17 13:06:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:55.374314 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:55.375952 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Oct 17 13:06:55.376353 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:55.909627 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-f9d19d43-f330-45f2-b24e-b67a4273edf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:55.929757 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-f9d19d43-f330-45f2-b24e-b67a4273edf8 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.414437 Oct 17 13:06:55.930310 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Oct 17 13:06:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:57.157688 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:57.158681 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 17 13:06:57.159069 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:57.691869 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-4fd2741e-96d1-4551-b884-6125b10aea40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:57.711615 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-4fd2741e-96d1-4551-b884-6125b10aea40 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.414438 Oct 17 13:06:57.712144 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Oct 17 13:06:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:06:58.949939 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:06:58.950947 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Oct 17 13:06:58.951346 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:06:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:06:59.481006 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-fcd1385d-728c-4e81-8f98-ca7a10cbf189 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:06:59.500982 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-fcd1385d-728c-4e81-8f98-ca7a10cbf189 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.412433 Oct 17 13:06:59.501597 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Mon Oct 17 13:06:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:07:00.738178 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:00.739182 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 17 13:07:00.739578 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:01.265176 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-7eea83bc-6312-488f-8383-e6700c332004 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:01.285216 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-7eea83bc-6312-488f-8383-e6700c332004 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.408309 Oct 17 13:07:01.285759 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Mon Oct 17 13:07:00 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:59.409776 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.410822 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-28a0bacf-c0cb-4bf5-8859-074b6e8bd7c0 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 17 13:07:59.411221 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 931 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:07:59.422091 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:59.825973 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-5ce44df3-4c7c-4097-ba33-fa70f3d1f183 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.845901 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-5ce44df3-4c7c-4097-ba33-fa70f3d1f183 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428282 Oct 17 13:07:59.846445 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:07:59.867912 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_api:SELECT=14 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:07:59.872538 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-53461a57-39eb-4587-8be0-08182ce54a5a admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.879997 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-53461a57-39eb-4587-8be0-08182ce54a5a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013520 Oct 17 13:07:59.880519 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1283 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:59.892598 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-833aac53-498c-4eec-911e-843cf31412e8 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.900117 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-833aac53-498c-4eec-911e-843cf31412e8 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011173 Oct 17 13:07:59.900659 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1286 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:59.912724 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-21e9222f-6c75-4467-9130-77ed16e2ed70 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.920894 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-21e9222f-6c75-4467-9130-77ed16e2ed70 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011734 Oct 17 13:07:59.921489 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1286 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:07:59.933895 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-727895cb-183b-4353-a97f-db9be7f1e679 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:07:59.941082 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-727895cb-183b-4353-a97f-db9be7f1e679 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011407 Oct 17 13:07:59.941646 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1283 bytes} [Mon Oct 17 13:07:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:13:27.386535 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-21e9222f-6c75-4467-9130-77ed16e2ed70 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.387664 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-21e9222f-6c75-4467-9130-77ed16e2ed70 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Oct 17 13:13:27.388147 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:27.531144 n-d-854121-14 devstack@n-api.service[104833]: DEBUG dbcounter [-] [104833] Writing DB stats nova_api:SELECT=6 {{(pid=104833) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:13:27.675566 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:27.680950 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.681450 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.681871 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.682569 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:27.683006 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:27.683412 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:27.721969 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-de434902-9718-4ac8-a629-1c8a87a81360 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.192392 Oct 17 13:13:27.722535 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:13:27 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:13:28.824528 n-d-854121-14 devstack@n-api.service[104832]: DEBUG nova.api.openstack.wsgi [None req-21e9222f-6c75-4467-9130-77ed16e2ed70 admin admin] Calling method '>' {{(pid=104832) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:28.825585 n-d-854121-14 devstack@n-api.service[104832]: INFO nova.api.openstack.requestlog [None req-21e9222f-6c75-4467-9130-77ed16e2ed70 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 17 13:13:28.826018 n-d-854121-14 devstack@n-api.service[104832]: [pid: 104832|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:13:29.019605 n-d-854121-14 devstack@n-api.service[104833]: DEBUG nova.api.openstack.wsgi [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Calling method '>' {{(pid=104833) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:13:29.023527 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.023995 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.024407 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.025136 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:13:29.025593 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:13:29.025998 n-d-854121-14 devstack@n-api.service[104833]: DEBUG oslo_concurrency.lockutils [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104833) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:13:29.049857 n-d-854121-14 devstack@n-api.service[104833]: INFO nova.api.openstack.requestlog [None req-701956f7-8979-4dc7-a7e7-411b94495dfd admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.082502 Oct 17 13:13:29.050358 n-d-854121-14 devstack@n-api.service[104833]: [pid: 104833|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:13:28 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:14:15.059923 n-d-854121-14 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 17 13:14:15.060542 n-d-854121-14 devstack@n-api.service[104831]: Mon Oct 17 13:14:15 2022 - graceful shutdown triggered... Oct 17 13:14:15.061023 n-d-854121-14 devstack@n-api.service[104832]: Gracefully killing worker 1 (pid: 104832)... Oct 17 13:14:15.061433 n-d-854121-14 devstack@n-api.service[104833]: Gracefully killing worker 2 (pid: 104833)... Oct 17 13:14:15.185800 n-d-854121-14 devstack@n-api.service[104832]: DEBUG dbcounter [-] [104832] Writing DB stats nova_api:SELECT=4 {{(pid=104832) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:14:16.061376 n-d-854121-14 devstack@n-api.service[104831]: worker 1 buried after 1 seconds Oct 17 13:14:16.061376 n-d-854121-14 devstack@n-api.service[104831]: worker 2 buried after 1 seconds Oct 17 13:14:16.061376 n-d-854121-14 devstack@n-api.service[104831]: goodbye to uWSGI. Oct 17 13:14:16.062925 n-d-854121-14 systemd[1]: devstack@n-api.service: Succeeded. Oct 17 13:14:16.063512 n-d-854121-14 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 17 13:14:16.066370 n-d-854121-14 systemd[1]: Starting Devstack devstack@n-api.service... Oct 17 13:14:16.081000 n-d-854121-14 devstack@n-api.service[120685]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 17 13:14:16 2022] *** Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: nodename: n-d-854121-14 Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: machine: x86_64 Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: clock source: unix Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: pcre jit disabled Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: detected number of CPU cores: 4 Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: current working directory: / Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: detected binary path: /usr/bin/uwsgi-core Oct 17 13:14:16.098062 n-d-854121-14 devstack@n-api.service[120685]: your processes number limit is 47680 Oct 17 13:14:16.099350 n-d-854121-14 devstack@n-api.service[120685]: your memory page size is 4096 bytes Oct 17 13:14:16.099350 n-d-854121-14 devstack@n-api.service[120685]: detected max file descriptor number: 2048 Oct 17 13:14:16.099350 n-d-854121-14 devstack@n-api.service[120685]: lock engine: pthread robust mutexes Oct 17 13:14:16.099350 n-d-854121-14 devstack@n-api.service[120685]: thunder lock: enabled Oct 17 13:14:16.099350 n-d-854121-14 devstack@n-api.service[120685]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 17 13:14:16.099350 n-d-854121-14 devstack@n-api.service[120685]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 17 13:14:16.141502 n-d-854121-14 devstack@n-api.service[120685]: Python main interpreter initialized at 0x55a7887899c0 Oct 17 13:14:16.141502 n-d-854121-14 devstack@n-api.service[120685]: python threads support enabled Oct 17 13:14:16.141502 n-d-854121-14 devstack@n-api.service[120685]: your server socket listen backlog is limited to 100 connections Oct 17 13:14:16.141502 n-d-854121-14 devstack@n-api.service[120685]: your mercy for graceful operations on workers is 90 seconds Oct 17 13:14:16.141983 n-d-854121-14 devstack@n-api.service[120685]: mapped 403077 bytes (393 KB) for 2 cores Oct 17 13:14:16.141983 n-d-854121-14 devstack@n-api.service[120685]: *** Operational MODE: preforking *** Oct 17 13:14:16.142213 n-d-854121-14 devstack@n-api.service[120685]: *** uWSGI is running in multiple interpreter mode *** Oct 17 13:14:16.142213 n-d-854121-14 devstack@n-api.service[120685]: spawned uWSGI master process (pid: 120685) Oct 17 13:14:16.142466 n-d-854121-14 systemd[1]: Started Devstack devstack@n-api.service. Oct 17 13:14:16.145939 n-d-854121-14 devstack@n-api.service[120685]: spawned uWSGI worker 1 (pid: 120697, cores: 1) Oct 17 13:14:16.145939 n-d-854121-14 devstack@n-api.service[120685]: spawned uWSGI worker 2 (pid: 120698, cores: 1) Oct 17 13:14:16.145939 n-d-854121-14 devstack@n-api.service[120685]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 17 13:14:16.825620 n-d-854121-14 devstack@n-api.service[120698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:14:16.836259 n-d-854121-14 devstack@n-api.service[120697]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 17 13:14:17.998040 n-d-854121-14 devstack@n-api.service[120698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:14:17.998040 n-d-854121-14 devstack@n-api.service[120698]: from cryptography.utils import int_from_bytes Oct 17 13:14:17.998681 n-d-854121-14 devstack@n-api.service[120698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:14:17.998681 n-d-854121-14 devstack@n-api.service[120698]: from cryptography.utils import int_from_bytes Oct 17 13:14:18.013493 n-d-854121-14 devstack@n-api.service[120697]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:14:18.013493 n-d-854121-14 devstack@n-api.service[120697]: from cryptography.utils import int_from_bytes Oct 17 13:14:18.014013 n-d-854121-14 devstack@n-api.service[120697]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 17 13:14:18.014013 n-d-854121-14 devstack@n-api.service[120697]: from cryptography.utils import int_from_bytes Oct 17 13:14:20.493648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:14:20.494316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:14:20.494556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:14:20.494820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:14:20.495079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:14:20.495472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.495805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.496138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.496467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.496802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.497119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.497476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.497802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.498138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.498409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.498733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.499223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-14 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.499556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.500088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.500270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.500602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.500919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.501295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.501626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.501987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 17 13:14:20.502396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.502506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 17 13:14:20.502590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.503909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 17 13:14:20.504044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 17 13:14:20.504235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 17 13:14:20.504402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.504967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-14 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.505954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.506092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.506280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.506411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.506542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.506727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.506856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.507720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.507854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854121-14 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.508041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.508185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.508361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.508594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.508693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.508917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.509018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.509262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.509358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.509577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.509690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.509917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.510115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.510221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.510310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.510601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.510707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.510893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.511990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.512165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.512307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.512477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.512617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.512733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.512937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.513042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.513273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.513386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.513598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.513691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.513912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854121-14 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.514934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.515154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.515248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.515467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.515617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.515783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.515930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.516096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.516267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.516409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.516691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.516792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.517024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.517118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.517362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.517477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.517692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.517787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.518957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.519075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.519270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.519400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.519581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.519686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.519901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.520874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.521082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.521217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.521455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.521644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.521785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.521901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.522090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.522276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.522424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.522517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.523199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.523321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.523603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.523713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.523948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.524052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.524261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.524425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.524582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.524728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.524875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.525022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.525348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.525522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.525682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.525829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.525973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.526125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.526287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.526432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.526596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.526746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.526889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.527941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.528981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.529128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.529250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.529335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.529494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.529699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.529859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.530888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.531939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.532185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.532348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.532489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.532630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.532772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.532951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.533958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.534975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.535190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.535293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.535499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.535602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.535807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.535909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.536113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.536225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.536421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.536515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.536729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.536822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.537990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.538092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.538373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.538501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.538689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.538803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.538997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.539102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.539307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.539415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.539680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.539775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.539994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.540145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.540322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.540427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.540669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.540770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.540990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.541108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.541366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.541554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.541646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.541732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.541929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.542032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.542242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.542410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.542553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.542664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.542877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.543034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.543195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.543358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.543507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.543667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.543821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.543973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.544124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.544274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.544415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.544554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.544697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.544847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.544997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.545214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.545377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.545519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.545667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.545818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.545959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.546099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.546253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.546406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.546547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.546695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.546837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.546984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.547143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.547316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.547471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.547621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.547770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.547910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.548057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.548220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 17 13:14:20.548353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.548560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.548656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.548897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.549020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.549262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.549424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.549577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.549727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.549880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.550955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.551128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.551272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.551432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.551610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.551757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.551901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.552045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.552899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.553898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.554376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.554376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.554776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.554923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.555075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.555219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.555371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.555515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.555668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.555840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.558656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.558820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.558966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.559115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.559271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.559412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.559575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.559575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.559852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.560877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.561878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.562981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.563907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.564931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.565962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.566897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.567921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.568963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.569207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.569324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.570121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.570396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.570498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.570585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.570761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.570867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.571073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.571217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.571389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.571487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.571703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.571812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.572972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.573110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.573307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.573414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.573622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.573776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.573918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.574962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.575173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.575267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.575529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.575646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.575807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.575903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.576121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.576222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.576432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.576527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.576768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.576870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.577084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.577221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.577425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.577528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.577743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.577844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.578069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.578160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.578388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.578482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.578694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.578794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.579933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.580059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.580242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.580347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.580547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.580649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.580857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.581039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.581250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.581412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.581576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.581725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.581869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.582955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.583110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.583264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.583409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.583572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.583734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.583890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.584944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.585224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.585878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.586034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.586325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.586488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.586488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.586820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.586976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.587121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.587277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.587431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.587583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.587737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.587881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.588958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.589104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.589275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.589435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.589589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.589743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.589903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.590975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.591119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.591263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.591418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.591580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.591726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.591877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.592947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.593091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.593263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.593422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.593569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.593721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.593874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.594019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.594174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.594338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.594491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.594712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.594874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.595921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.596997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.597340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.597340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.597629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.597776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.597929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.598172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.598321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.598477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.598623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.598774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.598920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.599965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.600116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.600273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.600417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.600560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.600795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.601047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.601312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.601580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.601790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.601943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.602099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.602254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.602254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.602546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.602712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.602866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.603938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.604330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.604479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.604631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.604776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.604946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.605103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.605279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.605437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.605437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.605714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.605868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.606014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.606166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.606311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.606465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.606785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.606953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.607889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.608165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.608324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.608472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.608616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.608759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.608923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.609070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.609274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.609429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.609582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.609729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.609884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.610993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.611148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.611305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.611471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.611626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.611823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.611984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.612139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.612285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.612431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.612584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.612744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.612891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.613869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.614152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.614299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.614444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.614599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.614747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.614891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.615971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.616118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.616271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.616468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.616625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.616792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.617097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.617273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.617432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.617432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.617712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.617857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.618929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.619994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.620148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.620927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.621097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.621389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.621545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.621691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.621852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.621997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.622142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.622296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.622451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.622597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.622750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.622907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.623979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.624125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.624271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.624416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.624568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.624713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.624872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.625973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.626127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.626273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.626425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.626585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.626733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.626885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.627031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.627350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.627507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.627663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.627830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.627978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.628135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.628283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.628428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.628668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.628827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.628982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.629129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.629312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.629462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.629629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.630238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.630404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.630562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.630716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.630873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.631027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.631184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.631341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.631497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.631652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.631809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.632528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.632791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.632959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.633119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.633290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.633500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.633698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.633847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.633993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.634138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.634292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.634457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.636421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.637465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.637654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.637835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.638934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.639080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.639080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.639357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.639517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.639517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.639921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.640077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.640235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.640382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.640534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.640690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.640846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.641959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.642114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.642267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.642432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.642579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.642732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.642880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.643941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.644986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.645202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.645359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.645505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.645661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.645819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.645976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.646130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.646130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.646466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.646622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.646768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.646922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.647168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.647406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.648371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.648598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.648799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.648962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.649119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.649363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.649513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.649659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.649816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.649970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.650125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.650125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.650413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.650566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.650721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.650880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.651946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.652097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.652250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.652250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.652590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.652590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.652878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.653963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.654117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.654277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.654431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.654431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.654737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.654737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.655127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.655283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.655437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.655596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.655748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.655908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.656069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.656223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.656382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.656536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.656687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.656846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.657027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.657209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.657370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.657370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.657680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.657841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.658004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.658164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.658344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.658645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.658808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.658969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.659140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.659305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.659458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.659458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.659748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.659748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.660989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.661153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.661335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.661489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.661652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.661823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.661989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.662142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.662303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.662672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.662928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.663102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.663361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.663521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.663702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.663858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.664035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.664247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.664402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.664553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.664704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.664856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.665022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.665798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.665957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.666123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.666296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.666624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.666781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.666932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.667097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.667250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.667415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.667570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.667722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.667872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.668083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.668258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.668420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.668580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.668868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.673214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.673902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.674946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.675947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.676944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.677995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.678870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.679867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.680995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.681978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.682998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.683988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.684970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.685982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.686993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.687956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.688920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.689988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.690104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.690314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.690412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.690634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.690745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.690952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.691051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.691274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.691380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.691591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.691702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.691906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.692955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.693225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.693325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.693512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.693623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.693838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.693956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.694236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.694911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.695066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.695328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.695436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.695656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.695753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.695951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.696999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.697228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.697329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.697546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.697657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.697859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.697977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.698171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.698309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.698499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.698610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.698822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.698928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.699153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.699352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.699474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.699680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.699798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.700025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.700122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.700360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.700463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.700696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.700809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.701995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.702091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.702311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.702413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.702627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.702750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.702937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.703983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.704185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.704327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.704496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.704640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.704808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.704906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.705120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.705374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.705492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.705734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.705831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.706058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.706153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.706392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.706495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.706725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.706822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.707044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.707138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.707357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.707567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.707688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.707885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.708970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.709226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.709373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.709538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.709673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.709871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.710695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.711930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.712982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.713227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.713326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.713522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.713617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.713832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.714058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.714155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.714409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.714522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.714727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.714821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.715052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.715178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.715361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.715493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.715681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.715988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.716219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.716376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.716527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.716688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.716852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.716991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.717218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.717369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.717521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.717671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.717837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.717930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.718118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.718222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.718430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.718525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.718738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.718833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.719041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.719136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.719381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.719485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.719713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.719826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.720977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.721087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.721329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.721589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.721695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.721899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.721993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.722204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.722300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.722515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.722609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.722827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.722922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.723130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.723225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.723494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.723587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.723807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.723900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.724124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.724219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.724442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.724544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.724761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.724865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.725072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.725196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.725416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.725509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.725769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.725890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.726098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.726192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.726458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.726558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.726771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.726876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.727096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.727191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.727410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.727511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.727724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.727863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.728054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.728149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.728372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.728531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.728690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.728908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.729031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.729525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.729624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.729846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.729955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.730182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.730289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.730509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.730603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.730815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.730936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.731120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.731217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.731426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.731522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.731750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.731846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.732999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.733101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.733335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.733433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.733648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.733776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.733958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.734098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.734269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.734428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.734580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.734758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.734889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.735079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.735183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.735409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.735512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.735739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.735842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.736058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.736161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.736386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.736480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.736702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.736796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.737035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.737142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.737379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.737487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.737696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.737798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.738336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.738566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.738686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.738789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.738885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.738973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.739941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.740151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.740259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.740461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.740566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.740774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.740870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.741088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.741223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.742031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.742130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.742355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.742491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.742759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.742862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.743113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.743214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.743424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.743558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.743736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.743865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.744980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.745129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.745316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.745413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.745618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.745715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.745958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.746943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.747164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.747256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.747477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.747570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.747782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.747878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.748089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.748220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.748401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.748512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.748710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.748856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.749985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.750087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.750289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.750438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.750593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.750723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.750882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.751989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.752091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.752305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.752408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.752621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.752724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.752959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.753062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.753289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.753399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.753595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.753742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.753927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.754996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.755199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.755300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.755522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.755624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.755835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.755943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.756148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.756242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.756465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.756560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.756778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.756880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.757978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.758990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.759079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.759179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.759364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.759493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.759704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.759814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.760038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.760161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.760376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.760477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.760698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.760854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.761980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.762122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.762269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.762418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.762582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.762688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.762900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.763004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.763213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.763307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.763518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:14:20.763626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.763826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.764137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.764454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.764765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.765078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.765422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.765740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.766065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.766390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.766699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.767026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.767352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.767698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.768015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.768360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.768689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.769013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.769349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.769654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 17 13:14:20.769897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 17 13:14:20.826412 n-d-854121-14 devstack@n-api.service[120697]: INFO dbcounter [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Registered counter for database nova_api Oct 17 13:14:20.831722 n-d-854121-14 devstack@n-api.service[120698]: INFO dbcounter [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Registered counter for database nova_api Oct 17 13:14:20.847334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:20.852814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:20.855369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:20.860111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:20.915301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.context [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=120697) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:14:20.919399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.919548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.context [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=120698) load_cells /opt/stack/nova/nova/context.py:464}} Oct 17 13:14:20.919879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.921510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.922266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.922719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.923703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.924182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.924731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.925798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.926546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:14:20.926769 n-d-854121-14 devstack@n-api.service[120697]: INFO dbcounter [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Registered counter for database nova_cell0 Oct 17 13:14:20.927001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:14:20.929881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:14:20.931713 n-d-854121-14 devstack@n-api.service[120697]: INFO dbcounter [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Registered counter for database nova_cell1 Oct 17 13:14:20.931874 n-d-854121-14 devstack@n-api.service[120698]: INFO dbcounter [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Registered counter for database nova_cell0 Oct 17 13:14:20.936158 n-d-854121-14 devstack@n-api.service[120698]: INFO dbcounter [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Registered counter for database nova_cell1 Oct 17 13:14:20.939546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:20.943674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:20.946262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:20.947762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:20.951325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:20.952472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:21.099121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:21.100331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:21.109441 n-d-854121-14 devstack@n-api.service[120698]: INFO dbcounter [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Registered counter for database nova_cell0 Oct 17 13:14:21.110666 n-d-854121-14 devstack@n-api.service[120697]: INFO dbcounter [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Registered counter for database nova_cell0 Oct 17 13:14:21.117150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:21.121487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 17 13:14:21.123281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:21.127737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 17 13:14:21.453453 n-d-854121-14 devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:14:21.461962 n-d-854121-14 devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:14:21.463182 n-d-854121-14 devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:14:21.470540 n-d-854121-14 devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:14:21.816032 n-d-854121-14 devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:14:21.822783 n-d-854121-14 devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 17 13:14:21.823183 n-d-854121-14 devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-13da625e-85b1-42ec-bb62-68501d7fb4f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:14:21.828086 n-d-854121-14 devstack@n-api.service[120698]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7887899c0 pid: 120698 (default app) Oct 17 13:14:21.828747 n-d-854121-14 devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-965eceab-e10b-4bf0-8582-e99dd1769438 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 17 13:14:21.834095 n-d-854121-14 devstack@n-api.service[120697]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7887899c0 pid: 120697 (default app) Oct 17 13:15:02.535777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.537659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.538718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.540134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.817224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.818646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.820088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:02.821032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:03.723453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ad2a5dd-2670-498c-baa9-fc3bf66bc832 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-187064509", "id": 2051078878, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:03.780037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ad2a5dd-2670-498c-baa9-fc3bf66bc832 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 1.253542 Oct 17 13:15:03.780931 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:02 2022] POST /compute/v2.1/flavors => generated 429 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:04.148780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71e2b800-1d09-40f0-a5f0-f8bfc8fedd2d tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2055592459", "ram": 512, "vcpus": 1, "disk": 10, "id": 2034248365, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:04.200754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71e2b800-1d09-40f0-a5f0-f8bfc8fedd2d tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 1.394375 Oct 17 13:15:04.201416 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1/2] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:02 2022] POST /compute/v2.1/flavors => generated 416 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:04.230238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3163a78f-5ecc-461b-98f7-88273add7dfe tempest-AZAdminNegativeTestJSON-85329640 tempest-AZAdminNegativeTestJSON-85329640-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.231756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3163a78f-5ecc-461b-98f7-88273add7dfe tempest-AZAdminNegativeTestJSON-85329640 tempest-AZAdminNegativeTestJSON-85329640-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'a36e1a35adfc4fab9da0279577ba210b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2baa8462ea89439387d6c7b721b0a69c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3163a78f-5ecc-461b-98f7-88273add7dfe tempest-AZAdminNegativeTestJSON-85329640 tempest-AZAdminNegativeTestJSON-85329640-project] Request method failure captured: Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVvUNHt4SLBTh51QZ3qp82vzJ-aJebZ0S9Kq2GN1TcoU5Yx4c2eAT-UYGwH8WbMYdgrbCDY3ONCZGl67otg9wErB8orPnOf8nUESBsOreW_9tGOEqKj5SRZPoqjf2i59xRAO6hAH2T3AzRYDEZBs-ny7sL4zpmgmyqPPiRhNpARDs Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2baa8462ea89439387d6c7b721b0a69c Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AZAdminNegativeTestJSON-85329640 Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:04.235198 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2baa8462ea89439387d6c7b721b0a69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2baa8462ea89439387d6c7b721b0a69c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2baa8462ea89439387d6c7b721b0a69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2baa8462ea89439387d6c7b721b0a69c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AZAdminNegativeTestJSON-85329640 Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2baa8462ea89439387d6c7b721b0a69c Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-85329640 Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AZAdminNegativeTestJSON-85329640-project Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: a36e1a35adfc4fab9da0279577ba210b Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AZAdminNegativeTestJSON-85329640-project Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 13:15:04.236618 n-d-854121-14 devstack@n-api.service[120698]: action_args: {} Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:04.237408 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:04.238581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3163a78f-5ecc-461b-98f7-88273add7dfe tempest-AZAdminNegativeTestJSON-85329640 tempest-AZAdminNegativeTestJSON-85329640-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:04.239637 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3163a78f-5ecc-461b-98f7-88273add7dfe tempest-AZAdminNegativeTestJSON-85329640 tempest-AZAdminNegativeTestJSON-85329640-project] 10.222.0.65 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.454801 Oct 17 13:15:04.239637 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 13:15:03 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 456 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:04.241561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-adb39ce8-bcac-4579-993b-b274533586c6 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.272616 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-adb39ce8-bcac-4579-993b-b274533586c6 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2051078878" status: 202 len: 0 microversion: 2.1 time: 0.033735 Oct 17 13:15:04.273309 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3/4] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:04 2022] DELETE /compute/v2.1/flavors/2051078878 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:04.321939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '.version_select at 0x7f419f83dee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.329233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=120697) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 13:15:04.329976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.330475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.330893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.360395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.360897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.361382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.370032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Calling method '.version_select at 0x7f419f6e6280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.376852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.377411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.377872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.378920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=120698) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 17 13:15:04.379824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.380319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.380924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.386298 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87ee7547-1252-49b1-a204-fb8ec8bb65d4 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.183608 Oct 17 13:15:04.386864 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2/5] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:04.426334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.427015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.427443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.441725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.442303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.442698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.449725 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-351f1012-3529-4752-aba0-53b440f3b211 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.174989 Oct 17 13:15:04.450547 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 4/6] 10.222.0.65 () {60 vars in 1208 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:04.466507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.470869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.471547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.472047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.472925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.473461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.474184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.518955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11040486-8acf-4304-ab10-4ed41e71ffc4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.130612 Oct 17 13:15:04.519455 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3/7] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:04.635104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1829192174", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:04.662206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.664395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.664875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.665343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.666067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.666517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.666944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.700745 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c0a2442-79e7-41f5-9b0e-06dc80494ec8 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] 10.222.0.65 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.180003 Oct 17 13:15:04.701614 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1164 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:04.706215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-443db369-fb10-4b83-9b44-59fa6d5f408f tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:04.755849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-443db369-fb10-4b83-9b44-59fa6d5f408f tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.052973 Oct 17 13:15:04.761332 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 5/9] 10.222.0.65 () {60 vars in 1224 bytes} [Mon Oct 17 13:15:04 2022] POST /compute/v2.1/flavors/2034248365/os-extra_specs => generated 66 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:04.764780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b04b8e3-f228-4c5b-bd12-810faab12182 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.795527 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b04b8e3-f228-4c5b-bd12-810faab12182 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.037499 Oct 17 13:15:04.796123 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 6/10] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:04.800568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9b34749-e8ad-413f-966f-46ed63b1ea13 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-12700670", "name": "tempest-test_aggregate-1520742724"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:04.821798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-f9b34749-e8ad-413f-966f-46ed63b1ea13 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 28ece9c4-641b-4908-a5c7-df4110e34b65 for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:04.902367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9b34749-e8ad-413f-966f-46ed63b1ea13 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.105028 Oct 17 13:15:04.903498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 7/11] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Oct 17 13:15:04 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:04.908563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:04.914134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.914640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.915136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.915961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:04.916422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:04.916917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:04.955385 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-707f92fa-31e1-4aaf-9936-5ece3b11f721 tempest-AZAdminV2TestJSON-510765794 tempest-AZAdminV2TestJSON-510765794-project-admin] 10.222.0.65 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.050737 Oct 17 13:15:04.956202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 8/12] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:04.980687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:05.092629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bedbd62d-7b2d-4051-a59a-068f411f3059 tempest-FlavorsExtraSpecsTestJSON-726725305 tempest-FlavorsExtraSpecsTestJSON-726725305-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.122823 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bedbd62d-7b2d-4051-a59a-068f411f3059 tempest-FlavorsExtraSpecsTestJSON-726725305 tempest-FlavorsExtraSpecsTestJSON-726725305-project] 10.222.0.65 "GET /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.163900 Oct 17 13:15:05.123776 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 9/13] 10.222.0.65 () {58 vars in 1203 bytes} [Mon Oct 17 13:15:04 2022] GET /compute/v2.1/flavors/2034248365/os-extra_specs => generated 66 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:05.134788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-064f3ddd-4779-450c-9c4d-d6915976791a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-505182365", "id": 1691367323, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.169118 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-064f3ddd-4779-450c-9c4d-d6915976791a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.042840 Oct 17 13:15:05.176982 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 10/14] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:05 2022] POST /compute/v2.1/flavors => generated 416 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:05.181913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53216ec3-5526-4aae-a3cc-77ea6802b8d5 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.197307 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53216ec3-5526-4aae-a3cc-77ea6802b8d5 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.019154 Oct 17 13:15:05.198406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 11/15] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:05.203205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c42cf36a-47cb-46be-8c89-4f093f0d9ab7 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.240116 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c42cf36a-47cb-46be-8c89-4f093f0d9ab7 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040434 Oct 17 13:15:05.240739 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 12/16] 10.222.0.65 () {60 vars in 1224 bytes} [Mon Oct 17 13:15:05 2022] POST /compute/v2.1/flavors/2034248365/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:05.246686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87791fa7-1197-4ea9-9ec3-49c7632335ab tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.279076 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87791fa7-1197-4ea9-9ec3-49c7632335ab tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5803 microversion: 2.1 time: 0.033950 Oct 17 13:15:05.280032 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 13/17] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/flavors/detail => generated 5803 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:05.284817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05871de0-7a3e-4c99-98b3-7f977fd32e8c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.299499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05871de0-7a3e-4c99-98b3-7f977fd32e8c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:05.299985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05871de0-7a3e-4c99-98b3-7f977fd32e8c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:05.300426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05871de0-7a3e-4c99-98b3-7f977fd32e8c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:05.332757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:05.333303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:05.333845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:05.334325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:05.335516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:05.352805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:05.353417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:05.353959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:05.355095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:05.355652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:05.356251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:05.397028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Getting quotas for project d5562a66777d42a99bb3a4f3b44f1887. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:05.404473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Getting quotas for user 4914f4e6368d4b7e942eef79a11e8df7 and project d5562a66777d42a99bb3a4f3b44f1887. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:05.418569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:05.421744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:05.519363 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24ae836a-6eab-44dd-b484-c0d96ceb93ef tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066998 Oct 17 13:15:05.530136 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 5/18] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:05.538660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58da643a-7052-45fd-9148-ccb485a0d545 tempest-FlavorsExtraSpecsTestJSON-726725305 tempest-FlavorsExtraSpecsTestJSON-726725305-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.552986 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58da643a-7052-45fd-9148-ccb485a0d545 tempest-FlavorsExtraSpecsTestJSON-726725305 tempest-FlavorsExtraSpecsTestJSON-726725305-project] 10.222.0.65 "GET /compute/v2.1/flavors/2034248365/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.020093 Oct 17 13:15:05.554731 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 6/19] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/flavors/2034248365/os-extra_specs/hw:numa_nodes => generated 22 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:05.562153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c014ab28-2185-4046-844e-ecc6316aa162 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.595569 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c014ab28-2185-4046-844e-ecc6316aa162 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1691367323" status: 202 len: 0 microversion: 2.1 time: 0.039515 Oct 17 13:15:05.597607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 7/20] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:05 2022] DELETE /compute/v2.1/flavors/1691367323 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:05.610024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-486412dd-9463-4104-b677-3f10507bd69a tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.610659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-486412dd-9463-4104-b677-3f10507bd69a tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:05.730515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-486412dd-9463-4104-b677-3f10507bd69a tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:05.750444 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-486412dd-9463-4104-b677-3f10507bd69a tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1220 microversion: 2.1 time: 0.148318 Oct 17 13:15:05.752224 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 8/21] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1220 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:05.758732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae7ca36f-6f32-4cab-9282-0ad71ff107b3 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.798935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae7ca36f-6f32-4cab-9282-0ad71ff107b3 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044754 Oct 17 13:15:05.799787 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 9/22] 10.222.0.65 () {60 vars in 1224 bytes} [Mon Oct 17 13:15:05 2022] POST /compute/v2.1/flavors/2034248365/os-extra_specs => generated 66 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:05.804595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a19f5601-8f4d-4041-9875-fe3976e672b9 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.838262 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a19f5601-8f4d-4041-9875-fe3976e672b9 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.037193 Oct 17 13:15:05.838846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 10/23] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:05.843917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b90310c-c496-4c1e-8f4c-d5f48923c39a tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.852834 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b90310c-c496-4c1e-8f4c-d5f48923c39a tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012435 Oct 17 13:15:05.855846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 11/24] 10.222.0.65 () {58 vars in 1203 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/flavors/2034248365/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:05.865281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f0549db-9e78-4b74-a06d-b77634b0502f tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.898864 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f0549db-9e78-4b74-a06d-b77634b0502f tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "PUT /compute/v2.1/flavors/2034248365/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.037348 Oct 17 13:15:05.899623 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 12/25] 10.222.0.65 () {60 vars in 1265 bytes} [Mon Oct 17 13:15:05 2022] PUT /compute/v2.1/flavors/2034248365/os-extra_specs/hw:numa_nodes => generated 22 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:15:05.905636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05e8b0df-4b4b-4b24-9456-3a9a4d6ba720 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-268426377", "id": 154878423, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:05.938179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05e8b0df-4b4b-4b24-9456-3a9a4d6ba720 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.037190 Oct 17 13:15:05.947021 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 13/26] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:05 2022] POST /compute/v2.1/flavors => generated 425 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:05.947021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-422be137-ea02-4c5e-9e3c-34f8fe9b48c9 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.953796 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-422be137-ea02-4c5e-9e3c-34f8fe9b48c9 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013200 Oct 17 13:15:05.954476 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 14/27] 10.222.0.65 () {58 vars in 1203 bytes} [Mon Oct 17 13:15:05 2022] GET /compute/v2.1/flavors/2034248365/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:05.959712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50adc15a-894e-4f7f-919c-6b762b143ab4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:05.985780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50adc15a-894e-4f7f-919c-6b762b143ab4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/154878423" status: 202 len: 0 microversion: 2.1 time: 0.029542 Oct 17 13:15:05.986444 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:15:05 2022] DELETE /compute/v2.1/flavors/154878423 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:05.993024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e00f924-3cc8-4427-9124-2ea195f8dc52 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.027405 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e00f924-3cc8-4427-9124-2ea195f8dc52 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2034248365/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.039666 Oct 17 13:15:06.031745 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 16/29] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:15:05 2022] DELETE /compute/v2.1/flavors/2034248365/os-extra_specs/hw:numa_nodes => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:06.037309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93e0cf5a-2547-4eb2-bfdf-4e99d533f033 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.062906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93e0cf5a-2547-4eb2-bfdf-4e99d533f033 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.029752 Oct 17 13:15:06.064093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 17/30] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:06.070935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7410e1d-f601-4005-b2d7-f917eba10c11 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.085316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5,nova_api:DELETE=11,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:06.095522 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05871de0-7a3e-4c99-98b3-7f977fd32e8c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.1 time: 0.814027 Oct 17 13:15:06.099418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 14/31] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:05 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:06.108967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7410e1d-f601-4005-b2d7-f917eba10c11 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2034248365/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.043427 Oct 17 13:15:06.113393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 18/32] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:15:06 2022] DELETE /compute/v2.1/flavors/2034248365/os-extra_specs/hw:cpu_policy => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:06.118572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66a81a02-febc-4eeb-8390-f3bc91961406 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1530997920", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:06.123605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea6d2367-ea4d-485d-bb22-2ee3fcbfcfbb tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.136830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea6d2367-ea4d-485d-bb22-2ee3fcbfcfbb tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/2034248365/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021651 Oct 17 13:15:06.147134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66a81a02-febc-4eeb-8390-f3bc91961406 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.039475 Oct 17 13:15:06.148557 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 15/33] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:06 2022] POST /compute/v2.1/flavors => generated 507 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:06.155501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18ff9e51-db1e-4568-93e8-c05099bc1696 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.166856 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 19/34] 10.222.0.65 () {58 vars in 1203 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/2034248365/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:06.181354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2bde2887-3c97-4aaa-b1f3-e9eef7a061d2 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.187200 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18ff9e51-db1e-4568-93e8-c05099bc1696 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2034248365" status: 202 len: 0 microversion: 2.1 time: 0.037241 Oct 17 13:15:06.188977 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 16/35] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:06 2022] DELETE /compute/v2.1/flavors/2034248365 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:06.198622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80242537-6f73-4e6c-9ba1-508e26626142 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.213367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2bde2887-3c97-4aaa-b1f3-e9eef7a061d2 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2d4f1ba2-cfd7-45ba-8ee4-638936ee801d" status: 202 len: 0 microversion: 2.1 time: 0.045231 Oct 17 13:15:06.218241 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 20/36] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:06 2022] DELETE /compute/v2.1/flavors/2d4f1ba2-cfd7-45ba-8ee4-638936ee801d => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:06.223374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80242537-6f73-4e6c-9ba1-508e26626142 tempest-FlavorsExtraSpecsTestJSON-1631042790 tempest-FlavorsExtraSpecsTestJSON-1631042790-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5488 microversion: 2.1 time: 0.029397 Oct 17 13:15:06.224380 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 17/37] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/detail => generated 5488 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:06.231314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9fc9432e-70c7-444a-aa56-58e1b98e808a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.253635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9fc9432e-70c7-444a-aa56-58e1b98e808a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031609 Oct 17 13:15:06.254608 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 21/38] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:06.292288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8d3f6fc-9a4c-4cb9-8e01-10443c033b0a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1534289224", "id": "bd76157a-2dec-4264-a770-1f5155aa6c7a", "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:06.319217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8d3f6fc-9a4c-4cb9-8e01-10443c033b0a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032117 Oct 17 13:15:06.319900 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 22/39] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:06 2022] POST /compute/v2.1/flavors => generated 507 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:06.332529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d41ac7a9-8756-4eee-948b-e0c323e496b4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.351579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d41ac7a9-8756-4eee-948b-e0c323e496b4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/bd76157a-2dec-4264-a770-1f5155aa6c7a" status: 202 len: 0 microversion: 2.1 time: 0.022828 Oct 17 13:15:06.356141 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 23/40] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:06 2022] DELETE /compute/v2.1/flavors/bd76157a-2dec-4264-a770-1f5155aa6c7a => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:06.361224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2cab77ea-2a53-49e3-a0bd-181abd5b03ad tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.387297 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2cab77ea-2a53-49e3-a0bd-181abd5b03ad tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029831 Oct 17 13:15:06.388032 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 24/41] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:06.408618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbdd7deb-f307-438f-9340-23b3808995f4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-202233343", "id": 220944850, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:06.431445 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbdd7deb-f307-438f-9340-23b3808995f4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.027529 Oct 17 13:15:06.432246 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 25/42] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:06 2022] POST /compute/v2.1/flavors => generated 410 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:06.444412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f38deff9-b422-4ec8-b0f3-55e28562495c tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:06.451933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f38deff9-b422-4ec8-b0f3-55e28562495c tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/220944850" status: 200 len: 410 microversion: 2.1 time: 0.011445 Oct 17 13:15:06.453005 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 26/43] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/220944850 => generated 410 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:06.880768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-665954731", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "availability_zone": "tempest-test_az-12700670"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:06.903232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:06.903726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:06.904998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:06.906062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:06.907851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:06.909179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.092225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da57ef12-9b54-4066-b906-58017dc3df74 tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.153538 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da57ef12-9b54-4066-b906-58017dc3df74 tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.691093 Oct 17 13:15:07.155326 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 27/44] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:06 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.175255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.175879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:07.183762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.184547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.185131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.186339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:07.187428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:07.188152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:07.394914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:07.418086 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46e8fa71-d200-4118-a5d4-4701587229a3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1236 microversion: 2.1 time: 0.246022 Oct 17 13:15:07.420150 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 28/45] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1236 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.426075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fbba1b5b-aca1-4fdf-9d30-2f2edadc1560 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.470859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fbba1b5b-aca1-4fdf-9d30-2f2edadc1560 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/220944850" status: 202 len: 0 microversion: 2.1 time: 0.048896 Oct 17 13:15:07.471514 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 29/46] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:15:07 2022] DELETE /compute/v2.1/flavors/220944850 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:07.485293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b9c3eaa-f76c-4a1d-bdd4-754d8f2ca80d tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.514214 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b9c3eaa-f76c-4a1d-bdd4-754d8f2ca80d tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037295 Oct 17 13:15:07.515175 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 30/47] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.537836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a206a95c-0ac6-436c-97cb-300e486f2548 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1426543538", "id": 2025912412, "os-flavor-access:is_public": "False"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:07.577744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a206a95c-0ac6-436c-97cb-300e486f2548 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.045610 Oct 17 13:15:07.579875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 31/48] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:07 2022] POST /compute/v2.1/flavors => generated 430 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:07.592685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca4b3a05-c05f-4590-aef7-33a2e682eaae tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "2025912412"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:07.624911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ca4b3a05-c05f-4590-aef7-33a2e682eaae tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] HTTP exception thrown: Flavor 2025912412 could not be found. Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca4b3a05-c05f-4590-aef7-33a2e682eaae tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] Request method failure captured: Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 107 Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVUqHu0Aq6knigNO1KJ8pW9UlEupt0asctUSSlv7KC6dxkFFQUWR3Tomevse6mg6M-cOtc5QnqRp9goGvYKF0Ogp7pQXau9W4rTRJePUNfU6G6GAaxys9kBHa6FzvCsK0rW36OcqeQ9T2GqfhtbbEvW0jqWfCFocr__A3uljx66zUg Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 76280d585ec5437c880e1f79f70e9db1 Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsAdminTestJSON-1673541382 Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:07.635561 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/76280d585ec5437c880e1f79f70e9db1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/76280d585ec5437c880e1f79f70e9db1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/76280d585ec5437c880e1f79f70e9db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_76280d585ec5437c880e1f79f70e9db1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsAdminTestJSON-1673541382 Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 76280d585ec5437c880e1f79f70e9db1 Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1673541382 Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsAdminTestJSON-1673541382-project Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 3224bd522af24c768744a22a377e7706 Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsAdminTestJSON-1673541382-project Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "test", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "2025912412"}} Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:07.636664 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor 2025912412 could not be found. Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '2025912412'}}} Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2025912412 could not be found. Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:07.637341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2025912412 could not be found. Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:07.642191 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2025912412 could not be found. Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca4b3a05-c05f-4590-aef7-33a2e682eaae tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] Returning 400 to user: Flavor 2025912412 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca4b3a05-c05f-4590-aef7-33a2e682eaae tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.049113 Oct 17 13:15:07.644075 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 32/49] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:07 2022] POST /compute/v2.1/servers => generated 81 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 13:15:07.647953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60a292b3-b47f-45d8-aa50-a15946421af8 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.672655 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60a292b3-b47f-45d8-aa50-a15946421af8 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2025912412" status: 202 len: 0 microversion: 2.1 time: 0.029436 Oct 17 13:15:07.676378 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 33/50] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:07 2022] DELETE /compute/v2.1/flavors/2025912412 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:15:07.682096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:07.683960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-995e9b6a-f316-4e57-bd5e-0c41ecdb6f80 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.708974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-995e9b6a-f316-4e57-bd5e-0c41ecdb6f80 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030607 Oct 17 13:15:07.717843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 34/51] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:07.730685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a4ea8ff-dbfd-4537-a520-51cb964f1f35 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-48811259", "id": 31880851, "os-flavor-access:is_public": "False"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:07.754350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a4ea8ff-dbfd-4537-a520-51cb964f1f35 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.028790 Oct 17 13:15:07.757758 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 35/52] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:07.778749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a993da72-bf06-487f-b4eb-43c29ff4b0b4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-197792664", "id": 1826548574, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:07.840749 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a993da72-bf06-487f-b4eb-43c29ff4b0b4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.076328 Oct 17 13:15:07.844882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 36/53] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:07 2022] POST /compute/v2.1/flavors => generated 413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:07.855068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28bc43fe-fdb6-46b2-a00c-98e618310f5a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.875883 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-28bc43fe-fdb6-46b2-a00c-98e618310f5a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 410 microversion: 2.1 time: 0.025930 Oct 17 13:15:07.876825 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 37/54] 10.222.0.65 () {58 vars in 1169 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 410 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:07.889812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bdc4b8c-bec0-4c14-a058-aeae8aaadd06 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.903636 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7bdc4b8c-bec0-4c14-a058-aeae8aaadd06 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 410 microversion: 2.1 time: 0.017427 Oct 17 13:15:07.905483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 38/55] 10.222.0.65 () {58 vars in 1177 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 410 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:07.922748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db4c6f93-88ad-42ff-ab9f-1b9fea33ac10 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:07.957118 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db4c6f93-88ad-42ff-ab9f-1b9fea33ac10 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 410 microversion: 2.1 time: 0.042490 Oct 17 13:15:07.958010 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 39/56] 10.222.0.65 () {58 vars in 1171 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 410 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:07.986081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e408ebb1-b663-43aa-a3e5-e3e5c55aae5e tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.005933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e408ebb1-b663-43aa-a3e5-e3e5c55aae5e tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 410 microversion: 2.1 time: 0.038073 Oct 17 13:15:08.007285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 40/57] 10.222.0.65 () {58 vars in 1169 bytes} [Mon Oct 17 13:15:07 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 410 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:08.021247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0300fe8d-4d0b-4df2-a5ac-e8c9f55e29e8 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.064373 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0300fe8d-4d0b-4df2-a5ac-e8c9f55e29e8 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.041918 Oct 17 13:15:08.067813 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 41/58] 10.222.0.65 () {58 vars in 1169 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:08.093221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0007c12-cc83-4a4d-a6fe-8878001ef980 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.142434 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0007c12-cc83-4a4d-a6fe-8878001ef980 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.059994 Oct 17 13:15:08.143023 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 42/59] 10.222.0.65 () {58 vars in 1175 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.163343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c2aa8a3-9dbc-418d-8f20-69e6ac4916e9 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.187686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:08.188365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:08.189006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:08.189453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:08.190579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c2aa8a3-9dbc-418d-8f20-69e6ac4916e9 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.031034 Oct 17 13:15:08.190712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:08.191259 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 43/60] 10.222.0.65 () {58 vars in 1173 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:08.208965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.212363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93882f88-363b-4b0a-96f5-894f1c9cef89 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.215682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.216253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.217072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.218438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.219017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.254193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93882f88-363b-4b0a-96f5-894f1c9cef89 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.047632 Oct 17 13:15:08.266192 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 44/61] 10.222.0.65 () {58 vars in 1169 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:08.277237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Getting quotas for project f41797bbbb5445f091a5bfa5171de0fc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:08.280271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e46615c6-fb6d-4a82-83ab-d363f9fe5b4d tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.284153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:08.292393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Getting quotas for user 9894c0cb1c154a20968ace5dc27eec30 and project f41797bbbb5445f091a5bfa5171de0fc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:08.325879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:08.329699 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e46615c6-fb6d-4a82-83ab-d363f9fe5b4d tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1826548574" status: 202 len: 0 microversion: 2.1 time: 0.054482 Oct 17 13:15:08.330114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:08.333418 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 45/62] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:08 2022] DELETE /compute/v2.1/flavors/1826548574 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:08.343454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ecd5dee-6215-427c-9662-6d334676f6bc tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.372503 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ecd5dee-6215-427c-9662-6d334676f6bc tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032710 Oct 17 13:15:08.372503 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 46/63] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.400755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd216bc2-7294-460a-a7f2-4083507f9ea7 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.416770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=18,nova_api:INSERT=5 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:08.420365 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-450ede12-1f5f-49c8-aef4-7ef1c6fa8cce tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.143651 Oct 17 13:15:08.421026 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 18/64] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:08.426522 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd216bc2-7294-460a-a7f2-4083507f9ea7 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/31880851" status: 202 len: 0 microversion: 2.1 time: 0.039842 Oct 17 13:15:08.427882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 47/65] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:15:08 2022] DELETE /compute/v2.1/flavors/31880851 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:08.434618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c63a7294-dae5-49ad-aa88-5581b8086e2b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.435545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c63a7294-dae5-49ad-aa88-5581b8086e2b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:08.443141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5ef8d69-6d00-4316-a777-70db6fc8e0b5 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.483380 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5ef8d69-6d00-4316-a777-70db6fc8e0b5 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050301 Oct 17 13:15:08.484176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 19/66] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.491968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.496871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:08.525330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.526147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.526761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.527655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:08.528289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:08.528886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:08.547160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c63a7294-dae5-49ad-aa88-5581b8086e2b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:08.555301 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c63a7294-dae5-49ad-aa88-5581b8086e2b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1240 microversion: 2.1 time: 0.126121 Oct 17 13:15:08.558688 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 48/67] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.569665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f323c7c-137f-4e50-9ff7-78dcc83e0b5d tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1042706497", "id": 147970029, "os-flavor-access:is_public": "False"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:08.613266 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f323c7c-137f-4e50-9ff7-78dcc83e0b5d tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.052231 Oct 17 13:15:08.614801 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 49/68] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:08 2022] POST /compute/v2.1/flavors => generated 412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:08.633116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4da6b216-1a9c-4691-80f7-a42733b1b8fb tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.677194 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4da6b216-1a9c-4691-80f7-a42733b1b8fb tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053363 Oct 17 13:15:08.680286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 50/69] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:08.705496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba7a98a7-54f6-4ece-9103-2433b6b6ef0c tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.764517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:08.768975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba7a98a7-54f6-4ece-9103-2433b6b6ef0c tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073065 Oct 17 13:15:08.773208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 51/70] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.786887 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4efedc51-2897-47a9-bc91-b6e35f0ebfa9 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1298 microversion: 2.1 time: 0.301412 Oct 17 13:15:08.787766 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 20/71] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1298 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.797543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64c90296-67d1-4ea2-ac75-c7147796b3f1 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.817732 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64c90296-67d1-4ea2-ac75-c7147796b3f1 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/147970029" status: 202 len: 0 microversion: 2.1 time: 0.030336 Oct 17 13:15:08.818993 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 52/72] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:15:08 2022] DELETE /compute/v2.1/flavors/147970029 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:08.830899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb993684-d456-458c-9c2c-d2829d0956c7 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:08.872643 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb993684-d456-458c-9c2c-d2829d0956c7 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047117 Oct 17 13:15:08.874255 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 21/73] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:08.898893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eecbecfe-ce0e-4694-a2f8-6958a6458dc0 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-204335111", "id": 789605271, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:08.927315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eecbecfe-ce0e-4694-a2f8-6958a6458dc0 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.032622 Oct 17 13:15:08.928727 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 53/74] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:08 2022] POST /compute/v2.1/flavors => generated 410 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:08.941209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ff3150b-9450-4be8-a263-b06b61f89636 tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.001722 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ff3150b-9450-4be8-a263-b06b61f89636 tempest-FlavorsAdminTestJSON-1673541382 tempest-FlavorsAdminTestJSON-1673541382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.064353 Oct 17 13:15:09.013582 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 22/75] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:08 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:09.023312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb86d375-653c-46e6-b4f3-59dec20bb4d4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.063835 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb86d375-653c-46e6-b4f3-59dec20bb4d4 tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/789605271" status: 202 len: 0 microversion: 2.1 time: 0.044260 Oct 17 13:15:09.064653 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 54/76] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:15:09 2022] DELETE /compute/v2.1/flavors/789605271 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:09.073579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1923c46-0af7-4eac-bf95-dfd1bd0c460a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.113381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1923c46-0af7-4eac-bf95-dfd1bd0c460a tempest-FlavorsAdminTestJSON-1411672259 tempest-FlavorsAdminTestJSON-1411672259-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044145 Oct 17 13:15:09.114361 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 23/77] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:09.587107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5929ef58-214c-45bc-8a2a-9bcba09ee50d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.589040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5929ef58-214c-45bc-8a2a-9bcba09ee50d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:09.719328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5929ef58-214c-45bc-8a2a-9bcba09ee50d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:09.762884 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5929ef58-214c-45bc-8a2a-9bcba09ee50d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1240 microversion: 2.1 time: 0.176181 Oct 17 13:15:09.763471 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 55/78] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:09 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1240 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:09.814940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:09.815652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:09.831920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:09.832505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:09.835837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:09.839763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:09.840327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:09.840782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:10.028728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:10.041523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-151e0236-0404-414e-973f-8523530cff29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1298 microversion: 2.1 time: 0.233245 Oct 17 13:15:10.048079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 24/79] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:09 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1298 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:10.792039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:10.793379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:10.816274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.817515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.819875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:10.822705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:10.830266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:10.830970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.003912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:11.022454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e255c5da-f03a-42eb-8802-ca4a62a168ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1232 microversion: 2.1 time: 0.230022 Oct 17 13:15:11.025300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 56/80] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:10 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1232 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:11.082107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:11.082988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:11.120484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:11.120995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:11.123563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.124865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:11.125811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:11.128164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:11.899026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:11.917188 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00a79871-e5d1-4742-9dfe-059920fea31e tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.837600 Oct 17 13:15:11.918091 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 25/81] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:11 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:12.047029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:12.047830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:12.086729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.087906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.089002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.093205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.096446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.103190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.348742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:12.377364 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e6f0e0a-26d1-4fe7-b67e-8308d0a492f5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1288 microversion: 2.1 time: 0.334366 Oct 17 13:15:12.380321 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 26/82] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:12 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1288 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:12.861542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1859262683", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:12.968379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:12.970448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:12.989614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:12.990645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:12.991132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:12.991245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:12.993972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:12.995440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:12.996419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:12.998735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:12.999163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.003429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.004071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.028524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.032854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.033989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.036150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:13.038954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:13.040737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:13.095866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Getting quotas for project a92bd7a8339b4827a3b06531561d9da2. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:13.104185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Getting quotas for user 22ada44e69cf45a6a06d80f70dc80c25 and project a92bd7a8339b4827a3b06531561d9da2. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:13.135414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:13.138995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:13.296430 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4338ebba-cbb6-40e4-bec7-2bbba29d4cba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.318595 Oct 17 13:15:13.297949 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 57/83] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:15:13.326464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c12da55d-02f3-48cf-a9ae-7b13074c6d2e tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:13.331395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c12da55d-02f3-48cf-a9ae-7b13074c6d2e tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:14.196984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.212416 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d82abee-88a0-4aad-97fa-ebc302a5bc97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 1.259898 Oct 17 13:15:14.214525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 27/84] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:12 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:14.220941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:14.221714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:14.230463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.231279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.231852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.233391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.234611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.235188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:14.238748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c12da55d-02f3-48cf-a9ae-7b13074c6d2e tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.250148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c12da55d-02f3-48cf-a9ae-7b13074c6d2e tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.257352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c12da55d-02f3-48cf-a9ae-7b13074c6d2e tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.275155 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c12da55d-02f3-48cf-a9ae-7b13074c6d2e tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "PUT /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1359 microversion: 2.75 time: 0.968242 Oct 17 13:15:14.291149 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 58/85] 10.222.0.65 () {62 vars in 1297 bytes} [Mon Oct 17 13:15:13 2022] PUT /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1359 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:15:14.322036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b06066d6-a57c-4da8-b3e0-df754c790c01 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:14.331383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b06066d6-a57c-4da8-b3e0-df754c790c01 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:14.562652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b06066d6-a57c-4da8-b3e0-df754c790c01 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.568295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b06066d6-a57c-4da8-b3e0-df754c790c01 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.578780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b06066d6-a57c-4da8-b3e0-df754c790c01 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.593091 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b06066d6-a57c-4da8-b3e0-df754c790c01 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1359 microversion: 2.75 time: 0.281432 Oct 17 13:15:14.595432 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 59/86] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:14 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:14.614517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:14.640842 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5401baf9-5629-4add-81df-a6deaf305fb7 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1294 microversion: 2.1 time: 0.424582 Oct 17 13:15:14.651836 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 28/87] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:14 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1294 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:14.972007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Calling method '.version_select at 0x7f419ec24700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:14.974393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:14.975043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:14.975902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.072663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.073708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.075787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.121379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.124208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.124878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.140280 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8e43e5a-eb65-4f53-9dc0-68f61dfb9ec9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.541478 Oct 17 13:15:15.144144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 60/88] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:14 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:15.244439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:15.246501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:15.273650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.276419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.278499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.281071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:15.283675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:15.285756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:15.766295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1fe045b-074a-4dc0-ac70-3297443979ca tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Calling method '.version_select at 0x7f419ec43940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:15.768817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1fe045b-074a-4dc0-ac70-3297443979ca tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'fe4efaad99fd4552978e1218cf402eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d83efbcf5ba41b492be8a3e14f72afa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1fe045b-074a-4dc0-ac70-3297443979ca tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Request method failure captured: Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hypervisors/n-h1-854121-14/search HTTP/1.1 Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVgGP1iMPcXj-48WNuOxqgTSsPURUb9YLPR6xov6LQUWLG7tGCf8XR-qlFfApuguGyqhECcITnDsz5lazY2g1dqkNolWbnhK6zfl9zC0EuMwBX_FgGIt-lBpEPYchQCbf-Ky5I0zaSc5sfQ7YiydToBwdN-afURDZBRibYB7Q90thk Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 8d83efbcf5ba41b492be8a3e14f72afa Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099976932 Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:15:15.780206 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1099976932 Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 8d83efbcf5ba41b492be8a3e14f72afa Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099976932 Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fe4efaad99fd4552978e1218cf402eae Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 13:15:15.781544 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'n-h1-854121-14'} Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:15.782250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 17 13:15:15.783334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:15.785544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1fe045b-074a-4dc0-ac70-3297443979ca tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:15.788539 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1fe045b-074a-4dc0-ac70-3297443979ca tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/n-h1-854121-14/search" status: 403 len: 117 microversion: 2.1 time: 0.636653 Oct 17 13:15:15.802519 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 29/89] 10.222.0.65 () {58 vars in 1212 bytes} [Mon Oct 17 13:15:15 2022] GET /compute/v2.1/os-hypervisors/n-h1-854121-14/search => generated 117 bytes in 647 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:15.979227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.013320 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3b96b586-3f98-4939-8540-7231e1b64992 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.775390 Oct 17 13:15:16.014206 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 61/90] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:15 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:16.026264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:16.041087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:16.061013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.062680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.066470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.067420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.069682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.071748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.158226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a471c66-e137-480f-bd59-ef3dd43da13f", "tag": "12e942e2-e4a3-4415-86c6-ba89010d9447"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:16.222467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.230707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.232957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.331965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Creating event network-changed:12e942e2-e4a3-4415-86c6-ba89010d9447 for instance 5a471c66-e137-480f-bd59-ef3dd43da13f on n-h1-854121-14 Oct 17 13:15:16.332511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:15:16.332901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50662b7c-0359-4846-bbcf-a48162c76cc5 req-79790a10-9fe1-4ec5-8257-e1405655d0af service nova] Acquired lock "compute-rpcapi-router" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:15:16.338651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.339145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.339578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.340310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.340768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.341211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.386375 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.rpcapi [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 13:15:16.387847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] Releasing lock "compute-rpcapi-router" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:15:16.408260 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77ca01b8-02c1-41b0-bef7-47a41267a385 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.608721 Oct 17 13:15:16.409795 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 30/91] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:16.417687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:16.418785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:16.427210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.428316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.429065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.430040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.430667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.431269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.708921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.729305 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1462651-24f1-47e3-9895-231256c58fd5 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1294 microversion: 2.1 time: 0.315007 Oct 17 13:15:16.746453 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 31/92] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:16 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1294 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:16.758417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Calling method '.version_select at 0x7f419eaead30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:16.763389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.763959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.764433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.802705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Request method failure captured: Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVViDMz1SwwkNHYu2sT4qLOGyQ9fywfYjDa6aQ9qXNxoFoqZcnM7YQWXxoNxwtOsfzX3Kvn5DIWCCIgVHgghrayrIKpEv-fb3aCdCUUc45IhCLd4wo3MwVdfRXLF_emc4PAcMgMuU9thb22hl7Dn1PlE5iSe7B5aED0uxUPWCBQyQpk Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a2288ce849b043b5908aff8b9b5f2f2d Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-812618004 Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:16.808991 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-812618004 Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a2288ce849b043b5908aff8b9b5f2f2d Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-812618004 Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 73fd335117284ff294debba2ff549103 Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:15:16.810134 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:16.810740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:16.812112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:16.812112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:16.812112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:16.812112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 17 13:15:16.812112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:16.816601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:16.821936 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29ccc5f0-6eda-4c9e-a495-b98edef105d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.071530 Oct 17 13:15:16.826516 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 32/93] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:15:16 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:16.843704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Calling method '.version_select at 0x7f419eaeaca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:16.852233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.852962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.853647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:16.873241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.890117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.900586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:16.912165 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad4b1aa9-907c-4af5-b9e8-950f80b1d1f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.891537 Oct 17 13:15:16.924519 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 62/94] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:16 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:16.924983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:16.928997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:16.932713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.002945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.007411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.008325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.028818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d2b54fb-a0b3-4189-917b-68fc944907d9 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.199935 Oct 17 13:15:17.041662 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 33/95] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:16 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:17.043387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26145f67-c721-4925-994b-c7ac50cbd7b2 tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Calling method '.version_select at 0x7f419ec24a60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.045347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26145f67-c721-4925-994b-c7ac50cbd7b2 tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'fe4efaad99fd4552978e1218cf402eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d83efbcf5ba41b492be8a3e14f72afa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26145f67-c721-4925-994b-c7ac50cbd7b2 tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Request method failure captured: Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVgGP1iMPcXj-48WNuOxqgTSsPURUb9YLPR6xov6LQUWLG7tGCf8XR-qlFfApuguGyqhECcITnDsz5lazY2g1dqkNolWbnhK6zfl9zC0EuMwBX_FgGIt-lBpEPYchQCbf-Ky5I0zaSc5sfQ7YiydToBwdN-afURDZBRibYB7Q90thk Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 8d83efbcf5ba41b492be8a3e14f72afa Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099976932 Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:17.047313 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8d83efbcf5ba41b492be8a3e14f72afa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1099976932 Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 8d83efbcf5ba41b492be8a3e14f72afa Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099976932 Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fe4efaad99fd4552978e1218cf402eae Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 13:15:17.048438 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '1'} Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:17.049183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 17 13:15:17.050116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:17.051025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26145f67-c721-4925-994b-c7ac50cbd7b2 tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:17.051025 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26145f67-c721-4925-994b-c7ac50cbd7b2 tempest-HypervisorAdminNegativeUnderV252Test-1099976932 tempest-HypervisorAdminNegativeUnderV252Test-1099976932-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010372 Oct 17 13:15:17.051143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.051689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:17.057099 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 63/96] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:17.066923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Calling method '.version_select at 0x7f419eb8bf70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.069183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.071356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.072076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.075681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.078213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.082505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.083684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.084895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.087158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.129325 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] HTTP exception thrown: No hypervisor matching 'a130e256-aaf1-4325-b9b3-7fa3287d113c' could be found. Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Request method failure captured: Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hypervisors/a130e256-aaf1-4325-b9b3-7fa3287d113c/servers HTTP/1.1 Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVViDMz1SwwkNHYu2sT4qLOGyQ9fywfYjDa6aQ9qXNxoFoqZcnM7YQWXxoNxwtOsfzX3Kvn5DIWCCIgVHgghrayrIKpEv-fb3aCdCUUc45IhCLd4wo3MwVdfRXLF_emc4PAcMgMuU9thb22hl7Dn1PlE5iSe7B5aED0uxUPWCBQyQpk Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a2288ce849b043b5908aff8b9b5f2f2d Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-812618004 Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:17.134083 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a2288ce849b043b5908aff8b9b5f2f2d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-812618004 Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a2288ce849b043b5908aff8b9b5f2f2d Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-812618004 Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 73fd335117284ff294debba2ff549103 Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: exception: No hypervisor matching 'a130e256-aaf1-4325-b9b3-7fa3287d113c' could be found. Oct 17 13:15:17.135343 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a130e256-aaf1-4325-b9b3-7fa3287d113c'} Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'a130e256-aaf1-4325-b9b3-7fa3287d113c' could be found. Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:17.135983 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:17.137109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:17.137109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:17.137109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:17.137109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:17.137109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'a130e256-aaf1-4325-b9b3-7fa3287d113c' could be found. Oct 17 13:15:17.137109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:17.139018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] Returning 404 to user: No hypervisor matching 'a130e256-aaf1-4325-b9b3-7fa3287d113c' could be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:17.140295 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1f97b85-e3f4-4d55-8ae0-70c387c5c639 tempest-HypervisorAdminNegativeUnderV252Test-812618004 tempest-HypervisorAdminNegativeUnderV252Test-812618004-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/a130e256-aaf1-4325-b9b3-7fa3287d113c/servers" status: 404 len: 123 microversion: 2.1 time: 0.077641 Oct 17 13:15:17.141466 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 64/97] 10.222.0.65 () {58 vars in 1281 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/os-hypervisors/a130e256-aaf1-4325-b9b3-7fa3287d113c/servers => generated 123 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:15:17.626317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:17.637005 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37ffbab3-15d0-4edd-8fe3-cd7bc2091023 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.594061 Oct 17 13:15:17.642898 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 34/98] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:17.753349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.753965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:17.768144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.768639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.769076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.769806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.770255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.770671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.947386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:17.948840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:17.965461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.968971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.970224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:17.971546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:17.976671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:17.977976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.312770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:18.795523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:18.808731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:18.810372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:18.828970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab7d289e-bd7b-410f-b9ce-ff484dfbfe65 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.888331 Oct 17 13:15:18.830689 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 35/99] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:18.843476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:18.844760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:18.858530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.861030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.861738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:18.862678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:18.867692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:18.868528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.336066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:19.349660 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58ea0ca7-2912-443f-b0c0-a65ec466df36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 1.599820 Oct 17 13:15:19.350778 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 65/100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:17 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:19.538741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:19.564366 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e1ed9c2-1aa1-4938-97c8-f5e055d59f4b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.728422 Oct 17 13:15:19.569413 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 36/101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:18 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:19.865023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:19.866249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:19.886004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.886533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.887092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:19.887895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:19.888477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:19.888906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.211825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:20.226778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:20.230782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:20.242550 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef2c9c0a-cb08-4c1f-950f-bf11538a1846 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.382388 Oct 17 13:15:20.245099 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 66/102] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:19 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:20.334753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cc81a64-8df7-4f2e-9eee-9e0e9e8a1756 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-378005852", "id": 1678350391, "os-flavor-access:is_public": "False"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:20.377329 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2cc81a64-8df7-4f2e-9eee-9e0e9e8a1756 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.480404 Oct 17 13:15:20.380039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:20.383112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:20.387253 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 37/103] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:19 2022] POST /compute/v2.1/flavors => generated 438 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:20.399190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.401293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-458e162f-d475-4b50-9e52-0ebf70f4716e tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:20.405308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.408166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.414160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.419886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.422032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.621036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-458e162f-d475-4b50-9e52-0ebf70f4716e tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/1678350391/action" status: 200 len: 97 microversion: 2.1 time: 0.232345 Oct 17 13:15:20.623880 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 38/104] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:20 2022] POST /compute/v2.1/flavors/1678350391/action => generated 97 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:20.651363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:20.655029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:20.675026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.676170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.679341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:20.680482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:20.684571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:20.685727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.295052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.304838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64600c5f-6e27-418b-a649-8eb016fd2597 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.669992 Oct 17 13:15:21.314481 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 39/105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:20 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:21.322123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.334735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60dd8b1b-b6c1-4740-83dd-5b2533427d46 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:21.346484 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98503e28-d520-429a-8332-81d28ce73b36 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.968258 Oct 17 13:15:21.350182 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 67/106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:20 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:21.376288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:21.380123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:21.399914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.404359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.406193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.409703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:21.410989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:21.413912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:21.723237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.755056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.761911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:21.784066 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77c889a2-4fdb-4191-b2a2-ed371fb02174 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.430610 Oct 17 13:15:21.785674 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 68/107] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:21 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:21.879553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-60dd8b1b-b6c1-4740-83dd-5b2533427d46 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] HTTP exception thrown: Flavor access already exists for flavor 27 and project ba24216c67c8444d9c621bd47c8c5fc8 combination. Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60dd8b1b-b6c1-4740-83dd-5b2533427d46 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Request method failure captured: Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/flavors/1678350391/action HTTP/1.1 Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 67 Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVmG3U8CytyTq9WJoGvgIzRSYZqrr383CtkvMmpYAH6lx0uwsZvpRqQD5lWNwpnFRhkr9X6oTW9rOrPYCNuFEMDrjX0tO6P0CnvR9wQae4oCzVkOM6b67TZkQbKzIGADDTDluZL7Qgjn_tKj9ynPezEcxKObbZs3IlDatux1UeoGTQ Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f0fdc0090b0f40ebb61370acb5121d64 Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:21.990905 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f0fdc0090b0f40ebb61370acb5121d64 Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fe38c8e72de64e3e8b7ae02a30bc3864 Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: {"addTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} Oct 17 13:15:21.992530 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: exception: Flavor access already exists for flavor 27 and project ba24216c67c8444d9c621bd47c8c5fc8 combination. Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '1678350391', 'body': {'addTenantAccess': {'tenant': 'ba24216c67c8444d9c621bd47c8c5fc8'}}} Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:15:21.993313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '27-ba24216c67c8444d9c621bd47c8c5fc8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 13:15:21.994301 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 13:15:21.995261 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:15:21.996226 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '27-ba24216c67c8444d9c621bd47c8c5fc8' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 13, 15, 21, 862554), 'updated_at': None, 'flavor_id': 27, 'project_id': 'ba24216c67c8444d9c621bd47c8c5fc8'}] Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:21.997117 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 27 and project ba24216c67c8444d9c621bd47c8c5fc8 combination. Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:21.999487 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 27 and project ba24216c67c8444d9c621bd47c8c5fc8 combination. Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:22.005361 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:22.007627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 27 and project ba24216c67c8444d9c621bd47c8c5fc8 combination. Oct 17 13:15:22.007627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:22.007627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60dd8b1b-b6c1-4740-83dd-5b2533427d46 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Returning 409 to user: Flavor access already exists for flavor 27 and project ba24216c67c8444d9c621bd47c8c5fc8 combination. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:22.007627 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60dd8b1b-b6c1-4740-83dd-5b2533427d46 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/1678350391/action" status: 409 len: 152 microversion: 2.1 time: 0.678514 Oct 17 13:15:22.007627 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 40/108] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:21 2022] POST /compute/v2.1/flavors/1678350391/action => generated 152 bytes in 682 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:15:22.012134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02f85b09-794f-4ea2-b84b-977df9faf292 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:22.023026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dc692142-1aa4-4e88-aa39-e7df8f5690f0 req-4657fadb-1afe-4393-81be-9d2f5e00a8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7101e2b4-4d05-495a-a629-56cb53c7b309", "tag": "d0cea19f-b56f-41d0-81d0-0edd35ada53f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:22.077435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dc692142-1aa4-4e88-aa39-e7df8f5690f0 req-4657fadb-1afe-4393-81be-9d2f5e00a8d2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.097607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dc692142-1aa4-4e88-aa39-e7df8f5690f0 req-4657fadb-1afe-4393-81be-9d2f5e00a8d2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.105380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dc692142-1aa4-4e88-aa39-e7df8f5690f0 req-4657fadb-1afe-4393-81be-9d2f5e00a8d2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.156988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:22.164799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dc692142-1aa4-4e88-aa39-e7df8f5690f0 req-4657fadb-1afe-4393-81be-9d2f5e00a8d2 service nova] Creating event network-changed:d0cea19f-b56f-41d0-81d0-0edd35ada53f for instance 7101e2b4-4d05-495a-a629-56cb53c7b309 on n-h1-854121-14 Oct 17 13:15:22.177327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dc692142-1aa4-4e88-aa39-e7df8f5690f0 req-4657fadb-1afe-4393-81be-9d2f5e00a8d2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165819 Oct 17 13:15:22.181912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 41/109] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:22.345791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:22.346788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:22.366893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.367870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.368762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.371965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.372756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.375240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.650622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02f85b09-794f-4ea2-b84b-977df9faf292 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/1678350391/action" status: 200 len: 21 microversion: 2.1 time: 0.644912 Oct 17 13:15:22.659780 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 69/110] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:22 2022] POST /compute/v2.1/flavors/1678350391/action => generated 21 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:22.680958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:22.686411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:22.704810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.707749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.708502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.711887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:22.713756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:22.716666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:22.859007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:22.871854 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddbaa76d-74df-4c0b-9c59-d3d5e1226a47 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.530758 Oct 17 13:15:22.893046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 42/111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:22 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:22.913884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bd444bfb-f1ae-4e60-bd38-5f201c745985 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:22.963784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bd444bfb-f1ae-4e60-bd38-5f201c745985 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1678350391" status: 202 len: 0 microversion: 2.1 time: 0.066641 Oct 17 13:15:22.973225 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 43/112] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:22 2022] DELETE /compute/v2.1/flavors/1678350391 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:22.995199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:22.995817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:23.015138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.015637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.016071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.016788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.017239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.017659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.067846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:23.218461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.231207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.232996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.246306 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a29d22d2-685e-4847-89af-d489ddda68ca tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.271767 Oct 17 13:15:23.250199 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 44/113] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:22 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:23.258858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bd30c716-f5bf-4764-b899-c47f7f97645f tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.306111 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bd30c716-f5bf-4764-b899-c47f7f97645f tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054296 Oct 17 13:15:23.321334 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 45/114] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:23.334754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49570cda-d0f1-46b0-bb9d-3f8d7fea72de tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-369204964", "id": 1224852376, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:23.342416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.370170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05ddc549-2b6c-44ad-a5a9-d827c5c5d4e1 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.708130 Oct 17 13:15:23.370404 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49570cda-d0f1-46b0-bb9d-3f8d7fea72de tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.039464 Oct 17 13:15:23.376232 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 70/115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:22 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:23.379274 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 46/116] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:23 2022] POST /compute/v2.1/flavors => generated 437 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:23.408822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bdd4c04-71dc-438d-a785-07ac2d363fd0 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.423444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:23.436759 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7bdd4c04-71dc-438d-a785-07ac2d363fd0 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bdd4c04-71dc-438d-a785-07ac2d363fd0 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Request method failure captured: Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/flavors/1224852376/os-flavor-access HTTP/1.1 Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVmG3U8CytyTq9WJoGvgIzRSYZqrr383CtkvMmpYAH6lx0uwsZvpRqQD5lWNwpnFRhkr9X6oTW9rOrPYCNuFEMDrjX0tO6P0CnvR9wQae4oCzVkOM6b67TZkQbKzIGADDTDluZL7Qgjn_tKj9ynPezEcxKObbZs3IlDatux1UeoGTQ Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f0fdc0090b0f40ebb61370acb5121d64 Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:23.446018 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f0fdc0090b0f40ebb61370acb5121d64 Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fe38c8e72de64e3e8b7ae02a30bc3864 Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: exception: Access list not available for public flavors. Oct 17 13:15:23.447550 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'flavor_id': '1224852376'} Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 17 13:15:23.448345 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.454934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bdd4c04-71dc-438d-a785-07ac2d363fd0 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:23.459465 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7bdd4c04-71dc-438d-a785-07ac2d363fd0 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/1224852376/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.077790 Oct 17 13:15:23.470596 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 71/117] 10.222.0.65 () {58 vars in 1209 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/flavors/1224852376/os-flavor-access => generated 91 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:15:23.475238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c885352b-d32b-40c7-949b-96cd55b40d25 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.505674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c885352b-d32b-40c7-949b-96cd55b40d25 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1224852376" status: 202 len: 0 microversion: 2.1 time: 0.036111 Oct 17 13:15:23.510654 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 47/118] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:23 2022] DELETE /compute/v2.1/flavors/1224852376 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:23.517860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3951cebf-2baa-42ad-adce-100c477e8f04 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.595770 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3951cebf-2baa-42ad-adce-100c477e8f04 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082803 Oct 17 13:15:23.596707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 72/119] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:23.627074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3f5aa8a-a5f3-4a7a-951d-bf0ada310f43 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-189921815", "id": 1150441155, "os-flavor-access:is_public": "False"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:23.677381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3f5aa8a-a5f3-4a7a-951d-bf0ada310f43 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.062841 Oct 17 13:15:23.697576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 48/120] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:23 2022] POST /compute/v2.1/flavors => generated 438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:23.901463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:23.902763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:23.921013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.921979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.922272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.929761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:23.930422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:23.930856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:23.983819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20b74f25-1a68-4f50-a11e-cbdd3eac8c60 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:23.987479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20b74f25-1a68-4f50-a11e-cbdd3eac8c60 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '54ece8b14e62431fa5170cbfda071918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24216c67c8444d9c621bd47c8c5fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20b74f25-1a68-4f50-a11e-cbdd3eac8c60 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Request method failure captured: Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/flavors/1150441155/action HTTP/1.1 Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 67 Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVk-Fww69ypqoXZHCSTEl7FT4z8Ww3tpBVXHYKUN5x1IiX1MtjK-AYeCrMKcOdzWogVyIGJwR5cG-59MPKEEx-m3DWsgUowu8-hKgFqKImlWUJ9AoC3e5FBq83D7HTPhHFpNrnUx9XWgB0MC0fikDZGMiNPw6Pf1LxbGxROm-4KXkI Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ba24216c67c8444d9c621bd47c8c5fc8 Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-356339418 Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:23.990104 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-356339418 Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ba24216c67c8444d9c621bd47c8c5fc8 Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-356339418 Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsAccessNegativeTestJSON-356339418-project Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 54ece8b14e62431fa5170cbfda071918 Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-356339418-project Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: {"addTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} Oct 17 13:15:23.991705 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '1150441155', 'body': {'addTenantAccess': {'tenant': 'ba24216c67c8444d9c621bd47c8c5fc8'}}} Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:23.992476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 17 13:15:23.993766 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:23.995057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20b74f25-1a68-4f50-a11e-cbdd3eac8c60 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:23.995127 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20b74f25-1a68-4f50-a11e-cbdd3eac8c60 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] 10.222.0.65 "POST /compute/v2.1/flavors/1150441155/action" status: 403 len: 130 microversion: 2.1 time: 0.307044 Oct 17 13:15:24.004321 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 73/121] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:23 2022] POST /compute/v2.1/flavors/1150441155/action => generated 130 bytes in 312 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:15:24.014047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aeebaf6e-1e53-4f95-b1cf-5b2b17034b77 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:24.037710 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aeebaf6e-1e53-4f95-b1cf-5b2b17034b77 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1150441155" status: 202 len: 0 microversion: 2.1 time: 0.031142 Oct 17 13:15:24.038643 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 74/122] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:24 2022] DELETE /compute/v2.1/flavors/1150441155 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:24.047514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2f50626-8dce-4fa6-b0d2-ae5f4f41da32 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:24.096787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2f50626-8dce-4fa6-b0d2-ae5f4f41da32 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053531 Oct 17 13:15:24.100204 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 75/123] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:24.125881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b64cc68-d10e-4dfc-bb08-fb83d275b8e8 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1607472802", "id": 2108867897, "os-flavor-access:is_public": "False"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:24.160831 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b64cc68-d10e-4dfc-bb08-fb83d275b8e8 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.039412 Oct 17 13:15:24.161486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 76/124] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:24 2022] POST /compute/v2.1/flavors => generated 439 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:24.176260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c59b2bf6-2d85-4a0c-b79a-b5391fe758a8 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:24.330380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.351342 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb673b80-7f05-4743-b42f-e503e8cf21d3 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.450860 Oct 17 13:15:24.354090 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 49/125] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:23 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:24.358481 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c59b2bf6-2d85-4a0c-b79a-b5391fe758a8 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2108867897/action" status: 200 len: 97 microversion: 2.1 time: 0.186119 Oct 17 13:15:24.362923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 77/126] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:24 2022] POST /compute/v2.1/flavors/2108867897/action => generated 97 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:15:24.377900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:24.378536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:24.384511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c0d006f-5bd5-43b9-a208-1c96dd798ea8 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:24.389277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c0d006f-5bd5-43b9-a208-1c96dd798ea8 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '54ece8b14e62431fa5170cbfda071918', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba24216c67c8444d9c621bd47c8c5fc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c0d006f-5bd5-43b9-a208-1c96dd798ea8 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Request method failure captured: Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/flavors/2108867897/action HTTP/1.1 Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 70 Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVk-Fww69ypqoXZHCSTEl7FT4z8Ww3tpBVXHYKUN5x1IiX1MtjK-AYeCrMKcOdzWogVyIGJwR5cG-59MPKEEx-m3DWsgUowu8-hKgFqKImlWUJ9AoC3e5FBq83D7HTPhHFpNrnUx9XWgB0MC0fikDZGMiNPw6Pf1LxbGxROm-4KXkI Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ba24216c67c8444d9c621bd47c8c5fc8 Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-356339418 Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:24.394206 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba24216c67c8444d9c621bd47c8c5fc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-356339418 Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ba24216c67c8444d9c621bd47c8c5fc8 Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-356339418 Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsAccessNegativeTestJSON-356339418-project Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 54ece8b14e62431fa5170cbfda071918 Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-356339418-project Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: {"removeTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} Oct 17 13:15:24.397928 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '2108867897', 'body': {'removeTenantAccess': {'tenant': 'ba24216c67c8444d9c621bd47c8c5fc8'}}} Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can( Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:24.398589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 17 13:15:24.399694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:24.400737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c0d006f-5bd5-43b9-a208-1c96dd798ea8 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:24.400737 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c0d006f-5bd5-43b9-a208-1c96dd798ea8 tempest-FlavorsAccessNegativeTestJSON-356339418 tempest-FlavorsAccessNegativeTestJSON-356339418-project] 10.222.0.65 "POST /compute/v2.1/flavors/2108867897/action" status: 403 len: 133 microversion: 2.1 time: 0.016129 Oct 17 13:15:24.400855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.400855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.400855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.401049 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 78/127] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:24 2022] POST /compute/v2.1/flavors/2108867897/action => generated 133 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:24.401685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.403713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.405043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.412985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:24.418097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:24.432939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.433684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.434450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.436762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:24.437394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:24.439141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:24.561293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.562860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=22 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:24.579010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.586249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.600439 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0e654b3-42f0-45c1-b3b2-23091c58f172 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.242975 Oct 17 13:15:24.618125 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 50/128] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:24 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:24.628571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9142b5c0-21e1-49a7-acd0-60d02e654465 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ba24216c67c8444d9c621bd47c8c5fc8"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:24.878208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:24.889072 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41123b57-31ae-41f5-8e5a-4c2234d40847 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.487604 Oct 17 13:15:24.895263 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 79/129] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:24 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:25.068645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=8,nova_api:DELETE=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:25.137258 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9142b5c0-21e1-49a7-acd0-60d02e654465 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2108867897/action" status: 200 len: 21 microversion: 2.1 time: 0.517601 Oct 17 13:15:25.142874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 51/130] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:15:24 2022] POST /compute/v2.1/flavors/2108867897/action => generated 21 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:25.155208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7104c75d-1919-4028-8277-94a020a9a604 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.218041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7104c75d-1919-4028-8277-94a020a9a604 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2108867897" status: 202 len: 0 microversion: 2.1 time: 0.068725 Oct 17 13:15:25.218648 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 80/131] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:25 2022] DELETE /compute/v2.1/flavors/2108867897 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:25.230294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae95c80c-9ea1-4048-b21b-b00b64523fea tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.320543 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae95c80c-9ea1-4048-b21b-b00b64523fea tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.084836 Oct 17 13:15:25.321280 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 52/132] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:25.348461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2040f75-077c-410d-a868-9b5a16be9517 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1841502037", "id": 361734692, "os-flavor-access:is_public": "False"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:25.382853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.383964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:25.403609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.404705 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2040f75-077c-410d-a868-9b5a16be9517 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.061424 Oct 17 13:15:25.420090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.420570 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 81/133] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:25 2022] POST /compute/v2.1/flavors => generated 436 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:25.422798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.425356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.429965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.430894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.433373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78485c17-891d-4227-8226-f862cb82a566 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "891d40ff2a9947bcbb5c18018209703d"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:25.895535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:25.918224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-457f2254-b9f9-4304-b71b-0709cb60794d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.535466 Oct 17 13:15:25.918224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 53/134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:25 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:25.933867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:25.934491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:25.973482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.973482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.973482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:25.973482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:25.973832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:25.977864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.116221 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-78485c17-891d-4227-8226-f862cb82a566 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] HTTP exception thrown: Flavor access not found for 31 / 891d40ff2a9947bcbb5c18018209703d combination. Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78485c17-891d-4227-8226-f862cb82a566 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Request method failure captured: Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/flavors/361734692/action HTTP/1.1 Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 70 Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVmG3U8CytyTq9WJoGvgIzRSYZqrr383CtkvMmpYAH6lx0uwsZvpRqQD5lWNwpnFRhkr9X6oTW9rOrPYCNuFEMDrjX0tO6P0CnvR9wQae4oCzVkOM6b67TZkQbKzIGADDTDluZL7Qgjn_tKj9ynPezEcxKObbZs3IlDatux1UeoGTQ Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f0fdc0090b0f40ebb61370acb5121d64 Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:26.119966 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0fdc0090b0f40ebb61370acb5121d64"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f0fdc0090b0f40ebb61370acb5121d64 Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-769403273 Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fe38c8e72de64e3e8b7ae02a30bc3864 Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: {"removeTenantAccess": {"tenant": "891d40ff2a9947bcbb5c18018209703d"}} Oct 17 13:15:26.122385 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor access not found for 31 / 891d40ff2a9947bcbb5c18018209703d combination. Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '361734692', 'body': {'removeTenantAccess': {'tenant': '891d40ff2a9947bcbb5c18018209703d'}}} Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 17 13:15:26.123081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 891d40ff2a9947bcbb5c18018209703d combination. Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 891d40ff2a9947bcbb5c18018209703d combination. Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:26.124081 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:26.125238 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:26.125238 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:26.125238 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:26.125238 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:26.125238 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 891d40ff2a9947bcbb5c18018209703d combination. Oct 17 13:15:26.125238 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:26.128455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78485c17-891d-4227-8226-f862cb82a566 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Returning 404 to user: Flavor access not found for 31 / 891d40ff2a9947bcbb5c18018209703d combination. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:26.129972 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-78485c17-891d-4227-8226-f862cb82a566 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/361734692/action" status: 404 len: 124 microversion: 2.1 time: 0.708161 Oct 17 13:15:26.130928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 82/135] 10.222.0.65 () {60 vars in 1197 bytes} [Mon Oct 17 13:15:25 2022] POST /compute/v2.1/flavors/361734692/action => generated 124 bytes in 710 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:26.141404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:26.142823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:26.152525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.153306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.153959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.154928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.155588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.156803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.173880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:26.184480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:26.191492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:26.206541 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05f90485-2a8e-4c8d-848b-ed77e5eb6e0d tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.290435 Oct 17 13:15:26.207496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 54/136] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:25 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:26.222855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef7c07ae-e305-4094-974d-421e2f373b25 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:26.286678 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef7c07ae-e305-4094-974d-421e2f373b25 tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/361734692" status: 202 len: 0 microversion: 2.1 time: 0.075651 Oct 17 13:15:26.293497 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 55/137] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:15:26 2022] DELETE /compute/v2.1/flavors/361734692 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:26.308027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-795aeb4c-a9eb-45d9-9d59-a6793098923b tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:26.357289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-795aeb4c-a9eb-45d9-9d59-a6793098923b tempest-FlavorsAccessNegativeTestJSON-769403273 tempest-FlavorsAccessNegativeTestJSON-769403273-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057230 Oct 17 13:15:26.358915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 56/138] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:26.440828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:26.455932 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c36dc52d-fb62-4f33-a914-127abda13932 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.323048 Oct 17 13:15:26.456690 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 83/139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:26 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:26.962553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:26.962553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:26.962553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:26.972746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.985699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.986052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:26.986937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:26.987393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:26.987988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.241862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:27.243267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:27.259689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.260510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.265474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.266883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.267604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.268310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.305737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.323521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-354fd723-fbaa-4e70-a826-f859e0a6ed29 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.368416 Oct 17 13:15:27.324971 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 57/140] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:26 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:27.433358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.449662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.452299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.468479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bfb4fef8-c707-42dd-b918-ccaa0d2acc30 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.229901 Oct 17 13:15:27.469499 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 84/141] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:27 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:27.481626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:27.482515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:27.492701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.494568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.496495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.497416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:27.499106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:27.501755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:27.749986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:27.764480 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57599b99-196a-42fb-827f-c685992823fb tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.283919 Oct 17 13:15:27.766038 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 58/142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:27 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:28.351295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:28.351916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:28.362266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.362776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.363219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.363938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.364395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.364823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.507474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:28.508913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:28.529808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.534143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.544814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.546375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.549318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.552253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.893864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:28.897243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:28.908876 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21f6db50-7468-4b57-9391-9af42b1dc50c tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.563424 Oct 17 13:15:28.912614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:28.913338 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 85/143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:28 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:28.918126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:28.921033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:28.921682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:28.932740 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0774739b-805b-40b4-9fd9-78f803bef4fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.427275 Oct 17 13:15:28.936729 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 59/144] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:28 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:15:28.974426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.981765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.983494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:28.984517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:28.985234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:28.985834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.042475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:29.479017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:29.516847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-000fce0a-97cf-4216-a9f9-7c502d299e7d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.601282 Oct 17 13:15:29.553713 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 86/145] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:28 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:29.939218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:29.939969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:29.962761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.965261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.966749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.967856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.968795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.968912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:29.969561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:29.970690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.981334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.981872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.982299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:29.983004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:29.983452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:29.983871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:30.143088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.159476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.161423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.170283 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-459c0d24-2426-4c0f-9924-524785d3c8dc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.206319 Oct 17 13:15:30.182727 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 87/146] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:29 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:30.490093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.504296 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cfc94df6-2a6e-43fd-8d4b-7b17025adb45 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.569561 Oct 17 13:15:30.520625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 60/147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:29 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:30.548433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:30.549687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:30.559769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:30.560256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:30.569530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:30.570392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:30.570870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:30.571300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:30.919238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:30.934855 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed133e61-1bf4-4bb9-808b-2fa15550bbb6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.389942 Oct 17 13:15:30.936878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 88/148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:30 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:31.206538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:31.209528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:31.234731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.235340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.236696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.239473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.240834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.242089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.402905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:31.413957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:31.415434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:31.430406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-587a53ea-ba13-4deb-a22b-500ec03b89da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.229197 Oct 17 13:15:31.431012 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 61/149] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:31 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:31.532292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:31.533890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:31.545478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.547244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.548066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.552376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.554388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.555637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.909767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:31.948145 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b64d1af-bf10-42e5-b580-0d50d813edae tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.422646 Oct 17 13:15:31.949451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 89/150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:31 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:31.969932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:31.970796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:31.981659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.982170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.982735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:31.983320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:31.983779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:31.984206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.216968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:32.229138 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2036fd1c-7429-4432-8d93-4cdee59b12a6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.263065 Oct 17 13:15:32.230004 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 62/151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:31 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:32.460319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:32.461004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:32.472073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.472574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.475651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.476444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.478029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.480189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.601666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:32.629041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:32.633836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:32.653897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20f5cc58-f602-4fb4-8f3c-ff1420dbf591 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.198661 Oct 17 13:15:32.654571 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 90/152] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:32 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:32.972802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:32.973887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:32.984743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.985510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.990909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:32.993857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:32.994936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:32.997413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.251996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:33.252863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:33.267383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:33.274005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:33.274919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.276533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:33.280386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:33.281659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.658822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:33.668021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7408530a-e55a-460f-9317-8ce93e7fef2b tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.699824 Oct 17 13:15:33.668600 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 63/153] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:32 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:33.682942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:33.686198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:33.703079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:33.704130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:33.704882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.705833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:33.706431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:33.707185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:33.848961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:33.864273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e081e77-5380-45ef-a639-cabbd5d85908 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.616053 Oct 17 13:15:33.867379 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 91/154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:33 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:33.901513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:33.915354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:33.917278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:33.928165 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78b8b618-94d7-45d6-a690-b6d4ba68e376 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.249080 Oct 17 13:15:33.930079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 64/155] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:33 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:15:34.696669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:34.697543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c72c2f5-c917-41fa-94fd-53113050aec5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-15332924", "ram": 512, "vcpus": 1, "disk": 10, "id": 1421350741, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:34.699582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:34.721584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:34.722557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:34.723138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:34.724062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:34.732722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:34.733545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:34.777057 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c72c2f5-c917-41fa-94fd-53113050aec5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.402417 Oct 17 13:15:34.791800 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 92/156] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:34 2022] POST /compute/v2.1/flavors => generated 414 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:35.020480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-407b9c39-2477-4e95-a172-9658af03a3c0 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.033575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-407b9c39-2477-4e95-a172-9658af03a3c0 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] HTTP exception thrown: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-407b9c39-2477-4e95-a172-9658af03a3c0 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Request method failure captured: Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/flavors/1421350741/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVV0l3VVh_hfenBj2EF6SIvpLgI0mDS3kMrmfHLikUkRwjQIBGHhge8yGAKB-PcMarMNdVnsV8GYhE9e7PraFFNw4qdGlNa19Jh8Lb38iBsJQrQ4k41FqTVxcdcrktMKBubSsexJbSt81zW85Camxd7qFqwJ4-y6C6Q-H9ZRPVpwR0w Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:35.039618 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a3a3ed33e7864de7b983832776b56010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 530e912694374b76a85b1957d2990e88 Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:35.041056 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'flavor_id': '1421350741', 'id': 'hw:cpu_thread_policy'} Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.041750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-407b9c39-2477-4e95-a172-9658af03a3c0 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Returning 404 to user: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-407b9c39-2477-4e95-a172-9658af03a3c0 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] 10.222.0.65 "GET /compute/v2.1/flavors/1421350741/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.239908 Oct 17 13:15:35.043025 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 93/157] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:15:34 2022] GET /compute/v2.1/flavors/1421350741/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 241 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:35.063985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.064624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:35.081181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.081687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.082122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.088775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.089301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.089743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.219611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.238364 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52a53d0a-576b-478a-b39c-2fbb803e5f00 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.550064 Oct 17 13:15:35.238963 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 65/158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:34 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:35.248157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.251504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:35.265179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.266086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.266707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.267756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:35.268418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:35.269270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:35.401313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.415973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d4ab7fe-ed35-422f-9fa4-98e353b2469e tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.372937 Oct 17 13:15:35.417386 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 94/159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:35 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:35.417718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.421895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92abd9b8-04eb-4f46-81fb-14cf2034e416 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:35.438179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92abd9b8-04eb-4f46-81fb-14cf2034e416 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '530e912694374b76a85b1957d2990e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a3ed33e7864de7b983832776b56010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92abd9b8-04eb-4f46-81fb-14cf2034e416 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Request method failure captured: Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/flavors/1421350741/os-extra_specs HTTP/1.1 Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 66 Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVV0l3VVh_hfenBj2EF6SIvpLgI0mDS3kMrmfHLikUkRwjQIBGHhge8yGAKB-PcMarMNdVnsV8GYhE9e7PraFFNw4qdGlNa19Jh8Lb38iBsJQrQ4k41FqTVxcdcrktMKBubSsexJbSt81zW85Camxd7qFqwJ4-y6C6Q-H9ZRPVpwR0w Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:35.440092 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a3a3ed33e7864de7b983832776b56010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 530e912694374b76a85b1957d2990e88 Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 17 13:15:35.441244 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'flavor_id': '1421350741', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:35.441905 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 17 13:15:35.443148 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.445733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92abd9b8-04eb-4f46-81fb-14cf2034e416 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.446793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92abd9b8-04eb-4f46-81fb-14cf2034e416 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] 10.222.0.65 "POST /compute/v2.1/flavors/1421350741/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.028471 Oct 17 13:15:35.448636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 95/160] 10.222.0.65 () {60 vars in 1224 bytes} [Mon Oct 17 13:15:35 2022] POST /compute/v2.1/flavors/1421350741/os-extra_specs => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:35.479442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-246e4a65-7d54-4c8d-a3e6-a33b9164a8fb tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:35.481732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.486882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.503090 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f506f16f-9653-4bb4-a6b2-e8d95b136e8b tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1417 microversion: 2.75 time: 0.262889 Oct 17 13:15:35.518258 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 66/161] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:35 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1417 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:35.573520 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-246e4a65-7d54-4c8d-a3e6-a33b9164a8fb tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/1421350741/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.106299 Oct 17 13:15:35.579580 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 96/162] 10.222.0.65 () {60 vars in 1224 bytes} [Mon Oct 17 13:15:35 2022] POST /compute/v2.1/flavors/1421350741/os-extra_specs => generated 66 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:35.588081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-441d2b5a-8e81-4342-ace0-37ca90098df9 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.589999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-441d2b5a-8e81-4342-ace0-37ca90098df9 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '530e912694374b76a85b1957d2990e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a3ed33e7864de7b983832776b56010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-441d2b5a-8e81-4342-ace0-37ca90098df9 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Request method failure captured: Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVV0l3VVh_hfenBj2EF6SIvpLgI0mDS3kMrmfHLikUkRwjQIBGHhge8yGAKB-PcMarMNdVnsV8GYhE9e7PraFFNw4qdGlNa19Jh8Lb38iBsJQrQ4k41FqTVxcdcrktMKBubSsexJbSt81zW85Camxd7qFqwJ4-y6C6Q-H9ZRPVpwR0w Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:15:35.592811 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a3a3ed33e7864de7b983832776b56010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 530e912694374b76a85b1957d2990e88 Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:35.593993 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'flavor_id': '1421350741', 'id': 'hw:numa_nodes'} Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:35.594646 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.600843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-441d2b5a-8e81-4342-ace0-37ca90098df9 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.601765 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-441d2b5a-8e81-4342-ace0-37ca90098df9 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] 10.222.0.65 "DELETE /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013273 Oct 17 13:15:35.601765 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 67/163] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:15:35 2022] DELETE /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:35.606015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3150f2d4-33bc-4d07-8378-f23756563ba6 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:35.683088 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3150f2d4-33bc-4d07-8378-f23756563ba6 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/1421350741/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.081867 Oct 17 13:15:35.684054 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 97/164] 10.222.0.65 () {60 vars in 1224 bytes} [Mon Oct 17 13:15:35 2022] POST /compute/v2.1/flavors/1421350741/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:35.695030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c20c8a25-1b9e-45cb-ae9d-6093569e0b6a tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:35.698874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c20c8a25-1b9e-45cb-ae9d-6093569e0b6a tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '530e912694374b76a85b1957d2990e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a3ed33e7864de7b983832776b56010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c20c8a25-1b9e-45cb-ae9d-6093569e0b6a tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Request method failure captured: Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 22 Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVV0l3VVh_hfenBj2EF6SIvpLgI0mDS3kMrmfHLikUkRwjQIBGHhge8yGAKB-PcMarMNdVnsV8GYhE9e7PraFFNw4qdGlNa19Jh8Lb38iBsJQrQ4k41FqTVxcdcrktMKBubSsexJbSt81zW85Camxd7qFqwJ4-y6C6Q-H9ZRPVpwR0w Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:15:35.700420 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a3a3ed33e7864de7b983832776b56010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a3a3ed33e7864de7b983832776b56010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a3a3ed33e7864de7b983832776b56010 Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 530e912694374b76a85b1957d2990e88 Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: {"hw:numa_nodes": "1"} Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:35.701701 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'flavor_id': '1421350741', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:35.702421 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 17 13:15:35.703373 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.705122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c20c8a25-1b9e-45cb-ae9d-6093569e0b6a tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.706043 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c20c8a25-1b9e-45cb-ae9d-6093569e0b6a tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526 tempest-FlavorsExtraSpecsNegativeTestJSON-2076541526-project] 10.222.0.65 "PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015873 Oct 17 13:15:35.709776 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 68/165] 10.222.0.65 () {60 vars in 1265 bytes} [Mon Oct 17 13:15:35 2022] PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:35.726661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d9ec666-21fe-4020-9882-bcefdc046ab5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.752161 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0d9ec666-21fe-4020-9882-bcefdc046ab5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] HTTP exception thrown: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d9ec666-21fe-4020-9882-bcefdc046ab5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Request method failure captured: Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/flavors/1421350741/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVV2XtOlF41WGAYlYmfNOhAyHh24Yr7NwSWWNWjtNt7chqklChTcF66sqsttKmVDwZCKj83ZOPAoDifkJBZdjOsKnWUn5Pt-QhsfaKgEvJqVmT3ehGSrm3z_aZ54cngpdEZvkZS9VUqJTV0Qe4iAQYZ1JYL3KQr1zepg_kaxpAtN5Jk Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9de2edc7d9a241849f2a5891a1c00625 Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:35.754731 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9de2edc7d9a241849f2a5891a1c00625 Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 34f782f7faba4a30b70f424140575f63 Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:35.756569 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'flavor_id': '1421350741', 'id': 'hw:cpu_thread_policy'} Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.757258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. Oct 17 13:15:35.758479 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.762496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d9ec666-21fe-4020-9882-bcefdc046ab5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Returning 404 to user: Flavor 1421350741 has no extra specs with key hw:cpu_thread_policy. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.764418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d9ec666-21fe-4020-9882-bcefdc046ab5 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1421350741/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.043234 Oct 17 13:15:35.773805 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 98/166] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:15:35 2022] DELETE /compute/v2.1/flavors/1421350741/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:35.782456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60dc4ef1-7c33-4b6a-8841-783e49242c35 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:35.789012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-60dc4ef1-7c33-4b6a-8841-783e49242c35 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60dc4ef1-7c33-4b6a-8841-783e49242c35 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Request method failure captured: Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 27 Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVV2XtOlF41WGAYlYmfNOhAyHh24Yr7NwSWWNWjtNt7chqklChTcF66sqsttKmVDwZCKj83ZOPAoDifkJBZdjOsKnWUn5Pt-QhsfaKgEvJqVmT3ehGSrm3z_aZ54cngpdEZvkZS9VUqJTV0Qe4iAQYZ1JYL3KQr1zepg_kaxpAtN5Jk Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9de2edc7d9a241849f2a5891a1c00625 Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:35.805115 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9de2edc7d9a241849f2a5891a1c00625 Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 34f782f7faba4a30b70f424140575f63 Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: {"hw:cpu_policy": "shared"} Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:35.807601 n-d-854121-14 devstack@n-api.service[120697]: exception: Request body and URI mismatch Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'flavor_id': '1421350741', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.809078 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.811424 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:35.811424 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:35.811424 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 17 13:15:35.811424 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.815549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60dc4ef1-7c33-4b6a-8841-783e49242c35 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.825193 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60dc4ef1-7c33-4b6a-8841-783e49242c35 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.042902 Oct 17 13:15:35.827061 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 69/167] 10.222.0.65 () {60 vars in 1265 bytes} [Mon Oct 17 13:15:35 2022] PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes => generated 73 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:15:35.837395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0534886c-0d44-428d-96fc-264f6b388356 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0534886c-0d44-428d-96fc-264f6b388356 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Request method failure captured: Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 49 Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVV2XtOlF41WGAYlYmfNOhAyHh24Yr7NwSWWNWjtNt7chqklChTcF66sqsttKmVDwZCKj83ZOPAoDifkJBZdjOsKnWUn5Pt-QhsfaKgEvJqVmT3ehGSrm3z_aZ54cngpdEZvkZS9VUqJTV0Qe4iAQYZ1JYL3KQr1zepg_kaxpAtN5Jk Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9de2edc7d9a241849f2a5891a1c00625 Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:35.857211 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9de2edc7d9a241849f2a5891a1c00625"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9de2edc7d9a241849f2a5891a1c00625 Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 34f782f7faba4a30b70f424140575f63 Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 17 13:15:35.858690 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'flavor_id': '1421350741', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 17 13:15:35.859380 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.861377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:35.862710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:35.862710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:35.862710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:35.862710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:35.862710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 17 13:15:35.862710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:35.864337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0534886c-0d44-428d-96fc-264f6b388356 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:35.865964 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0534886c-0d44-428d-96fc-264f6b388356 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.032631 Oct 17 13:15:35.867071 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 99/168] 10.222.0.65 () {60 vars in 1265 bytes} [Mon Oct 17 13:15:35 2022] PUT /compute/v2.1/flavors/1421350741/os-extra_specs/hw:numa_nodes => generated 117 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:35.875539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9724fe5-c016-4768-abd3-8ab255f10e86 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.915811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9724fe5-c016-4768-abd3-8ab255f10e86 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1421350741" status: 202 len: 0 microversion: 2.1 time: 0.043926 Oct 17 13:15:35.922272 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 70/169] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:15:35 2022] DELETE /compute/v2.1/flavors/1421350741 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:15:35.936119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e34dea5f-f549-4118-a508-e30b85cda89b tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:35.975583 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e34dea5f-f549-4118-a508-e30b85cda89b tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410 tempest-FlavorsExtraSpecsNegativeTestJSON-1728385410-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050145 Oct 17 13:15:35.976813 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 100/170] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:15:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:36.271937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:36.272862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:36.291234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.291984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.293734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.295263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.296252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.298167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.339169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:36.457497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:36.458879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:36.478117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.480945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.481477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.482229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.482728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.483152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.675721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:36.690161 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3284941a-e15b-48b0-ab46-0069cee469bd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.426684 Oct 17 13:15:36.692839 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 71/171] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:36 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:36.709843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:36.727327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:36.766871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.768577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.770785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.774677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:36.777149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:36.780739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:36.879331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:36.893288 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f529f7c-211a-47ff-9e3f-63172d48d3fe tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.440856 Oct 17 13:15:36.898734 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 101/172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:36 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:36.931389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:36.944311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:36.947265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:36.956326 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90224a9e-5cb3-4563-9725-70cddbffc4f3 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1438 microversion: 2.75 time: 0.259408 Oct 17 13:15:36.957182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 72/173] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:36 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1438 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:36.994732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:36.998869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.015512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=7,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:37.020214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.022287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.022884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.024148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.026283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.029275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.177007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:37.178812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:37.179395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:37.179870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:37.180397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:37.343239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.366600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.368869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.370805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.373121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.375258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.375941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.592749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.608828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.610410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.636000 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69f8e706-b7ec-4922-ba08-81d315e08feb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "POST /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e/action" status: 202 len: 1495 microversion: 2.75 time: 0.646513 Oct 17 13:15:37.668821 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 102/174] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:15:36 2022] POST /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e/action => generated 1495 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:15:37.671920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.672767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.682170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.683323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.684060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.685685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.686378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.687051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.885862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.899865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.921045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:37.940371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-251b49a8-e221-4759-9bfb-fe317c2beece tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.273531 Oct 17 13:15:37.945626 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 73/175] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:37 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:37.960585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.961678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.962132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-690a5dc6-584f-43bf-a8c3-67a61c4bd086 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.974240 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-690a5dc6-584f-43bf-a8c3-67a61c4bd086 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.286311 Oct 17 13:15:37.975965 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 103/176] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:15:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:37.977951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.980568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.981206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.982607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:37.982765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.983447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:37.985325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.986195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.990518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.992515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.993330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:37.994243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:37.995258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:37.995932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:38.342488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:38.354147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e88ae22a-1f65-4343-a4b2-e8ce0d7050ab tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.405270 Oct 17 13:15:38.374833 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 74/177] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:37 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:38.423113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:38.435714 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfb9d29d-632b-43af-a346-3041720afb56 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.458431 Oct 17 13:15:38.437487 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 104/178] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:37 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:38.516817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-455d4dcb-3377-4861-b83f-4e21ad905469 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1326642187", "id": 1734308731, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:38.548325 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-455d4dcb-3377-4861-b83f-4e21ad905469 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.172013 Oct 17 13:15:38.548976 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 75/179] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:38 2022] POST /compute/v2.1/flavors => generated 425 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:38.562452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc0db654-97a9-4ac3-91b4-0fcf1757a533 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:38.576324 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc0db654-97a9-4ac3-91b4-0fcf1757a533 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018290 Oct 17 13:15:38.580903 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 105/180] 10.222.0.65 () {58 vars in 1182 bytes} [Mon Oct 17 13:15:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:15:38.590617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f5c3c91-a783-404c-b209-69919cf9133f tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1586759307", "id": 588673018, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:38.629621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f5c3c91-a783-404c-b209-69919cf9133f tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.042594 Oct 17 13:15:38.630743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 76/181] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:38 2022] POST /compute/v2.1/flavors => generated 422 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:38.644743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29871a5f-3702-461e-9413-318319aa1244 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:38.662506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29871a5f-3702-461e-9413-318319aa1244 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022241 Oct 17 13:15:38.667593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 106/182] 10.222.0.65 () {58 vars in 1182 bytes} [Mon Oct 17 13:15:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:15:38.683478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a65b8a9-7ebd-469a-8b86-12bc87148fd1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Action: 'create', calling method: .version_select at 0x7f419e853dc0>, body: {"keypair": {"name": "tempest-keypair-1087051587", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcfuaWakykIBir6Ra05ddkEbUUsIr/nEQqV0tj2Lwr5h6MNdxkgc3IFBuy29Q0KBFLm3NjwklXPpjyQnYgaa92mZxKdQMbMJSm+vgikLyK3tlh0k3LWKO4vIXE33jVw+w=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:38.723560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-8a65b8a9-7ebd-469a-8b86-12bc87148fd1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Getting quotas for project dc11740e1af34fb89993b21d04f22d49. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:38.732508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-8a65b8a9-7ebd-469a-8b86-12bc87148fd1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Getting quotas for user 76b1fd5cee4248bbaf5f972c3fadea02 and project dc11740e1af34fb89993b21d04f22d49. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:38.820827 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a65b8a9-7ebd-469a-8b86-12bc87148fd1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143882 Oct 17 13:15:38.822097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 77/183] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:15:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:38.974054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:38.975168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:38.996458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.996964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.997432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:38.998336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:38.998806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:38.999238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:39.162800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:39.186303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:39.189479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:39.197442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e667829d-3633-4753-877e-1f7594e5b6b6 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.227220 Oct 17 13:15:39.198937 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 107/184] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:38 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:39.383017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:39.383643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:39.398057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:39.398553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:39.398985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:39.399699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:39.408030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:39.408656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:39.463236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:39.465220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:39.478086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:39.479509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:39.482048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:39.484167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:39.485430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:39.486057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.120244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.136960 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31fdd9e7-16ce-45d1-87dc-096288b029c6 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.677656 Oct 17 13:15:40.140869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 108/185] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:39 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:40.186614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.198378 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a435a796-0cc6-4ece-b3eb-a7173ba8d996 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.818847 Oct 17 13:15:40.202401 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 78/186] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:39 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:40.232663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:40.234368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:40.249670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a471c66-e137-480f-bd59-ef3dd43da13f", "name": "network-vif-plugged", "status": "completed", "tag": "12e942e2-e4a3-4415-86c6-ba89010d9447"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:40.256685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.257235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.260343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.264614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.267000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.271545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.282979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.290201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.290526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.360721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Creating event network-vif-plugged:12e942e2-e4a3-4415-86c6-ba89010d9447 for instance 5a471c66-e137-480f-bd59-ef3dd43da13f on n-h1-854121-14 Oct 17 13:15:40.361602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:15:40.362205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81d0d78c-2682-4a07-b033-77cd08056d02 req-82fcb253-ccd8-42b1-a204-b2ac8815dd9c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:15:40.365809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.366557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.367188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.368200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:40.369908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:40.371486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:40.401508 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.compute.rpcapi [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 17 13:15:40.403041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] Releasing lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:15:40.428351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d7d3a9f-f816-4f4c-883a-175bfafd14ec None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285828 Oct 17 13:15:40.431234 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 109/187] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:40.838867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.849244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.858175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:40.882017 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b686f4c9-c143-4006-8db1-aeb50c4511fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.655832 Oct 17 13:15:40.883408 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 79/188] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:40 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:41.170340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:41.171103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:41.193615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.194983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.195951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.197220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.197888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.201248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.231185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:41.232170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:41.244011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.250920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.250920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.252315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.252803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.255158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.682757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:41.692826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5eadac60-cdef-4c00-9b63-7fd463fe67b2 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.469201 Oct 17 13:15:41.709921 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 80/189] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:41 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:41.722742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:41.736000 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.571411 Oct 17 13:15:41.754277 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 110/190] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:41 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:41.914512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:41.915381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:41.935733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.938883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.940642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:41.942401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:41.944256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:41.946576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.082803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:42.094254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:42.095901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:42.098842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=7,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:42.102510 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-767b54ad-80a7-4051-aba7-4c52369c3006 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.194305 Oct 17 13:15:42.117190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 81/191] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:41 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:42.376029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:42.377011 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63d08a6c-77e2-4971-9f2c-a49ca1286f53 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001336 Oct 17 13:15:42.377429 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 111/192] 10.222.0.65 () {56 vars in 886 bytes} [Mon Oct 17 13:15:42 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:15:42.619979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9df6debc-084d-4544-b0a0-ed8b07f3008d req-22180e20-f868-4fdb-87b7-2390c72d7044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7101e2b4-4d05-495a-a629-56cb53c7b309", "name": "network-vif-plugged", "status": "completed", "tag": "d0cea19f-b56f-41d0-81d0-0edd35ada53f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:42.649977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9df6debc-084d-4544-b0a0-ed8b07f3008d req-22180e20-f868-4fdb-87b7-2390c72d7044 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.650495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9df6debc-084d-4544-b0a0-ed8b07f3008d req-22180e20-f868-4fdb-87b7-2390c72d7044 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.650937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9df6debc-084d-4544-b0a0-ed8b07f3008d req-22180e20-f868-4fdb-87b7-2390c72d7044 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.702756 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9df6debc-084d-4544-b0a0-ed8b07f3008d req-22180e20-f868-4fdb-87b7-2390c72d7044 service nova] Creating event network-vif-plugged:d0cea19f-b56f-41d0-81d0-0edd35ada53f for instance 7101e2b4-4d05-495a-a629-56cb53c7b309 on n-h1-854121-14 Oct 17 13:15:42.717517 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9df6debc-084d-4544-b0a0-ed8b07f3008d req-22180e20-f868-4fdb-87b7-2390c72d7044 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104209 Oct 17 13:15:42.719068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:42.719680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:42.722490 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 82/193] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:42.733234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.733948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.734553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.735408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.736007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.736743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.766802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:42.767534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:42.797225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.810644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.811245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:42.813666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:42.817219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:42.818279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.351392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.369814 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b9f32a7-1def-42ec-887f-2c1f24967883 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1340 microversion: 2.1 time: 0.654444 Oct 17 13:15:43.384889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 112/194] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:42 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1340 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:43.388389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-316762367", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "588673018", "adminPass": "***", "networks": [{"uuid": "6a103d5b-3642-483b-9de5-752fc6a13039"}], "security_groups": [{"name": "tempest-securitygroup--143728265"}], "key_name": "tempest-keypair-1087051587", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:43.408516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.419805 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ff173cb-b347-4d96-be28-b07976d68c85 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1336 microversion: 2.1 time: 0.661839 Oct 17 13:15:43.425797 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 83/195] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:42 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1336 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:43.437398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:43.438011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:43.454272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.460345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.461042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.461951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:43.462553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:43.463128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:43.629611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.651151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.652621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:43.658925 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85078b54-2b5e-478e-8db7-0f1d56ada8de tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.231811 Oct 17 13:15:43.660280 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 84/196] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:43 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:43.759536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] validate_networks() for [('6a103d5b-3642-483b-9de5-752fc6a13039', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:44.394274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:44.394879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:44.406423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.406920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.407360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.408069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:44.412349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:44.414358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:44.966807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:44.992947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e507b7c-546b-40d4-8c2f-c6cb0c4d503f tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1488 microversion: 2.1 time: 0.603869 Oct 17 13:15:44.994043 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 85/197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:44 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1488 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:44.999339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:45.000132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:45.007318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.008008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.008902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.009909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.010506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.011343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.241964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:45.242518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:45.242974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:45.243740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:45.244032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:45.265430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.269783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.270399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.277066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.277758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.278310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.298100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:45.337016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Getting quotas for project dc11740e1af34fb89993b21d04f22d49. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:45.355027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Getting quotas for user 76b1fd5cee4248bbaf5f972c3fadea02 and project dc11740e1af34fb89993b21d04f22d49. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:45.370250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:45.375074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:45.458214 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36f2defb-cdb1-480b-86e8-97cad849bff3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.086182 Oct 17 13:15:45.461426 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 113/198] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:45.481342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:45.482296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:45.494937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.495880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.497094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.498709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:45.499421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:45.500244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:45.671029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:45.684891 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00288f08-beec-44c3-8b76-90da8c4e1dcc tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1486 microversion: 2.1 time: 0.686895 Oct 17 13:15:45.702087 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 86/199] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:44 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1486 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:45.783566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:45.806347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:45.810233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:45.828450 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd5eb569-8e4c-41ff-94d7-f77863fb12fe tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.357767 Oct 17 13:15:45.837686 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 114/200] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:45 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:45.857089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2424491-17ea-4802-878f-62117caeb667 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:45.862675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2424491-17ea-4802-878f-62117caeb667 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:46.024270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2424491-17ea-4802-878f-62117caeb667 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:46.082450 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2424491-17ea-4802-878f-62117caeb667 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1262 microversion: 2.1 time: 0.236881 Oct 17 13:15:46.108874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 115/201] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:45 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1262 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:46.119716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:46.122341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:46.134022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:46.134824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:46.135928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:46.137633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:46.139348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:46.140078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:46.337566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:46.338165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:46.355704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:46.357244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:46.359209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:46.371457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:46.378470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:46.386344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:46.545879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:15:46.833801 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46a1fd82-02a6-47fb-ae49-dd81e19b12cb tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] 10.222.0.65 "DELETE /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 204 len: 0 microversion: 2.1 time: 1.128217 Oct 17 13:15:46.837202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 87/202] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:45 2022] DELETE /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:15:46.844283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:46.844972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:46.864325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:46.864853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:46.872853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:46.874013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:46.874788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:46.875256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.202177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:47.211339 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c3a607f-47a1-4297-b130-520b4245f956 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1494 microversion: 2.1 time: 0.371135 Oct 17 13:15:47.211940 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 88/203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:46 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1494 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:47.218647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:47.219457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:47.226832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.227653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.228393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.229449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.230357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.231133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.279917 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25198b25-9767-453c-9853-216c04d3b6c3 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1639 microversion: 2.1 time: 1.169360 Oct 17 13:15:47.280591 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 116/204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:46 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1639 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:47.286636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:47.287482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:47.294626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.295344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.295907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.296709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.297272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.297913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.473570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:47.486871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:47.488357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:47.490445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:47.500719 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a4e59e7-5621-4e71-b069-00e3a4fe3ec1 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1314 microversion: 2.1 time: 0.217562 Oct 17 13:15:47.502276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 117/205] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:47 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:47.512280 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-515c2391-0dff-474d-849c-51bea7f7a907 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.299225 Oct 17 13:15:47.513108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:47.513948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:47.516343 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 89/206] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:47 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:47.524313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.525173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.526241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.527226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.527995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.530902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.599875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:15:47.745897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d122864-455c-4ee4-8fad-f56d111053b8 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 204 len: 0 microversion: 2.1 time: 0.242011 Oct 17 13:15:47.747086 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 118/207] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:15:47 2022] DELETE /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:15:47.756940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:47.757589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:47.778055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.778552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.778992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.779706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:47.780156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:47.780592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:47.799433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:48.078860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.090046 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a0911cc-68cb-4668-97b5-fe81a958a44b tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1492 microversion: 2.1 time: 0.337234 Oct 17 13:15:48.090636 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 90/208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:47 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1492 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:48.132329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Calling method '.version_select at 0x7f419e9beee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.134162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.135075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.135075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.149507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.149998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.150463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.175799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.176293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.176727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.184308 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a35a0a36-9c0d-4a38-9386-06c56e86cb25 tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.176993 Oct 17 13:15:48.185283 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 119/209] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:15:48.196929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Calling method '.version_select at 0x7f419e8a6a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.198468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.198951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.200897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.217391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.217892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.218381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.227405 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d199ca1b-7fce-4a71-8523-1093e290292a tempest-HypervisorAdminV228Test-1127365028 tempest-HypervisorAdminV228Test-1127365028-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.035362 Oct 17 13:15:48.228365 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 91/210] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:15:48.242898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.243840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:48.255972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.257103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.257947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.258926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.259564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.260171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.537010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.538752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:48.546072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.548009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.548660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.549656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.559897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.560741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.672238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.690785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84648e09-4732-4416-8214-d9d581e46ed3 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1320 microversion: 2.1 time: 0.161986 Oct 17 13:15:48.705812 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 92/211] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:48.714179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:48.715272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:48.723198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.724046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.724746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.725976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:48.726699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:48.727326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:48.755921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:48.928140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.944735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.952835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:48.967695 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3134b5a0-be80-46a9-aa8d-33646fdd248c tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.260371 Oct 17 13:15:48.968291 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 93/212] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:49.028336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:49.037552 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7eed6b4-1614-4af7-8213-5573ce750003 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1494 microversion: 2.1 time: 0.800389 Oct 17 13:15:49.041653 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 120/213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:48 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1494 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:49.114023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:49.115496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:49.134950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.135751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.136381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.137384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.138020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.138620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.574067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:49.588795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bde83614-03f9-4ae0-ac08-7531934dfa98 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1492 microversion: 2.1 time: 0.478121 Oct 17 13:15:49.597573 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 94/214] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:49 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1492 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:49.721850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:49.722507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:49.734716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.735619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.736522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:49.740187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:49.740742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:49.741066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.001022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:50.009886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:50.022665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.024042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.024665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.026001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.026907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.027481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.219298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:50.243911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:50.253510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:50.272185 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-daa2e7fd-3a8e-44be-b1a9-4678a165dfcf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.276010 Oct 17 13:15:50.273398 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 95/215] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:49 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:50.292594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:50.294319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:50.305136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.307085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.312048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.313212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.313958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.315075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.377463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:50.406251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15076348-bb0b-4ba6-9d8e-3e1e38d7030b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.691307 Oct 17 13:15:50.407093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 121/216] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:49 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:50.619514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:50.620200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:50.633373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.633983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.635085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:50.635897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:50.636630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:50.637306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.142820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9894c0cb1c154a20968ace5dc27eec30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41797bbbb5445f091a5bfa5171de0fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.163945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57de66cc-6b1c-4a20-ba8d-22d45a7ca305 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 200 len: 1450 microversion: 2.1 time: 0.545851 Oct 17 13:15:51.187544 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 122/217] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:50 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 1450 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:51.195095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ca4d10f4-f4d3-452f-b5f5-4ad97a2902e3 req-49214ae9-a72c-4148-9218-020c6fb667e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a471c66-e137-480f-bd59-ef3dd43da13f", "name": "network-vif-deleted", "tag": "12e942e2-e4a3-4415-86c6-ba89010d9447"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:51.209500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ca4d10f4-f4d3-452f-b5f5-4ad97a2902e3 req-49214ae9-a72c-4148-9218-020c6fb667e3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.210324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ca4d10f4-f4d3-452f-b5f5-4ad97a2902e3 req-49214ae9-a72c-4148-9218-020c6fb667e3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.211027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ca4d10f4-f4d3-452f-b5f5-4ad97a2902e3 req-49214ae9-a72c-4148-9218-020c6fb667e3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.226783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ca4d10f4-f4d3-452f-b5f5-4ad97a2902e3 req-49214ae9-a72c-4148-9218-020c6fb667e3 service nova] Creating event network-vif-deleted:12e942e2-e4a3-4415-86c6-ba89010d9447 for instance 5a471c66-e137-480f-bd59-ef3dd43da13f on n-h1-854121-14 Oct 17 13:15:51.257558 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ca4d10f4-f4d3-452f-b5f5-4ad97a2902e3 req-49214ae9-a72c-4148-9218-020c6fb667e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066780 Oct 17 13:15:51.264323 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 123/218] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:51.293585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.310523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c14be457-617d-4879-82f4-47c703304fdd tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 200 len: 1494 microversion: 2.1 time: 1.034832 Oct 17 13:15:51.311649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:51.329947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 96/219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:50 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 1494 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:51.330529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:51.339600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.340627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.341404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.342609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.343268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.343931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.431963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:51.433019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:51.446818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.447438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.448117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.448950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.456252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.457109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.517448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.532046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.539385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.549355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2499af0-4a8d-40c9-b1f7-9639a12dbee9 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.248325 Oct 17 13:15:51.553602 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 124/220] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:51 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:51.834891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:51.847310 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b08b068f-9ae4-4c06-ad7c-5a9a47a4297b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.420045 Oct 17 13:15:51.848403 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 97/221] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:51 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:15:51.851574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-eb4484e6-93d7-4627-aff9-9afe9706ba57 req-f273a647-d919-4dab-a333-1dd8ff2f79ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7101e2b4-4d05-495a-a629-56cb53c7b309", "name": "network-vif-deleted", "tag": "d0cea19f-b56f-41d0-81d0-0edd35ada53f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:51.867303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eb4484e6-93d7-4627-aff9-9afe9706ba57 req-f273a647-d919-4dab-a333-1dd8ff2f79ff service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:51.867842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eb4484e6-93d7-4627-aff9-9afe9706ba57 req-f273a647-d919-4dab-a333-1dd8ff2f79ff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:51.868225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eb4484e6-93d7-4627-aff9-9afe9706ba57 req-f273a647-d919-4dab-a333-1dd8ff2f79ff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:51.887254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-eb4484e6-93d7-4627-aff9-9afe9706ba57 req-f273a647-d919-4dab-a333-1dd8ff2f79ff service nova] Creating event network-vif-deleted:d0cea19f-b56f-41d0-81d0-0edd35ada53f for instance 7101e2b4-4d05-495a-a629-56cb53c7b309 on n-h1-854121-14 Oct 17 13:15:51.892436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-eb4484e6-93d7-4627-aff9-9afe9706ba57 req-f273a647-d919-4dab-a333-1dd8ff2f79ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151387 Oct 17 13:15:51.894138 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 125/222] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:52.195224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:52.196347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.206173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.206653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.207079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.210605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.213742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.214188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.242037 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] HTTP exception thrown: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Request method failure captured: Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 HTTP/1.1 Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVE9CLGdiyxQCHRh_GqKDnaZfyQd4pqPIgVVxsWo7UAWPgRnF6cOg58VfJ-5lGEHWh_AJMmO0pau20K9GrHnYvFIy0P2lgxn9peePiPpn2kVTVgDPzZoPkhsyTa9Hga5U3u3Td6MMS5kVaq_U06DxCcnVJZrwh1DRn5v9zZcnw_tk Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f41797bbbb5445f091a5bfa5171de0fc Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:15:52.263717 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f41797bbbb5445f091a5bfa5171de0fc Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminTestJSON-1216610636-project Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 9894c0cb1c154a20968ace5dc27eec30 Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminTestJSON-1216610636-project Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:15:52.266185 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7101e2b4-4d05-495a-a629-56cb53c7b309'} Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:52.268059 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:15:52.274457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.281437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Returning 404 to user: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:52.284741 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-097e48cc-ecc0-49cd-b152-dc2897dddc57 tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 404 len: 111 microversion: 2.1 time: 0.094866 Oct 17 13:15:52.287446 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 98/223] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:52 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:52.300010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09b3f7be-2b20-4d62-b969-3524554303c1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:52.343142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:52.344241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.351434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09b3f7be-2b20-4d62-b969-3524554303c1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.351993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09b3f7be-2b20-4d62-b969-3524554303c1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.352436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09b3f7be-2b20-4d62-b969-3524554303c1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.384187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.385016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.389506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.390774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.391576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.401717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.433982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] HTTP exception thrown: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Request method failure captured: Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f HTTP/1.1 Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVRKEfMtRSMaweg7LDNUDPK5WyWOQRabmRqtrWuYU94bInfBOQ5NPnuwtMZUmvIyhaknG8F44UkJzT7xVv8hexkjsMThWHP2ywCKsmOEP2MJavrQ_UetGliKNuh_6nqozjshrITSTK_nDBPWe8daCxIOYoba_DLCQ2Khhzi33ho9U Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:15:52.436952 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4914f4e6368d4b7e942eef79a11e8df7 Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:15:52.438334 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5a471c66-e137-480f-bd59-ef3dd43da13f'} Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:52.439094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:15:52.440287 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:52.444195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Returning 404 to user: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:52.445807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b7e6514-6e7f-4371-accf-bb0d25dcda51 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 404 len: 111 microversion: 2.1 time: 0.113888 Oct 17 13:15:52.467459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 99/224] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:52 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:52.579785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:52.580462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:52.591605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.592097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.592529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.595427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:52.595902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:52.596334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:52.778029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.788231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.792495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:52.810820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-529e023b-c312-46b8-b407-03353e5c6617 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.235338 Oct 17 13:15:52.825261 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 100/225] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:52 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:15:52.832889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-368011694", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:52.915587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:15:53.067780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09b3f7be-2b20-4d62-b969-3524554303c1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.774558 Oct 17 13:15:53.076251 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 126/226] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:53.082054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:53.082792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:53.092127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.093105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.093815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.094776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.095629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.096320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.675025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:53.683596 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab629abe-d8cb-4bcc-9ee4-02f069a5963a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.605998 Oct 17 13:15:53.684200 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 127/227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:53 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:53.703564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:15:53.704723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:15:53.705438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:15:53.706963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:15:53.707567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:15:53.707787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46ec1dd4-9108-4c31-a13c-7d01a15455a6 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:53.723987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.724689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.725494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.726720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.728131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.728534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.766037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46ec1dd4-9108-4c31-a13c-7d01a15455a6 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.061743 Oct 17 13:15:53.767662 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 128/228] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:53 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:53.775750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-87b3c7ad-6f16-4e59-a159-575ece771685 req-077f4d46-70f8-4e2d-841d-e25ec0f5d667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06cfa7a-43e5-4c28-930b-4999358934b2", "tag": "e9077ca8-69e0-4d30-a803-019fb6f6b7a2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:53.787799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Getting quotas for project d5562a66777d42a99bb3a4f3b44f1887. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:53.798718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:53.803333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-87b3c7ad-6f16-4e59-a159-575ece771685 req-077f4d46-70f8-4e2d-841d-e25ec0f5d667 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.804239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-87b3c7ad-6f16-4e59-a159-575ece771685 req-077f4d46-70f8-4e2d-841d-e25ec0f5d667 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.804936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-87b3c7ad-6f16-4e59-a159-575ece771685 req-077f4d46-70f8-4e2d-841d-e25ec0f5d667 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.826427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Getting quotas for user 4914f4e6368d4b7e942eef79a11e8df7 and project d5562a66777d42a99bb3a4f3b44f1887. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:53.835497 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-87b3c7ad-6f16-4e59-a159-575ece771685 req-077f4d46-70f8-4e2d-841d-e25ec0f5d667 service nova] Creating event network-changed:e9077ca8-69e0-4d30-a803-019fb6f6b7a2 for instance f06cfa7a-43e5-4c28-930b-4999358934b2 on n-h2-854121-14 Oct 17 13:15:53.846680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-87b3c7ad-6f16-4e59-a159-575ece771685 req-077f4d46-70f8-4e2d-841d-e25ec0f5d667 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077478 Oct 17 13:15:53.853293 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 129/229] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:53.867004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d01cc135-1928-4841-95b0-cbd57312f449 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-253636200"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:53.868197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:15:53.875653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:15:53.884021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-d01cc135-1928-4841-95b0-cbd57312f449 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 039f9f3a-35f6-45d2-8ba9-445777917c6a for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:53.947109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d01cc135-1928-4841-95b0-cbd57312f449 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.089302 Oct 17 13:15:53.948300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 130/230] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:53.963004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:53.963989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:53.985431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.987236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.987867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:53.990489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:53.991148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:53.992047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.016694 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a38b053f-40a6-4bae-afb4-4890c3775cf0 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.199722 Oct 17 13:15:54.018969 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 101/231] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:15:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:15:54.028535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ea6c1a2-744e-4507-828c-91cb1ef14797 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:54.079962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ea6c1a2-744e-4507-828c-91cb1ef14797 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.080683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ea6c1a2-744e-4507-828c-91cb1ef14797 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.083264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ea6c1a2-744e-4507-828c-91cb1ef14797 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.246252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.268910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.271590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.279703 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8a412ce-c3f9-422e-ab3a-7bf983354adf tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.329958 Oct 17 13:15:54.280899 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 131/232] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:53 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:54.304603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1af9cc18-bd9b-4b0d-93f7-a942c8e106ba tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:54.305353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1af9cc18-bd9b-4b0d-93f7-a942c8e106ba tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:54.321543 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ea6c1a2-744e-4507-828c-91cb1ef14797 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.300248 Oct 17 13:15:54.322336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 102/233] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:54.336347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7069f29-8173-4407-9b69-ab503de2291d tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:54.364538 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7069f29-8173-4407-9b69-ab503de2291d tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.033062 Oct 17 13:15:54.365690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 103/234] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:15:54 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:54.381794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef5ef093-b5f2-4c72-8b52-293257da6e00 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:54.419796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef5ef093-b5f2-4c72-8b52-293257da6e00 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.420670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef5ef093-b5f2-4c72-8b52-293257da6e00 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.421663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef5ef093-b5f2-4c72-8b52-293257da6e00 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.477285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1af9cc18-bd9b-4b0d-93f7-a942c8e106ba tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:54.486123 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1af9cc18-bd9b-4b0d-93f7-a942c8e106ba tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1219 microversion: 2.1 time: 0.203709 Oct 17 13:15:54.486709 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 132/235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:54 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1219 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:54.642976 n-d-854121-14 devstack@n-api.service[120697]: WARNING nova.scheduler.client.report [None req-ef5ef093-b5f2-4c72-8b52-293257da6e00 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] [req-17c5e30a-f1dc-4af8-a26d-66358ef46b25] Failed to update aggregates to [] for resource provider with UUID 2eff0b50-7fa7-4ff8-83b8-2c6fa5201237. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Resource provider's generation already changed. Please update the generation and try again. ", "request_id": "req-17c5e30a-f1dc-4af8-a26d-66358ef46b25"}]} Oct 17 13:15:54.826730 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef5ef093-b5f2-4c72-8b52-293257da6e00 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.452407 Oct 17 13:15:54.836252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 104/236] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:54 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:54.847245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:54.849825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:54.860293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.861037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.867152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.869296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:54.870141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:54.872158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:54.997785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff6bd554-1f94-4df2-9e8b-9fba2f067f03 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Action: 'create', calling method: .version_select at 0x7f419e8e7790>, body: {"keypair": {"name": "tempest-keypair-302996996", "type": "ssh", "user_id": "7959346a5fbb4bcc844f94ba47dd3c19", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1akpe2LZ5J3d78gHacanJJJakXcTq7aJl+C/SRzS5pt9Ne5NDf8g4zy/QnV4aFWgtb1yo2MLaeM0ZNXIXWtkxsPRbPwSIqx4ZgfmOhOUS9vGcWSsSmHk+w+g0R0Vbwrg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.044830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ff6bd554-1f94-4df2-9e8b-9fba2f067f03 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Getting quotas for project 840363c1807b46d8a22f21f05c8d1112. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:55.049542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ff6bd554-1f94-4df2-9e8b-9fba2f067f03 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Getting quotas for user 659e1eb80fdd4a3ebeeedb4aaf7b8693 and project 840363c1807b46d8a22f21f05c8d1112. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:55.077684 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff6bd554-1f94-4df2-9e8b-9fba2f067f03 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.377795 Oct 17 13:15:55.078341 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 133/237] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:15:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 379 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:15:55.084920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16be12d2-cdea-40f2-a411-15b17b546ba2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.116467 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16be12d2-cdea-40f2-a411-15b17b546ba2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.036662 Oct 17 13:15:55.120146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 134/238] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:55 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:55.135686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1bc1c5c-b6af-4619-a8dd-cf0e2ba08779 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Action: 'create', calling method: .version_select at 0x7f419e8ce430>, body: {"keypair": {"name": "tempest-keypair-1119107600", "type": "ssh", "user_id": "7959346a5fbb4bcc844f94ba47dd3c19", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAShdf88CmoQNDLcYpNQ4FzJeB9gqzEXQbsgJT0HeQIabexB4sNBF30jXRovLtiYTWzWivmTMwbAUFPTg+PMQL576Oz+PaK6VU7zZk7dYTMwLBgUn5guYWPiDSLh/KJQQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.148842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.167942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-708d8540-0d77-424d-92ac-ae02db712a74 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.329880 Oct 17 13:15:55.168674 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 105/239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:54 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:55.174722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df2671bb-a2e8-432a-9266-2cf0f9a07b82 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1766115535"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.181072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-df2671bb-a2e8-432a-9266-2cf0f9a07b82 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 8f12e3c6-3e62-4bd2-b068-7179319f651c for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:55.190852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-d1bc1c5c-b6af-4619-a8dd-cf0e2ba08779 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Getting quotas for project 840363c1807b46d8a22f21f05c8d1112. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:55.196641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-d1bc1c5c-b6af-4619-a8dd-cf0e2ba08779 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Getting quotas for user 659e1eb80fdd4a3ebeeedb4aaf7b8693 and project 840363c1807b46d8a22f21f05c8d1112. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:55.211526 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df2671bb-a2e8-432a-9266-2cf0f9a07b82 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.040670 Oct 17 13:15:55.212479 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 106/240] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:55.227082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26f73eee-fdb1-466e-8565-379cbc3d3cc9 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.237437 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1bc1c5c-b6af-4619-a8dd-cf0e2ba08779 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.110751 Oct 17 13:15:55.246197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 135/241] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:15:55.257468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f73eee-fdb1-466e-8565-379cbc3d3cc9 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.257969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f73eee-fdb1-466e-8565-379cbc3d3cc9 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.258455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f73eee-fdb1-466e-8565-379cbc3d3cc9 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.261956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abf5e680-5fe9-4994-8e2f-f18ed9c596bf tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Calling method '.version_select at 0x7f419e8e7e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.279128 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abf5e680-5fe9-4994-8e2f-f18ed9c596bf tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "GET /compute/v2.1/os-keypairs/tempest-keypair-302996996?user_id=7959346a5fbb4bcc844f94ba47dd3c19" status: 200 len: 511 microversion: 2.10 time: 0.029998 Oct 17 13:15:55.286172 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 136/242] 10.222.0.65 () {60 vars in 1337 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-302996996?user_id=7959346a5fbb4bcc844f94ba47dd3c19 => generated 511 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:55.287341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:55.330278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec9ed299-9888-4136-acbc-4250e14a1cee tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Action: 'create', calling method: .version_select at 0x7f419eaa09d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1931999785", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2HzET3L1yBe23lhkeX7iLR31FHN+fh6L8MTEVZmXe5jJLfdpQQpL75DVTUrbKu6U2FDnkPiwJAk9Cchq2UGNIQEj9RCO6J+5/8vR8jCOPvqwq3Ggj/e0UKhJM7J8b+2Q=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.338498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:55.352714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ec9ed299-9888-4136-acbc-4250e14a1cee tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Getting quotas for project 840363c1807b46d8a22f21f05c8d1112. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:15:55.357732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ec9ed299-9888-4136-acbc-4250e14a1cee tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Getting quotas for user 659e1eb80fdd4a3ebeeedb4aaf7b8693 and project 840363c1807b46d8a22f21f05c8d1112. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:15:55.405010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec9ed299-9888-4136-acbc-4250e14a1cee tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.084328 Oct 17 13:15:55.406287 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 137/243] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:15:55.415574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.416194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:55.424235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.424937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.425548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.426442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.427443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.427875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.453289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26f73eee-fdb1-466e-8565-379cbc3d3cc9 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.231191 Oct 17 13:15:55.461250 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 107/244] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:55.466537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c380f92-7da0-44ce-8040-8e74d7adf220 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Calling method '.version_select at 0x7f419e633ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.471237 n-d-854121-14 devstack@n-api.service[120697]: WARNING oslo_db.sqlalchemy.utils [None req-4c380f92-7da0-44ce-8040-8e74d7adf220 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:15:55.480018 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c380f92-7da0-44ce-8040-8e74d7adf220 tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "GET /compute/v2.1/os-keypairs?user_id=7959346a5fbb4bcc844f94ba47dd3c19" status: 200 len: 725 microversion: 2.10 time: 0.017050 Oct 17 13:15:55.481182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 108/245] 10.222.0.65 () {60 vars in 1259 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/os-keypairs?user_id=7959346a5fbb4bcc844f94ba47dd3c19 => generated 725 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:55.485766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4f117563-5971-46e3-8add-358952b84a90 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.494068 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4f117563-5971-46e3-8add-358952b84a90 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.011148 Oct 17 13:15:55.494765 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 109/246] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:55.499436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31c5461a-5fe2-48ce-8728-66cc7e7f8b3c tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Calling method '.version_select at 0x7f419e633430>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.522645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31c5461a-5fe2-48ce-8728-66cc7e7f8b3c tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1931999785" status: 204 len: 0 microversion: 2.10 time: 0.026632 Oct 17 13:15:55.524734 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 110/247] 10.222.0.65 () {60 vars in 1325 bytes} [Mon Oct 17 13:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1931999785 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:15:55.531370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e63ec424-6601-4956-9e6f-88444a4a9f3f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.537826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.545749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e63ec424-6601-4956-9e6f-88444a4a9f3f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.546291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e63ec424-6601-4956-9e6f-88444a4a9f3f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.546734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e63ec424-6601-4956-9e6f-88444a4a9f3f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.558786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.560382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.569354 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad85d504-3af2-408e-bc52-6228616d36da tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.161666 Oct 17 13:15:55.570607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 138/248] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:55.576804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.577457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:55.592232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.592730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.617608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.618809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:55.626260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:55.626722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:55.764402 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e63ec424-6601-4956-9e6f-88444a4a9f3f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.237984 Oct 17 13:15:55.765657 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 111/249] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:55.774704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf784bfb-7b46-4774-8e8a-f3ed347caccb tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Calling method '.version_select at 0x7f419e638940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.824387 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf784bfb-7b46-4774-8e8a-f3ed347caccb tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119107600?user_id=7959346a5fbb4bcc844f94ba47dd3c19" status: 204 len: 0 microversion: 2.10 time: 0.056900 Oct 17 13:15:55.826208 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 112/250] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119107600?user_id=7959346a5fbb4bcc844f94ba47dd3c19 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:15:55.832135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e71b49c-f597-4f54-adba-eece302af4f0 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.866978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e71b49c-f597-4f54-adba-eece302af4f0 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.039180 Oct 17 13:15:55.868004 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 113/251] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:55 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:55.874056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d43562ff-be6b-47c2-b5a3-02b14d0bd0cc tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] Calling method '.version_select at 0x7f419e697f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:55.892854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:55.904829 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d43562ff-be6b-47c2-b5a3-02b14d0bd0cc tempest-KeyPairsV210TestJSON-946547180 tempest-KeyPairsV210TestJSON-946547180-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302996996?user_id=7959346a5fbb4bcc844f94ba47dd3c19" status: 204 len: 0 microversion: 2.10 time: 0.035373 Oct 17 13:15:55.908669 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 114/252] 10.222.0.65 () {60 vars in 1340 bytes} [Mon Oct 17 13:15:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302996996?user_id=7959346a5fbb4bcc844f94ba47dd3c19 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:15:55.908939 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2337c8a4-1bdd-41bb-b36e-6fea740e1410 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1271 microversion: 2.1 time: 0.336996 Oct 17 13:15:55.909552 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 139/253] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:55 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1271 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:55.925317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1149e63-48c7-429e-a8e6-04b502646915 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1476783737"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:55.933201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-c1149e63-48c7-429e-a8e6-04b502646915 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 4ba02d24-cafe-43ec-a710-0c824d8030d5 for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:55.995575 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1149e63-48c7-429e-a8e6-04b502646915 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.077761 Oct 17 13:15:55.998971 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 115/254] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:56.011656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4bde546-3eaa-4db8-bc01-bef342ccc4ca tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:56.030314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4bde546-3eaa-4db8-bc01-bef342ccc4ca tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.030833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4bde546-3eaa-4db8-bc01-bef342ccc4ca tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.031281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4bde546-3eaa-4db8-bc01-bef342ccc4ca tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.034548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:56.192855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.193924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:56.204806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.205568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.206974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.208104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.210456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.211979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.267065 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4bde546-3eaa-4db8-bc01-bef342ccc4ca tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.259607 Oct 17 13:15:56.267993 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 140/255] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:56 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:56.279975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cdb26b7f-f052-4861-80ec-21e22d79bc6c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:56.291844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb26b7f-f052-4861-80ec-21e22d79bc6c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.292768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb26b7f-f052-4861-80ec-21e22d79bc6c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.293232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb26b7f-f052-4861-80ec-21e22d79bc6c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.549930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:56.570677 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d07a34d-3101-419e-a63a-70e566d93520 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.372967 Oct 17 13:15:56.572565 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 116/256] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:56.610042 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cdb26b7f-f052-4861-80ec-21e22d79bc6c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.333842 Oct 17 13:15:56.610286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.611738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:56.612191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 141/257] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:56 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:15:56.630114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1bb9f9bd-0561-44d1-af70-ee56f9145d7f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.631447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.633866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.635554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.637660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.640171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.640768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.685091 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1bb9f9bd-0561-44d1-af70-ee56f9145d7f tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.064329 Oct 17 13:15:56.694831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 142/258] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:56 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:56.699631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbcc1493-b5a3-47b2-b224-70342ae1880e tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1370226000"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:56.708924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-bbcc1493-b5a3-47b2-b224-70342ae1880e tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 3d96854b-a85f-4daa-8bba-55dcc99e8f67 for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:56.781450 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbcc1493-b5a3-47b2-b224-70342ae1880e tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.086305 Oct 17 13:15:56.782369 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 143/259] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:56.793608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-06499f27-9c50-4b15-8d85-4a81f917d3dc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1395531411"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:56.799372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-06499f27-9c50-4b15-8d85-4a81f917d3dc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 269fe888-4037-408d-b661-329e52e92865 for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:56.824386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:56.846252 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-06499f27-9c50-4b15-8d85-4a81f917d3dc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062840 Oct 17 13:15:56.848217 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 144/260] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:56.860196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7848df7b-0d07-4e92-a738-4e7670855232 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.862502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:56.864985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:56.871846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a03e225-4929-4fee-a40c-f9b6358ccc29 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.274543 Oct 17 13:15:56.875350 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 117/261] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:15:56.890111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f27486a8-e910-4ab1-a798-7b5effad4136 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:56.918887 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7848df7b-0d07-4e92-a738-4e7670855232 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.061918 Oct 17 13:15:56.922185 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 145/262] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:56 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:56.930665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f27486a8-e910-4ab1-a798-7b5effad4136 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:56.931083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aaa86a15-cd2a-45c3-b45c-c108a6aa7d91 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.931953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f27486a8-e910-4ab1-a798-7b5effad4136 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:56.934617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f27486a8-e910-4ab1-a798-7b5effad4136 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:56.947299 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-aaa86a15-cd2a-45c3-b45c-c108a6aa7d91 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aaa86a15-cd2a-45c3-b45c-c108a6aa7d91 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Request method failure captured: Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVX-j8r_AfnxyTWiGwDaEc1iVUwr14aO_b51UNecMZe7ZpeQ08NzfN9Axgs3lv5Q_1A6uIzoud18InH5E9yPJcZPjBYQTmA-JUyaRw06qjbgvo0Y3Ju6GOsKLt9cp0_lW8AhF6bXzYwXqES2RYoU2NxFbxDZdtefNi2aPY-UwskSqM Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:56.959829 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 58e2772632d341fe98d8ee67dc843b51 Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: exception: Aggregate 5 could not be found. Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5'} Oct 17 13:15:56.961416 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:56.962245 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 17 13:15:56.963601 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:56.964856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aaa86a15-cd2a-45c3-b45c-c108a6aa7d91 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:56.964856 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aaa86a15-cd2a-45c3-b45c-c108a6aa7d91 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.038183 Oct 17 13:15:56.964856 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 146/263] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:15:56.978301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:56.978301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:57.024309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7,nova_api:DELETE=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:57.031815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.033863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.034517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.035587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.036669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.037399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.156209 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f27486a8-e910-4ab1-a798-7b5effad4136 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 243 microversion: 2.1 time: 0.279182 Oct 17 13:15:57.160191 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 118/264] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:56 2022] POST /compute/v2.1/os-aggregates/6/action => generated 243 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.175288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49fa8b06-054f-4d43-9257-979260b487e2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.187662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:57.203743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63e5a6a9-3109-4cd7-80c4-492c2ddea572 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1277 microversion: 2.1 time: 0.232849 Oct 17 13:15:57.222515 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 147/265] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:56 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:57.234678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.246780 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-49fa8b06-054f-4d43-9257-979260b487e2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49fa8b06-054f-4d43-9257-979260b487e2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Request method failure captured: Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX-j8r_AfnxyTWiGwDaEc1iVUwr14aO_b51UNecMZe7ZpeQ08NzfN9Axgs3lv5Q_1A6uIzoud18InH5E9yPJcZPjBYQTmA-JUyaRw06qjbgvo0Y3Ju6GOsKLt9cp0_lW8AhF6bXzYwXqES2RYoU2NxFbxDZdtefNi2aPY-UwskSqM Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:57.249545 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 58e2772632d341fe98d8ee67dc843b51 Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: exception: Aggregate 5 could not be found. Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5'} Oct 17 13:15:57.250879 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:57.251762 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.253065 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.254304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.254304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:57.254304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:57.254304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Oct 17 13:15:57.254304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.256566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49fa8b06-054f-4d43-9257-979260b487e2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:57.257564 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49fa8b06-054f-4d43-9257-979260b487e2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.095966 Oct 17 13:15:57.262515 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 119/266] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:57 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:15:57.270750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0628884e-60de-4ae4-8d8b-6850ee55bcbd tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-854431372", "name": "tempest-test_aggregate-469724466"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.271413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.272436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.273037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.281563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-0628884e-60de-4ae4-8d8b-6850ee55bcbd tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 201c06a7-dd78-49c3-b705-8491d579081b for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:57.339949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h1-854121-14. Oct 17 13:15:57.370374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0628884e-60de-4ae4-8d8b-6850ee55bcbd tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.106508 Oct 17 13:15:57.379304 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 120/267] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 40 Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:57.390129 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: {"add_host": {"host": "n-h1-854121-14"}} Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:57.391514 n-d-854121-14 devstack@n-api.service[120698]: exception: Aggregate 6 already has host n-h1-854121-14. Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h1-854121-14'}}} Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:15:57.392316 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-854121-14-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 13:15:57.393476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 13:15:57.394556 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:15:57.398301 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-854121-14-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 13, 15, 57, 305087), 'updated_at': None, 'host': 'n-h1-854121-14', 'aggregate_id': 6}] Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.403241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h1-854121-14. Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.405669 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h1-854121-14. Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:57.411683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:57.414830 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h1-854121-14. Oct 17 13:15:57.414830 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.414830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 409 to user: Aggregate 6 already has host n-h1-854121-14. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:57.414830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b9c4196-6f38-46f7-9b04-9cab0fa2ba27 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 96 microversion: 2.1 time: 0.168091 Oct 17 13:15:57.414830 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 148/268] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/os-aggregates/6/action => generated 96 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 17 13:15:57.415911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e5b94fc-e370-46f7-9a94-6d72f071a558 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.416660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44cf6f1b-574e-4037-93cf-155f5a473c00 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.448027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44cf6f1b-574e-4037-93cf-155f5a473c00 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.450250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44cf6f1b-574e-4037-93cf-155f5a473c00 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.450706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44cf6f1b-574e-4037-93cf-155f5a473c00 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.455094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e5b94fc-e370-46f7-9a94-6d72f071a558 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.073879 Oct 17 13:15:57.455683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 121/269] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:57.464186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e95a85d8-8fa1-4ece-a2e1-5de327354835 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.476520 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e95a85d8-8fa1-4ece-a2e1-5de327354835 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e95a85d8-8fa1-4ece-a2e1-5de327354835 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Request method failure captured: Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX-j8r_AfnxyTWiGwDaEc1iVUwr14aO_b51UNecMZe7ZpeQ08NzfN9Axgs3lv5Q_1A6uIzoud18InH5E9yPJcZPjBYQTmA-JUyaRw06qjbgvo0Y3Ju6GOsKLt9cp0_lW8AhF6bXzYwXqES2RYoU2NxFbxDZdtefNi2aPY-UwskSqM Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:57.478144 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 58e2772632d341fe98d8ee67dc843b51 Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: exception: Aggregate 7 could not be found. Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7'} Oct 17 13:15:57.479612 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.480742 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 17 13:15:57.482043 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.487836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e95a85d8-8fa1-4ece-a2e1-5de327354835 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:57.490432 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e95a85d8-8fa1-4ece-a2e1-5de327354835 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.030682 Oct 17 13:15:57.494187 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 122/270] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:15:57 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:15:57.502721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b6dc89f-4684-487b-b961-8bce04d268af tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.525129 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8b6dc89f-4684-487b-b961-8bce04d268af tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b6dc89f-4684-487b-b961-8bce04d268af tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Request method failure captured: Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX-j8r_AfnxyTWiGwDaEc1iVUwr14aO_b51UNecMZe7ZpeQ08NzfN9Axgs3lv5Q_1A6uIzoud18InH5E9yPJcZPjBYQTmA-JUyaRw06qjbgvo0Y3Ju6GOsKLt9cp0_lW8AhF6bXzYwXqES2RYoU2NxFbxDZdtefNi2aPY-UwskSqM Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:57.527123 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6adde257e60e463bbe39063b5f68e4e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6adde257e60e463bbe39063b5f68e4e2 Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1557815723 Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 58e2772632d341fe98d8ee67dc843b51 Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminTestJSON-1557815723-project-admin Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: exception: Aggregate 7 could not be found. Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7'} Oct 17 13:15:57.528508 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:57.529236 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:57.530229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:57.531381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:57.531381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:57.531381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:57.531381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 17 13:15:57.531381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:57.532358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b6dc89f-4684-487b-b961-8bce04d268af tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:57.533600 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b6dc89f-4684-487b-b961-8bce04d268af tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.035074 Oct 17 13:15:57.534379 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 123/271] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:15:57.544841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5415d4f3-257b-4a77-a1c0-e2faead5cf04 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1827205808"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.548560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-5415d4f3-257b-4a77-a1c0-e2faead5cf04 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 482a9cfa-4024-43e7-850c-c3d2c1bf120f for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:57.579437 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5415d4f3-257b-4a77-a1c0-e2faead5cf04 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038756 Oct 17 13:15:57.589212 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 124/272] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.596723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b49d33f0-0c2a-438a-8787-66e7978f5d33 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.624690 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b49d33f0-0c2a-438a-8787-66e7978f5d33 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.034312 Oct 17 13:15:57.635313 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 125/273] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:15:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.640458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.643913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:57.659268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.659770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.660209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.660962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:57.661455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:57.661882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:57.752805 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44cf6f1b-574e-4037-93cf-155f5a473c00 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.346782 Oct 17 13:15:57.753878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 149/274] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.768015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5048725-57e6-4a1f-913a-92dbf500b1bf tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.820811 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5048725-57e6-4a1f-913a-92dbf500b1bf tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.064168 Oct 17 13:15:57.822935 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 150/275] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.830868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da0a3eaa-1a42-4046-bc84-9ae6052cb1ab tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.855473 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da0a3eaa-1a42-4046-bc84-9ae6052cb1ab tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.030806 Oct 17 13:15:57.856793 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 151/276] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:57 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:57.862474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47b3c77f-e4a0-4765-8e8e-969f39849c0c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.903149 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47b3c77f-e4a0-4765-8e8e-969f39849c0c tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.044963 Oct 17 13:15:57.905496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 152/277] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:15:57 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.914912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1bc47bad-18f7-486f-82f6-9c6ea3e1a72a tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1916248662"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:57.923376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-1bc47bad-18f7-486f-82f6-9c6ea3e1a72a tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 73d2ef4a-b476-4faf-808d-8db34357cf4d for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:57.966832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1bc47bad-18f7-486f-82f6-9c6ea3e1a72a tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060230 Oct 17 13:15:57.969502 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 153/278] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:57.988255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:57.989002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:58.011624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.012306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.012898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.014395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.015168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.015742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.297197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.310086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.313143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.329847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-142ffe93-2cd0-4b45-919a-f6a85863ae54 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.358827 Oct 17 13:15:58.341359 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 154/279] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:57 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:58.353430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.353430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:58.355472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f94b408d-8d39-4389-97d6-cc2dd6d68b9e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.718732 Oct 17 13:15:58.356388 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 126/280] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:57 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:58.361232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-534a0887-9558-46b3-85f3-5cada062998a tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2020978447"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.375903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-534a0887-9558-46b3-85f3-5cada062998a tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Generated uuid 611cfb76-731f-458c-9453-e6f4cbfb2b3c for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:58.378965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76ecd2e2-6955-41e2-aff3-afc91be8b5ef tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.422412 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76ecd2e2-6955-41e2-aff3-afc91be8b5ef tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.078950 Oct 17 13:15:58.423975 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 155/281] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:58 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:58.425863 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-534a0887-9558-46b3-85f3-5cada062998a tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.066419 Oct 17 13:15:58.428377 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 127/282] 10.222.0.65 () {62 vars in 1205 bytes} [Mon Oct 17 13:15:58 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:58.443733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.444882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:58.451818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.452667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.453360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.454295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:58.455150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:58.455807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:58.779643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57ddcf71-ed69-4c5f-bd0c-ba83cc667cce tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.785366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57ddcf71-ed69-4c5f-bd0c-ba83cc667cce tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '625eab8f78704c75a6fb8c7424ecab20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28f0bf5c71448390be541c98a6c8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57ddcf71-ed69-4c5f-bd0c-ba83cc667cce tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Request method failure captured: Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 40 Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVtIsgJc0VGdEm0r3NyyqxXSwO3bRms0An6T8sZ3jRh7twuoDSpLzTSCuxXPiFiuQOj9IAZbNB9bjT1eTbLIK5-zTIXA9ur3QtbrsxZSecuYhFLc1yt4DJBmG4161jHQu3fEZcwVM9jyRglK5nAOCRXPS4yKi1GnOutYcKvWA4lAE Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:15:58.787384 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 625eab8f78704c75a6fb8c7424ecab20 Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: {"add_host": {"host": "n-h1-854121-14"}} Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:58.788622 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h1-854121-14'}}} Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:58.789448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 17 13:15:58.790468 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:58.792882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57ddcf71-ed69-4c5f-bd0c-ba83cc667cce tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:58.792882 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57ddcf71-ed69-4c5f-bd0c-ba83cc667cce tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] 10.222.0.65 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.363310 Oct 17 13:15:58.792882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 156/283] 10.222.0.65 () {60 vars in 1191 bytes} [Mon Oct 17 13:15:58 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 365 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:58.797483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13d81ebe-a10a-4dde-96ea-dff0f036dc36 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-500562270", "availability_zone": "tempest-test_az-1959141749"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.820125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-13d81ebe-a10a-4dde-96ea-dff0f036dc36 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 94dc30c4-e548-40ac-845b-eea8e3b4d972 for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:58.854028 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13d81ebe-a10a-4dde-96ea-dff0f036dc36 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.062880 Oct 17 13:15:58.854973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 157/284] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Oct 17 13:15:58 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:58.859687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e5bb5ae-e91c-4372-b483-52564d832182 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1710833896"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.874289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:58.885377 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41e3bfca-d208-4f8d-8de2-a0c83fe6d0de tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.454270 Oct 17 13:15:58.897185 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 128/285] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:58 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:15:58.897185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b682f2f-f81f-4d54-9e90-aae95fc2a8ab tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:58.930690 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b682f2f-f81f-4d54-9e90-aae95fc2a8ab tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.042190 Oct 17 13:15:58.932423 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 129/286] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:15:58 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:58.942346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9a45014-9646-4838-94a5-705704a5e302 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-500562270_new", "availability_zone": "tempest-test_az-1959141749_new"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.979266 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e5bb5ae-e91c-4372-b483-52564d832182 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.122140 Oct 17 13:15:58.980394 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 158/287] 10.222.0.65 () {62 vars in 1213 bytes} [Mon Oct 17 13:15:58 2022] PUT /compute/v2.1/os-aggregates/10 => generated 300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:58.985809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b783aeb-786a-4707-8247-c9cf0ba514d0 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2104352265"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:58.990758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-1b783aeb-786a-4707-8247-c9cf0ba514d0 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid dda2840e-0d9b-4242-8a14-f41e7825a758 for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:59.022221 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b783aeb-786a-4707-8247-c9cf0ba514d0 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040400 Oct 17 13:15:59.023754 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 159/288] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:58 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:59.030097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-867dca8a-c628-495a-8c7c-b43089f49787 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.043210 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-867dca8a-c628-495a-8c7c-b43089f49787 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 300 microversion: 2.41 time: 0.018216 Oct 17 13:15:59.044133 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 160/289] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/os-aggregates/10 => generated 300 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:59.050028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2141034049"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.077415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.077923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.078357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.080991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a45014-9646-4838-94a5-705704a5e302 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.081500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a45014-9646-4838-94a5-705704a5e302 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.081933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a45014-9646-4838-94a5-705704a5e302 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.088336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.088853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.089289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.112033 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2141034049 could not be found. Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 58 Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:15:59.115412 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: {"add_host": {"host": "tempest-nonexist_host-2141034049"}} Oct 17 13:15:59.118011 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: exception: Compute host tempest-nonexist_host-2141034049 could not be found. Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-2141034049'}}} Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2141034049' is not mapped to any cell Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.118790 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 17 13:15:59.120438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2141034049 could not be found. Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2141034049 could not be found. Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.121602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2141034049 could not be found. Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2141034049 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d67da66a-b9e3-42ad-b2db-92ab5d557bcc tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 111 microversion: 2.1 time: 0.072405 Oct 17 13:15:59.126742 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 161/290] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates/12/action => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:59.131281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16e38b4d-7b56-4715-8815-2144e86229aa tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.139835 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9a45014-9646-4838-94a5-705704a5e302 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 336 microversion: 2.1 time: 0.204757 Oct 17 13:15:59.140728 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 130/291] 10.222.0.65 () {60 vars in 1173 bytes} [Mon Oct 17 13:15:58 2022] PUT /compute/v2.1/os-aggregates/11 => generated 336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:59.146867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03b8f0d9-33eb-4c81-b0bb-948df82af20b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.158695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e38b4d-7b56-4715-8815-2144e86229aa tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.159190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e38b4d-7b56-4715-8815-2144e86229aa tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.159626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e38b4d-7b56-4715-8815-2144e86229aa tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.160830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:15:59.181832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03b8f0d9-33eb-4c81-b0bb-948df82af20b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.039291 Oct 17 13:15:59.183042 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 131/292] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:15:59 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:59.194471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8d091af-9fb4-4030-8a1a-4e9d118bfbf1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.207315 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8d091af-9fb4-4030-8a1a-4e9d118bfbf1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates" status: 200 len: 578 microversion: 2.1 time: 0.022990 Oct 17 13:15:59.208892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 132/293] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/os-aggregates => generated 578 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:59.215720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e79905eb-a4d5-4919-84a0-e128684a209b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e79905eb-a4d5-4919-84a0-e128684a209b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 283 Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:59.221914 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:59.223909 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:59.224588 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:59.226096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.227220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.228216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:59.228216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:59.228216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:15:59.228216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.228216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e79905eb-a4d5-4919-84a0-e128684a209b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:59.228545 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e79905eb-a4d5-4919-84a0-e128684a209b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.013459 Oct 17 13:15:59.228545 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 133/294] 10.222.0.65 () {60 vars in 1165 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:59.236300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1432c8a-0da4-4536-9720-99c65fb1f2a2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.277370 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1432c8a-0da4-4536-9720-99c65fb1f2a2 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050331 Oct 17 13:15:59.278126 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 134/295] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:15:59 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:15:59.283038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25cba2f1-703b-4731-85ef-61e80cb20aa6 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25cba2f1-703b-4731-85ef-61e80cb20aa6 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 27 Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:15:59.289192 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: {"aggregate": {"name": ""}} Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:59.290690 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '' Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:59.291624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:15:59.293095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.295847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25cba2f1-703b-4731-85ef-61e80cb20aa6 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:59.296847 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25cba2f1-703b-4731-85ef-61e80cb20aa6 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.017652 Oct 17 13:15:59.297904 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 135/296] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:15:59.309010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5134ce6a-5681-49f8-abcb-0849624ddad1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1457832744"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.315776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-5134ce6a-5681-49f8-abcb-0849624ddad1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Generated uuid 62187ac8-de07-486b-bd9e-6de799b2dc13 for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:59.368836 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5134ce6a-5681-49f8-abcb-0849624ddad1 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069181 Oct 17 13:15:59.370462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 136/297] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:59.381081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32449de3-6587-4d1b-a5f6-b3a10488487c tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-943041583"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.386908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-32449de3-6587-4d1b-a5f6-b3a10488487c tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '625eab8f78704c75a6fb8c7424ecab20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28f0bf5c71448390be541c98a6c8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32449de3-6587-4d1b-a5f6-b3a10488487c tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Request method failure captured: Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 59 Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVtIsgJc0VGdEm0r3NyyqxXSwO3bRms0An6T8sZ3jRh7twuoDSpLzTSCuxXPiFiuQOj9IAZbNB9bjT1eTbLIK5-zTIXA9ur3QtbrsxZSecuYhFLc1yt4DJBmG4161jHQu3fEZcwVM9jyRglK5nAOCRXPS4yKi1GnOutYcKvWA4lAE Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:15:59.389544 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 625eab8f78704c75a6fb8c7424ecab20 Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: {"aggregate": {"name": "tempest-test_aggregate-943041583"}} Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:15:59.391052 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-943041583'}}} Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:15:59.392048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:15:59.393349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 17 13:15:59.394643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:15:59.396217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32449de3-6587-4d1b-a5f6-b3a10488487c tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:15:59.401808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32449de3-6587-4d1b-a5f6-b3a10488487c tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.026643 Oct 17 13:15:59.402871 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 137/298] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:15:59.413203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.415541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:59.425587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.430775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.432751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.435393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.436562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.437299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.451480 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16e38b4d-7b56-4715-8815-2144e86229aa tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 316 microversion: 2.41 time: 0.332342 Oct 17 13:15:59.452234 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 162/299] 10.222.0.65 () {62 vars in 1235 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates/10/action => generated 316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:15:59.457572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99906502-8c02-485a-a3d4-f1fb7a8c60c0 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.487260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-99906502-8c02-485a-a3d4-f1fb7a8c60c0 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates" status: 200 len: 486 microversion: 2.1 time: 0.033613 Oct 17 13:15:59.496186 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 163/300] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/os-aggregates => generated 486 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:59.508286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:15:59.514183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:15:59.524620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.525118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.525866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.526882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.527556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.528140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:15:59.611019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.621884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.624148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:15:59.644713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-885eb198-e058-4e76-8880-301a3ec411f5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.240691 Oct 17 13:15:59.645526 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 138/301] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:15:59.661547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b92cbd6f-1fbc-4bd2-8092-41022ff65ec8 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-155771749"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.666471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-b92cbd6f-1fbc-4bd2-8092-41022ff65ec8 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 41a597e8-a795-4afb-9fec-8427a0a84bea for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:15:59.708582 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b92cbd6f-1fbc-4bd2-8092-41022ff65ec8 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060902 Oct 17 13:15:59.709599 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 139/302] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:15:59.717991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dab4a0df-ea27-46b3-9b53-d2d4303b03f6 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:15:59.740661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab4a0df-ea27-46b3-9b53-d2d4303b03f6 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:15:59.741442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab4a0df-ea27-46b3-9b53-d2d4303b03f6 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:15:59.742628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab4a0df-ea27-46b3-9b53-d2d4303b03f6 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.095804 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dab4a0df-ea27-46b3-9b53-d2d4303b03f6 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 300 microversion: 2.41 time: 0.381832 Oct 17 13:16:00.096426 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 140/303] 10.222.0.65 () {62 vars in 1235 bytes} [Mon Oct 17 13:15:59 2022] POST /compute/v2.1/os-aggregates/10/action => generated 300 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:00.101818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ea7d3d9-5dc6-46ca-bc04-748e8a261a26 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.147340 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ea7d3d9-5dc6-46ca-bc04-748e8a261a26 tempest-AggregatesAdminTestJSON-1557815723 tempest-AggregatesAdminTestJSON-1557815723-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.049816 Oct 17 13:16:00.149250 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 141/304] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:16:00.159405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a221fad-259a-4ecf-8f1e-6ae9f66693c4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-155771749"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:00.164398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-6a221fad-259a-4ecf-8f1e-6ae9f66693c4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 96b95e67-338d-4e71-8cdf-dc7f013095b6 for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:16:00.171283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.175087 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6a221fad-259a-4ecf-8f1e-6ae9f66693c4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-155771749 already exists. Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a221fad-259a-4ecf-8f1e-6ae9f66693c4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 59 Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:00.178079 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: {"aggregate": {"name": "tempest-test_aggregate-155771749"}} Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:00.179505 n-d-854121-14 devstack@n-api.service[120697]: exception: Aggregate tempest-test_aggregate-155771749 already exists. Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-155771749'}}} Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 17 13:16:00.180483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-155771749 already exists. Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:00.181605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-155771749 already exists. Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-155771749 already exists. Oct 17 13:16:00.182664 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.186704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a221fad-259a-4ecf-8f1e-6ae9f66693c4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-155771749 already exists. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:00.188672 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a221fad-259a-4ecf-8f1e-6ae9f66693c4 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.035216 Oct 17 13:16:00.190006 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 142/305] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:16:00 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:00.191698 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9af688fb-2201-4795-a366-91e630580142 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.694045 Oct 17 13:16:00.192320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 164/306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:15:59 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:00.196396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8a05cd1e-3041-4104-a2d9-eec59a596264 req-9929b412-df37-4bfd-b3aa-7bc0c801a709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06cfa7a-43e5-4c28-930b-4999358934b2", "name": "network-vif-plugged", "status": "completed", "tag": "e9077ca8-69e0-4d30-a803-019fb6f6b7a2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:00.209444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ccaa56ec-ea06-4b61-a705-3660099bed9f req-3610fe4f-c961-4e83-b5e7-7cba4dbebb57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72f0f53d-7f7b-4c43-a138-6c8d665d2252", "tag": "536c585d-f055-472a-b683-2aaa869340e4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:00.214681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8a05cd1e-3041-4104-a2d9-eec59a596264 req-9929b412-df37-4bfd-b3aa-7bc0c801a709 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.215240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8a05cd1e-3041-4104-a2d9-eec59a596264 req-9929b412-df37-4bfd-b3aa-7bc0c801a709 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.216917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8a05cd1e-3041-4104-a2d9-eec59a596264 req-9929b412-df37-4bfd-b3aa-7bc0c801a709 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.220818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ccaa56ec-ea06-4b61-a705-3660099bed9f req-3610fe4f-c961-4e83-b5e7-7cba4dbebb57 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.228957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ccaa56ec-ea06-4b61-a705-3660099bed9f req-3610fe4f-c961-4e83-b5e7-7cba4dbebb57 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.229688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ccaa56ec-ea06-4b61-a705-3660099bed9f req-3610fe4f-c961-4e83-b5e7-7cba4dbebb57 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.238278 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8a05cd1e-3041-4104-a2d9-eec59a596264 req-9929b412-df37-4bfd-b3aa-7bc0c801a709 service nova] Creating event network-vif-plugged:e9077ca8-69e0-4d30-a803-019fb6f6b7a2 for instance f06cfa7a-43e5-4c28-930b-4999358934b2 on n-h2-854121-14 Oct 17 13:16:00.248127 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8a05cd1e-3041-4104-a2d9-eec59a596264 req-9929b412-df37-4bfd-b3aa-7bc0c801a709 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055784 Oct 17 13:16:00.249225 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 143/307] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:00.252854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ccaa56ec-ea06-4b61-a705-3660099bed9f req-3610fe4f-c961-4e83-b5e7-7cba4dbebb57 service nova] Creating event network-changed:536c585d-f055-472a-b683-2aaa869340e4 for instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 on n-h1-854121-14 Oct 17 13:16:00.258127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.258963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.267467 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ccaa56ec-ea06-4b61-a705-3660099bed9f req-3610fe4f-c961-4e83-b5e7-7cba4dbebb57 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073882 Oct 17 13:16:00.267613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.268198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.268727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.269981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.270101 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 165/308] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:00.270748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.271575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.283508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e7f9aa9-daa4-4e6c-9a72-00f0f622fcf8 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.324163 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e7f9aa9-daa4-4e6c-9a72-00f0f622fcf8 tempest-AggregatesAdminTestV241-576726975 tempest-AggregatesAdminTestV241-576726975-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.052861 Oct 17 13:16:00.324972 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 166/309] 10.222.0.65 () {60 vars in 1196 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:00.332277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.337466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.357731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.358572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.359356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.360293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.360946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.361587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.389387 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] HTTP exception thrown: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Request method failure captured: Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 HTTP/1.1 Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVE9CLGdiyxQCHRh_GqKDnaZfyQd4pqPIgVVxsWo7UAWPgRnF6cOg58VfJ-5lGEHWh_AJMmO0pau20K9GrHnYvFIy0P2lgxn9peePiPpn2kVTVgDPzZoPkhsyTa9Hga5U3u3Td6MMS5kVaq_U06DxCcnVJZrwh1DRn5v9zZcnw_tk Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f41797bbbb5445f091a5bfa5171de0fc Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:00.391595 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f41797bbbb5445f091a5bfa5171de0fc Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminTestJSON-1216610636-project Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9894c0cb1c154a20968ace5dc27eec30 Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminTestJSON-1216610636-project Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.392949 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '7101e2b4-4d05-495a-a629-56cb53c7b309'} Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:00.393635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.394769 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.403062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Returning 404 to user: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:00.404512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0132a745-5ae8-4e33-a261-be8e5d917a5d tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 404 len: 111 microversion: 2.1 time: 0.078249 Oct 17 13:16:00.405546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 167/310] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:00.418034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4792ca7f-c50c-4a80-aebb-00ecc74ca314 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.471234 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4792ca7f-c50c-4a80-aebb-00ecc74ca314 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.064375 Oct 17 13:16:00.471858 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 168/311] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:16:00.490032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.490649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] [instance: 7101e2b4-4d05-495a-a629-56cb53c7b309] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.510669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.513009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.513883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.515314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.520960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.522078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.539405 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] HTTP exception thrown: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Request method failure captured: Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 HTTP/1.1 Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVE9CLGdiyxQCHRh_GqKDnaZfyQd4pqPIgVVxsWo7UAWPgRnF6cOg58VfJ-5lGEHWh_AJMmO0pau20K9GrHnYvFIy0P2lgxn9peePiPpn2kVTVgDPzZoPkhsyTa9Hga5U3u3Td6MMS5kVaq_U06DxCcnVJZrwh1DRn5v9zZcnw_tk Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f41797bbbb5445f091a5bfa5171de0fc Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:00.552987 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f41797bbbb5445f091a5bfa5171de0fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f41797bbbb5445f091a5bfa5171de0fc Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1216610636 Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminTestJSON-1216610636-project Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9894c0cb1c154a20968ace5dc27eec30 Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminTestJSON-1216610636-project Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.554374 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '7101e2b4-4d05-495a-a629-56cb53c7b309'} Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:00.555011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. Oct 17 13:16:00.556045 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.564917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] Returning 404 to user: Instance 7101e2b4-4d05-495a-a629-56cb53c7b309 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:00.571936 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8095156f-28ab-48a7-bc6a-b00e73ea62ca tempest-AggregatesAdminTestJSON-1216610636 tempest-AggregatesAdminTestJSON-1216610636-project] 10.222.0.65 "GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309" status: 404 len: 111 microversion: 2.1 time: 0.093995 Oct 17 13:16:00.573115 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 169/312] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/7101e2b4-4d05-495a-a629-56cb53c7b309 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:00.580631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d14643b9-8cf3-4f73-8172-3587187ca8d9 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1090360795"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:00.590199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-d14643b9-8cf3-4f73-8172-3587187ca8d9 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 5252aa28-d2a6-4612-8f7e-5ece10ed690a for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:16:00.646330 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d14643b9-8cf3-4f73-8172-3587187ca8d9 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071894 Oct 17 13:16:00.650075 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 170/313] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:16:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:00.659670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2b09aa4-d57c-4200-9e1c-a58d78e0686b tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.665823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2b09aa4-d57c-4200-9e1c-a58d78e0686b tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '625eab8f78704c75a6fb8c7424ecab20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28f0bf5c71448390be541c98a6c8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2b09aa4-d57c-4200-9e1c-a58d78e0686b tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Request method failure captured: Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVtIsgJc0VGdEm0r3NyyqxXSwO3bRms0An6T8sZ3jRh7twuoDSpLzTSCuxXPiFiuQOj9IAZbNB9bjT1eTbLIK5-zTIXA9ur3QtbrsxZSecuYhFLc1yt4DJBmG4161jHQu3fEZcwVM9jyRglK5nAOCRXPS4yKi1GnOutYcKvWA4lAE Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:00.670248 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 625eab8f78704c75a6fb8c7424ecab20 Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 13:16:00.671495 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '15'} Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:00.672694 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 17 13:16:00.674006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.679462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2b09aa4-d57c-4200-9e1c-a58d78e0686b tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:00.680618 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2b09aa4-d57c-4200-9e1c-a58d78e0686b tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.025459 Oct 17 13:16:00.682703 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 171/314] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:00.694284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.695486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:00.714284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.715705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.716741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.718094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:00.719257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:00.720698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:00.753467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.769986 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c846ce60-3ef1-4da0-9df3-34832720f899 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.518923 Oct 17 13:16:00.770881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 144/315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:00.784781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38537840-921d-41fa-8e09-3be1f85b217c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.851248 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38537840-921d-41fa-8e09-3be1f85b217c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.075054 Oct 17 13:16:00.862432 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 145/316] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:16:00.878222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56749004-add2-4464-9ede-0c11f54bfc08 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:00.922658 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-56749004-add2-4464-9ede-0c11f54bfc08 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56749004-add2-4464-9ede-0c11f54bfc08 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:00.924688 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: exception: Aggregate -1 could not be found. Oct 17 13:16:00.926275 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '-1'} Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:16:00.927938 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.929136 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:00.930545 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:00.930545 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:00.930545 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:00.930545 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:00.930545 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 13:16:00.930545 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:00.936472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56749004-add2-4464-9ede-0c11f54bfc08 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:00.937851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-56749004-add2-4464-9ede-0c11f54bfc08 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.073978 Oct 17 13:16:00.938564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 146/317] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:00 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:00.956167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e87f807-f7f3-4efb-ad23-5a445d5f3c0b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1061305110"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:00.962288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-3e87f807-f7f3-4efb-ad23-5a445d5f3c0b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid f2197371-9848-4be6-802a-c986cd7969de for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:16:00.971334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.986109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:00.991098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.010490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8d5185a-22d5-4b4c-a24b-614c4a5f4b73 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.321478 Oct 17 13:16:01.011453 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 172/318] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:00 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:01.030355 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e87f807-f7f3-4efb-ad23-5a445d5f3c0b tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.084470 Oct 17 13:16:01.032620 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 147/319] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:16:00 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:01.045733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63c3311c-441d-45a3-a6d7-ed95bbf4467d tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.048069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63c3311c-441d-45a3-a6d7-ed95bbf4467d tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '625eab8f78704c75a6fb8c7424ecab20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28f0bf5c71448390be541c98a6c8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63c3311c-441d-45a3-a6d7-ed95bbf4467d tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Request method failure captured: Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVtIsgJc0VGdEm0r3NyyqxXSwO3bRms0An6T8sZ3jRh7twuoDSpLzTSCuxXPiFiuQOj9IAZbNB9bjT1eTbLIK5-zTIXA9ur3QtbrsxZSecuYhFLc1yt4DJBmG4161jHQu3fEZcwVM9jyRglK5nAOCRXPS4yKi1GnOutYcKvWA4lAE Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:01.049859 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 625eab8f78704c75a6fb8c7424ecab20 Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 13:16:01.051290 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '16'} Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:01.052625 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 17 13:16:01.054006 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.056112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63c3311c-441d-45a3-a6d7-ed95bbf4467d tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:01.062303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63c3311c-441d-45a3-a6d7-ed95bbf4467d tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] 10.222.0.65 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.016550 Oct 17 13:16:01.063527 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 173/320] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:01.072134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0b276cd-f5e5-4c0d-baa1-9a052b626740 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.119563 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0b276cd-f5e5-4c0d-baa1-9a052b626740 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.051526 Oct 17 13:16:01.120123 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 148/321] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:01 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:16:01.131730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be14a5a7-3028-42aa-bbc2-46e53a25022e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.135928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:01.154700 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-be14a5a7-3028-42aa-bbc2-46e53a25022e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be14a5a7-3028-42aa-bbc2-46e53a25022e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:01.156331 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: exception: Aggregate -1 could not be found. Oct 17 13:16:01.157540 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '-1'} Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.158196 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 17 13:16:01.159281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.167759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be14a5a7-3028-42aa-bbc2-46e53a25022e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:01.168902 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be14a5a7-3028-42aa-bbc2-46e53a25022e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.042749 Oct 17 13:16:01.171545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 174/322] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:01.182586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db8a58c1-2484-4b41-b102-c641bf223e4e tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.184929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db8a58c1-2484-4b41-b102-c641bf223e4e tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '625eab8f78704c75a6fb8c7424ecab20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28f0bf5c71448390be541c98a6c8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db8a58c1-2484-4b41-b102-c641bf223e4e tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Request method failure captured: Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVtIsgJc0VGdEm0r3NyyqxXSwO3bRms0An6T8sZ3jRh7twuoDSpLzTSCuxXPiFiuQOj9IAZbNB9bjT1eTbLIK5-zTIXA9ur3QtbrsxZSecuYhFLc1yt4DJBmG4161jHQu3fEZcwVM9jyRglK5nAOCRXPS4yKi1GnOutYcKvWA4lAE Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:01.186761 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 625eab8f78704c75a6fb8c7424ecab20 Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 13:16:01.188224 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:01.189033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 17 13:16:01.190321 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.193958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db8a58c1-2484-4b41-b102-c641bf223e4e tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:01.195010 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db8a58c1-2484-4b41-b102-c641bf223e4e tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] 10.222.0.65 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017020 Oct 17 13:16:01.202011 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 149/323] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:01.212019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cba1f60e-36d1-47c4-92a8-37159b44b50e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073590688"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:01.219098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.219742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:01.221392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-cba1f60e-36d1-47c4-92a8-37159b44b50e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 1b8716e7-f953-4f01-bf96-d4412d490475 for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:16:01.237746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.238245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.238693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.239976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.240541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.240974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.273579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cba1f60e-36d1-47c4-92a8-37159b44b50e tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065608 Oct 17 13:16:01.274506 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 175/324] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:16:01 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:01.289223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb0736bf-b9d0-4e16-a583-fb3286815c7c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:01.322878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb0736bf-b9d0-4e16-a583-fb3286815c7c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.324008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb0736bf-b9d0-4e16-a583-fb3286815c7c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.324655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb0736bf-b9d0-4e16-a583-fb3286815c7c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.526987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.543441 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1dea9331-7664-46f4-88c1-113fdfea142e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.331745 Oct 17 13:16:01.545223 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 150/325] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:01.597460 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb0736bf-b9d0-4e16-a583-fb3286815c7c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.313539 Oct 17 13:16:01.600094 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 176/326] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:16:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:01.613252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10d12b26-c576-4a38-9eeb-ce3d587b3dd1 tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:01.618804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10d12b26-c576-4a38-9eeb-ce3d587b3dd1 tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '625eab8f78704c75a6fb8c7424ecab20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a28f0bf5c71448390be541c98a6c8d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10d12b26-c576-4a38-9eeb-ce3d587b3dd1 tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Request method failure captured: Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 43 Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVtIsgJc0VGdEm0r3NyyqxXSwO3bRms0An6T8sZ3jRh7twuoDSpLzTSCuxXPiFiuQOj9IAZbNB9bjT1eTbLIK5-zTIXA9ur3QtbrsxZSecuYhFLc1yt4DJBmG4161jHQu3fEZcwVM9jyRglK5nAOCRXPS4yKi1GnOutYcKvWA4lAE Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:01.625039 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a28f0bf5c71448390be541c98a6c8d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a28f0bf5c71448390be541c98a6c8d2 Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-467484015 Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 625eab8f78704c75a6fb8c7424ecab20 Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-467484015-project Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: {"remove_host": {"host": "n-h1-854121-14"}} Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:01.626471 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-854121-14'}}} Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:01.627370 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 17 13:16:01.628636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:01.631976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10d12b26-c576-4a38-9eeb-ce3d587b3dd1 tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:01.634942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10d12b26-c576-4a38-9eeb-ce3d587b3dd1 tempest-AggregatesAdminNegativeTestJSON-467484015 tempest-AggregatesAdminNegativeTestJSON-467484015-project] 10.222.0.65 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.027252 Oct 17 13:16:01.635696 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 151/327] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:16:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:01.644622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e23e47e2-7c2e-440c-918b-f975fe2c3357 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:01.672168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23e47e2-7c2e-440c-918b-f975fe2c3357 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.672681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23e47e2-7c2e-440c-918b-f975fe2c3357 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.674859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e23e47e2-7c2e-440c-918b-f975fe2c3357 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.793690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:01.794882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:01.807128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.807927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.808575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.809520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:01.811891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:01.812904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:01.889270 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e23e47e2-7c2e-440c-918b-f975fe2c3357 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.248224 Oct 17 13:16:01.889880 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 177/328] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:16:01 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:01.931497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77c943eb-f3e2-4d8a-8bc1-f9650c52c2bb tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.005849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77c943eb-f3e2-4d8a-8bc1-f9650c52c2bb tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.104454 Oct 17 13:16:02.006624 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 178/329] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:01 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:16:02.016127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c433c83-be0e-4c8d-bc0a-30b0a9a0ef04 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1948980427"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:02.023678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.aggregate [None req-3c433c83-be0e-4c8d-bc0a-30b0a9a0ef04 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Generated uuid 3bfa016d-d8dc-41f2-b0d4-25f6e8602253 for aggregate {{(pid=120698) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:16:02.075853 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c433c83-be0e-4c8d-bc0a-30b0a9a0ef04 tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.062106 Oct 17 13:16:02.086198 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 179/330] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:16:02 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:02.097951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.101483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.123406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.123930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.124362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.125069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.125561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.125983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.195263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.204714 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb8f6c3c-e1bc-4f2b-8c67-c16075e6e8f7 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.414634 Oct 17 13:16:02.222057 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 152/331] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:01 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:02.227617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:02.243758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.244584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.245323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.272761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.276603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.277266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.305937 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.compute.aggregates [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 13:16:02.307448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Request method failure captured: Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 42 Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVX4mNvMKYC41NsJT_RtZs9cVPiaxVOXLx_QTY9W4k1DleljqG676jWRzyq24jI7ogj8tnCSh9CVPZt3Nlufxiut5pBY0DvZi0WvwLtF5DIFVGkuX4EWuSvXbBS9Ofk70YniKWfkYHe3rWBdIUpXZzFPyFq5exfo9IwrVlu7fOzycQ Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:02.309707 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a1e68045e5334f2da5bc8013bf477afe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a1e68045e5334f2da5bc8013bf477afe Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724 Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dd22b0fd58af448793b688762781fcfd Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: {"remove_host": {"host": "nonexist_host"}} Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:02.310903 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 17 13:16:02.311619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 17 13:16:02.312714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.313896 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:02.315014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:02.315014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:02.315014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:02.315014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:02.315014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 17 13:16:02.315014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:02.316789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:02.320674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d941e88-8f01-4bd7-a81c-1225981020af tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.096651 Oct 17 13:16:02.321562 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 153/332] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:16:02 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:02.334170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17296cb9-559e-453c-9b54-6d87b806be3c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.334432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.353353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.356247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.373330 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab099b6a-7cb8-40c0-99e1-fbf36365913a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.283351 Oct 17 13:16:02.377209 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 180/333] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:02 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:02.429207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17296cb9-559e-453c-9b54-6d87b806be3c tempest-AggregatesAdminNegativeTestJSON-1228306724 tempest-AggregatesAdminNegativeTestJSON-1228306724-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.103311 Oct 17 13:16:02.431879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 154/334] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:02 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:16:02.571606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:02.572442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:02.582712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.588860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.589358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.590111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:02.590569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:02.590994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:02.912574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:02.937006 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-253c2555-daa6-4c42-98ab-f275c1c26b58 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1387 microversion: 2.1 time: 0.370040 Oct 17 13:16:02.937991 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 155/335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:02 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1387 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:03.233414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.235476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.244999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.247781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.249140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.251074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.254419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.256713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.277937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-559757765", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:03.376513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:03.770954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.805599 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f20e8cb9-4c6c-4357-a0ba-b08ac8f937d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.576209 Oct 17 13:16:03.809066 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 156/336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:03.816355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:03.822969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:03.836990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.838026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.838734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.839679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:03.840803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:03.858078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:03.885389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:03.984469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:03.999456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.001183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.010152 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8a61e3d-6ee9-458a-ac0d-020b93262a44 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.199279 Oct 17 13:16:04.011296 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 157/337] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:03 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:04.016996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.017890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.025573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.026472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.027146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.027994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.028622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.029290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.057474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:04.058169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:04.058849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:04.059751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:04.060374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:04.078820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.079905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.080568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.082969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.084027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.084672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.179022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Getting quotas for project 401070ff300848dbb15e6bb09d4e194b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:04.185791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Getting quotas for user 456395d8405a409c997dff3c903b1174 and project 401070ff300848dbb15e6bb09d4e194b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:04.218749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:04.221593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:04.289039 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a372bf1-8102-400b-9278-eee9774a969f tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.816756 Oct 17 13:16:04.294905 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 181/338] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:04.306498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85707592-3887-4a99-a0e3-d16e94c4e26b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.307410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85707592-3887-4a99-a0e3-d16e94c4e26b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.487191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85707592-3887-4a99-a0e3-d16e94c4e26b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.497150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85707592-3887-4a99-a0e3-d16e94c4e26b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1218 microversion: 2.1 time: 0.199674 Oct 17 13:16:04.497769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 182/339] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:04.509882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:04.524473 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-47abed62-d430-4d48-be65-e8b7ef46f61d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1586 microversion: 2.1 time: 0.502488 Oct 17 13:16:04.534547 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 158/340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1586 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:04.556362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.556871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.564876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.566418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.568245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.570024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.570949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.571562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.694642 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94003502-3af3-4c85-9249-bb1e4f9c8458 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143200 Oct 17 13:16:04.695517 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 183/341] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:04.839083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:04.839646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:04.850160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.850646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.851077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:04.851772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:04.852218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:04.852636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.050811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.051968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.071849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.072514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.073070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.075421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.076861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.077660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.310977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.320920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.325974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.345725 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-27a42126-1f24-4c5f-8794-4289eada909a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.307255 Oct 17 13:16:05.357944 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 184/342] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:05.521546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:05.522418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:05.531967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.534383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.536627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.540862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:05.541637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:05.542232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:05.743331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.759401 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90989ae4-a621-4f76-a891-d222bcf14aae tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1214 microversion: 2.1 time: 0.234215 Oct 17 13:16:05.760316 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 185/343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:05 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:05.791524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:05.802521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75bae2af-dd68-436a-b1e4-9c459fdf1722 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.972101 Oct 17 13:16:05.803304 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 159/344] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:04 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:06.386457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.387077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.403005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.403514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.403941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.404647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.405098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.405552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.572219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.592509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.594777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:06.608391 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-391333ab-ded2-4104-bbdc-5d7b54a41da5 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.224013 Oct 17 13:16:06.612287 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 186/345] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:06.783689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.784452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.796592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.796592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.797651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.797731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.798144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.798813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.834574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:06.835188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:06.849123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.849712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.850269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:06.850976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:06.851627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:06.852230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.013480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.021794 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8e172e9-6ed0-448d-b5f0-44cc445338f8 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1276 microversion: 2.1 time: 0.242089 Oct 17 13:16:07.029458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 160/346] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1276 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:07.039034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-956b30fe-be42-44d3-b5f7-93adf7d9e4ac req-3a904f29-9c5c-424e-8bd4-78d161e896b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f0f53d-7f7b-4c43-a138-6c8d665d2252", "name": "network-vif-plugged", "status": "completed", "tag": "536c585d-f055-472a-b683-2aaa869340e4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:07.069992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-956b30fe-be42-44d3-b5f7-93adf7d9e4ac req-3a904f29-9c5c-424e-8bd4-78d161e896b8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.070473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-956b30fe-be42-44d3-b5f7-93adf7d9e4ac req-3a904f29-9c5c-424e-8bd4-78d161e896b8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.070915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-956b30fe-be42-44d3-b5f7-93adf7d9e4ac req-3a904f29-9c5c-424e-8bd4-78d161e896b8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.105215 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-956b30fe-be42-44d3-b5f7-93adf7d9e4ac req-3a904f29-9c5c-424e-8bd4-78d161e896b8 service nova] Creating event network-vif-plugged:536c585d-f055-472a-b683-2aaa869340e4 for instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 on n-h1-854121-14 Oct 17 13:16:07.118684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-956b30fe-be42-44d3-b5f7-93adf7d9e4ac req-3a904f29-9c5c-424e-8bd4-78d161e896b8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088656 Oct 17 13:16:07.121420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 161/347] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:07.247629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.273135 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ab4443f-26d8-437c-8ad4-8b741b28ffa5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.442662 Oct 17 13:16:07.274098 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 187/348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:06 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:07.642967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:07.643774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:07.654904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.655393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.658596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.659341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.659816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.660238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.818132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.824633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:07.825612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:07.841697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.848340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.849256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.849565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:07.852765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.855407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.857814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.858896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.870666 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab258595-7177-4eb9-be34-63085c346410 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.230338 Oct 17 13:16:07.874487 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 162/349] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:07 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:07.890823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bc024057-0bbd-404e-be08-d6b5a05aee67 req-abd641c1-2f79-4961-8914-19cfe0b2b18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06cfa7a-43e5-4c28-930b-4999358934b2", "tag": "e9077ca8-69e0-4d30-a803-019fb6f6b7a2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:07.924861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bc024057-0bbd-404e-be08-d6b5a05aee67 req-abd641c1-2f79-4961-8914-19cfe0b2b18f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:07.932045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bc024057-0bbd-404e-be08-d6b5a05aee67 req-abd641c1-2f79-4961-8914-19cfe0b2b18f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:07.932548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bc024057-0bbd-404e-be08-d6b5a05aee67 req-abd641c1-2f79-4961-8914-19cfe0b2b18f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:07.967723 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bc024057-0bbd-404e-be08-d6b5a05aee67 req-abd641c1-2f79-4961-8914-19cfe0b2b18f service nova] Creating event network-changed:e9077ca8-69e0-4d30-a803-019fb6f6b7a2 for instance f06cfa7a-43e5-4c28-930b-4999358934b2 on n-h2-854121-14 Oct 17 13:16:07.984315 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bc024057-0bbd-404e-be08-d6b5a05aee67 req-abd641c1-2f79-4961-8914-19cfe0b2b18f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108149 Oct 17 13:16:07.985394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 163/350] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:08.049869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.050927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.060542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.061555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.062697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.064295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.065475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.066328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.209141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.223567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.233072 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25de02d1-53da-4c13-81a9-989f309ab55c tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 200 len: 1586 microversion: 2.1 time: 0.417769 Oct 17 13:16:08.246759 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4bb93ea-88dc-4383-b3f1-5536ef107c2e tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1276 microversion: 2.1 time: 0.201621 Oct 17 13:16:08.251405 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 188/351] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:07 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 1586 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.252545 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 164/352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.298978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.299803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.307962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.309531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.310747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.312239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.313433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.315471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.325128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:08.698877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:08.708421 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d93c65bd-63cb-42fa-91d1-01691eb838b5 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1319 microversion: 2.1 time: 0.414178 Oct 17 13:16:08.724482 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 189/353] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1319 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:08.909502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:08.911498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:08.918691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.920061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.920706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:08.921576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:08.922037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:08.922468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.023450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.035093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.039330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.054952 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b688c911-4b8f-4060-9469-2e4a9ea9573a tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1447 microversion: 2.75 time: 0.149864 Oct 17 13:16:09.065827 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 190/354] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:09.225462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e6338b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.234583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.236057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.240170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.242515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.244303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.245924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.280396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.281328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:09.291828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.292618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.295914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.296971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.297521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.298279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.306216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c059f0ac-5da8-40f8-9f78-d09a941b8b1e tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.451823 Oct 17 13:16:09.307359 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 165/355] 10.222.0.65 () {58 vars in 1128 bytes} [Mon Oct 17 13:16:08 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:09.322360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e633940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.327889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.328689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.329543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.330909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.331632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.332462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.357318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:DELETE=13,nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:09.373689 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-adbd33a8-6edd-49dc-b6fd-ea0504e2dbad tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.058673 Oct 17 13:16:09.377711 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 166/356] 10.222.0.65 () {58 vars in 1139 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:09.400822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e633b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.413110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.413634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.414070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.417874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.418357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.420040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.462762 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bde40fc0-7731-4c7f-a62a-253f221e5d8f tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.076312 Oct 17 13:16:09.463941 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 167/357] 10.222.0.65 () {58 vars in 1145 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:16:09.496110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e5a5940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.510065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.511121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.511805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.512887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.513747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.514427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.540803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:09.555339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7de5e5c5-82b9-45ea-91d6-158581edd956 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.283164 Oct 17 13:16:09.559071 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 191/358] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:09.563105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:09.581911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7f880db-246e-48ed-aaa1-f481a6769ece tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.100413 Oct 17 13:16:09.584039 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 168/359] 10.222.0.65 () {58 vars in 1128 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:09.595653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e53c280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.601370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.603459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.605843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.608099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.608957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.610463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.703845 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ade3664c-118a-4d2e-bcaa-effa92382006 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.112707 Oct 17 13:16:09.705080 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 192/360] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:09.718033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e5f98b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.722403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.723550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.727183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.732464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.738357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.742687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.746740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.749799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:09.776357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.776862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.783748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.784593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.785070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.785526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.836832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16f2038b-8866-4171-a274-c0e941d87179 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.120930 Oct 17 13:16:09.839084 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 169/361] 10.222.0.65 () {58 vars in 1128 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:09.859520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e5a50d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:09.875802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.882205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.883131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:09.925486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:09.929572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:09.930312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.019299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d80d7db3-0cc6-45d4-8074-b04c3f8c3288 tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts/n-h1-854121-14" status: 200 len: 603 microversion: 2.1 time: 0.173351 Oct 17 13:16:10.021316 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 170/362] 10.222.0.65 () {58 vars in 1173 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/os-hosts/n-h1-854121-14 => generated 603 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:10.037783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Calling method '.version_select at 0x7f419e5a5820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.048175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.050033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.052328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.084310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.085439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.091216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.136846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.137375 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bba8937-5816-45f4-a026-812212a871ff tempest-HostsAdminTestJSON-355297273 tempest-HostsAdminTestJSON-355297273-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts/n-h2-854121-14" status: 200 len: 603 microversion: 2.1 time: 0.106985 Oct 17 13:16:10.145996 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 171/363] 10.222.0.65 () {58 vars in 1173 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/os-hosts/n-h2-854121-14 => generated 603 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:10.146698 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e78bb09b-0fdf-4186-9023-007ee82dd3c6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1469 microversion: 2.1 time: 0.417998 Oct 17 13:16:10.147286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 193/364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:09 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1469 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:10.170187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.170989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.175908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:10.179603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.179739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.180084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.180518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.181467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.184289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.185200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.196139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.197604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.199323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.202445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.203568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.205458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.347698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.362759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.366728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.381005 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6685f33-5b7b-432b-897c-a36f771b6274 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1453 microversion: 2.75 time: 0.236644 Oct 17 13:16:10.382921 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 172/365] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1453 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:10.389862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-612e000e-5276-40ab-b501-7db2191011d8 req-1aeaef04-70f9-4485-a4d8-9435e965e787 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d120eef2-6bf8-44f4-a111-c0e68b321b94", "tag": "090e0642-a1ed-4e78-ab59-b6a2ba52a116"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:10.407138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-612e000e-5276-40ab-b501-7db2191011d8 req-1aeaef04-70f9-4485-a4d8-9435e965e787 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.407738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-612e000e-5276-40ab-b501-7db2191011d8 req-1aeaef04-70f9-4485-a4d8-9435e965e787 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.408185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-612e000e-5276-40ab-b501-7db2191011d8 req-1aeaef04-70f9-4485-a4d8-9435e965e787 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.423980 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48a3e75e-35d9-4b20-83bd-397ba15594ca tempest-DeleteServersAdminTestJSON-1808366161 tempest-DeleteServersAdminTestJSON-1808366161-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252/action" status: 202 len: 0 microversion: 2.1 time: 0.252291 Oct 17 13:16:10.425259 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 194/366] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:10 2022] POST /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:16:10.433940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.434975 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-612e000e-5276-40ab-b501-7db2191011d8 req-1aeaef04-70f9-4485-a4d8-9435e965e787 service nova] Creating event network-changed:090e0642-a1ed-4e78-ab59-b6a2ba52a116 for instance d120eef2-6bf8-44f4-a111-c0e68b321b94 on n-h1-854121-14 Oct 17 13:16:10.435355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.443421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.444134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.445063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.447191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.447919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.448518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.449005 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-612e000e-5276-40ab-b501-7db2191011d8 req-1aeaef04-70f9-4485-a4d8-9435e965e787 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064853 Oct 17 13:16:10.449943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 173/367] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:10.499441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.499925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.500672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.501486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lazy-loading 'fault' on Instance uuid 72f0f53d-7f7b-4c43-a138-6c8d665d2252 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:10.585129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.586117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.594760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.595827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.596370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.597151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.598585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.599509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.763236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.769132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cc7a691-f1f3-40e4-87fe-7f71f9f13460 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1452 microversion: 2.1 time: 0.339609 Oct 17 13:16:10.771218 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 195/368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1452 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:10.795030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:10.795541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:10.802059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.802829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.803349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.804076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:10.805556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:10.806037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:10.843261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:10.895848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:10.905082 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ea802ce-4ccd-4a9c-a92b-cf0bc573045a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.324799 Oct 17 13:16:10.917185 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 174/369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:10 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:11.016815 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1097c6c6-e424-4f7b-ae71-d46e308050dc tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "DELETE /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 204 len: 0 microversion: 2.1 time: 0.226602 Oct 17 13:16:11.018004 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 196/370] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:10 2022] DELETE /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:16:11.031425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:11.032803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:11.043983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.045039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.045716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.047268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.047864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.048637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.084543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.085099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.086021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.086585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lazy-loading 'fault' on Instance uuid 72f0f53d-7f7b-4c43-a138-6c8d665d2252 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:11.227891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:11.240238 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e83b7f05-47d7-4d28-89be-63d79b83045d tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1458 microversion: 2.1 time: 0.215854 Oct 17 13:16:11.246496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 175/371] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:11 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1458 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:11.414359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:11.416382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:11.425264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.425936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.430197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.431746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:11.432598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:11.433803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:11.539349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:11.551921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:11.554050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:11.559666 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab8d46ab-42f3-4cbd-8444-7964df52cbeb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1453 microversion: 2.75 time: 0.151407 Oct 17 13:16:11.560268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 176/372] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:11 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:11.641656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef597676-b2b4-4b49-aa44-05f4fa667553 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1989948002", "id": 2132941056, "os-flavor-access:is_public": "False"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:11.651883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:11.665409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef597676-b2b4-4b49-aa44-05f4fa667553 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.272427 Oct 17 13:16:11.666405 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 197/373] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:11 2022] POST /compute/v2.1/flavors => generated 431 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:11.679394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee719909-0c21-487a-88e0-9e6ac4a2d1fa tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7b0ba66a66b24885ba6f47b9002f0e36"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:12.012918 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee719909-0c21-487a-88e0-9e6ac4a2d1fa tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2132941056/action" status: 200 len: 97 microversion: 2.1 time: 0.338014 Oct 17 13:16:12.013776 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 177/374] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:16:11 2022] POST /compute/v2.1/flavors/2132941056/action => generated 97 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:16:12.019838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.021691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:12.030023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.030695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.031143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.032027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.032814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.033276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.206956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.219136 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-278885cb-2aab-4705-8355-4d5b19f05fd9 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.204236 Oct 17 13:16:12.233728 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 178/375] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:12.239865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a3cb6ba-b66b-40c7-ae8c-21eb07ceb622 tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] Calling method '.version_select at 0x7f419e53c700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.261095 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a3cb6ba-b66b-40c7-ae8c-21eb07ceb622 tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.506140 Oct 17 13:16:12.262056 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 198/376] 10.222.0.65 () {60 vars in 1226 bytes} [Mon Oct 17 13:16:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:16:12.272389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.273472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:12.280125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.280801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.281599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.282386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.282844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.283456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.319479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.320220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.320809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.321554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lazy-loading 'fault' on Instance uuid 72f0f53d-7f7b-4c43-a138-6c8d665d2252 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:12.472846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.484626 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5c3ae9d-796d-4d72-a47e-93b857dc2f97 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1458 microversion: 2.1 time: 0.220680 Oct 17 13:16:12.485516 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 199/377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1458 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:12.490915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf321070-6c6d-44aa-a690-5d55f620761f tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] Action: 'update', calling method: .version_select at 0x7f419e4c7a60>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:12.534376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6fbb8e8-d1e3-48c8-b50d-a554a265af35 tempest-FlavorsAccessTestJSON-918436688 tempest-FlavorsAccessTestJSON-918436688-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.564599 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6fbb8e8-d1e3-48c8-b50d-a554a265af35 tempest-FlavorsAccessTestJSON-918436688 tempest-FlavorsAccessTestJSON-918436688-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.1 time: 0.329354 Oct 17 13:16:12.565217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 179/378] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:12.587134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a851fbc4-462b-4fa9-8fcc-e782b2b234a9 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7b0ba66a66b24885ba6f47b9002f0e36"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:12.702010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cf321070-6c6d-44aa-a690-5d55f620761f tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.215221 Oct 17 13:16:12.702923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 200/379] 10.222.0.65 () {62 vars in 1247 bytes} [Mon Oct 17 13:16:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:12.707870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.708481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:12.714830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.715325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.716179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.716900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:12.717453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:12.721227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:12.824748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.836810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.838998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:12.855923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b39bab86-029c-49c0-8b5c-48b3d443c4c7 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1453 microversion: 2.75 time: 0.151941 Oct 17 13:16:12.856508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 201/380] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:12.963533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a851fbc4-462b-4fa9-8fcc-e782b2b234a9 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2132941056/action" status: 200 len: 21 microversion: 2.1 time: 0.381042 Oct 17 13:16:12.964575 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 180/381] 10.222.0.65 () {60 vars in 1200 bytes} [Mon Oct 17 13:16:12 2022] POST /compute/v2.1/flavors/2132941056/action => generated 21 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:16:12.970359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-391db9b0-f994-4aa8-b399-913f4e779dc7 tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] Calling method '.version_select at 0x7f419e5f94c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:12.992949 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-391db9b0-f994-4aa8-b399-913f4e779dc7 tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.026744 Oct 17 13:16:13.000886 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 181/382] 10.222.0.65 () {60 vars in 1226 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:13.008336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-753933df-474a-4f62-8582-d745e3364636 tempest-FlavorsAccessTestJSON-918436688 tempest-FlavorsAccessTestJSON-918436688-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.058115 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-753933df-474a-4f62-8582-d745e3364636 tempest-FlavorsAccessTestJSON-918436688 tempest-FlavorsAccessTestJSON-918436688-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.055436 Oct 17 13:16:13.064786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 182/383] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:13.080309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91d09dd0-09e1-4688-8613-f5ea60b18a8c tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] Action: 'update', calling method: .version_select at 0x7f419e5f9b80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:13.101545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Calling method '.version_select at 0x7f419e4c7700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.108929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.109590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.110412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.111210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.113336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.114532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.181820 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a733770c-bfcd-4895-a4a1-b5ef12f90823 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.323832 Oct 17 13:16:13.189310 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 202/384] 10.222.0.65 () {58 vars in 1128 bytes} [Mon Oct 17 13:16:12 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:13.194058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36acbc80-afd1-4036-bc6a-b88c7f3ff764 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.217041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91d09dd0-09e1-4688-8613-f5ea60b18a8c tempest-QuotaClassesAdmin257Test-1589701831 tempest-QuotaClassesAdmin257Test-1589701831-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.149476 Oct 17 13:16:13.225581 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36acbc80-afd1-4036-bc6a-b88c7f3ff764 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2132941056" status: 202 len: 0 microversion: 2.1 time: 0.031082 Oct 17 13:16:13.225581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 203/385] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:16:13 2022] DELETE /compute/v2.1/flavors/2132941056 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:13.225955 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 183/386] 10.222.0.65 () {62 vars in 1247 bytes} [Mon Oct 17 13:16:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:13.237298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8427b356-2d6c-48dd-8ff2-855b9b88941f tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.268725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8427b356-2d6c-48dd-8ff2-855b9b88941f tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.045685 Oct 17 13:16:13.280964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 184/387] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:13.291514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.292820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:13.313033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.313570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.314014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.314733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.315180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.315614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.574116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.587042 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66e72cb3-a924-417a-b5df-29c1b6492d26 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.308306 Oct 17 13:16:13.587669 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 185/388] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:13.601464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a949807b-968c-466a-bc05-8a60f135594d tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-880628960", "id": 1850370216, "os-flavor-access:is_public": "False"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:13.645329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95d8319b-7d26-4bec-9ada-b8cb90d68f6c tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Calling method '.version_select at 0x7f419e4a8430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.654363 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a949807b-968c-466a-bc05-8a60f135594d tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.064038 Oct 17 13:16:13.655176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-95d8319b-7d26-4bec-9ada-b8cb90d68f6c tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f4c333714f0e4aaa9668bee1bde6f739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1867b8cad98741988c7cb6b2191b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.657677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 186/389] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:13 2022] POST /compute/v2.1/flavors => generated 430 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:13.665043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.670375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95d8319b-7d26-4bec-9ada-b8cb90d68f6c tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Request method failure captured: Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWb09aOfAVDcRi0geh1gICVku7_dFI5G9vUDNOoUEeHIvjG3FyEW5eaQ9Zuz1yPmnhJTzLRP3WUs4Wfb7JFCD3b9BKhuUpZUFk69gY_B27butVCxG0Mg4hex5R21IaC3mm3DGswhuupmSc8tZWKltpKlZ7DccczDPCYNl7FSTndS74 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:13.674546 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f4c333714f0e4aaa9668bee1bde6f739 Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: action_args: {} Oct 17 13:16:13.676614 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:13.677909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 17 13:16:13.680016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.682232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95d8319b-7d26-4bec-9ada-b8cb90d68f6c tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:13.682232 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95d8319b-7d26-4bec-9ada-b8cb90d68f6c tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] 10.222.0.65 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.453049 Oct 17 13:16:13.682232 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 204/390] 10.222.0.65 () {58 vars in 1128 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 460 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:13.688383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.689264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.689920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.691129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.692442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.693569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.709902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b6f01c8-d709-4198-96cb-4db019d391e1 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.733629 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b6f01c8-d709-4198-96cb-4db019d391e1 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/1850370216/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.052638 Oct 17 13:16:13.734980 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 205/391] 10.222.0.65 () {58 vars in 1209 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/flavors/1850370216/os-flavor-access => generated 21 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:16:13.740586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0eea4a7-61a9-4367-8f0f-4066d4f7f3c5 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Calling method '.version_select at 0x7f419e46c280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.742750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0eea4a7-61a9-4367-8f0f-4066d4f7f3c5 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f4c333714f0e4aaa9668bee1bde6f739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1867b8cad98741988c7cb6b2191b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0eea4a7-61a9-4367-8f0f-4066d4f7f3c5 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Request method failure captured: Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hosts/n-d-854121-14/reboot HTTP/1.1 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWb09aOfAVDcRi0geh1gICVku7_dFI5G9vUDNOoUEeHIvjG3FyEW5eaQ9Zuz1yPmnhJTzLRP3WUs4Wfb7JFCD3b9BKhuUpZUFk69gY_B27butVCxG0Mg4hex5R21IaC3mm3DGswhuupmSc8tZWKltpKlZ7DccczDPCYNl7FSTndS74 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:13.745258 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f4c333714f0e4aaa9668bee1bde6f739 Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'n-d-854121-14'} Oct 17 13:16:13.746527 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:13.747241 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 17 13:16:13.748280 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.752015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0eea4a7-61a9-4367-8f0f-4066d4f7f3c5 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:13.753106 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0eea4a7-61a9-4367-8f0f-4066d4f7f3c5 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] 10.222.0.65 "GET /compute/v2.1/os-hosts/n-d-854121-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.016752 Oct 17 13:16:13.753874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 206/392] 10.222.0.65 () {58 vars in 1191 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/os-hosts/n-d-854121-14/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:13.757044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.758656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.759279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.761656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f9cf5d9-e801-4202-a2bc-0526cbefa4dc tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.764663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lazy-loading 'fault' on Instance uuid 72f0f53d-7f7b-4c43-a138-6c8d665d2252 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:13.789425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f9cf5d9-e801-4202-a2bc-0526cbefa4dc tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1850370216" status: 202 len: 0 microversion: 2.1 time: 0.032321 Oct 17 13:16:13.791045 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 207/393] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:16:13 2022] DELETE /compute/v2.1/flavors/1850370216 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:13.797876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84b9dfdc-d0fa-49a3-9d6b-d94eaaaed344 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Calling method '.version_select at 0x7f419e538ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.809587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-84b9dfdc-d0fa-49a3-9d6b-d94eaaaed344 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84b9dfdc-d0fa-49a3-9d6b-d94eaaaed344 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:13.811824 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:16:13.813110 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:13.813904 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 13:16:13.815016 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.816101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84b9dfdc-d0fa-49a3-9d6b-d94eaaaed344 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:13.816869 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84b9dfdc-d0fa-49a3-9d6b-d94eaaaed344 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.022440 Oct 17 13:16:13.823996 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 208/394] 10.222.0.65 () {58 vars in 1212 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:13.833290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f283b28-daf0-407e-8bf1-7ff6e6b84802 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.898171 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f283b28-daf0-407e-8bf1-7ff6e6b84802 tempest-FlavorsAccessTestJSON-712705572 tempest-FlavorsAccessTestJSON-712705572-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.071373 Oct 17 13:16:13.900147 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 209/395] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:13.917058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-441a7627-ecdd-4bfb-8832-7164a2cc53e9 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Calling method '.version_select at 0x7f419e46c040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.921703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-441a7627-ecdd-4bfb-8832-7164a2cc53e9 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f4c333714f0e4aaa9668bee1bde6f739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1867b8cad98741988c7cb6b2191b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-441a7627-ecdd-4bfb-8832-7164a2cc53e9 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Request method failure captured: Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hosts/n-d-854121-14 HTTP/1.1 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWb09aOfAVDcRi0geh1gICVku7_dFI5G9vUDNOoUEeHIvjG3FyEW5eaQ9Zuz1yPmnhJTzLRP3WUs4Wfb7JFCD3b9BKhuUpZUFk69gY_B27butVCxG0Mg4hex5R21IaC3mm3DGswhuupmSc8tZWKltpKlZ7DccczDPCYNl7FSTndS74 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:13.924954 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f4c333714f0e4aaa9668bee1bde6f739 Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'n-d-854121-14'} Oct 17 13:16:13.927093 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:13.928106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 17 13:16:13.929595 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:13.932757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-441a7627-ecdd-4bfb-8832-7164a2cc53e9 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:13.934599 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-441a7627-ecdd-4bfb-8832-7164a2cc53e9 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] 10.222.0.65 "GET /compute/v2.1/os-hosts/n-d-854121-14" status: 403 len: 109 microversion: 2.1 time: 0.031998 Oct 17 13:16:13.938296 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 210/396] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/os-hosts/n-d-854121-14 => generated 109 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:13.948514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:13.952653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:13.975543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.979685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.981068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:13.984060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:13.985113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:13.986167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.006690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4914f4e6368d4b7e942eef79a11e8df7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5562a66777d42a99bb3a4f3b44f1887', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.020922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-93a37711-a81f-45ae-8fd6-dcfd830195d8 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 200 len: 1458 microversion: 2.1 time: 0.360659 Oct 17 13:16:14.038093 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 187/397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 1458 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:14.050892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3650c1d2-7a9b-4d3e-95a2-6489e7d695a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Calling method '.version_select at 0x7f419e555700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.061931 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3650c1d2-7a9b-4d3e-95a2-6489e7d695a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3650c1d2-7a9b-4d3e-95a2-6489e7d695a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:14.064503 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:16:14.065878 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.066669 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.067921 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.068898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3650c1d2-7a9b-4d3e-95a2-6489e7d695a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.068898 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3650c1d2-7a9b-4d3e-95a2-6489e7d695a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026794 Oct 17 13:16:14.073010 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 188/398] 10.222.0.65 () {58 vars in 1191 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:14.078156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8c062a6-bac8-487a-914a-cba0a5d64647 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Calling method '.version_select at 0x7f419e555a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.083953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8c062a6-bac8-487a-914a-cba0a5d64647 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f4c333714f0e4aaa9668bee1bde6f739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1867b8cad98741988c7cb6b2191b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8c062a6-bac8-487a-914a-cba0a5d64647 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Request method failure captured: Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hosts/n-d-854121-14/shutdown HTTP/1.1 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWb09aOfAVDcRi0geh1gICVku7_dFI5G9vUDNOoUEeHIvjG3FyEW5eaQ9Zuz1yPmnhJTzLRP3WUs4Wfb7JFCD3b9BKhuUpZUFk69gY_B27butVCxG0Mg4hex5R21IaC3mm3DGswhuupmSc8tZWKltpKlZ7DccczDPCYNl7FSTndS74 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:14.086626 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f4c333714f0e4aaa9668bee1bde6f739 Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'n-d-854121-14'} Oct 17 13:16:14.088291 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:14.089077 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 17 13:16:14.090269 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.091319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8c062a6-bac8-487a-914a-cba0a5d64647 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.091319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8c062a6-bac8-487a-914a-cba0a5d64647 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] 10.222.0.65 "GET /compute/v2.1/os-hosts/n-d-854121-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015066 Oct 17 13:16:14.096744 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 189/399] 10.222.0.65 () {58 vars in 1197 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/os-hosts/n-d-854121-14/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:14.114976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18cb3d5a-f7ff-4d5c-be13-f2383c3b42b2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Calling method '.version_select at 0x7f419e633700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.138754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-18cb3d5a-f7ff-4d5c-be13-f2383c3b42b2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18cb3d5a-f7ff-4d5c-be13-f2383c3b42b2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:14.140519 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:16:14.141953 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:14.143544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 13:16:14.145459 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18cb3d5a-f7ff-4d5c-be13-f2383c3b42b2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.146670 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18cb3d5a-f7ff-4d5c-be13-f2383c3b42b2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.044179 Oct 17 13:16:14.149911 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 190/400] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:14.162835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c3ba6af-1861-463a-8eca-c620521a8a28 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Calling method '.version_select at 0x7f419e555e50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.171507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c3ba6af-1861-463a-8eca-c620521a8a28 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f4c333714f0e4aaa9668bee1bde6f739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1867b8cad98741988c7cb6b2191b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c3ba6af-1861-463a-8eca-c620521a8a28 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Request method failure captured: Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hosts/n-d-854121-14/startup HTTP/1.1 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWb09aOfAVDcRi0geh1gICVku7_dFI5G9vUDNOoUEeHIvjG3FyEW5eaQ9Zuz1yPmnhJTzLRP3WUs4Wfb7JFCD3b9BKhuUpZUFk69gY_B27butVCxG0Mg4hex5R21IaC3mm3DGswhuupmSc8tZWKltpKlZ7DccczDPCYNl7FSTndS74 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:14.176128 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f4c333714f0e4aaa9668bee1bde6f739 Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'n-d-854121-14'} Oct 17 13:16:14.177791 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:14.178826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 17 13:16:14.180771 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.186812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c3ba6af-1861-463a-8eca-c620521a8a28 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.187820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c3ba6af-1861-463a-8eca-c620521a8a28 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] 10.222.0.65 "GET /compute/v2.1/os-hosts/n-d-854121-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.033015 Oct 17 13:16:14.195169 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 191/401] 10.222.0.65 () {58 vars in 1194 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/os-hosts/n-d-854121-14/startup => generated 110 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:14.211518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-341996e6-82e2-4cfa-9c36-bfd56f70c0a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Calling method '.version_select at 0x7f419e4ed280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.212397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.234046 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-341996e6-82e2-4cfa-9c36-bfd56f70c0a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-341996e6-82e2-4cfa-9c36-bfd56f70c0a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:14.236636 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'nonexistent_hostname'} Oct 17 13:16:14.238123 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:14.238916 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 17 13:16:14.240657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-341996e6-82e2-4cfa-9c36-bfd56f70c0a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.241727 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-341996e6-82e2-4cfa-9c36-bfd56f70c0a2 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.043188 Oct 17 13:16:14.248530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.248930 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 192/402] 10.222.0.65 () {58 vars in 1215 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:16:14.256677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-02578c93-6ebe-4a3a-b9b3-95accc0472b4 req-57751600-f6f7-4293-b6d0-2bb04ceaf4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72f0f53d-7f7b-4c43-a138-6c8d665d2252", "name": "network-vif-deleted", "tag": "536c585d-f055-472a-b683-2aaa869340e4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.257352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.276480 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fec55190-04c0-43d3-9acf-e707a574c7fc tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1453 microversion: 2.75 time: 0.336082 Oct 17 13:16:14.277928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 211/403] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:13 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1453 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:14.279059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-02578c93-6ebe-4a3a-b9b3-95accc0472b4 req-57751600-f6f7-4293-b6d0-2bb04ceaf4fc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.279665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-02578c93-6ebe-4a3a-b9b3-95accc0472b4 req-57751600-f6f7-4293-b6d0-2bb04ceaf4fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.281864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-02578c93-6ebe-4a3a-b9b3-95accc0472b4 req-57751600-f6f7-4293-b6d0-2bb04ceaf4fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.291673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52702a60-90ff-48fb-9751-401c1584cdc1 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Action: 'update', calling method: .version_select at 0x7f419e4c7820>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.299037 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-02578c93-6ebe-4a3a-b9b3-95accc0472b4 req-57751600-f6f7-4293-b6d0-2bb04ceaf4fc service nova] Creating event network-vif-deleted:536c585d-f055-472a-b683-2aaa869340e4 for instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 on n-h1-854121-14 Oct 17 13:16:14.305799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-02578c93-6ebe-4a3a-b9b3-95accc0472b4 req-57751600-f6f7-4293-b6d0-2bb04ceaf4fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055405 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52702a60-90ff-48fb-9751-401c1584cdc1 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/os-hosts/n-d-854121-14 HTTP/1.1 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 51 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:14.308908 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: {"status": "enable", "maintenance_mode": "invalid"} Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:14.310338 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'n-d-854121-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.311382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.314279 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.317263 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.317263 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:16:14.317263 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:16:14.317263 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.317263 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.319731 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 193/404] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:14.319907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52702a60-90ff-48fb-9751-401c1584cdc1 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.319907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52702a60-90ff-48fb-9751-401c1584cdc1 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-hosts/n-d-854121-14" status: 400 len: 199 microversion: 2.1 time: 0.035007 Oct 17 13:16:14.324390 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 212/405] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:16:14 2022] PUT /compute/v2.1/os-hosts/n-d-854121-14 => generated 199 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:14.331199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-335c67c4-0c99-40d9-b802-2fcd19c0eee0 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Action: 'update', calling method: .version_select at 0x7f419e5d5ee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-335c67c4-0c99-40d9-b802-2fcd19c0eee0 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/os-hosts/n-d-854121-14 HTTP/1.1 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 51 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:14.337018 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: {"status": "invalid", "maintenance_mode": "enable"} Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.338549 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'n-d-854121-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.339456 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.341048 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.344183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.344183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:16:14.344183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:16:14.344183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 17 13:16:14.344183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.350770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-335c67c4-0c99-40d9-b802-2fcd19c0eee0 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.352012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-335c67c4-0c99-40d9-b802-2fcd19c0eee0 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-hosts/n-d-854121-14" status: 400 len: 189 microversion: 2.1 time: 0.025263 Oct 17 13:16:14.357480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 194/406] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:16:14 2022] PUT /compute/v2.1/os-hosts/n-d-854121-14 => generated 189 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:14.366250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dca243f-6ae5-427c-85dc-8877880b5ad1 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Action: 'update', calling method: .version_select at 0x7f419e47bca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.371199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5dca243f-6ae5-427c-85dc-8877880b5ad1 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f4c333714f0e4aaa9668bee1bde6f739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1867b8cad98741988c7cb6b2191b5680', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dca243f-6ae5-427c-85dc-8877880b5ad1 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Request method failure captured: Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/os-hosts/n-d-854121-14 HTTP/1.1 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 50 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWb09aOfAVDcRi0geh1gICVku7_dFI5G9vUDNOoUEeHIvjG3FyEW5eaQ9Zuz1yPmnhJTzLRP3WUs4Wfb7JFCD3b9BKhuUpZUFk69gY_B27butVCxG0Mg4hex5R21IaC3mm3DGswhuupmSc8tZWKltpKlZ7DccczDPCYNl7FSTndS74 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:14.374982 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1867b8cad98741988c7cb6b2191b5680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1867b8cad98741988c7cb6b2191b5680 Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1253265577 Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f4c333714f0e4aaa9668bee1bde6f739 Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1253265577-project Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 13:16:14.376778 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'n-d-854121-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:14.377877 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 17 13:16:14.380465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.384233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dca243f-6ae5-427c-85dc-8877880b5ad1 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.385350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5dca243f-6ae5-427c-85dc-8877880b5ad1 tempest-HostsAdminNegativeTestJSON-1253265577 tempest-HostsAdminNegativeTestJSON-1253265577-project] 10.222.0.65 "PUT /compute/v2.1/os-hosts/n-d-854121-14" status: 403 len: 111 microversion: 2.1 time: 0.025990 Oct 17 13:16:14.386462 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 213/407] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:16:14 2022] PUT /compute/v2.1/os-hosts/n-d-854121-14 => generated 111 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:14.396218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38657e1e-0cee-43bd-a5c0-ee09394eeb11 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Action: 'update', calling method: .version_select at 0x7f419e555ee0>, body: {"status": null, "maintenance_mode": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38657e1e-0cee-43bd-a5c0-ee09394eeb11 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/os-hosts/n-d-854121-14 HTTP/1.1 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 42 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:14.403383 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: {"status": null, "maintenance_mode": null} Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 13:16:14.404729 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'n-d-854121-14', 'body': {'status': None, 'maintenance_mode': None}} Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'disable', Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'Enable', Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'Disable', Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance: Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi None Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.405641 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.406979 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.408042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:16:14.408042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:16:14.408042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 17 13:16:14.408042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.408042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38657e1e-0cee-43bd-a5c0-ee09394eeb11 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.408042 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38657e1e-0cee-43bd-a5c0-ee09394eeb11 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-hosts/n-d-854121-14" status: 400 len: 127 microversion: 2.1 time: 0.013024 Oct 17 13:16:14.412554 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 195/408] 10.222.0.65 () {60 vars in 1190 bytes} [Mon Oct 17 13:16:14 2022] PUT /compute/v2.1/os-hosts/n-d-854121-14 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:14.431562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6d38377-a5de-4bd4-8f87-ced3497b4689 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Action: 'update', calling method: .version_select at 0x7f419e53c550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:14.436602 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.hosts [None req-a6d38377-a5de-4bd4-8f87-ced3497b4689 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Enabling host nonexistent_hostname. Oct 17 13:16:14.462342 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a6d38377-a5de-4bd4-8f87-ced3497b4689 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6d38377-a5de-4bd4-8f87-ced3497b4689 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Request method failure captured: Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 50 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWchFxj0lxva8uAJ_ktYqfCgzeztdC8mJqxQgiITMEupuLhNunX24eYrNEKXVlmoyyytQdbX1TnkixC29yYL7kkq7_6MSpWaIGTGWwHJQN5dUZKEI-ZcJUnz6O-n-e0TwY6u0jaVBw01eD8klnHQxMMj2heJnz_dInrZaKEvzGhKX4 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:14.467612 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cbe778f7fc2341978320c58a918db189"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cbe778f7fc2341978320c58a918db189"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cbe778f7fc2341978320c58a918db189"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: cbe778f7fc2341978320c58a918db189 Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-75914975 Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d0208c686745484ca473a8d8a49a9aed Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HostsAdminNegativeTestJSON-75914975-project-admin Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: {"status": "enable", "maintenance_mode": "enable"} Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.468797 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 17 13:16:14.469702 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:14.470723 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 17 13:16:14.471845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:14.475784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6d38377-a5de-4bd4-8f87-ced3497b4689 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:14.477692 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a6d38377-a5de-4bd4-8f87-ced3497b4689 tempest-HostsAdminNegativeTestJSON-75914975 tempest-HostsAdminNegativeTestJSON-75914975-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.055501 Oct 17 13:16:14.479013 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 214/409] 10.222.0.65 () {60 vars in 1211 bytes} [Mon Oct 17 13:16:14 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:16:14.622213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:14.622958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:14.641858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.642355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.642803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.643526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:14.643987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:14.644417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:14.906748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:14.916775 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42e0be51-c88a-4a20-9c36-961f49332d66 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.306257 Oct 17 13:16:14.920200 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 196/410] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:14 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:15.054411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.055738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.072011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.074277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.076243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.077106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.081465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.082157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.104324 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] HTTP exception thrown: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Request method failure captured: Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 HTTP/1.1 Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVRKEfMtRSMaweg7LDNUDPK5WyWOQRabmRqtrWuYU94bInfBOQ5NPnuwtMZUmvIyhaknG8F44UkJzT7xVv8hexkjsMThWHP2ywCKsmOEP2MJavrQ_UetGliKNuh_6nqozjshrITSTK_nDBPWe8daCxIOYoba_DLCQ2Khhzi33ho9U Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:15.105870 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4914f4e6368d4b7e942eef79a11e8df7 Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.107077 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '72f0f53d-7f7b-4c43-a138-6c8d665d2252'} Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:15.107739 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.111244 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.112308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Returning 404 to user: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:15.112308 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2258c911-b4ef-4daf-bbf6-c8c74eeaa689 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 404 len: 111 microversion: 2.1 time: 0.059338 Oct 17 13:16:15.112308 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 215/411] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:15.119975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.120565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.128072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.136869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.137560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.138228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.138703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.139133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.170855 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] HTTP exception thrown: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Request method failure captured: Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 HTTP/1.1 Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVRKEfMtRSMaweg7LDNUDPK5WyWOQRabmRqtrWuYU94bInfBOQ5NPnuwtMZUmvIyhaknG8F44UkJzT7xVv8hexkjsMThWHP2ywCKsmOEP2MJavrQ_UetGliKNuh_6nqozjshrITSTK_nDBPWe8daCxIOYoba_DLCQ2Khhzi33ho9U Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:15.174733 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4914f4e6368d4b7e942eef79a11e8df7 Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.176764 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '72f0f53d-7f7b-4c43-a138-6c8d665d2252'} Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:15.177469 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.178707 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.181984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Returning 404 to user: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:15.183114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72fcf39a-e8cb-4be9-b645-9762e2ed40b6 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "DELETE /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 404 len: 111 microversion: 2.1 time: 0.067304 Oct 17 13:16:15.183606 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 197/412] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:15 2022] DELETE /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:15.193334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.193966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 72f0f53d-7f7b-4c43-a138-6c8d665d2252] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.206225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.206731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.207180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.208064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.208584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.209037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.229114 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] HTTP exception thrown: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Request method failure captured: Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 HTTP/1.1 Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVVRKEfMtRSMaweg7LDNUDPK5WyWOQRabmRqtrWuYU94bInfBOQ5NPnuwtMZUmvIyhaknG8F44UkJzT7xVv8hexkjsMThWHP2ywCKsmOEP2MJavrQ_UetGliKNuh_6nqozjshrITSTK_nDBPWe8daCxIOYoba_DLCQ2Khhzi33ho9U Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:15.232089 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4914f4e6368d4b7e942eef79a11e8df7 Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.233419 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '72f0f53d-7f7b-4c43-a138-6c8d665d2252'} Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:15.234093 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. Oct 17 13:16:15.235187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.243166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Returning 404 to user: Instance 72f0f53d-7f7b-4c43-a138-6c8d665d2252 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:15.244690 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12c90c1e-6dc1-4ea8-975b-ea1b4b767861 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252" status: 404 len: 111 microversion: 2.1 time: 0.057012 Oct 17 13:16:15.246195 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 216/413] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/servers/72f0f53d-7f7b-4c43-a138-6c8d665d2252 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:15.258344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.258979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.271815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.273596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.275890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.277727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.278090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.284115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.312006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.313573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.318652 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] HTTP exception thrown: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.323362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.324805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.326040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.327033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Request method failure captured: Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f HTTP/1.1 Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVRKEfMtRSMaweg7LDNUDPK5WyWOQRabmRqtrWuYU94bInfBOQ5NPnuwtMZUmvIyhaknG8F44UkJzT7xVv8hexkjsMThWHP2ywCKsmOEP2MJavrQ_UetGliKNuh_6nqozjshrITSTK_nDBPWe8daCxIOYoba_DLCQ2Khhzi33ho9U Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:15.327300 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4914f4e6368d4b7e942eef79a11e8df7 Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.328520 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5a471c66-e137-480f-bd59-ef3dd43da13f'} Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:15.329402 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.330494 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.331705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Returning 404 to user: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:15.331705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c5b2f47-e7a5-4598-b105-f06f93e14f65 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 404 len: 111 microversion: 2.1 time: 0.078489 Oct 17 13:16:15.332228 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 198/414] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:15 2022] DELETE /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:15.334227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.335662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.344943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:15.346228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] [instance: 5a471c66-e137-480f-bd59-ef3dd43da13f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:15.350695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:15.356157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.357037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.357800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.358954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:15.359676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:15.360315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:15.400058 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] HTTP exception thrown: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Request method failure captured: Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f HTTP/1.1 Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVVRKEfMtRSMaweg7LDNUDPK5WyWOQRabmRqtrWuYU94bInfBOQ5NPnuwtMZUmvIyhaknG8F44UkJzT7xVv8hexkjsMThWHP2ywCKsmOEP2MJavrQ_UetGliKNuh_6nqozjshrITSTK_nDBPWe8daCxIOYoba_DLCQ2Khhzi33ho9U Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:15.401978 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5562a66777d42a99bb3a4f3b44f1887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d5562a66777d42a99bb3a4f3b44f1887 Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1864572832 Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4914f4e6368d4b7e942eef79a11e8df7 Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersAdminTestJSON-1864572832-project Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.403238 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5a471c66-e137-480f-bd59-ef3dd43da13f'} Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:15.404189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. Oct 17 13:16:15.405381 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:15.408462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] Returning 404 to user: Instance 5a471c66-e137-480f-bd59-ef3dd43da13f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:15.409558 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-472e5a8e-aaf3-4017-8e37-e5b54170cb90 tempest-DeleteServersAdminTestJSON-1864572832 tempest-DeleteServersAdminTestJSON-1864572832-project] 10.222.0.65 "GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f" status: 404 len: 111 microversion: 2.1 time: 0.072137 Oct 17 13:16:15.413837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 199/415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/servers/5a471c66-e137-480f-bd59-ef3dd43da13f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:15.476882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.499766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.503748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:15.511728 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a3c27a0-b915-4b97-acaa-6efda3f8bf20 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1438 microversion: 2.75 time: 0.204504 Oct 17 13:16:15.524769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 217/416] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1438 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:15.996652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:16.007138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.023240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.024624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.025091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.029862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.029862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.029862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.141293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:16.141725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:16.142234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:16.142647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:16.143227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:16.211915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.219464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.220145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.220872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.221929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.222531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.224011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.256481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Calling method '.version_select at 0x7f419e46c280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.264180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.264688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.265130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.294389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.295505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.296164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.320203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:16.337370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.338255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.339048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.354602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.355605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.356261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.392433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.393234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.393786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.405614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:16.417656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-645f2adf-2f37-4e80-b747-026a72c5d36d tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.546436 Oct 17 13:16:16.420254 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 218/417] 10.222.0.65 () {60 vars in 1243 bytes} [Mon Oct 17 13:16:15 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:16.425573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.426612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.432788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.433310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.433744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.435367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.436131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.436740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.498658 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b634097-fff4-4ac0-b902-d52cda371fec tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e/action" status: 202 len: 1944 microversion: 2.75 time: 0.962855 Oct 17 13:16:16.499727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 200/418] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:16:15 2022] POST /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e/action => generated 1944 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:16:16.504207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Calling method '.version_select at 0x7f419e4ed820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.508187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.508663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.509255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.516224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:16.555264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.555988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.556701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.581713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.583323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.583997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.606274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.607118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.607972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.684548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:16.694068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.694602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.696298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.703913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-451d4616-9aae-4eda-bf92-a9d605cd81c6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.280277 Oct 17 13:16:16.704689 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 219/419] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:16.723937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.723937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:16.726611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=7,nova_api:INSERT=7,nova_api:DELETE=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:16.730721 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c97c502-ed11-4a9f-a95d-3782ba9063f5 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.227079 Oct 17 13:16:16.732292 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 201/420] 10.222.0.65 () {60 vars in 1222 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:16.739912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.747018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.747694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.748399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.748873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.748985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Calling method '.version_select at 0x7f419e5f95e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:16.751782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.760285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.760771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.761241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.829767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.830379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.831069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.839766 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3629d3b9-4a1a-4f89-871f-aef874812a49 tempest-HypervisorAdminV253TestBase-1373667654 tempest-HypervisorAdminV253TestBase-1373667654-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/2eff0b50-7fa7-4ff8-83b8-2c6fa5201237" status: 200 len: 794 microversion: 2.53 time: 0.097091 Oct 17 13:16:16.841469 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 202/421] 10.222.0.65 () {60 vars in 1298 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/os-hypervisors/2eff0b50-7fa7-4ff8-83b8-2c6fa5201237 => generated 794 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:16.889520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-85e3b24e-89f3-43be-8098-ef13501eeb17 req-f8d1c74a-3eb3-4ee9-82c7-7839c3ee9a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d120eef2-6bf8-44f4-a111-c0e68b321b94", "name": "network-vif-plugged", "status": "completed", "tag": "090e0642-a1ed-4e78-ab59-b6a2ba52a116"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:16.929448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-85e3b24e-89f3-43be-8098-ef13501eeb17 req-f8d1c74a-3eb3-4ee9-82c7-7839c3ee9a47 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:16.929955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-85e3b24e-89f3-43be-8098-ef13501eeb17 req-f8d1c74a-3eb3-4ee9-82c7-7839c3ee9a47 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:16.932894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-85e3b24e-89f3-43be-8098-ef13501eeb17 req-f8d1c74a-3eb3-4ee9-82c7-7839c3ee9a47 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:16.955509 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-85e3b24e-89f3-43be-8098-ef13501eeb17 req-f8d1c74a-3eb3-4ee9-82c7-7839c3ee9a47 service nova] Creating event network-vif-plugged:090e0642-a1ed-4e78-ab59-b6a2ba52a116 for instance d120eef2-6bf8-44f4-a111-c0e68b321b94 on n-h1-854121-14 Oct 17 13:16:16.965207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-85e3b24e-89f3-43be-8098-ef13501eeb17 req-f8d1c74a-3eb3-4ee9-82c7-7839c3ee9a47 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085121 Oct 17 13:16:16.965207 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 203/422] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:17.037223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:17.115079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-334aa052-704c-4e62-8e63-1601123f6ddd tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.408268 Oct 17 13:16:17.116151 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 220/423] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:16 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:17.733484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:17.734899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:17.743591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.744634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.745321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:17.746391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:17.747150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:17.748096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.012843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:18.025340 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a5b3162-75ab-45b9-bc4d-3f1d03f42e4c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1318 microversion: 2.1 time: 0.296781 Oct 17 13:16:18.027824 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 204/424] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:17 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:18.149233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:18.149233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:18.162220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:18.162729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:18.163174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.164036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:18.164492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:18.164924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:18.262527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:18.283536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc828bb7-5981-40d0-981e-022ff99f79af tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.140042 Oct 17 13:16:18.284193 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 221/425] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:18 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:19.055118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:19.056534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.063658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.064331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.064980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.065714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.066163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.067367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.217634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:19.227912 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-004dbd5d-cea6-4fc3-b586-384e57b0fe6d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1468 microversion: 2.1 time: 0.178382 Oct 17 13:16:19.228486 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 205/426] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:19 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1468 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:19.315427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:19.316247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.324701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.325556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.326080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.326763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.327366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.327938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.442755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:19.467591 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ead332a-886c-46d9-b299-dfbe36656ee9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.156911 Oct 17 13:16:19.478694 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 206/427] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:19 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:19.660792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1055518906", "block_migration": true, "disk_over_commit": false}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:19.664278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.671114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.671837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.672470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.673413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.674044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.674667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.795216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lazy-loading 'flavor' on Instance uuid d120eef2-6bf8-44f4-a111-c0e68b321b94 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:19.848547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Going to try to live migrate instance to tempest-host-1055518906 {{(pid=120698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:16:19.858659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] HTTP exception thrown: Compute host tempest-host-1055518906 could not be found. Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Request method failure captured: Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94/action HTTP/1.1 Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 107 Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWSYnowBFuNVcaWgGxPP3UaZncN1IdnezRwjNeSQARGFEcT9WmLG47dWklg7wgEbQzKZ6qLT7oPP_7Ou_AAB6F1uUTzbEA0EqfDiF4Woo1xRylcIWynAK1GhB7I9d9Xvs7r4U74K9HhWvjd8O2h5kAjFeBvF20SyEsufE_XQPubC8g Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: db2fdf9c6ddb4b94892d3776b2053d72 Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-LiveMigrationNegativeTest-656286844 Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:19.872228 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-LiveMigrationNegativeTest-656286844 Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: db2fdf9c6ddb4b94892d3776b2053d72 Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-656286844 Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-LiveMigrationNegativeTest-656286844-project-admin Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 08cec2ee75464b53bb9b2bcbededb64f Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-LiveMigrationNegativeTest-656286844-project-admin Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: {"os-migrateLive": {"host": "tempest-host-1055518906", "block_migration": true, "disk_over_commit": false}} Oct 17 13:16:19.873856 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: exception: Compute host tempest-host-1055518906 could not be found. Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'd120eef2-6bf8-44f4-a111-c0e68b321b94', 'body': {'os-migrateLive': {'host': 'tempest-host-1055518906', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:19.875094 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1055518906 could not be found. Oct 17 13:16:19.876494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1055518906 could not be found. Oct 17 13:16:19.878011 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1055518906 could not be found. Oct 17 13:16:19.879623 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:19.881274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Returning 400 to user: Compute host tempest-host-1055518906 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:19.882495 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55f8e695-9856-4058-8e3f-8f9232da1279 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94/action" status: 400 len: 100 microversion: 2.1 time: 0.634183 Oct 17 13:16:19.883679 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 222/428] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Oct 17 13:16:19 2022] POST /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94/action => generated 100 bytes in 636 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:19.892396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:19.893285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:19.902772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=14 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:19.905522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.906212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.906803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:19.907693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:19.908307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:19.908874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.064894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:20.079186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-917f3f7b-bbf9-4abc-bad1-b18ef9304606 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1468 microversion: 2.1 time: 0.190895 Oct 17 13:16:20.080829 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 207/429] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:19 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1468 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:20.475699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2115774981", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:20.499709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:20.501114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:20.509249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.510158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.511443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.513234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.513913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.514705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.552609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:20.622765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:20.655383 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6e2da41-59f0-4d95-84dc-7edad555504d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.160716 Oct 17 13:16:20.661370 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 208/430] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:20 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:20.859830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:20.860407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:20.861451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:20.862006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:20.862551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:20.869773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=56,nova_cell0:UPDATE=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:20.876924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.877363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.877985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.878910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:20.880208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:20.880906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:20.908860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Getting quotas for project 401070ff300848dbb15e6bb09d4e194b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:20.913834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Getting quotas for user 456395d8405a409c997dff3c903b1174 and project 401070ff300848dbb15e6bb09d4e194b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:20.928192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:16:20.930525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:16:20.983648 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd7f1ef9-954b-49d8-9571-8257c233434d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.513264 Oct 17 13:16:20.989604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 223/431] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:16:20.998419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9787037-9dca-4337-b565-122c074b834c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:20.999563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9787037-9dca-4337-b565-122c074b834c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:21.086554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9787037-9dca-4337-b565-122c074b834c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:21.106974 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9787037-9dca-4337-b565-122c074b834c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1219 microversion: 2.1 time: 0.114077 Oct 17 13:16:21.107642 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 209/432] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:20 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:21.465678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c506a093-5f49-4250-9ec4-742c60c8e8d5 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Calling method '.version_select at 0x7f419e3ef280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:21.695110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:21.696323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:21.707136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:21.707819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:21.708260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:21.709654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:21.711023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:21.711023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:21.807237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:21.831206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17179845-419f-43a5-8e72-f8bca8f76d3d tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.150586 Oct 17 13:16:21.832070 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 210/433] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:21 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:22.101634 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c506a093-5f49-4250-9ec4-742c60c8e8d5 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 371 microversion: 2.1 time: 1.029160 Oct 17 13:16:22.104378 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 224/434] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:16:21 2022] GET /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 371 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:22.276528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-267f66fd-86f9-421e-9b35-b05f814ada34 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Calling method '.version_select at 0x7f419e5f9820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.278989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-267f66fd-86f9-421e-9b35-b05f814ada34 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '7145c6926f4f4b2e89f8dccfad286b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9ff4ef79574c118e0f0ddcd59c8094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-267f66fd-86f9-421e-9b35-b05f814ada34 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Request method failure captured: Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWjd79zzOQhZbRLjL4V10OHQoAW9lrVesyrrQiIBPfeVkquLAXtbMxvwAGmzIznQYn20s0vaFgbK3EVWc3dwvGKzR4RPtJXh3f0oqImzz3Ioq0uf8LYDdkpnK_BCexwRjb8AGI_yovzLWxkoOAUwLyZTF_l4D3oaEAmTNf1K0fcL5c Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:22.280593 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 7145c6926f4f4b2e89f8dccfad286b91 Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:16:22.282177 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:22.283106 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 17 13:16:22.284509 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.287553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-267f66fd-86f9-421e-9b35-b05f814ada34 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:22.291136 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-267f66fd-86f9-421e-9b35-b05f814ada34 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.454952 Oct 17 13:16:22.292331 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 211/435] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Oct 17 13:16:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 456 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:22.302259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Action: 'update', calling method: .version_select at 0x7f419e4ed1f0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:22.343015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1895f096-f817-4be7-9959-407e0158ac03 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-553882369", "id": 945913180, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:22.380626 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1895f096-f817-4be7-9959-407e0158ac03 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.275168 Oct 17 13:16:22.381854 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 225/436] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:16:22 2022] POST /compute/v2.1/flavors => generated 464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:22.389315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.390555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.398268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.398826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.399358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.400118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.400633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.401118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.430150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.431229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.432759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.433624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.434306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.434978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.492858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:22.507524 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07cc7c8d-e71d-432b-a83a-a02b53470e8d tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1277 microversion: 2.1 time: 0.124228 Oct 17 13:16:22.518526 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 226/437] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:22.534096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9226d9cb-e238-4a2f-8cfc-e18d71c2691a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 328 microversion: 2.1 time: 0.239514 Oct 17 13:16:22.536944 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 212/438] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:22 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:22.543339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-085ca349-7259-4672-b586-d257436c80d9 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Calling method '.version_select at 0x7f419e5d53a0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.546130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-085ca349-7259-4672-b586-d257436c80d9 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '7145c6926f4f4b2e89f8dccfad286b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9ff4ef79574c118e0f0ddcd59c8094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-085ca349-7259-4672-b586-d257436c80d9 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Request method failure captured: Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWjd79zzOQhZbRLjL4V10OHQoAW9lrVesyrrQiIBPfeVkquLAXtbMxvwAGmzIznQYn20s0vaFgbK3EVWc3dwvGKzR4RPtJXh3f0oqImzz3Ioq0uf8LYDdkpnK_BCexwRjb8AGI_yovzLWxkoOAUwLyZTF_l4D3oaEAmTNf1K0fcL5c Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:22.548129 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 7145c6926f4f4b2e89f8dccfad286b91 Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:16:22.549415 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:22.550224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 17 13:16:22.551756 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.554543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-085ca349-7259-4672-b586-d257436c80d9 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:22.556127 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-085ca349-7259-4672-b586-d257436c80d9 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.017544 Oct 17 13:16:22.557547 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 213/439] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:22.763839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e4954c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.766415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.766533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f6f0c2e-f9f4-4cb1-8531-d1387b0e7e06 tempest-FlavorsV261TestJSON-811236339 tempest-FlavorsV261TestJSON-811236339-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.768283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.768975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.783957 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f6f0c2e-f9f4-4cb1-8531-d1387b0e7e06 tempest-FlavorsV261TestJSON-811236339 tempest-FlavorsV261TestJSON-811236339-project] 10.222.0.65 "GET /compute/v2.1/flavors/945913180" status: 200 len: 464 microversion: 2.61 time: 0.225010 Oct 17 13:16:22.791093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.792590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.794164 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 214/440] 10.222.0.65 () {60 vars in 1196 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/flavors/945913180 => generated 464 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:22.794836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.799218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ed2b653-ad99-4bc7-a107-9e17c30c0ec1 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Calling method '.version_select at 0x7f419e40da60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.801776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ed2b653-ad99-4bc7-a107-9e17c30c0ec1 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '7145c6926f4f4b2e89f8dccfad286b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9ff4ef79574c118e0f0ddcd59c8094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ed2b653-ad99-4bc7-a107-9e17c30c0ec1 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Request method failure captured: Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWjd79zzOQhZbRLjL4V10OHQoAW9lrVesyrrQiIBPfeVkquLAXtbMxvwAGmzIznQYn20s0vaFgbK3EVWc3dwvGKzR4RPtJXh3f0oqImzz3Ioq0uf8LYDdkpnK_BCexwRjb8AGI_yovzLWxkoOAUwLyZTF_l4D3oaEAmTNf1K0fcL5c Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:22.803756 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 7145c6926f4f4b2e89f8dccfad286b91 Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:16:22.804979 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:22.809686 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 17 13:16:22.811122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:22.812261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ed2b653-ad99-4bc7-a107-9e17c30c0ec1 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:22.812261 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ed2b653-ad99-4bc7-a107-9e17c30c0ec1 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009819 Oct 17 13:16:22.812261 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 215/441] 10.222.0.65 () {58 vars in 1179 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:22.815232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebaffa5c-d1f4-40c3-8160-ae68adea0846 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] Action: 'update', calling method: .version_select at 0x7f419fbf8b80>, body: {"flavor": {"description": "new"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:22.823588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.825563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.826187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.839829 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94b315c0-e4e1-46fb-ba22-426b9ca68559 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.306928 Oct 17 13:16:22.841043 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 227/442] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:22.872497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebaffa5c-d1f4-40c3-8160-ae68adea0846 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] 10.222.0.65 "PUT /compute/v2.1/flavors/945913180" status: 200 len: 465 microversion: 2.61 time: 0.065122 Oct 17 13:16:22.873115 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 216/443] 10.222.0.65 () {62 vars in 1216 bytes} [Mon Oct 17 13:16:22 2022] PUT /compute/v2.1/flavors/945913180 => generated 465 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:22.881010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e5f9310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.882943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.883423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.883860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.899473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.899979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.900395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.911278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.911758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.912665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.919376 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b1ab89a5-94a4-4667-a4b2-ad61f4087547 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.043412 Oct 17 13:16:22.925190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 217/444] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:22.930165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:22.931057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:22.938054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.938822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.939490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:22.940397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:22.941046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:22.942273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.026100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:23.049289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a330c35-df15-4abe-bef5-bd2ffde86604 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.127656 Oct 17 13:16:23.062831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 218/445] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:23.172409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Calling method '.version_select at 0x7f419e4959d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.174265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.174933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.175592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.193088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.193920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.194539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.207470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.208455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.209079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.219132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8395bb5a-e048-4c82-b081-84fe3d9137cc tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.376630 Oct 17 13:16:23.226698 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 228/446] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:23.232038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64182a70-f2de-4aef-88f8-c618b685cf91 tempest-FlavorsV261TestJSON-811236339 tempest-FlavorsV261TestJSON-811236339-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.263974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64182a70-f2de-4aef-88f8-c618b685cf91 tempest-FlavorsV261TestJSON-811236339 tempest-FlavorsV261TestJSON-811236339-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 7153 microversion: 2.61 time: 0.035337 Oct 17 13:16:23.265129 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 229/447] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/flavors/detail => generated 7153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:23.279149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e3efaf0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.283248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.285263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.287035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.295170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1072184055", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:23.303397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.304128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.304674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.316217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.317560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.318096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.324938 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-393f881b-e432-45f9-86b9-02fca3b10d5e tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.058362 Oct 17 13:16:23.325566 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 230/448] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:23.359943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:23.395811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62cf1924-439b-495c-b2e4-0b3a4f2f2bef tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.398196 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-62cf1924-439b-495c-b2e4-0b3a4f2f2bef tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62cf1924-439b-495c-b2e4-0b3a4f2f2bef tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin] Request method failure captured: Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWmitaedrFUGvU2OBo7RLFWaoBjDyUof8bTug6Qiyq64Wz2fS_Lcjc7_4ow0J8adEysQluFZQLn-tU_1TgzNXqiSdwaab_dn_vlClf5gjGVBH-K0NM7hme_P5yBIYQORZhVz5TsGVVogpHedliNDR0Pa7S0MxjMSja_JqJaiSKC1lY Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9913cb64d6b54b8796681d76c9e16f2a Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:23.415484 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9913cb64d6b54b8796681d76c9e16f2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9913cb64d6b54b8796681d76c9e16f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9913cb64d6b54b8796681d76c9e16f2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9913cb64d6b54b8796681d76c9e16f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9913cb64d6b54b8796681d76c9e16f2a Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 04a12b34af6a4605ba3aceb3e396f8db Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:23.416838 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid timestamp for date invalid_time Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'invalid_time'} Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:23.417540 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62cf1924-439b-495c-b2e4-0b3a4f2f2bef tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:23.418686 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62cf1924-439b-495c-b2e4-0b3a4f2f2bef tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195 tempest-InstanceUsageAuditLogNegativeTestJSON-2023060195-project-admin] 10.222.0.65 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.090553 Oct 17 13:16:23.422704 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 231/449] 10.222.0.65 () {58 vars in 1224 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:16:23.430623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac94e1d7-f322-4323-9de4-8e01fdc50873 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Calling method '.version_select at 0x7f419e4c7700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.432860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac94e1d7-f322-4323-9de4-8e01fdc50873 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '7145c6926f4f4b2e89f8dccfad286b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9ff4ef79574c118e0f0ddcd59c8094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac94e1d7-f322-4323-9de4-8e01fdc50873 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Request method failure captured: Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWjd79zzOQhZbRLjL4V10OHQoAW9lrVesyrrQiIBPfeVkquLAXtbMxvwAGmzIznQYn20s0vaFgbK3EVWc3dwvGKzR4RPtJXh3f0oqImzz3Ioq0uf8LYDdkpnK_BCexwRjb8AGI_yovzLWxkoOAUwLyZTF_l4D3oaEAmTNf1K0fcL5c Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:23.434949 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 7145c6926f4f4b2e89f8dccfad286b91 Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '1'} Oct 17 13:16:23.436186 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:23.437017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 17 13:16:23.438109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.441103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac94e1d7-f322-4323-9de4-8e01fdc50873 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:23.441103 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac94e1d7-f322-4323-9de4-8e01fdc50873 tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012547 Oct 17 13:16:23.441103 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 232/450] 10.222.0.65 () {58 vars in 1173 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:23.448183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d20d478-738f-4e57-8781-faae7668b0e4 tempest-FlavorsV261TestJSON-811236339 tempest-FlavorsV261TestJSON-811236339-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.470674 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d20d478-738f-4e57-8781-faae7668b0e4 tempest-FlavorsV261TestJSON-811236339 tempest-FlavorsV261TestJSON-811236339-project] 10.222.0.65 "GET /compute/v2.1/flavors" status: 200 len: 3680 microversion: 2.61 time: 0.030624 Oct 17 13:16:23.477875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 233/451] 10.222.0.65 () {60 vars in 1166 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/flavors => generated 3680 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:23.477875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e495790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.478374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.478829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.479273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.499112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.499712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.500219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.507575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c15df67-60f5-42e8-94c3-02eb67a4ad76 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.035277 Oct 17 13:16:23.508273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 234/452] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:23.595781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:23.596210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:23.597431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:23.598734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:23.599181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:23.609195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.609631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.610092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.610822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.611275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.611697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.632523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4223e62b-c26b-42bb-95f9-b7e4c03e8e6b tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.634328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4223e62b-c26b-42bb-95f9-b7e4c03e8e6b tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'dd6374560dc74b82ae5258fc29522375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b30f13517d4597987de935d3feeb41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4223e62b-c26b-42bb-95f9-b7e4c03e8e6b tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Request method failure captured: Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWlIuXns6poDJx_NG0R-EUpVQZEfVv74zqfAPz_qrwBgqYrwxMompigvxlnWUwxlzj2GXtDSlbYrQJcvDVQglHvnh-WVtvmdZ99DhWTCaFmonu4lAb0hvx3KlQ0flXuiRUvAICrETERJEw_6qayPeNwM5aeKVxeYIRwkHrIJhh_orw Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 72b30f13517d4597987de935d3feeb41 Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:23.635864 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72b30f13517d4597987de935d3feeb41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72b30f13517d4597987de935d3feeb41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72b30f13517d4597987de935d3feeb41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72b30f13517d4597987de935d3feeb41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 72b30f13517d4597987de935d3feeb41 Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: dd6374560dc74b82ae5258fc29522375 Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project Oct 17 13:16:23.637223 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: action_args: {} Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:23.637827 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 17 13:16:23.638932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.644401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4223e62b-c26b-42bb-95f9-b7e4c03e8e6b tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:23.644401 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4223e62b-c26b-42bb-95f9-b7e4c03e8e6b tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] 10.222.0.65 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.129545 Oct 17 13:16:23.644401 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 235/453] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 131 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:23.644401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94aa1e42-0ad5-4729-91ff-c41b342fc1f7 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Calling method '.version_select at 0x7f419e4c7820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.646152 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-94aa1e42-0ad5-4729-91ff-c41b342fc1f7 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] HTTP exception thrown: Hypervisor with ID 'b775e5d6-71f1-464c-b6a4-b2c00bc45259' could not be found. Oct 17 13:16:23.650263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Getting quotas for project 6bf29e8087ec475781875815d081ef4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:23.654926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Getting quotas for user 1410547fc3034365b499b08a5b569d41 and project 6bf29e8087ec475781875815d081ef4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94aa1e42-0ad5-4729-91ff-c41b342fc1f7 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Request method failure captured: Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hypervisors/b775e5d6-71f1-464c-b6a4-b2c00bc45259/uptime HTTP/1.1 Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWl-1w7B8Hd5pI-gMnpdrk3t-vreWmgIadQY5ZLt8y2lEauf2lMj5C8Lx2EHHPvo2T-b3zJbraWTiWbtSWoYYeDzq941lFkV9XZaqn1f3592iv4bog5c3QmhGqPU9QoDfCWmObZmHl-ZICcU5zxTa52e2IjVinUVpXmvIVRiyL8YDw Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: bb2a3dcae2c14a99aa3c522aa4f7fd7e Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-489075274 Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:16:23.657387 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-489075274 Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: bb2a3dcae2c14a99aa3c522aa4f7fd7e Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-489075274 Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f7be00f26a38440e9103fe95c204f22c Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: exception: Hypervisor with ID 'b775e5d6-71f1-464c-b6a4-b2c00bc45259' could not be found. Oct 17 13:16:23.658649 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'b775e5d6-71f1-464c-b6a4-b2c00bc45259'} Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'b775e5d6-71f1-464c-b6a4-b2c00bc45259' Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 13:16:23.659410 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'b775e5d6-71f1-464c-b6a4-b2c00bc45259' could not be found. Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.661508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'b775e5d6-71f1-464c-b6a4-b2c00bc45259' could not be found. Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94aa1e42-0ad5-4729-91ff-c41b342fc1f7 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Returning 404 to user: Hypervisor with ID 'b775e5d6-71f1-464c-b6a4-b2c00bc45259' could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94aa1e42-0ad5-4729-91ff-c41b342fc1f7 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/b775e5d6-71f1-464c-b6a4-b2c00bc45259/uptime" status: 404 len: 123 microversion: 2.1 time: 0.018412 Oct 17 13:16:23.662678 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 236/454] 10.222.0.65 () {58 vars in 1278 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors/b775e5d6-71f1-464c-b6a4-b2c00bc45259/uptime => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:23.668318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.utils [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] cores quota exceeded for 6bf29e8087ec475781875815d081ef4b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120697) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 13:16:23.669330 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:16:23.671209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-daf5caca-d785-4c5e-a546-5a9815656295 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Request method failure captured: Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 145 Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWjTWsNciiDgtAi8xoP4jQeLg_25OQrP7yroBPmon_brDf3kMQojpe6n90ek1gjlAIAnar6Oj352ncg8SuswG0f47k2Db_pQOf_2r8cUcpTrrBkhdHicH9T94dCZJrrNG5Y5Zsl1NMTj039DbJpneZoRz_oTOiqowi2ZIPxJ7yymyc Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:23.673096 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6bf29e8087ec475781875815d081ef4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 1410547fc3034365b499b08a5b569d41 Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1072184055", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} Oct 17 13:16:23.676859 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1072184055', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452'}}} Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:16:23.679606 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.682067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.686428 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1487b467-f652-4a6f-a9fe-df5df8090930 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.610527 Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 219/455] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:23 2022] POST /compute/v2.1/servers => generated 111 bytes in 612 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:23.689524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45cff165-b873-435a-8649-faeff386bfb1 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e3c93a0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.690780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45cff165-b873-435a-8649-faeff386bfb1 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.690780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45cff165-b873-435a-8649-faeff386bfb1 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.690780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45cff165-b873-435a-8649-faeff386bfb1 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.694352 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-daf5caca-d785-4c5e-a546-5a9815656295 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/945913180" status: 202 len: 0 microversion: 2.61 time: 0.027288 Oct 17 13:16:23.695523 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 237/456] 10.222.0.65 () {60 vars in 1199 bytes} [Mon Oct 17 13:16:23 2022] DELETE /compute/v2.1/flavors/945913180 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:16:23.700306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.701005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:23.704418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45cff165-b873-435a-8649-faeff386bfb1 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.026975 Oct 17 13:16:23.705238 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 220/457] 10.222.0.65 () {58 vars in 1179 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:23.707915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.708648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.709239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.710011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.710470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.710891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.717865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e8ffba0-4e52-42cc-b66e-50c3d201494c tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.719616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e8ffba0-4e52-42cc-b66e-50c3d201494c tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'dd6374560dc74b82ae5258fc29522375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72b30f13517d4597987de935d3feeb41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e8ffba0-4e52-42cc-b66e-50c3d201494c tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Request method failure captured: Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2013:16:23 HTTP/1.1 Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWlIuXns6poDJx_NG0R-EUpVQZEfVv74zqfAPz_qrwBgqYrwxMompigvxlnWUwxlzj2GXtDSlbYrQJcvDVQglHvnh-WVtvmdZ99DhWTCaFmonu4lAb0hvx3KlQ0flXuiRUvAICrETERJEw_6qayPeNwM5aeKVxeYIRwkHrIJhh_orw Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 72b30f13517d4597987de935d3feeb41 Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:23.721730 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72b30f13517d4597987de935d3feeb41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72b30f13517d4597987de935d3feeb41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72b30f13517d4597987de935d3feeb41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72b30f13517d4597987de935d3feeb41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 72b30f13517d4597987de935d3feeb41 Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dd6374560dc74b82ae5258fc29522375 Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project Oct 17 13:16:23.723549 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2022-10-17 13:16:23'} Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:23.724165 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 17 13:16:23.726497 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:23.730240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e8ffba0-4e52-42cc-b66e-50c3d201494c tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:23.730240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e8ffba0-4e52-42cc-b66e-50c3d201494c tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335 tempest-InstanceUsageAuditLogNegativeTestJSON-1636262335-project] 10.222.0.65 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 13:16:23" status: 403 len: 128 microversion: 2.1 time: 0.011806 Oct 17 13:16:23.730240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 221/458] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2013%3A16%3A23 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:23.735764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Calling method '.version_select at 0x7f419e5f9790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.737900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.738931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.739384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.757368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.758262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.758764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.771416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.771983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.772709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.779966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52c15586-a559-4dfe-a254-8b958be14c92 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.054379 Oct 17 13:16:23.780948 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 222/459] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:23.786488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Action: 'update', calling method: .version_select at 0x7f419e3c9940>, body: {"quota_set": {"cores": 20}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:23.881674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:23.890793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02b387e4-9dbb-4254-9920-795a5bc8b526 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.194186 Oct 17 13:16:23.891384 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 238/460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:23.905359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b57e482-71c9-4da1-bb56-9b0fad162698 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.936054 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b57e482-71c9-4da1-bb56-9b0fad162698 tempest-FlavorsV261TestJSON-852817642 tempest-FlavorsV261TestJSON-852817642-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 6698 microversion: 2.61 time: 0.039744 Oct 17 13:16:23.950468 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 239/461] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/flavors/detail => generated 6698 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:23.964609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.965424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.966041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e3efca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:23.966443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.967396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.968217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.968907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.970215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.970819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.971158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:23.990485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:23.991101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:23.991429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.005366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.006870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.007464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.020666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed863487-cc98-4cb6-961d-f138f83eef7d tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.062854 Oct 17 13:16:24.021406 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 240/462] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:16:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.030068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e7d2e75-bf38-4eed-a5a1-7b6c625d6fce tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Calling method '.version_select at 0x7f419e4950d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.032249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e7d2e75-bf38-4eed-a5a1-7b6c625d6fce tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '7145c6926f4f4b2e89f8dccfad286b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f9ff4ef79574c118e0f0ddcd59c8094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:24.032503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e7d2e75-bf38-4eed-a5a1-7b6c625d6fce tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Request method failure captured: Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWjd79zzOQhZbRLjL4V10OHQoAW9lrVesyrrQiIBPfeVkquLAXtbMxvwAGmzIznQYn20s0vaFgbK3EVWc3dwvGKzR4RPtJXh3f0oqImzz3Ioq0uf8LYDdkpnK_BCexwRjb8AGI_yovzLWxkoOAUwLyZTF_l4D3oaEAmTNf1K0fcL5c Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:24.036349 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f9ff4ef79574c118e0f0ddcd59c8094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2f9ff4ef79574c118e0f0ddcd59c8094 Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583 Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 7145c6926f4f4b2e89f8dccfad286b91 Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1515330583-project Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '1'} Oct 17 13:16:24.038186 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:24.039034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 17 13:16:24.040114 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.041971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e7d2e75-bf38-4eed-a5a1-7b6c625d6fce tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:24.041971 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e7d2e75-bf38-4eed-a5a1-7b6c625d6fce tempest-HypervisorAdminNegativeTestJSON-1515330583 tempest-HypervisorAdminNegativeTestJSON-1515330583-project] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.016376 Oct 17 13:16:24.043122 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 241/463] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:24.049846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e2e2dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.052629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.053143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.053678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.072371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.072955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.073703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.080352 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db3c64ce-5662-4898-9038-6cbe42956337 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 329 microversion: 2.1 time: 0.297780 Oct 17 13:16:24.081853 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 223/464] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:23 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 329 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.083603 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5cea90c6-b8cd-4938-9a37-218b48cd8a29 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.039267 Oct 17 13:16:24.090582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 242/465] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.094920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.095706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:24.100264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9c16c0a-a13a-484b-8f2b-701997b9f3d8 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Calling method '.version_select at 0x7f419e3c9790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.102422 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c9c16c0a-a13a-484b-8f2b-701997b9f3d8 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] HTTP exception thrown: Hypervisor with ID 'd70d0569-d01f-4eb2-b444-40cf86798036' could not be found. Oct 17 13:16:24.103546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.104139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.105213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.106678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.107311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9c16c0a-a13a-484b-8f2b-701997b9f3d8 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Request method failure captured: Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-hypervisors/d70d0569-d01f-4eb2-b444-40cf86798036 HTTP/1.1 Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWl-1w7B8Hd5pI-gMnpdrk3t-vreWmgIadQY5ZLt8y2lEauf2lMj5C8Lx2EHHPvo2T-b3zJbraWTiWbtSWoYYeDzq941lFkV9XZaqn1f3592iv4bog5c3QmhGqPU9QoDfCWmObZmHl-ZICcU5zxTa52e2IjVinUVpXmvIVRiyL8YDw Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: bb2a3dcae2c14a99aa3c522aa4f7fd7e Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-489075274 Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:24.107644 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bb2a3dcae2c14a99aa3c522aa4f7fd7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-489075274 Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: bb2a3dcae2c14a99aa3c522aa4f7fd7e Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-489075274 Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f7be00f26a38440e9103fe95c204f22c Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: exception: Hypervisor with ID 'd70d0569-d01f-4eb2-b444-40cf86798036' could not be found. Oct 17 13:16:24.108817 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd70d0569-d01f-4eb2-b444-40cf86798036'} Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd70d0569-d01f-4eb2-b444-40cf86798036' Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 17 13:16:24.109524 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:16:24.110735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd70d0569-d01f-4eb2-b444-40cf86798036' could not be found. Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd70d0569-d01f-4eb2-b444-40cf86798036' could not be found. Oct 17 13:16:24.111800 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:24.112354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.113877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9c16c0a-a13a-484b-8f2b-701997b9f3d8 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] Returning 404 to user: Hypervisor with ID 'd70d0569-d01f-4eb2-b444-40cf86798036' could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:24.116817 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9c16c0a-a13a-484b-8f2b-701997b9f3d8 tempest-HypervisorAdminNegativeTestJSON-489075274 tempest-HypervisorAdminNegativeTestJSON-489075274-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/d70d0569-d01f-4eb2-b444-40cf86798036" status: 404 len: 123 microversion: 2.1 time: 0.031301 Oct 17 13:16:24.119079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 224/466] 10.222.0.65 () {58 vars in 1257 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/os-hypervisors/d70d0569-d01f-4eb2-b444-40cf86798036 => generated 123 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:24.124753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59edcb29-241f-45a6-b274-ac75054ad5b9 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Calling method '.version_select at 0x7f419e3c93a0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.216261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:24.275221 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9962b86d-f955-479f-ac01-32e1736c7d4e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.188943 Oct 17 13:16:24.279939 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 243/467] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:24.289993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e2e2a60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.294174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.295113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.296116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.324108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.324603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.325044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.350659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3df8aedf-f08a-4f15-9d4a-0664fc8435b5 tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.068985 Oct 17 13:16:24.351275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 244/468] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.356343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b91ba4ab-8a66-4f43-a3f2-c9087cc6502e req-0a59400f-2657-4a72-9df6-88cb95a55f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c36ccad-9600-4841-8a26-59c3602c28e7", "tag": "c116354c-79dd-4be3-8a80-9b5d05e14a71"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:24.370194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b91ba4ab-8a66-4f43-a3f2-c9087cc6502e req-0a59400f-2657-4a72-9df6-88cb95a55f3e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.370825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b91ba4ab-8a66-4f43-a3f2-c9087cc6502e req-0a59400f-2657-4a72-9df6-88cb95a55f3e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.371267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b91ba4ab-8a66-4f43-a3f2-c9087cc6502e req-0a59400f-2657-4a72-9df6-88cb95a55f3e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.384777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b91ba4ab-8a66-4f43-a3f2-c9087cc6502e req-0a59400f-2657-4a72-9df6-88cb95a55f3e service nova] Creating event network-changed:c116354c-79dd-4be3-8a80-9b5d05e14a71 for instance 7c36ccad-9600-4841-8a26-59c3602c28e7 on n-h1-854121-14 Oct 17 13:16:24.392651 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b91ba4ab-8a66-4f43-a3f2-c9087cc6502e req-0a59400f-2657-4a72-9df6-88cb95a55f3e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038978 Oct 17 13:16:24.393292 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 245/469] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.399023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Calling method '.version_select at 0x7f419e53cee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.400864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.401372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.401813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.405008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:24.420640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.421144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.421604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.435033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.435806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.436083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.467339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ac4a7d8-c923-4829-9b01-5167236859cd tempest-HypervisorAdminTestJSON-1317637187 tempest-HypervisorAdminTestJSON-1317637187-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.072101 Oct 17 13:16:24.468929 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 246/470] 10.222.0.65 () {58 vars in 1173 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.640972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59edcb29-241f-45a6-b274-ac75054ad5b9 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 371 microversion: 2.1 time: 0.520594 Oct 17 13:16:24.641592 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 225/471] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 371 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:24.655147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Action: 'update', calling method: .version_select at 0x7f419e235160>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:24.796507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.797506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.798167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.799516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.800420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.801122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.905794 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89a2c620-6918-430b-9155-441f213e3c91 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 328 microversion: 2.1 time: 0.255375 Oct 17 13:16:24.907056 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 247/472] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:24 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 328 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:24.925826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:24.927302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:24.934181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.934984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.935662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:24.936872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:24.937579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:24.938240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.071085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-21413841", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:25.165181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:25.236488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:25.245146 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c00750ed-6673-4161-b47a-ae64c0794e22 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.323814 Oct 17 13:16:25.245944 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 226/473] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:24 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:25.307987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:25.308692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:25.317257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.318209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.318790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.320019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.320680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.321206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.576695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:25.586569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:25.626078 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d617137-6320-467b-88f6-dbc4f2cbc3c6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.322199 Oct 17 13:16:25.627224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 227/474] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:25 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:25.755151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:25.755853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:25.756093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:25.756942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:25.757552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:25.762307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:25.774237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.775881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.776639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.777846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:25.778515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:25.783961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:25.793929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=13 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:25.811090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Getting quotas for project 6bf29e8087ec475781875815d081ef4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:25.818088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Getting quotas for user 1410547fc3034365b499b08a5b569d41 and project 6bf29e8087ec475781875815d081ef4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:25.835328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.utils [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] instances quota exceeded for 6bf29e8087ec475781875815d081ef4b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120698) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 13:16:25.837500 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Request method failure captured: Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 143 Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWjTWsNciiDgtAi8xoP4jQeLg_25OQrP7yroBPmon_brDf3kMQojpe6n90ek1gjlAIAnar6Oj352ncg8SuswG0f47k2Db_pQOf_2r8cUcpTrrBkhdHicH9T94dCZJrrNG5Y5Zsl1NMTj039DbJpneZoRz_oTOiqowi2ZIPxJ7yymyc Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:25.841691 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6bf29e8087ec475781875815d081ef4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1410547fc3034365b499b08a5b569d41 Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-21413841", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} Oct 17 13:16:25.843250 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-21413841', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452'}}} Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:16:25.844100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:25.845359 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.846917 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:25.848389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:25.848389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:25.848389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:25.848389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:25.848389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 17 13:16:25.848389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:25.851690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:25.853419 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91548e83-de1a-4436-b64d-e5cd0fb23b1e tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.792941 Oct 17 13:16:25.854369 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 248/475] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:25 2022] POST /compute/v2.1/servers => generated 119 bytes in 795 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:25.864106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Action: 'update', calling method: .version_select at 0x7f419e6384c0>, body: {"quota_set": {"instances": 10}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:26.274827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:26.275889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:26.293960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.294953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.295228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.300727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.303292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.305092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.569407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:26.577813 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37e4362c-5c3b-4de4-a798-cad186d178e3 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.309784 Oct 17 13:16:26.579238 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 249/476] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:26 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:26.664237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:26.665222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:26.674121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.674889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.676402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.677471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.678435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.679073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.773360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.774210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.775409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.776238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:26.777148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:26.778453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:26.959857 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3df90775-9cfa-48fa-86b9-b5cbf4b9f72a tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 329 microversion: 2.1 time: 1.099183 Oct 17 13:16:26.962273 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 228/477] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:25 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 329 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:27.000505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-277f935a-3f61-44ee-a2ba-52a390bd2bd8 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Calling method '.version_select at 0x7f419e3edca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:27.031890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:27.100458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7aa49394-d4a9-43d5-bf1d-bab0f700cbad tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.441483 Oct 17 13:16:27.102648 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 250/478] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:26 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:27.577303 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-277f935a-3f61-44ee-a2ba-52a390bd2bd8 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 371 microversion: 2.1 time: 0.595297 Oct 17 13:16:27.578138 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 229/479] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:16:26 2022] GET /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:27.590772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Action: 'update', calling method: .version_select at 0x7f419e2254c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:27.604278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:27.605775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:27.615110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.615621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.616035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.616744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.617305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.617639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.809012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:27.819804 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fc16db3-c07c-40f0-81f2-84e01d1c1a55 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.219813 Oct 17 13:16:27.820603 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 230/480] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:27 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:27.976964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.977875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.978876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:27.979930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:27.980982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:27.981876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.039874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-239ca2ff-6464-4810-8bb6-2e3199767371 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 325 microversion: 2.1 time: 0.453174 Oct 17 13:16:28.045188 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 251/481] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:27 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 325 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:28.130967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:28.132399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.138898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.139442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.139991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.140909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.141424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.141874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.235507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:28.250776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1356816464", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:28.260215 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a654ab3-2d5c-43cc-a7fb-604da9b9d45b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.133839 Oct 17 13:16:28.261991 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 231/482] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:28 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:28.316086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:28.559827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:16:28.561078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:16:28.562212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:16:28.562904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:16:28.563602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:16:28.580477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.582060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.582816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.584996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.586098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.587103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.625022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Getting quotas for project 6bf29e8087ec475781875815d081ef4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:16:28.634157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Getting quotas for user 1410547fc3034365b499b08a5b569d41 and project 6bf29e8087ec475781875815d081ef4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:16:28.658072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.utils [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] ram quota exceeded for 6bf29e8087ec475781875815d081ef4b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120698) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 17 13:16:28.658966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Request method failure captured: Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 145 Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWjTWsNciiDgtAi8xoP4jQeLg_25OQrP7yroBPmon_brDf3kMQojpe6n90ek1gjlAIAnar6Oj352ncg8SuswG0f47k2Db_pQOf_2r8cUcpTrrBkhdHicH9T94dCZJrrNG5Y5Zsl1NMTj039DbJpneZoRz_oTOiqowi2ZIPxJ7yymyc Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:28.663889 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6bf29e8087ec475781875815d081ef4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1410547fc3034365b499b08a5b569d41 Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1356816464", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} Oct 17 13:16:28.666083 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1356816464', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452'}}} Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 13:16:28.667412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.671341 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.674103 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:28.680078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:28.682178 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-695e29c9-410d-4ee4-82f6-717da6ff6aed tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.436469 Oct 17 13:16:28.683485 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 252/483] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:16:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 442 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:28.692892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Action: 'update', calling method: .version_select at 0x7f419e3ed700>, body: {"quota_set": {"ram": 51200}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:28.845365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:28.845978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:28.855418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.856076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.856630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:28.857712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:28.858242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:28.858793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.040268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:29.051590 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7bd981e-eed6-4f28-9585-7682c3bb7854 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.211311 Oct 17 13:16:29.052802 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 253/484] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:28 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:29.292918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:29.295642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:29.307112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:29.307849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:29.308495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.309756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:29.311002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:29.311878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.320520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:29.321091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:29.321526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.322619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:29.323083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:29.323509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:29.437433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:29.440319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57a113c2-55a7-4213-9f25-96444aa3b860 tempest-QuotasAdminNegativeTest-2080371643 tempest-QuotasAdminNegativeTest-2080371643-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 200 len: 329 microversion: 2.1 time: 0.752036 Oct 17 13:16:29.441806 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 232/485] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:28 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 329 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:29.460102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b95345d6-4787-4ce2-8c72-e963fbcea502 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Action: 'update', calling method: .version_select at 0x7f419e4ed700>, body: {"quota_set": {"ram": 0}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:29.467103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b95345d6-4787-4ce2-8c72-e963fbcea502 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '1410547fc3034365b499b08a5b569d41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf29e8087ec475781875815d081ef4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b95345d6-4787-4ce2-8c72-e963fbcea502 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Request method failure captured: Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b HTTP/1.1 Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 25 Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWjTWsNciiDgtAi8xoP4jQeLg_25OQrP7yroBPmon_brDf3kMQojpe6n90ek1gjlAIAnar6Oj352ncg8SuswG0f47k2Db_pQOf_2r8cUcpTrrBkhdHicH9T94dCZJrrNG5Y5Zsl1NMTj039DbJpneZoRz_oTOiqowi2ZIPxJ7yymyc Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:29.470805 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6bf29e8087ec475781875815d081ef4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6bf29e8087ec475781875815d081ef4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6bf29e8087ec475781875815d081ef4b Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-793971271 Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 1410547fc3034365b499b08a5b569d41 Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-QuotasAdminNegativeTest-793971271-project Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: {"quota_set": {"ram": 0}} Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 13:16:29.476833 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '6bf29e8087ec475781875815d081ef4b', 'body': {'quota_set': {'ram': 0}}} Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:29.477824 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:29.478863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:29.479926 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:29.479926 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:29.479926 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:16:29.479926 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:16:29.479926 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 17 13:16:29.479926 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:29.482514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b95345d6-4787-4ce2-8c72-e963fbcea502 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:29.483704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b95345d6-4787-4ce2-8c72-e963fbcea502 tempest-QuotasAdminNegativeTest-793971271 tempest-QuotasAdminNegativeTest-793971271-project] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b" status: 403 len: 116 microversion: 2.1 time: 0.032082 Oct 17 13:16:29.484420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 233/486] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:16:29 2022] PUT /compute/v2.1/os-quota-sets/6bf29e8087ec475781875815d081ef4b => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:29.492427 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6d02ff4-b0d5-4921-9564-2b691d506304 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.206352 Oct 17 13:16:29.493437 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 254/487] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:29 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:30.078787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:30.079779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:30.088253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:30.089071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:30.089810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:30.090952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:30.091770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:30.092401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:30.529852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:30.530784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:30.555460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:30.556272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:30.557005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:30.569194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:30.570252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:30.571233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:30.579815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:30.634940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbf58012-38e4-4c44-83f0-f28d74a0382b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.559959 Oct 17 13:16:30.652102 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 234/488] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:30 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:30.807683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:30.851352 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-654cd753-76bb-4a9e-944e-95f6e9879be3 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.333640 Oct 17 13:16:30.854461 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 255/489] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:30 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:31.201861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Action: 'update', calling method: .version_select at 0x7f419e34d160>, body: {"quota_set": {"ram": "5120"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:31.302149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.302794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.303623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.304803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.305502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.306050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.373689 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6384d4ec-189a-4983-a8bd-aa3848aecefe tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db" status: 200 len: 240 microversion: 2.36 time: 0.559060 Oct 17 13:16:31.375054 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 235/490] 10.222.0.65 () {62 vars in 1303 bytes} [Mon Oct 17 13:16:30 2022] PUT /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db => generated 240 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:16:31.385975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Calling method '.version_select at 0x7f419e225c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:31.474176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.475384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.476133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.477395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.478193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.479002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.505959 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0bd02b95-21f1-4087-a5b0-2ecfd07c4bda tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db/detail" status: 200 len: 672 microversion: 2.36 time: 0.123537 Oct 17 13:16:31.506965 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 256/491] 10.222.0.65 () {60 vars in 1304 bytes} [Mon Oct 17 13:16:31 2022] GET /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db/detail => generated 672 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:31.676868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:31.677540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:31.688331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.690767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.691397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.693252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.695537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.696195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.728822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Action: 'update', calling method: .version_select at 0x7f419e1bdc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:31.811868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.812855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.813543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.814682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.815574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.816390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.862829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.864283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.864816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.867937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:31.868710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:31.878354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:31.971385 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0c091fc5-e906-4aef-a63c-55962c7a9046 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db?user_id=9fd8393571e2423ca8eb149a873ef533" status: 200 len: 240 microversion: 2.36 time: 0.247003 Oct 17 13:16:31.980705 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 257/492] 10.222.0.65 () {62 vars in 1384 bytes} [Mon Oct 17 13:16:31 2022] PUT /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db?user_id=9fd8393571e2423ca8eb149a873ef533 => generated 240 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:16:31.986378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-626f022c-1c79-4f2f-ab19-9629f268edef req-6a2d04a9-8795-4945-b566-4d263c8b1919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c36ccad-9600-4841-8a26-59c3602c28e7", "name": "network-vif-plugged", "status": "completed", "tag": "c116354c-79dd-4be3-8a80-9b5d05e14a71"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:32.008284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-626f022c-1c79-4f2f-ab19-9629f268edef req-6a2d04a9-8795-4945-b566-4d263c8b1919 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.008993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-626f022c-1c79-4f2f-ab19-9629f268edef req-6a2d04a9-8795-4945-b566-4d263c8b1919 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.009680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-626f022c-1c79-4f2f-ab19-9629f268edef req-6a2d04a9-8795-4945-b566-4d263c8b1919 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.029821 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-626f022c-1c79-4f2f-ab19-9629f268edef req-6a2d04a9-8795-4945-b566-4d263c8b1919 service nova] Creating event network-vif-plugged:c116354c-79dd-4be3-8a80-9b5d05e14a71 for instance 7c36ccad-9600-4841-8a26-59c3602c28e7 on n-h1-854121-14 Oct 17 13:16:32.053442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-626f022c-1c79-4f2f-ab19-9629f268edef req-6a2d04a9-8795-4945-b566-4d263c8b1919 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067850 Oct 17 13:16:32.056673 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 258/493] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:32.067227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:32.070133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:32.090268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.091889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.093490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.096178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:32.097499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:32.099620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:32.296407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:32.351250 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8616e24f-766b-4eff-b7ae-0142b59eade2 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.292391 Oct 17 13:16:32.352328 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 259/494] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:32 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:32.404410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4f6540b-9005-4963-a663-cd96afe8cbe2 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] Calling method '.version_select at 0x7f419e1bdf70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:32.667211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:32.681060 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc74ef9a-54cd-4d42-bcc3-623ce7342cfa tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 1.008988 Oct 17 13:16:32.707589 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 236/495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:31 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:32.830410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4f6540b-9005-4963-a663-cd96afe8cbe2 tempest-QuotasAdminTestV236-2067553547 tempest-QuotasAdminTestV236-2067553547-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db?user_id=9fd8393571e2423ca8eb149a873ef533" status: 200 len: 282 microversion: 2.36 time: 0.473639 Oct 17 13:16:32.834105 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 260/496] 10.222.0.65 () {60 vars in 1364 bytes} [Mon Oct 17 13:16:32 2022] GET /compute/v2.1/os-quota-sets/f268d4933233414b997d387f32c181db?user_id=9fd8393571e2423ca8eb149a873ef533 => generated 282 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:33.384649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:33.385294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.396672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.397195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.397654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.398443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.400079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.400525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.723510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:33.724547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:33.737743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.739327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.740089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.742287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:33.743216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:33.744193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:33.977504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:34.039826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1ecfcc9-2f18-4941-b29b-961e332b68b9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.659791 Oct 17 13:16:34.057559 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 237/497] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:33 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:34.507888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:34.554254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80cf1628-090d-4e8e-9161-f76621c49d13 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1319 microversion: 2.1 time: 0.848438 Oct 17 13:16:34.589934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 261/498] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:33 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1319 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:35.075782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:35.076395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:35.093232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.094908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.095372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.096110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.096565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.096994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.259204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d48505c6-b331-4b16-b3a6-177ea9a8dc38 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] Action: 'create', calling method: .version_select at 0x7f419e633b80>, body: {"security_group": {"name": "tempest-securitygroup-1664293487", "description": "tempest-description-696178368"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:35.287110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:35.339148 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2f6f5ad-b2cd-4e56-8407-08fa91a79e69 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.266968 Oct 17 13:16:35.340051 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 262/499] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:35 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:35.596274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:35.597173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:35.610257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.611115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.611796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:35.612738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:35.617575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:35.618273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.344942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:36.355902 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65729e65-7dc5-459e-85c6-e4126ff12ec6 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1468 microversion: 2.1 time: 0.761235 Oct 17 13:16:36.377494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 263/500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:35 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1468 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:36.383356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:36.392060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.395340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:36.413881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.415097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.415811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.416876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.417604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.418635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.556374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:36.581073 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0784c4d5-1882-4b9e-af25-7f3298bc71a9 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.202403 Oct 17 13:16:36.603286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 264/501] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:36 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:36.603286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:36.603286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.605326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.605326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.612840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.615994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.616493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.616937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.646192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lazy-loading 'flavor' on Instance uuid 7c36ccad-9600-4841-8a26-59c3602c28e7 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:36.658560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:36.791082 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21f48bd8-fd24-4bf7-a3f9-181569729039 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7/action" status: 202 len: 0 microversion: 2.1 time: 0.198672 Oct 17 13:16:36.792352 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 265/502] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:36 2022] POST /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:36.803806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:36.807305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:36.821724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.822758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.823480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:36.824438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:36.825567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:36.826478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.768326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:37.786950 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c83644bb-c97c-4598-9ffd-c8cf1d1b7a38 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1476 microversion: 2.1 time: 0.990110 Oct 17 13:16:37.787755 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 266/503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:36 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1476 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:37.792707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:37.797594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:37.819143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.819939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.820554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.821457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:37.822069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:37.822650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:37.977464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d48505c6-b331-4b16-b3a6-177ea9a8dc38 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 3.129784 Oct 17 13:16:37.979002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 238/504] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:16:34 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 3132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:37.993938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64f71f96-e0cd-44a1-a53a-a81ab6c69c38 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] Action: 'create', calling method: .version_select at 0x7f419e3c90d0>, body: {"security_group": {"name": "tempest-securitygroup-1333043383", "description": "tempest-description-889221069"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:38.227170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:38.273433 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88433d81-f713-4619-b4fc-779bf0eaaee6 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.484474 Oct 17 13:16:38.281554 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 267/505] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:37 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:38.816448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:38.817605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:38.828314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.831171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.833010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:38.834223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:38.835050 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64f71f96-e0cd-44a1-a53a-a81ab6c69c38 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.845865 Oct 17 13:16:38.835910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:38.836039 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 239/506] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:16:37 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:38.837235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.237745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:39.249936 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26129710-d912-41c9-b760-b931a40da15c tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1459 microversion: 2.1 time: 0.438789 Oct 17 13:16:39.265243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 268/507] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:38 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1459 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:39.279741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:39.280593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:39.290954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.291487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.291947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.295059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:39.295570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:39.296007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:39.604058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e8cdcda-6c2f-4468-9bea-f989d50869fe tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] Action: 'create', calling method: .version_select at 0x7f419e3c9670>, body: {"security_group": {"name": "tempest-securitygroup-1914836423", "description": "tempest-description-1564571549"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:41.150182 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16b408d6-0128-4fbc-8af4-05a3cb28c420 tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1612 microversion: 2.1 time: 1.871732 Oct 17 13:16:41.152497 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 269/508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:39 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1612 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:41.163836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:41.168273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:41.194372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.200981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.201937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.205550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.208331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.209648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.317997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:41.369325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=56 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:41.479275 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e8cdcda-6c2f-4468-9bea-f989d50869fe tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.633740 Oct 17 13:16:41.482076 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 240/509] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:16:38 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:16:41.496188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:41.504484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:41.528584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.529116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.533560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.542946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.543928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.545037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f223da31-1289-4019-8843-6db2cfe8fe1f tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.391225 Oct 17 13:16:41.548039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.561465 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 270/510] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:41 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:41.562620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5bde4b32-7146-49e6-933e-9c6871297553 tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] Action: 'create', calling method: .version_select at 0x7f419e1c6a60>, body: {"security_group": {"name": "tempest-securitygroup-898021995", "description": "tempest-description-1508159126"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:41.681484 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-162b4bda-a8fc-40ca-907c-3c10d4986b3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.198115 Oct 17 13:16:41.685040 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 241/511] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:16:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:41.701104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:41.708137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:41.735302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.736471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.737272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.740797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:41.747270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:41.747912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:41.894977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:42.230583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Lazy-loading 'flavor' on Instance uuid 7c36ccad-9600-4841-8a26-59c3602c28e7 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:42.403979 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 7c36ccad-9600-4841-8a26-59c3602c28e7 while it is in vm_state suspended Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Request method failure captured: Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7/action HTTP/1.1 Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 98 Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVWSYnowBFuNVcaWgGxPP3UaZncN1IdnezRwjNeSQARGFEcT9WmLG47dWklg7wgEbQzKZ6qLT7oPP_7Ou_AAB6F1uUTzbEA0EqfDiF4Woo1xRylcIWynAK1GhB7I9d9Xvs7r4U74K9HhWvjd8O2h5kAjFeBvF20SyEsufE_XQPubC8g Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: db2fdf9c6ddb4b94892d3776b2053d72 Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveMigrationNegativeTest-656286844 Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:16:42.414024 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db2fdf9c6ddb4b94892d3776b2053d72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveMigrationNegativeTest-656286844 Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: db2fdf9c6ddb4b94892d3776b2053d72 Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-656286844 Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveMigrationNegativeTest-656286844-project-admin Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 08cec2ee75464b53bb9b2bcbededb64f Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveMigrationNegativeTest-656286844-project-admin Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": true, "disk_over_commit": false}} Oct 17 13:16:42.415929 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'os-migrateLive' instance 7c36ccad-9600-4841-8a26-59c3602c28e7 while it is in vm_state suspended Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7c36ccad-9600-4841-8a26-59c3602c28e7', 'body': {'os-migrateLive': {'host': 'n-h2-854121-14', 'block_migration': True, 'disk_over_commit': False}}} Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:16:42.416906 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:42.419811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 7c36ccad-9600-4841-8a26-59c3602c28e7 while it is in vm_state suspended Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 7c36ccad-9600-4841-8a26-59c3602c28e7 while it is in vm_state suspended Oct 17 13:16:42.422291 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:42.425934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 7c36ccad-9600-4841-8a26-59c3602c28e7 while it is in vm_state suspended {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:42.427748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-419d2c8a-5efb-4043-8a17-6cfa9b1a4f3b tempest-LiveMigrationNegativeTest-656286844 tempest-LiveMigrationNegativeTest-656286844-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7/action" status: 409 len: 155 microversion: 2.1 time: 0.736230 Oct 17 13:16:42.428898 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 242/512] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:16:41 2022] POST /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7/action => generated 155 bytes in 738 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:16:42.440975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:42.441732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:42.449346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.450087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.450802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.451750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.453212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.454037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.522156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:42.664151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5bde4b32-7146-49e6-933e-9c6871297553 tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.105363 Oct 17 13:16:42.664925 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 271/513] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:16:41 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:42.682229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:42.682229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:42.698282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.701734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.702908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.703859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:42.706127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:42.709662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:42.811028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=53 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:42.854811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-461f41f2-89e4-491d-b215-9bbd6c76c7e0 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 204 len: 0 microversion: 2.1 time: 0.419286 Oct 17 13:16:42.856659 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 243/514] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:42 2022] DELETE /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:16:42.865849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62c07964-f4b8-4841-8e23-a5be0c060845 tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] Calling method '.version_select at 0x7f419e3c9d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:43.346657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:43.366843 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-27f5b6f8-ecfa-4c78-b9f5-f5d0b345071e tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.689763 Oct 17 13:16:43.368266 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 272/515] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:42 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:43.373738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:43.374565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:43.381904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:43.382616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:43.383215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:43.384136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:43.384749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:43.385382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:43.908081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:43.930827 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a4b2382-c7c2-474d-9965-5a8633a462c5 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1465 microversion: 2.1 time: 0.559892 Oct 17 13:16:43.932625 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 273/516] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:43 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1465 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:44.401668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:44.402299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:44.418717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.419243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.419751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.420413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.422587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.425178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.660046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:44.708561 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7fb8601-1ba4-4589-8477-cf2709a53992 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.312746 Oct 17 13:16:44.727617 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 274/517] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:44 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:44.955311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:44.956010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:44.975286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.975884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.976625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:44.977753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:44.978370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:44.978949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:45.848630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:45.858217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83d9ffb6-a324-4c3c-b9b0-dfb199964151 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1465 microversion: 2.1 time: 0.906926 Oct 17 13:16:45.861579 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 275/518] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:44 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1465 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:45.879233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:45.880185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:45.903201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:45.903965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:45.904563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:45.905499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:45.906120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:45.908689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.334083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:46.389987 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-56bcb211-10df-4b67-977d-49283a2eb217 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.520989 Oct 17 13:16:46.390962 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 276/519] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:45 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:46.404223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-12a50ade-6523-4774-9b13-29d3b26c6185 req-feedd3fd-5580-4dbd-bb0e-a7295cf45889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c36ccad-9600-4841-8a26-59c3602c28e7", "name": "network-vif-deleted", "tag": "c116354c-79dd-4be3-8a80-9b5d05e14a71"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:46.415281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12a50ade-6523-4774-9b13-29d3b26c6185 req-feedd3fd-5580-4dbd-bb0e-a7295cf45889 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.416161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12a50ade-6523-4774-9b13-29d3b26c6185 req-feedd3fd-5580-4dbd-bb0e-a7295cf45889 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.416817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12a50ade-6523-4774-9b13-29d3b26c6185 req-feedd3fd-5580-4dbd-bb0e-a7295cf45889 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.434456 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-12a50ade-6523-4774-9b13-29d3b26c6185 req-feedd3fd-5580-4dbd-bb0e-a7295cf45889 service nova] Creating event network-vif-deleted:c116354c-79dd-4be3-8a80-9b5d05e14a71 for instance 7c36ccad-9600-4841-8a26-59c3602c28e7 on n-h1-854121-14 Oct 17 13:16:46.445618 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-12a50ade-6523-4774-9b13-29d3b26c6185 req-feedd3fd-5580-4dbd-bb0e-a7295cf45889 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053232 Oct 17 13:16:46.446584 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 277/520] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:46.891202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:46.892144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:46.908837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.911583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.913296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:46.914249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:46.922989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:46.954604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.055860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.056666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.057283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.057923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lazy-loading 'fault' on Instance uuid 7c36ccad-9600-4841-8a26-59c3602c28e7 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:47.267232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:47.280665 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a31e930-8d22-4b28-958f-141a13da7f28 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 200 len: 1309 microversion: 2.1 time: 0.395130 Oct 17 13:16:47.281300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 278/521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:46 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 1309 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:47.429603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:47.431930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:47.454193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.465503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.466177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.467860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:47.469739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:47.474255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:47.859476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:47.928043 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5e32308-4e47-4324-a584-e6b16a3a5731 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1931 microversion: 2.75 time: 0.504466 Oct 17 13:16:47.929320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 279/522] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:47 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1931 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:48.305668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:48.306566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: 7c36ccad-9600-4841-8a26-59c3602c28e7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:48.316801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.317434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.317977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.318815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.319388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.322619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.336074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:48.369555 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] HTTP exception thrown: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 could not be found. Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Request method failure captured: Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 HTTP/1.1 Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWQv3DDK-g6k4Kub68zdiTqoMLyvGm7_rwfLTZVC7C61ahatnTdTHQ6L04FlJI403Hqfd-Kv6E-jXYT9As35fWkVZQClJ3Y2HEISETQGZ2Zv7YsWTGQ1sAMorm-ZUMHJ_IkVtiR69xUqBu0JMq9iSle5hrf2rxP9-7hRSv2dF2oMvc Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 401070ff300848dbb15e6bb09d4e194b Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-LiveMigrationNegativeTest-1170994291 Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:48.371565 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-LiveMigrationNegativeTest-1170994291 Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 401070ff300848dbb15e6bb09d4e194b Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1170994291 Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-LiveMigrationNegativeTest-1170994291-project Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 456395d8405a409c997dff3c903b1174 Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-LiveMigrationNegativeTest-1170994291-project Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 could not be found. Oct 17 13:16:48.372913 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '7c36ccad-9600-4841-8a26-59c3602c28e7'} Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 could not be found. Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:48.373735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 could not be found. Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 could not be found. Oct 17 13:16:48.374932 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:48.385023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Returning 404 to user: Instance 7c36ccad-9600-4841-8a26-59c3602c28e7 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:48.386247 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b554eab7-e0c0-4c58-899b-1ce0abd01d8b tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7" status: 404 len: 111 microversion: 2.1 time: 0.086201 Oct 17 13:16:48.387053 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 280/523] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:48 2022] GET /compute/v2.1/servers/7c36ccad-9600-4841-8a26-59c3602c28e7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:16:48.395926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:48.398631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:48.417451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.418551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.419235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.420211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.420905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.422186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.469611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:48.622382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a806dd5-ae27-41a5-8040-c15916e33f9a tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 204 len: 0 microversion: 2.1 time: 0.230871 Oct 17 13:16:48.623119 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 281/524] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:16:48 2022] DELETE /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:16:48.633324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:48.641738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:48.652131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.655093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.656288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:48.658862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:48.663912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:48.664514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.169846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:49.187254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-efcda74b-65cf-419b-971e-ddba1cb85499 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1474 microversion: 2.1 time: 0.557091 Oct 17 13:16:49.191807 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 282/525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:48 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1474 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:16:49.204089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:49.207377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:49.227785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:49.228666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:49.229444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.230984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:49.231918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:49.232506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:49.439051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:49.492504 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ed6f968-bd8c-4ef6-bef3-8e6eaa34d40b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1937 microversion: 2.75 time: 0.299325 Oct 17 13:16:49.496230 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 283/526] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:49 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1937 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:50.222428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:50.223331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:50.231317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:50.232035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:50.232623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:50.234601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:50.235221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:50.235820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:50.836503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '456395d8405a409c997dff3c903b1174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '401070ff300848dbb15e6bb09d4e194b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:50.848172 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-135ba432-5ca5-428b-b45f-e224ecff32b4 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 200 len: 1474 microversion: 2.1 time: 0.633857 Oct 17 13:16:50.848773 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 284/527] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:50 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 1474 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:50.858237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:50.859461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:50.867483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:50.868338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:50.868938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:50.869957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:50.871407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:50.872134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:51.184894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:51.246926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9a37c40f-0526-424a-a17b-005b688e0ae1 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1937 microversion: 2.75 time: 0.392540 Oct 17 13:16:51.251271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 285/528] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:50 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1937 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:51.261263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-198f3203-5958-4fd3-b3b0-a5f598f92f82 req-5b5eae03-216a-467b-b0c9-b3c1569a8667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d120eef2-6bf8-44f4-a111-c0e68b321b94", "name": "network-vif-deleted", "tag": "090e0642-a1ed-4e78-ab59-b6a2ba52a116"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:51.296449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-198f3203-5958-4fd3-b3b0-a5f598f92f82 req-5b5eae03-216a-467b-b0c9-b3c1569a8667 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:51.296449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-198f3203-5958-4fd3-b3b0-a5f598f92f82 req-5b5eae03-216a-467b-b0c9-b3c1569a8667 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:51.296919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-198f3203-5958-4fd3-b3b0-a5f598f92f82 req-5b5eae03-216a-467b-b0c9-b3c1569a8667 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:51.326508 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-198f3203-5958-4fd3-b3b0-a5f598f92f82 req-5b5eae03-216a-467b-b0c9-b3c1569a8667 service nova] Creating event network-vif-deleted:090e0642-a1ed-4e78-ab59-b6a2ba52a116 for instance d120eef2-6bf8-44f4-a111-c0e68b321b94 on n-h1-854121-14 Oct 17 13:16:51.333019 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-198f3203-5958-4fd3-b3b0-a5f598f92f82 req-5b5eae03-216a-467b-b0c9-b3c1569a8667 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079923 Oct 17 13:16:51.339786 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 286/529] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:16:51.621206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:51.872889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:51.873623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] [instance: d120eef2-6bf8-44f4-a111-c0e68b321b94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:51.896342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:51.896900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:51.897659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:51.898889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:51.899708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:51.900328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:51.933754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] HTTP exception thrown: Instance d120eef2-6bf8-44f4-a111-c0e68b321b94 could not be found. Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Request method failure captured: Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 HTTP/1.1 Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVWQv3DDK-g6k4Kub68zdiTqoMLyvGm7_rwfLTZVC7C61ahatnTdTHQ6L04FlJI403Hqfd-Kv6E-jXYT9As35fWkVZQClJ3Y2HEISETQGZ2Zv7YsWTGQ1sAMorm-ZUMHJ_IkVtiR69xUqBu0JMq9iSle5hrf2rxP9-7hRSv2dF2oMvc Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 401070ff300848dbb15e6bb09d4e194b Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-LiveMigrationNegativeTest-1170994291 Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:16:51.940987 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_401070ff300848dbb15e6bb09d4e194b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-LiveMigrationNegativeTest-1170994291 Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 401070ff300848dbb15e6bb09d4e194b Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1170994291 Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-LiveMigrationNegativeTest-1170994291-project Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 456395d8405a409c997dff3c903b1174 Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-LiveMigrationNegativeTest-1170994291-project Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance d120eef2-6bf8-44f4-a111-c0e68b321b94 could not be found. Oct 17 13:16:51.942305 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'd120eef2-6bf8-44f4-a111-c0e68b321b94'} Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d120eef2-6bf8-44f4-a111-c0e68b321b94 could not be found. Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:51.943171 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d120eef2-6bf8-44f4-a111-c0e68b321b94 could not be found. Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d120eef2-6bf8-44f4-a111-c0e68b321b94 could not be found. Oct 17 13:16:51.944304 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:16:51.945347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] Returning 404 to user: Instance d120eef2-6bf8-44f4-a111-c0e68b321b94 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:51.945347 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ae0bf43-c13c-485b-9312-4f1d38c61274 tempest-LiveMigrationNegativeTest-1170994291 tempest-LiveMigrationNegativeTest-1170994291-project] 10.222.0.65 "GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94" status: 404 len: 111 microversion: 2.1 time: 0.075541 Oct 17 13:16:51.948864 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 287/530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:16:51 2022] GET /compute/v2.1/servers/d120eef2-6bf8-44f4-a111-c0e68b321b94 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:16:52.285815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:52.286694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:52.308725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:52.311494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:52.314470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:52.315365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:52.316482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:52.319251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:52.601910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:52.651118 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1756092b-65ad-4ff1-b190-4f9b166ec2b5 tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1937 microversion: 2.75 time: 0.369260 Oct 17 13:16:52.652833 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 288/531] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:52 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1937 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:52.807447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:52.845478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:16:53.464889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62c07964-f4b8-4841-8e23-a5be0c060845 tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] 10.222.0.65 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11055 microversion: 2.1 time: 10.605703 Oct 17 13:16:53.465937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 244/532] 10.222.0.65 () {58 vars in 1191 bytes} [Mon Oct 17 13:16:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11055 bytes in 10609 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:16:53.498254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5bafa278-8aaa-4a42-a6ae-8fb6aae69603 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] Calling method '.version_select at 0x7f419e245280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:53.687001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:53.687922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:53.729969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.731227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.733746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:53.739755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:53.740520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:53.747778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.310300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] Lazy-loading 'services' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:54.371604 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d021681-c4f4-4394-8dfc-aea8968d900b tempest-ServersAdmin275Test-1463004870 tempest-ServersAdmin275Test-1463004870-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1922 microversion: 2.75 time: 0.691198 Oct 17 13:16:54.386162 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 245/533] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:53 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1922 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:16:54.418936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:54.419447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:54.429108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.430005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.430663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.433098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.433952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.434666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.474567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:16:54.638261 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ff28b0d-780f-4156-9c09-6467d2863dba tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "DELETE /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 204 len: 0 microversion: 2.75 time: 0.222725 Oct 17 13:16:54.639325 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 246/534] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:16:54 2022] DELETE /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:16:54.663797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:54.675795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:54.685750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.686241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.687553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:54.688308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:54.689219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:54.689662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:55.016271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.047174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.048900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:55.073781 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-13888356-e7d0-4648-84b4-244afe449f24 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1444 microversion: 2.75 time: 0.426495 Oct 17 13:16:55.075552 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 247/535] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:54 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1444 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:55.251779 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5bafa278-8aaa-4a42-a6ae-8fb6aae69603 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.758178 Oct 17 13:16:55.263894 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 289/536] 10.222.0.65 () {58 vars in 1191 bytes} [Mon Oct 17 13:16:53 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:16:55.270908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73a6d517-67c2-4ef0-91d1-58467b09c30c tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] Calling method '.version_select at 0x7f419e3c91f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:56.108596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:56.109558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:56.124104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.124870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.125517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.131458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:56.132318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:56.133022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:56.484887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:56.519419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:56.531967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:56.553838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95983239-0764-45c8-bbf8-ca6f390d48ec tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1444 microversion: 2.75 time: 0.449681 Oct 17 13:16:56.555419 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 290/537] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:56 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1444 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:57.591498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:57.592316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:57.608185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.609044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.627140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.631693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.632199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.632646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.743489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:57.747351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:57.747973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:57.748573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lazy-loading 'fault' on Instance uuid 89610249-80ec-480c-aa13-6494bf21582e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:16:58.086606 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73a6d517-67c2-4ef0-91d1-58467b09c30c tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/7f69d3fa-b24c-4b25-9908-901ee7e0ad60" status: 202 len: 0 microversion: 2.1 time: 2.821332 Oct 17 13:16:58.091392 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 248/538] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:16:55 2022] DELETE /compute/v2.1/os-security-groups/7f69d3fa-b24c-4b25-9908-901ee7e0ad60 => generated 0 bytes in 2827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:58.100360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c1f4d3c-bf74-431f-95b7-e812b08821c5 tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] Calling method '.version_select at 0x7f419e34d160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:58.235365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:58.255468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:58.257393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22ada44e69cf45a6a06d80f70dc80c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92bd7a8339b4827a3b06531561d9da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:16:58.287409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93d17ff7-e5e4-4235-a91d-bd50f5c90b28 tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 200 len: 1449 microversion: 2.75 time: 0.698992 Oct 17 13:16:58.319973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 291/539] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:57 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 1449 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:16:58.981457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-252951974", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "86f87344-a5a0-44c6-9bd6-49c37a87ed65"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:16:59.122653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] validate_networks() for [('86f87344-a5a0-44c6-9bd6-49c37a87ed65', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:16:59.595798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c1f4d3c-bf74-431f-95b7-e812b08821c5 tempest-SecurityGroupsTestAdminJSON-2011207115 tempest-SecurityGroupsTestAdminJSON-2011207115-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/318beaa0-a862-4a3b-b424-9a0ea668872c" status: 202 len: 0 microversion: 2.1 time: 1.502964 Oct 17 13:16:59.601391 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 249/540] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:16:58 2022] DELETE /compute/v2.1/os-security-groups/318beaa0-a862-4a3b-b424-9a0ea668872c => generated 0 bytes in 1509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:16:59.606764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:16:59.607607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] [instance: 89610249-80ec-480c-aa13-6494bf21582e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:16:59.626546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.627259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.628924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.629709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:16:59.630180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:16:59.630612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:16:59.668436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] HTTP exception thrown: Instance 89610249-80ec-480c-aa13-6494bf21582e could not be found. Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Request method failure captured: Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e HTTP/1.1 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVcE4f2ob7Xa4NxYwMeZXfz_RrLHflC12Bfnbz7hFDIeFero5wW6Uhb0M5Rgpj_ffopv4foVomVYoe5Dj-S1-btPOrrn67-PxtX7BpzP3wqRMOHGIKnXA7q0Q584AdqZhsaL6915XKsaKYynJkayqrO9Oz6ioQ2v2iTm1TATaO9IAE Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.75 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a92bd7a8339b4827a3b06531561d9da2 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdmin275Test-593149560 Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:16:59.670181 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a92bd7a8339b4827a3b06531561d9da2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a92bd7a8339b4827a3b06531561d9da2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a92bd7a8339b4827a3b06531561d9da2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a92bd7a8339b4827a3b06531561d9da2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdmin275Test-593149560 Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a92bd7a8339b4827a3b06531561d9da2 Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdmin275Test-593149560 Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdmin275Test-593149560-project Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 22ada44e69cf45a6a06d80f70dc80c25 Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdmin275Test-593149560-project Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 89610249-80ec-480c-aa13-6494bf21582e could not be found. Oct 17 13:16:59.671511 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '89610249-80ec-480c-aa13-6494bf21582e'} Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89610249-80ec-480c-aa13-6494bf21582e could not be found. Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:16:59.672245 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89610249-80ec-480c-aa13-6494bf21582e could not be found. Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89610249-80ec-480c-aa13-6494bf21582e could not be found. Oct 17 13:16:59.673578 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:16:59.675383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] Returning 404 to user: Instance 89610249-80ec-480c-aa13-6494bf21582e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:16:59.675383 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd2cfdd0-484b-424f-aed9-7ece142abcbb tempest-ServersAdmin275Test-593149560 tempest-ServersAdmin275Test-593149560-project] 10.222.0.65 "GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e" status: 404 len: 111 microversion: 2.75 time: 0.068990 Oct 17 13:16:59.675383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 250/541] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:16:59 2022] GET /compute/v2.1/servers/89610249-80ec-480c-aa13-6494bf21582e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:16:59.683827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8030c6ed-8479-4adb-a40c-d447b77e65d7 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] Calling method '.version_select at 0x7f419e3c9ca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:01.207455 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8030c6ed-8479-4adb-a40c-d447b77e65d7 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/409d5bf0-89ff-4329-9555-495b29d97504" status: 202 len: 0 microversion: 2.1 time: 1.533108 Oct 17 13:17:01.209494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 251/542] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:16:59 2022] DELETE /compute/v2.1/os-security-groups/409d5bf0-89ff-4329-9555-495b29d97504 => generated 0 bytes in 1537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:01.629003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:01.629655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:01.630144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:01.631226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:01.631827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:01.646268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcab6e3d-6606-4bb4-9c0d-fdef804937e7 tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Calling method '.version_select at 0x7f419e34da60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:01.665087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.665967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.666679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.668332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:01.671525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:01.672279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:01.719666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:01.738705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for user d9b63e4efecd4b9a96fc3b2e51f625fb and project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:01.765555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:01.771384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:01.827956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:01.840851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcab6e3d-6606-4bb4-9c0d-fdef804937e7 tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.629309 Oct 17 13:17:01.852791 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 252/543] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:17:01 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:17:01.890561 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05555455-df75-4dd5-9db6-4813d3978da3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.233696 Oct 17 13:17:01.900114 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 292/544] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:16:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 3244 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 13:17:01.917219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41acf605-3dc5-4a1c-a702-31048e516386 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] Calling method '.version_select at 0x7f419e244160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:02.277767 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41acf605-3dc5-4a1c-a702-31048e516386 tempest-SecurityGroupsTestAdminJSON-589581142 tempest-SecurityGroupsTestAdminJSON-589581142-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/de6374dd-39cf-4f47-b372-4b28a9ed8fee" status: 202 len: 0 microversion: 2.1 time: 0.371295 Oct 17 13:17:02.283249 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 293/545] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:17:01 2022] DELETE /compute/v2.1/os-security-groups/de6374dd-39cf-4f47-b372-4b28a9ed8fee => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:02.410248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46b9ccfa-5905-4184-8725-e0c9f62ad7ae tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] Calling method '.version_select at 0x7f419e34dca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:02.459081 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46b9ccfa-5905-4184-8725-e0c9f62ad7ae tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.595139 Oct 17 13:17:02.463018 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 253/546] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 13:17:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:02.481725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99e718b1-3071-44fe-a6b7-1ba33cc233ba tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Action: 'create', calling method: .version_select at 0x7f419e3c9430>, body: {"pool": "non_exist_pool"} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:02.891207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-99e718b1-3071-44fe-a6b7-1ba33cc233ba tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] HTTP exception thrown: Floating IP pool not found. Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99e718b1-3071-44fe-a6b7-1ba33cc233ba tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Request method failure captured: Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 26 Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXMyVaz2mXRCtIMo4LuHs4SA-RzKdcuhhxmrsb99B_Rbkwi2oIw3iK8fIMMDMJMtELGJOfCI50MDP8vNQqRf-wdnFYvIhMz_YQCavR_FMCHydAYMv3tsOcvvaYEHoF_uJUUsHyq0UZaA6dxatD13clgWuvqM1DXoC63RZ_3Y60HdU4 Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 036608e897f34285a644dc9cd5e6642d Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2110487719 Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:02.902814 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/036608e897f34285a644dc9cd5e6642d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/036608e897f34285a644dc9cd5e6642d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/036608e897f34285a644dc9cd5e6642d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_036608e897f34285a644dc9cd5e6642d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2110487719 Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 036608e897f34285a644dc9cd5e6642d Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2110487719 Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsNegativeTestJSON-2110487719-project Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: b23be551384043fc82f24acc4efada71 Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2110487719-project Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: {"pool": "non_exist_pool"} Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: exception: Floating IP pool not found. Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 17 13:17:02.904184 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:02.905205 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99e718b1-3071-44fe-a6b7-1ba33cc233ba tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Returning 404 to user: Floating IP pool not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:02.906530 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99e718b1-3071-44fe-a6b7-1ba33cc233ba tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.440249 Oct 17 13:17:02.907622 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 254/547] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:17:02 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:02.920678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:02.921709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:02.946016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.949942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.954095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:02.960481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:02.961598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:02.963121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1182464972", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "f00eb40b-7ce6-4995-9281-4d82713dfdfa"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:02.963985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:03.031944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] validate_networks() for [('f00eb40b-7ce6-4995-9281-4d82713dfdfa', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:17:03.295368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:03.312453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:03.314139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:03.315449 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fa2ed96-a13f-4b61-9867-216db81f13ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1265 microversion: 2.25 time: 0.408095 Oct 17 13:17:03.329194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 255/548] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:02 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1265 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:03.335131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab077b40-1cf8-4b84-846c-355d66098571 tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] Action: 'update', calling method: .version_select at 0x7f419e213ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:03.837380 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab077b40-1cf8-4b84-846c-355d66098571 tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.519353 Oct 17 13:17:03.838046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 256/549] 10.222.0.65 () {60 vars in 1206 bytes} [Mon Oct 17 13:17:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:03.857577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df7c9377-6f76-4f00-addd-ce5c2f8ddaef tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Calling method '.version_select at 0x7f419e17aee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:04.008183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-df7c9377-6f76-4f00-addd-ce5c2f8ddaef tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 579d7a36-b25b-4d19-966f-d43c91809eb7 could not be found", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:17:04.008890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-df7c9377-6f76-4f00-addd-ce5c2f8ddaef tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] HTTP exception thrown: Floating IP not found for ID 579d7a36-b25b-4d19-966f-d43c91809eb7 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df7c9377-6f76-4f00-addd-ce5c2f8ddaef tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Request method failure captured: Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-floating-ips/579d7a36-b25b-4d19-966f-d43c91809eb7 HTTP/1.1 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXMyVaz2mXRCtIMo4LuHs4SA-RzKdcuhhxmrsb99B_Rbkwi2oIw3iK8fIMMDMJMtELGJOfCI50MDP8vNQqRf-wdnFYvIhMz_YQCavR_FMCHydAYMv3tsOcvvaYEHoF_uJUUsHyq0UZaA6dxatD13clgWuvqM1DXoC63RZ_3Y60HdU4 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 036608e897f34285a644dc9cd5e6642d Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2110487719 Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:04.026361 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/036608e897f34285a644dc9cd5e6642d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/036608e897f34285a644dc9cd5e6642d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/036608e897f34285a644dc9cd5e6642d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_036608e897f34285a644dc9cd5e6642d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2110487719 Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 036608e897f34285a644dc9cd5e6642d Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2110487719 Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsNegativeTestJSON-2110487719-project Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: b23be551384043fc82f24acc4efada71 Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2110487719-project Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: exception: Floating IP not found for ID 579d7a36-b25b-4d19-966f-d43c91809eb7 Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '579d7a36-b25b-4d19-966f-d43c91809eb7'} Oct 17 13:17:04.027800 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:17:04.028604 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 579d7a36-b25b-4d19-966f-d43c91809eb7 could not be found Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbe7784a-1b6c-418b-9454-41ffb6e5bfb8'] Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 579d7a36-b25b-4d19-966f-d43c91809eb7. Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:04.030735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 579d7a36-b25b-4d19-966f-d43c91809eb7 Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:04.032085 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:04.035493 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 579d7a36-b25b-4d19-966f-d43c91809eb7 Oct 17 13:17:04.035493 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:04.035493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df7c9377-6f76-4f00-addd-ce5c2f8ddaef tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] Returning 404 to user: Floating IP not found for ID 579d7a36-b25b-4d19-966f-d43c91809eb7 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:04.035493 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df7c9377-6f76-4f00-addd-ce5c2f8ddaef tempest-FloatingIPsNegativeTestJSON-2110487719 tempest-FloatingIPsNegativeTestJSON-2110487719-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/579d7a36-b25b-4d19-966f-d43c91809eb7" status: 404 len: 111 microversion: 2.1 time: 0.189004 Oct 17 13:17:04.035493 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 257/550] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:17:03 2022] DELETE /compute/v2.1/os-floating-ips/579d7a36-b25b-4d19-966f-d43c91809eb7 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:17:04.035493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38d737a8-f757-43ec-8d85-c2ed279d1c97 tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] Calling method '.version_select at 0x7f419e18ddc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:04.061264 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38d737a8-f757-43ec-8d85-c2ed279d1c97 tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031336 Oct 17 13:17:04.065648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 258/551] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 13:17:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:04.075354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-452b0410-448c-49b0-ae1f-19650a0ae960 tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] Action: 'update', calling method: .version_select at 0x7f419e18df70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:04.260004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-452b0410-448c-49b0-ae1f-19650a0ae960 tempest-QuotaClassesAdminTestJSON-1104722534 tempest-QuotaClassesAdminTestJSON-1104722534-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.188932 Oct 17 13:17:04.272128 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 259/552] 10.222.0.65 () {60 vars in 1206 bytes} [Mon Oct 17 13:17:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:04.344839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:04.345667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:04.361742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:04.362536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:04.363751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:04.374481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:04.375142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:04.377759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:04.617786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:04.630793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:04.637185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:04.644318 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cac7f5a8-98e7-4379-9ad4-2b0c0f509892 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1319 microversion: 2.25 time: 0.300534 Oct 17 13:17:04.648665 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 260/553] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:04 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:05.294633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:05.295699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:05.296385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:05.297014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:05.297766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:05.344992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.345815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.349770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.350884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.355817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.357672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.440388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:05.459430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for user 3d18129f56c24321aeff6fa609f78c87 and project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:05.497183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:05.502932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:05.673146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:05.673791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:05.683564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ea4deae-8767-4746-8446-5908ec8482d7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.399035 Oct 17 13:17:05.686360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=25,nova_api:INSERT=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:05.688259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.689638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 294/554] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:17:05.692110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.696546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.699564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:05.699799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cc418b9-32ca-47f8-8e21-4d7c9c5652f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:05.703249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6cc418b9-32ca-47f8-8e21-4d7c9c5652f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:05.704286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:05.708007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:05.907767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cc418b9-32ca-47f8-8e21-4d7c9c5652f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:05.926503 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cc418b9-32ca-47f8-8e21-4d7c9c5652f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1211 microversion: 2.1 time: 0.233738 Oct 17 13:17:05.935577 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 295/555] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:05 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:06.398348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:06.412207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:06.416659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:06.420550 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce97f0ed-3a8d-4257-8689-e1c9db378823 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1319 microversion: 2.25 time: 0.752146 Oct 17 13:17:06.428825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 261/556] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:05 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1319 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:06.656980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0bd1e12c-caaf-4a8c-8bf2-a5a58b612f94 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Calling method '.version_select at 0x7f419e1660d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.700459 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0bd1e12c-caaf-4a8c-8bf2-a5a58b612f94 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] HTTP exception thrown: Image not found. Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0bd1e12c-caaf-4a8c-8bf2-a5a58b612f94 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Request method failure captured: Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/images/60f74d48-87e1-4d96-a51f-90b3a33ef82e/metadata/os_distro HTTP/1.1 Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXRe9l3jQTBtvS93rCBHUEVHaDnI0BR2FEStg-PDr2HoKxi6yX5qp0UJAvNTg8JKd8tczCEVNdbrf5ehp0IdLiRgpE1zoUdpBks8wFM2wMIXcpD-X_fPD_USX5tt8Lufk-G6hYsc3UpCXS1XePJNj7lGWle0y7y1HX4GnwIia1hzeo Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:17:06.727053 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6216b4d2a82146c6a97f2443ca7bd04c Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'image_id': '60f74d48-87e1-4d96-a51f-90b3a33ef82e', 'id': 'os_distro'} Oct 17 13:17:06.728520 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.729470 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60f74d48-87e1-4d96-a51f-90b3a33ef82e Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.730942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60f74d48-87e1-4d96-a51f-90b3a33ef82e could not be found. Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:06.732212 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.736755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0bd1e12c-caaf-4a8c-8bf2-a5a58b612f94 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:06.746130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0bd1e12c-caaf-4a8c-8bf2-a5a58b612f94 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] 10.222.0.65 "DELETE /compute/v2.1/images/60f74d48-87e1-4d96-a51f-90b3a33ef82e/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.791591 Oct 17 13:17:06.746130 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 296/557] 10.222.0.65 () {58 vars in 1293 bytes} [Mon Oct 17 13:17:05 2022] DELETE /compute/v2.1/images/60f74d48-87e1-4d96-a51f-90b3a33ef82e/metadata/os_distro => generated 62 bytes in 795 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:06.746454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1fcebdcb-a586-4706-a30d-98cc1f6186d5 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Calling method '.version_select at 0x7f419e15cd30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.780707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-1fcebdcb-a586-4706-a30d-98cc1f6186d5 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] HTTP exception thrown: Image not found. Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1fcebdcb-a586-4706-a30d-98cc1f6186d5 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Request method failure captured: Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/images/c995ad98-8bdb-43ce-a5ce-660e9ecfb044/metadata/os_version HTTP/1.1 Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXRe9l3jQTBtvS93rCBHUEVHaDnI0BR2FEStg-PDr2HoKxi6yX5qp0UJAvNTg8JKd8tczCEVNdbrf5ehp0IdLiRgpE1zoUdpBks8wFM2wMIXcpD-X_fPD_USX5tt8Lufk-G6hYsc3UpCXS1XePJNj7lGWle0y7y1HX4GnwIia1hzeo Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:06.786031 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6216b4d2a82146c6a97f2443ca7bd04c Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'image_id': 'c995ad98-8bdb-43ce-a5ce-660e9ecfb044', 'id': 'os_version'} Oct 17 13:17:06.787322 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.788184 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c995ad98-8bdb-43ce-a5ce-660e9ecfb044 Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.789285 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c995ad98-8bdb-43ce-a5ce-660e9ecfb044 could not be found. Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:06.790673 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.792119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1fcebdcb-a586-4706-a30d-98cc1f6186d5 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:06.801273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1fcebdcb-a586-4706-a30d-98cc1f6186d5 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] 10.222.0.65 "GET /compute/v2.1/images/c995ad98-8bdb-43ce-a5ce-660e9ecfb044/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.052938 Oct 17 13:17:06.805518 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 262/558] 10.222.0.65 () {58 vars in 1293 bytes} [Mon Oct 17 13:17:06 2022] GET /compute/v2.1/images/c995ad98-8bdb-43ce-a5ce-660e9ecfb044/metadata/os_version => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:06.818442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90dd3dd8-8b65-438b-ba9c-254a22f0ec13 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Calling method '.version_select at 0x7f419e0bf0d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.864715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-90dd3dd8-8b65-438b-ba9c-254a22f0ec13 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] HTTP exception thrown: Image not found. Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90dd3dd8-8b65-438b-ba9c-254a22f0ec13 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Request method failure captured: Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/images/edc07182-545a-4845-a4de-31763efe8056/metadata HTTP/1.1 Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXRe9l3jQTBtvS93rCBHUEVHaDnI0BR2FEStg-PDr2HoKxi6yX5qp0UJAvNTg8JKd8tczCEVNdbrf5ehp0IdLiRgpE1zoUdpBks8wFM2wMIXcpD-X_fPD_USX5tt8Lufk-G6hYsc3UpCXS1XePJNj7lGWle0y7y1HX4GnwIia1hzeo Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:17:06.868683 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6216b4d2a82146c6a97f2443ca7bd04c Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'image_id': 'edc07182-545a-4845-a4de-31763efe8056'} Oct 17 13:17:06.870312 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.871448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID edc07182-545a-4845-a4de-31763efe8056 Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.872836 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image edc07182-545a-4845-a4de-31763efe8056 could not be found. Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:06.874348 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.875794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90dd3dd8-8b65-438b-ba9c-254a22f0ec13 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:06.878419 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90dd3dd8-8b65-438b-ba9c-254a22f0ec13 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] 10.222.0.65 "GET /compute/v2.1/images/edc07182-545a-4845-a4de-31763efe8056/metadata" status: 404 len: 62 microversion: 2.1 time: 0.059777 Oct 17 13:17:06.882033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42ec1a5e-378a-4cde-a4aa-6859bdc24e28 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Action: 'update_all', calling method: .version_select at 0x7f419e17a940>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:06.884997 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 297/559] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:17:06 2022] GET /compute/v2.1/images/edc07182-545a-4845-a4de-31763efe8056/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:06.935155 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-42ec1a5e-378a-4cde-a4aa-6859bdc24e28 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] HTTP exception thrown: Image not found. Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42ec1a5e-378a-4cde-a4aa-6859bdc24e28 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Request method failure captured: Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/images/4acb2be4-ba82-4814-a999-ad2fe865767d/metadata HTTP/1.1 Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 57 Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXRe9l3jQTBtvS93rCBHUEVHaDnI0BR2FEStg-PDr2HoKxi6yX5qp0UJAvNTg8JKd8tczCEVNdbrf5ehp0IdLiRgpE1zoUdpBks8wFM2wMIXcpD-X_fPD_USX5tt8Lufk-G6hYsc3UpCXS1XePJNj7lGWle0y7y1HX4GnwIia1hzeo Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:06.941448 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6216b4d2a82146c6a97f2443ca7bd04c Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:06.944806 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'image_id': '4acb2be4-ba82-4814-a999-ad2fe865767d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.946408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4acb2be4-ba82-4814-a999-ad2fe865767d Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:06.949213 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4acb2be4-ba82-4814-a999-ad2fe865767d could not be found. Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:06.955160 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:17:06.958787 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:06.964217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:06.965377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:06.965898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42ec1a5e-378a-4cde-a4aa-6859bdc24e28 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:06.968705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42ec1a5e-378a-4cde-a4aa-6859bdc24e28 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] 10.222.0.65 "PUT /compute/v2.1/images/4acb2be4-ba82-4814-a999-ad2fe865767d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.091615 Oct 17 13:17:06.986632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.987281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:06.987886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:06.993008 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 263/560] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:17:06 2022] PUT /compute/v2.1/images/4acb2be4-ba82-4814-a999-ad2fe865767d/metadata => generated 62 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:06.997450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:06.998974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.009078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.023021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b68db9b-184b-4ef0-af4d-f03bfc98eda7 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Action: 'update', calling method: .version_select at 0x7f419e17a310>, body: {"meta": {"os_distro": "alt"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:07.082467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2b68db9b-184b-4ef0-af4d-f03bfc98eda7 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] HTTP exception thrown: Image not found. Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b68db9b-184b-4ef0-af4d-f03bfc98eda7 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Request method failure captured: Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/images/9fe105fc-5ac7-4112-bdb5-415812c829d9/metadata/os_distro HTTP/1.1 Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 30 Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXRe9l3jQTBtvS93rCBHUEVHaDnI0BR2FEStg-PDr2HoKxi6yX5qp0UJAvNTg8JKd8tczCEVNdbrf5ehp0IdLiRgpE1zoUdpBks8wFM2wMIXcpD-X_fPD_USX5tt8Lufk-G6hYsc3UpCXS1XePJNj7lGWle0y7y1HX4GnwIia1hzeo Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:07.087536 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6216b4d2a82146c6a97f2443ca7bd04c Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: {"meta": {"os_distro": "alt"}} Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:17:07.090239 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'image_id': '9fe105fc-5ac7-4112-bdb5-415812c829d9', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:07.092083 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9fe105fc-5ac7-4112-bdb5-415812c829d9 Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:07.094488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9fe105fc-5ac7-4112-bdb5-415812c829d9 could not be found. Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:07.098343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:17:07.103051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.106617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b68db9b-184b-4ef0-af4d-f03bfc98eda7 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:07.108888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b68db9b-184b-4ef0-af4d-f03bfc98eda7 tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] 10.222.0.65 "PUT /compute/v2.1/images/9fe105fc-5ac7-4112-bdb5-415812c829d9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.106157 Oct 17 13:17:07.119163 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 264/561] 10.222.0.65 () {60 vars in 1310 bytes} [Mon Oct 17 13:17:06 2022] PUT /compute/v2.1/images/9fe105fc-5ac7-4112-bdb5-415812c829d9/metadata/os_distro => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:07.131347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4a02a33-d6a3-4b19-81d6-665bcb2fa7ba tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Action: 'create', calling method: .version_select at 0x7f419e2bba60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:07.217447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a4a02a33-d6a3-4b19-81d6-665bcb2fa7ba tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] HTTP exception thrown: Image not found. Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4a02a33-d6a3-4b19-81d6-665bcb2fa7ba tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Request method failure captured: Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/images/9f5529cf-d003-4ed5-aa07-1cff5d07d6d1/metadata HTTP/1.1 Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 57 Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXRe9l3jQTBtvS93rCBHUEVHaDnI0BR2FEStg-PDr2HoKxi6yX5qp0UJAvNTg8JKd8tczCEVNdbrf5ehp0IdLiRgpE1zoUdpBks8wFM2wMIXcpD-X_fPD_USX5tt8Lufk-G6hYsc3UpCXS1XePJNj7lGWle0y7y1HX4GnwIia1hzeo Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:07.222701 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ffa6384cce4549548aca9e32d71bce0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ffa6384cce4549548aca9e32d71bce0b Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446 Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6216b4d2a82146c6a97f2443ca7bd04c Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1896726446-project Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:17:07.224383 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'image_id': '9f5529cf-d003-4ed5-aa07-1cff5d07d6d1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:07.225440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9f5529cf-d003-4ed5-aa07-1cff5d07d6d1 Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:17:07.226481 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9f5529cf-d003-4ed5-aa07-1cff5d07d6d1 could not be found. Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:07.228004 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:17:07.229392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:07.231044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4a02a33-d6a3-4b19-81d6-665bcb2fa7ba tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:07.231044 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4a02a33-d6a3-4b19-81d6-665bcb2fa7ba tempest-ImagesMetadataNegativeTestJSON-1896726446 tempest-ImagesMetadataNegativeTestJSON-1896726446-project] 10.222.0.65 "POST /compute/v2.1/images/9f5529cf-d003-4ed5-aa07-1cff5d07d6d1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.106176 Oct 17 13:17:07.234327 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 265/562] 10.222.0.65 () {60 vars in 1281 bytes} [Mon Oct 17 13:17:07 2022] POST /compute/v2.1/images/9f5529cf-d003-4ed5-aa07-1cff5d07d6d1/metadata => generated 62 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:17:07.457997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:07.458794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:07.467341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.479813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.480282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.481333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:07.481804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:07.482241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:07.799462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.829112 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d085177-a825-4e5f-a0ea-b814f92e4eae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1207 microversion: 2.1 time: 0.868613 Oct 17 13:17:07.831459 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 298/563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:06 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1207 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:07.866917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.901833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.908935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:07.920367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b219471-8276-4ff7-bbd7-f1bc9974be1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1319 microversion: 2.25 time: 0.467203 Oct 17 13:17:07.923652 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 266/564] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:07 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:08.854031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:08.854821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:08.868261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.875601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.876456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.879531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.880715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.881415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.954624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:08.956816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:08.966460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.969011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.971021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:08.972033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:08.977682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:08.978367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:09.132178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.153184 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de8e54f1-c551-4f5c-9f03-5639c8293d68 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1269 microversion: 2.1 time: 0.293115 Oct 17 13:17:09.154175 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 299/565] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:08 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1269 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:09.443039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.453869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.461520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:09.465703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62d33975-e99e-4fb1-80b6-00b8832bd714 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.514776 Oct 17 13:17:09.467821 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 267/566] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:08 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:10.190758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:10.192711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:10.219906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.220660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.225712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.230866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.234118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.238377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.497046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:10.497704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:10.508611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.517014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.517512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.525345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:10.525857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:10.528707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:10.685462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:10.727231 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-746fdae9-6d8e-469e-93b8-e80eb8110bf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1269 microversion: 2.1 time: 0.526654 Oct 17 13:17:10.731595 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 300/567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:10 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1269 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:11.115076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.133873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.137137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:11.150810 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c33ed69-c921-4255-8f7b-b0eb50aed0d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.658271 Oct 17 13:17:11.155811 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 268/568] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:10 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:11.758225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:11.758836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:11.771737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.774553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.775923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:11.780055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:11.781514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:11.782717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.177273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:12.182971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:12.197592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.198120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.198564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:12.199293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:12.199750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:12.200178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:13.324616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.338515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.357740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.359277 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cadaad4a-1547-4d39-a488-ba5aa4acae74 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 1.187277 Oct 17 13:17:13.361381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 269/569] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:12 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:13.366691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:13.386388 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-334d1ab7-3bc0-4cfd-af82-a2d907af6838 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 1.627387 Oct 17 13:17:13.408055 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 301/570] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:11 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:13.738953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0c524c1-2425-4ccb-87ba-7996d2d65aae tempest-TenantUsagesNegativeTestJSON-365329214 tempest-TenantUsagesNegativeTestJSON-365329214-project-admin] 10.222.0.65 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T13%3A17%3A12.574519&end=2022-10-18T13%3A17%3A12.574519" status: 404 len: 112 microversion: - time: 0.372569 Oct 17 13:17:13.739463 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 270/571] 10.222.0.65 () {58 vars in 1316 bytes} [Mon Oct 17 13:17:13 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-16T13%3A17%3A12.574519&end=2022-10-18T13%3A17%3A12.574519 => generated 112 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:17:13.750258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b62f644-06a1-4072-be69-dc7253d5c67a tempest-TenantUsagesNegativeTestJSON-365329214 tempest-TenantUsagesNegativeTestJSON-365329214-project-admin] Calling method '.version_select at 0x7f419e170940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:13.760274 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6b62f644-06a1-4072-be69-dc7253d5c67a tempest-TenantUsagesNegativeTestJSON-365329214 tempest-TenantUsagesNegativeTestJSON-365329214-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b62f644-06a1-4072-be69-dc7253d5c67a tempest-TenantUsagesNegativeTestJSON-365329214 tempest-TenantUsagesNegativeTestJSON-365329214-project-admin] Request method failure captured: Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-simple-tenant-usage/5e7ec80858e24709a14af852b9ab0fa8?start=2022-10-18T13%3A17%3A12.574519&end=2022-10-16T13%3A17%3A12.574519 HTTP/1.1 Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXYB4M02qGRh0C61LGeUn-QQA4kTO3lYqEdX4KjajarQbRE-fFCrdBk2UQLePzyJ0jZoc4rq9QCf0pZR1FdH-9Wsb6IRqL7kDTlF_seFdH3obSdT3gJeI3QfbkL2nlA9Vdbk23WVxU5XXWAZR42h7C0JikfZy2HSDxABxslzbOB6d8 Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 265df855ce394d5eb5996440be78a1ff Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-365329214 Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:17:13.762908 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/265df855ce394d5eb5996440be78a1ff"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/265df855ce394d5eb5996440be78a1ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/265df855ce394d5eb5996440be78a1ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_265df855ce394d5eb5996440be78a1ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-365329214 Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 265df855ce394d5eb5996440be78a1ff Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-365329214 Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TenantUsagesNegativeTestJSON-365329214-project-admin Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: b777266d068741a1aac1e1783f7e82f9 Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-365329214-project-admin Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid start time. The start time cannot occur after the end time. Oct 17 13:17:13.764565 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5e7ec80858e24709a14af852b9ab0fa8'} Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:17:13.765321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:17:13.766637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b62f644-06a1-4072-be69-dc7253d5c67a tempest-TenantUsagesNegativeTestJSON-365329214 tempest-TenantUsagesNegativeTestJSON-365329214-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:13.768944 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b62f644-06a1-4072-be69-dc7253d5c67a tempest-TenantUsagesNegativeTestJSON-365329214 tempest-TenantUsagesNegativeTestJSON-365329214-project-admin] 10.222.0.65 "GET /compute/v2.1/os-simple-tenant-usage/5e7ec80858e24709a14af852b9ab0fa8?start=2022-10-18T13%3A17%3A12.574519&end=2022-10-16T13%3A17%3A12.574519" status: 400 len: 111 microversion: 2.1 time: 0.022986 Oct 17 13:17:13.770705 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 302/572] 10.222.0.65 () {58 vars in 1412 bytes} [Mon Oct 17 13:17:13 2022] GET /compute/v2.1/os-simple-tenant-usage/5e7ec80858e24709a14af852b9ab0fa8?start=2022-10-18T13%3A17%3A12.574519&end=2022-10-16T13%3A17%3A12.574519 => generated 111 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:17:14.080459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-569b8c9f-76ed-4338-b367-7902246de963 req-79069396-22a8-4f71-9f3a-dcaccc29f9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7695663-7195-438d-be05-5c0e52665c89", "tag": "40da2ef7-39de-495c-ad80-f595dfbf584a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:14.103140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-569b8c9f-76ed-4338-b367-7902246de963 req-79069396-22a8-4f71-9f3a-dcaccc29f9e5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.103626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-569b8c9f-76ed-4338-b367-7902246de963 req-79069396-22a8-4f71-9f3a-dcaccc29f9e5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.113869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-569b8c9f-76ed-4338-b367-7902246de963 req-79069396-22a8-4f71-9f3a-dcaccc29f9e5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.134249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:14.136657 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-569b8c9f-76ed-4338-b367-7902246de963 req-79069396-22a8-4f71-9f3a-dcaccc29f9e5 service nova] Creating event network-changed:40da2ef7-39de-495c-ad80-f595dfbf584a for instance f7695663-7195-438d-be05-5c0e52665c89 on n-h1-854121-14 Oct 17 13:17:14.153252 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-569b8c9f-76ed-4338-b367-7902246de963 req-79069396-22a8-4f71-9f3a-dcaccc29f9e5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077466 Oct 17 13:17:14.154554 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 303/573] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:17:14.259899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-796294c5-abe9-497f-a851-91e1f94f77c4 tempest-TenantUsagesNegativeTestJSON-193029881 tempest-TenantUsagesNegativeTestJSON-193029881-project] Calling method '.version_select at 0x7f419e183280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:14.264923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-796294c5-abe9-497f-a851-91e1f94f77c4 tempest-TenantUsagesNegativeTestJSON-193029881 tempest-TenantUsagesNegativeTestJSON-193029881-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8994acf5c613427f8ee43e3f28f386af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e7ec80858e24709a14af852b9ab0fa8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-796294c5-abe9-497f-a851-91e1f94f77c4 tempest-TenantUsagesNegativeTestJSON-193029881 tempest-TenantUsagesNegativeTestJSON-193029881-project] Request method failure captured: Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A17%3A12.574519&end=2022-10-18T13%3A17%3A12.574519&detailed=1 HTTP/1.1 Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXWTw3OyyUWJ6rxvQ9rrHa7IiDuor6DGBoJg2oiK8YSENwziDfFp3YsG5Zxt75FEN2Jlp0u9G_lEOVAPwciW8ypOfFCuef-oY2j7mrRzXQwP3SZ8Zl_byR2dyILQavgWVE27hMf_1ite35N-QqPvfhFV-8viLIDPuYap6CACTiwKVM Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 5e7ec80858e24709a14af852b9ab0fa8 Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-193029881 Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:17:14.268445 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5e7ec80858e24709a14af852b9ab0fa8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5e7ec80858e24709a14af852b9ab0fa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5e7ec80858e24709a14af852b9ab0fa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5e7ec80858e24709a14af852b9ab0fa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-193029881 Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 5e7ec80858e24709a14af852b9ab0fa8 Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-193029881 Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TenantUsagesNegativeTestJSON-193029881-project Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 8994acf5c613427f8ee43e3f28f386af Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-193029881-project Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:17:14.269928 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:17:14.270748 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:17:14.271876 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:17:14.273035 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 17 13:17:14.273035 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:17:14.273035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-796294c5-abe9-497f-a851-91e1f94f77c4 tempest-TenantUsagesNegativeTestJSON-193029881 tempest-TenantUsagesNegativeTestJSON-193029881-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:17:14.273035 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-796294c5-abe9-497f-a851-91e1f94f77c4 tempest-TenantUsagesNegativeTestJSON-193029881 tempest-TenantUsagesNegativeTestJSON-193029881-project] 10.222.0.65 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A17%3A12.574519&end=2022-10-18T13%3A17%3A12.574519&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.491738 Oct 17 13:17:14.273035 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 271/574] 10.222.0.65 () {58 vars in 1335 bytes} [Mon Oct 17 13:17:13 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A17%3A12.574519&end=2022-10-18T13%3A17%3A12.574519&detailed=1 => generated 123 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:17:14.392661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:14.393661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:14.415863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:14.416467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:14.434482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.434722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:14.438293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.439748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.442040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.444204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.445903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.446524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.447609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.448429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:14.457864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:14.458391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:14.461296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:15.199253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.224001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.228661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.231467 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4099da89-2aee-4a74-87a5-d9e94b3388e2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.844100 Oct 17 13:17:15.242636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 304/575] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:14 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:15.284762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:15.305299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ae7451c-f1c2-4c7d-af1b-75feb16d58ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.891789 Oct 17 13:17:15.311987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 272/576] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:14 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:16.288926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:16.299865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:16.327827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:16.328784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:16.334830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.335510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:16.336178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:16.336314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.336904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.337799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.338398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.338969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.351341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.357529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.358665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:16.365603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:16.372743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:16.373679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.223815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.236173 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c2f1deb-e537-4110-bcd5-d10e457dce70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.908494 Oct 17 13:17:17.240085 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 273/577] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:16 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:17.289333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.343310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-cc7c6ef7-9225-4d29-900b-b8b096ea2fd6 req-ddef6024-f69f-4be8-8cba-bc392d78734c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb237cbb-7c63-45de-a406-b73d6b221ac5", "tag": "d4bdd4ae-856b-4eb5-9670-e2ce1a62a781"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:17.351237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.353684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:17.359062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9efc25a2-c8da-4f54-a6d6-4e3b0482da94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 1.093791 Oct 17 13:17:17.359686 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 305/578] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:16 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:17.373670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cc7c6ef7-9225-4d29-900b-b8b096ea2fd6 req-ddef6024-f69f-4be8-8cba-bc392d78734c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:17.374538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cc7c6ef7-9225-4d29-900b-b8b096ea2fd6 req-ddef6024-f69f-4be8-8cba-bc392d78734c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:17.379065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cc7c6ef7-9225-4d29-900b-b8b096ea2fd6 req-ddef6024-f69f-4be8-8cba-bc392d78734c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:17.418852 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-cc7c6ef7-9225-4d29-900b-b8b096ea2fd6 req-ddef6024-f69f-4be8-8cba-bc392d78734c service nova] Creating event network-changed:d4bdd4ae-856b-4eb5-9670-e2ce1a62a781 for instance eb237cbb-7c63-45de-a406-b73d6b221ac5 on n-h2-854121-14 Oct 17 13:17:17.427094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-cc7c6ef7-9225-4d29-900b-b8b096ea2fd6 req-ddef6024-f69f-4be8-8cba-bc392d78734c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127006 Oct 17 13:17:17.428620 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 274/579] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 17 13:17:18.276951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:18.278095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:18.293717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.298392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.302401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.303671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.304372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.305019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.390034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:18.390892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:18.405921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.417981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.420673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.422132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:18.425150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:18.426604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:18.843068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:18.862695 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-350796a2-86d9-4d18-a116-b8e450119464 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.590705 Oct 17 13:17:18.871313 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 306/580] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:18 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:19.058787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:19.077316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:19.078769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:19.079887 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb1aeb4d-ea07-47d3-95e0-5e7e7cc67e8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.694155 Oct 17 13:17:19.109543 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 275/581] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:18 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:19.896018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:19.896672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:19.908277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f68a735-07c3-4c08-bdd6-032955573c00 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e2443a0>, body: {"keypair": {"name": "tempest-keypair-862234794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFE195dU+Qk5D5qPr3GXFilNE8pAXzYzVxfSglsAn5a7RES3vXQwgtCnNTq2eDOMhEYhC3ViMAbq2y3HZek5Spu4RuJdkfPlqIJuBGux5mjVsLHT2SoDD1FnCB/u4JAlZA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:19.918943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.919254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.919698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.930948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:19.936535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:19.937001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:19.976311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2f68a735-07c3-4c08-bdd6-032955573c00 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:20.008921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2f68a735-07c3-4c08-bdd6-032955573c00 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:20.085393 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f68a735-07c3-4c08-bdd6-032955573c00 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.431377 Oct 17 13:17:20.086385 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 307/582] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 433 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:17:20.097255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc7e267e-5040-4817-b2e6-76859db5bbe8 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e12c670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:20.119501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc7e267e-5040-4817-b2e6-76859db5bbe8 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs/tempest-keypair-862234794" status: 200 len: 511 microversion: 2.2 time: 0.026209 Oct 17 13:17:20.123344 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 308/583] 10.222.0.65 () {60 vars in 1255 bytes} [Mon Oct 17 13:17:20 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-862234794 => generated 511 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:20.133526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:20.139964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:20.154390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.158641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.161472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:20.166367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:20.169860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:20.170509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:20.749880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.760037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.766371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.772409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b68deae8-dbf5-405e-964e-52639170ff79 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.647856 Oct 17 13:17:20.785816 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 309/584] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:20 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:20.817970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa9f0bb2-2667-4d81-ae38-7995cec59aac tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e19f790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:20.857131 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa9f0bb2-2667-4d81-ae38-7995cec59aac tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-862234794" status: 204 len: 0 microversion: 2.2 time: 0.059106 Oct 17 13:17:20.858152 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 310/585] 10.222.0.65 () {60 vars in 1258 bytes} [Mon Oct 17 13:17:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-862234794 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:20.873739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70192994-2eb7-4166-a816-6b14e19720b3 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e0bfc10>, body: {"keypair": {"name": "tempest-keypair-2138562919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUkKMQVghq8nsH/fOjmGWfjFo6EJV1WtQ8Ihp6A8Eu/ttRe/9junPcIMkWVSI8xvAMfmdpvS92CzAaIJ6YsyLu/gUJ1ytJvmd/YvyZ0bv21KfiZdLaEOMrBRnMOjdLGGQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:20.890297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:20.905334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:20.912000 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb83dc8c-f1dd-487e-92ab-2e0334163eb3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 1.020618 Oct 17 13:17:20.920177 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 276/586] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:19 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:20.958373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-70192994-2eb7-4166-a816-6b14e19720b3 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:20.988862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-70192994-2eb7-4166-a816-6b14e19720b3 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:21.094200 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70192994-2eb7-4166-a816-6b14e19720b3 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.227603 Oct 17 13:17:21.099937 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 311/587] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:17:21.108337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18e162c2-fd3f-4fce-a52f-b4c1808c8e77 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e121790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.158181 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18e162c2-fd3f-4fce-a52f-b4c1808c8e77 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138562919" status: 204 len: 0 microversion: 2.2 time: 0.054142 Oct 17 13:17:21.158814 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 277/588] 10.222.0.65 () {60 vars in 1261 bytes} [Mon Oct 17 13:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2138562919 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:21.168542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6c48f1e-530b-4ce4-81ce-af7f394c4bfa tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e0f9ca0>, body: {"keypair": {"name": "tempest-keypair-382504671", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:21.229885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-c6c48f1e-530b-4ce4-81ce-af7f394c4bfa tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:21.253693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-c6c48f1e-530b-4ce4-81ce-af7f394c4bfa tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:21.352762 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6c48f1e-530b-4ce4-81ce-af7f394c4bfa tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.188547 Oct 17 13:17:21.364708 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 312/589] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:21 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:17:21.374599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa950c5e-c243-43d4-b1e0-119956aaf4f7 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e15ca60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.463569 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa950c5e-c243-43d4-b1e0-119956aaf4f7 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382504671" status: 204 len: 0 microversion: 2.2 time: 0.091048 Oct 17 13:17:21.492147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-136287bc-d0b1-4e01-8480-21298495d7ab tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e170af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-992315305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwcbvm6leVjw+FhLQrGT+N/FNX2QIY92t0dNvTPtG+0G3dkcLjd/NL66DZiCUa1r9u4fDDz3VLZmvfmKPPK5Mp96IZTZswQHIQXCRp8yuahCT0n5pjOIgPX1bJ9NkVgIg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:21.498976 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 278/590] 10.222.0.65 () {60 vars in 1258 bytes} [Mon Oct 17 13:17:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382504671 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:21.544522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-136287bc-d0b1-4e01-8480-21298495d7ab tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:21.569487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-136287bc-d0b1-4e01-8480-21298495d7ab tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:21.691746 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-136287bc-d0b1-4e01-8480-21298495d7ab tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.203462 Oct 17 13:17:21.703017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 313/591] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:21 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:17:21.720340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2e5de69-97c0-46b6-a7cc-a7b312fac373 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e0bb550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1215308872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXWn5s/UKmw2Dkwu77f1Ufwx9b6KPmgDFnmpytICqmzG0kNqhkoOLO2EgWtxJWy5Py9JSHFF3p3ziatFSXS8OBlu7FE9wJpvfVWRrAhMUrJpMkanqepJTODrU5YFbL99g=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:21.785651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c2e5de69-97c0-46b6-a7cc-a7b312fac373 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:21.810090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c2e5de69-97c0-46b6-a7cc-a7b312fac373 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:21.830952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:21.831740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:21.844592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.854741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.857259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.860416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:21.867358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:21.867973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:21.917958 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2e5de69-97c0-46b6-a7cc-a7b312fac373 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.201823 Oct 17 13:17:21.918710 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 279/592] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:17:21.937055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f35044e-1f78-4e70-9b3c-64c5763cee38 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e0bba60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-51027198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSf/NaGQACjow3Et0IVSao+Ne45fRpAMGrl7hWZGq92kEL4r9n3hDam3+216fYh8VA0BHgBxbPnJS7KpGw/JWhl1QivvZxMdEhG3ClSIvOhRtifVYEkIZJ6jZDcApELKg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:22.003682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9f35044e-1f78-4e70-9b3c-64c5763cee38 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:22.012452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9f35044e-1f78-4e70-9b3c-64c5763cee38 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:22.090245 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f35044e-1f78-4e70-9b3c-64c5763cee38 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.159073 Oct 17 13:17:22.091179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 280/593] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:21 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 17 13:17:22.101140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:22.101858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:22.135611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.136358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.137023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:22.138016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:22.138726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:22.139375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:23.617220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.629027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.637940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.639445 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9991376-50e0-429a-9990-efea2cd093b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 1.812465 Oct 17 13:17:23.640271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 314/594] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:21 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:23.660512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:23.693381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62bfba5a-6ae8-4fec-a74b-c568f9b346fa tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 1.600695 Oct 17 13:17:23.694386 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 281/595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:22 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:23.711382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6727839-1ecb-4dac-8b70-48d48b0a67e8 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e121f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.716633 n-d-854121-14 devstack@n-api.service[120697]: WARNING oslo_db.sqlalchemy.utils [None req-a6727839-1ecb-4dac-8b70-48d48b0a67e8 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:17:23.734330 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6727839-1ecb-4dac-8b70-48d48b0a67e8 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.038747 Oct 17 13:17:23.740881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 282/596] 10.222.0.65 () {60 vars in 1177 bytes} [Mon Oct 17 13:17:23 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:23.755427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-634d37c0-c508-487a-a646-a11110ace46d tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e0af280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.802647 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-634d37c0-c508-487a-a646-a11110ace46d tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-51027198" status: 204 len: 0 microversion: 2.2 time: 0.051455 Oct 17 13:17:23.804369 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 283/597] 10.222.0.65 () {60 vars in 1315 bytes} [Mon Oct 17 13:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-51027198 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:23.819415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1095f43-7025-41e9-b886-5687ee8e051c tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e0bbc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.873597 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1095f43-7025-41e9-b886-5687ee8e051c tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1215308872" status: 204 len: 0 microversion: 2.2 time: 0.064629 Oct 17 13:17:23.877091 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 284/598] 10.222.0.65 () {60 vars in 1321 bytes} [Mon Oct 17 13:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1215308872 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:23.885971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2367d991-6303-4eb8-9de0-065e1cd0c6fe tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e0bb9d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:23.980396 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2367d991-6303-4eb8-9de0-065e1cd0c6fe tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-992315305" status: 204 len: 0 microversion: 2.2 time: 0.080389 Oct 17 13:17:23.982150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 285/599] 10.222.0.65 () {60 vars in 1318 bytes} [Mon Oct 17 13:17:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-992315305 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:17:23.999574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f857f08-abfe-41d8-be5f-c477212b4e93 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e121c10>, body: {"keypair": {"name": "tempest-keypair-2098539107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3lijhtytRKL81TH9AnKUNMfC7jMxKs+bwFriO3PumeXEMmGj4/CRO7DyUJuIdA4FjzR3JRUJE49D8ok8gzW+oD6uChNC13PWr8qhJSP762fsOS9h0x9/SCcruDiVrvXQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:24.000954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53757aac-f438-4f2f-88d7-45aaa02814eb tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.023640 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53757aac-f438-4f2f-88d7-45aaa02814eb tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.381080 Oct 17 13:17:24.038209 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 315/600] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:24.057196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ec2b227-cced-43f4-bcca-dfcab0d2b42f tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.068285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0f857f08-abfe-41d8-be5f-c477212b4e93 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:24.109952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0f857f08-abfe-41d8-be5f-c477212b4e93 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:24.160276 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ec2b227-cced-43f4-bcca-dfcab0d2b42f tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors" status: 200 len: 3079 microversion: 2.1 time: 0.120449 Oct 17 13:17:24.162820 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 316/601] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/flavors => generated 3079 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:24.175859 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f857f08-abfe-41d8-be5f-c477212b4e93 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.180671 Oct 17 13:17:24.178029 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 286/602] 10.222.0.65 () {62 vars in 1199 bytes} [Mon Oct 17 13:17:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 184 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 17 13:17:24.200883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb161c50-2114-4e47-9ae3-be4f3b4f18bf tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e1c6af0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.202520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-550da018-6823-48f0-8cde-cbee76623e87 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.230976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:24.231533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-550da018-6823-48f0-8cde-cbee76623e87 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032633 Oct 17 13:17:24.239110 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 287/603] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:24.241420 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb161c50-2114-4e47-9ae3-be4f3b4f18bf tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs/tempest-keypair-2098539107" status: 200 len: 513 microversion: 2.2 time: 0.047082 Oct 17 13:17:24.246991 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 317/604] 10.222.0.65 () {60 vars in 1258 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2098539107 => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:24.269663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ff646a3-808b-4a23-99c7-e6e9eec23473 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e121af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.274061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8df51505-7413-453b-9257-2c576ee5b1e9 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.277655 n-d-854121-14 devstack@n-api.service[120697]: WARNING oslo_db.sqlalchemy.utils [None req-9ff646a3-808b-4a23-99c7-e6e9eec23473 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:17:24.296935 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ff646a3-808b-4a23-99c7-e6e9eec23473 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.039454 Oct 17 13:17:24.303237 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8df51505-7413-453b-9257-2c576ee5b1e9 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037429 Oct 17 13:17:24.304273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 318/605] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:24.307009 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 288/606] 10.222.0.65 () {60 vars in 1177 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:24.322683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e39e6164-2be2-4547-8a11-ac34d597a350 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e0d0670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.328156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd750dac-01cf-4113-bab1-e1a62eab49b5 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.376460 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e39e6164-2be2-4547-8a11-ac34d597a350 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098539107" status: 204 len: 0 microversion: 2.2 time: 0.060564 Oct 17 13:17:24.382066 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 319/607] 10.222.0.65 () {60 vars in 1261 bytes} [Mon Oct 17 13:17:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2098539107 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:24.391882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.393616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:24.404998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.408269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.409676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.410719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.413065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.413714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.415116 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd750dac-01cf-4113-bab1-e1a62eab49b5 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.094316 Oct 17 13:17:24.427973 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 289/608] 10.222.0.65 () {58 vars in 1165 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:24.448707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Action: 'create', calling method: .version_select at 0x7f419e183940>, body: {"keypair": {"name": "tempest-keypair-566103713", "type": "x509"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:24.491783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:24.495974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:17:24.505017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:24.571984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.processutils [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpi2ip6u6m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpi2ip6u6m/temp.key -subj /CN=85dba171ea044843918f40e337677724 -extensions v3_req_client {{(pid=120697) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 13:17:24.717014 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa398848-a454-47fd-bde3-4548047e8f91 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 204 len: 0 microversion: 2.1 time: 0.333435 Oct 17 13:17:24.731710 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 320/609] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:17:24 2022] DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:24.746901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a398f2e2-f2cb-4c51-b9ba-34bfa8ec4b74 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.784793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a398f2e2-f2cb-4c51-b9ba-34bfa8ec4b74 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051234 Oct 17 13:17:24.789537 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 321/610] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:24.835439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:24.841359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:24.868606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.870654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.871557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.874524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:24.876681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:24.880288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:24.887251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.processutils [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpi2ip6u6m/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpi2ip6u6m/temp.key -subj /CN=85dba171ea044843918f40e337677724 -extensions v3_req_client" returned: 0 in 0.315s {{(pid=120697) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 13:17:24.888726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.processutils [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpi2ip6u6m/temp.key -password pass: {{(pid=120697) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 17 13:17:24.969229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.processutils [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpi2ip6u6m/temp.key -password pass:" returned: 0 in 0.080s {{(pid=120697) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 17 13:17:25.048009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:25.073058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:25.087203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Getting quotas for user 85dba171ea044843918f40e337677724 and project ecfc04250e3e48f5b2ca397fb879937a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:25.139908 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b49b1483-bdd1-4301-ae56-d6d3e0c90878 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.708952 Oct 17 13:17:25.165947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 290/611] 10.222.0.65 () {62 vars in 1198 bytes} [Mon Oct 17 13:17:24 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 731 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:25.172840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:25.173858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:25.201567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.208924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.209731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.212466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:25.219443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:25.220176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:25.926913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:25.937655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:25.943407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:25.946452 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26209c1a-f632-4315-b450-402b4f1a90f0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 1.155648 Oct 17 13:17:25.951065 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 322/612] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:24 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:25.961686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20f1818a-c1a7-4256-8702-6cd6d9f2c485 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.026555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:26.039490 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3ca32ca-2292-426a-8567-a2f117babd08 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.871877 Oct 17 13:17:26.042228 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 291/613] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:25 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.055765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-924471028", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "1734308731", "adminPass": "***", "networks": [{"uuid": "6a103d5b-3642-483b-9de5-752fc6a13039"}], "security_groups": [{"name": "tempest-securitygroup--143728265"}], "key_name": "tempest-keypair-1087051587", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:26.085755 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20f1818a-c1a7-4256-8702-6cd6d9f2c485 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.127263 Oct 17 13:17:26.091892 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 323/614] 10.222.0.65 () {58 vars in 1169 bytes} [Mon Oct 17 13:17:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.112617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5a51eb2-334b-41f2-9890-a9b55faf2420 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e245430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.154839 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5a51eb2-334b-41f2-9890-a9b55faf2420 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs/tempest-keypair-566103713" status: 200 len: 1533 microversion: 2.2 time: 0.061548 Oct 17 13:17:26.159200 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 324/615] 10.222.0.65 () {60 vars in 1255 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-566103713 => generated 1533 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.171158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4513a00-eb97-47e8-81ea-a8b51df1f26e tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.203519 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4513a00-eb97-47e8-81ea-a8b51df1f26e tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.042876 Oct 17 13:17:26.209501 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 325/616] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:26.220584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64d14ec3-573c-401d-80a0-ff53334180b7 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e244430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.233354 n-d-854121-14 devstack@n-api.service[120698]: WARNING oslo_db.sqlalchemy.utils [None req-64d14ec3-573c-401d-80a0-ff53334180b7 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:17:26.253709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64d14ec3-573c-401d-80a0-ff53334180b7 tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.040595 Oct 17 13:17:26.261614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 326/617] 10.222.0.65 () {60 vars in 1177 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.281420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49bade44-64f7-401b-a8cb-fc0d0ae38821 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.333859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49bade44-64f7-401b-a8cb-fc0d0ae38821 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064194 Oct 17 13:17:26.347440 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 327/618] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:26.358529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e98ae69-26ac-4e80-8856-130936feee2b tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] Calling method '.version_select at 0x7f419e170820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.439428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e98ae69-26ac-4e80-8856-130936feee2b tempest-KeyPairsV22TestJSON-110870023 tempest-KeyPairsV22TestJSON-110870023-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-566103713" status: 204 len: 0 microversion: 2.2 time: 0.087445 Oct 17 13:17:26.447602 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 328/619] 10.222.0.65 () {60 vars in 1258 bytes} [Mon Oct 17 13:17:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-566103713 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:26.451478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db44cd80-c0a1-446b-a67e-0990f2ef5d6f tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.563070 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db44cd80-c0a1-446b-a67e-0990f2ef5d6f tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2912 microversion: 2.1 time: 0.119797 Oct 17 13:17:26.571179 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 329/620] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2912 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.592424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11744138-652a-4261-806b-c514034d52f9 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.603059 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11744138-652a-4261-806b-c514034d52f9 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015041 Oct 17 13:17:26.613849 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 330/621] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:26.619270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a00216a4-15aa-412c-9254-6df5b3d3243b tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.665441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a00216a4-15aa-412c-9254-6df5b3d3243b tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.048938 Oct 17 13:17:26.678459 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 331/622] 10.222.0.65 () {58 vars in 1144 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.691522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53c71a02-38c6-43a3-8db7-bd91d23b8bcb tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.707542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53c71a02-38c6-43a3-8db7-bd91d23b8bcb tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020211 Oct 17 13:17:26.718699 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 332/623] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:26.745220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fffd1e2d-7d37-4d24-ad15-1a0650828f99 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.778702 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fffd1e2d-7d37-4d24-ad15-1a0650828f99 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.058734 Oct 17 13:17:26.779858 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 333/624] 10.222.0.65 () {58 vars in 1148 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.800425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d95615d-4c46-404f-9b52-1d9507873b81 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.827014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] validate_networks() for [('6a103d5b-3642-483b-9de5-752fc6a13039', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:17:26.836906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d95615d-4c46-404f-9b52-1d9507873b81 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.041049 Oct 17 13:17:26.838468 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 334/625] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:17:26.851069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c78ab04-30d7-42e1-a8a0-1951ebeeab9f tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.873191 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c78ab04-30d7-42e1-a8a0-1951ebeeab9f tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025854 Oct 17 13:17:26.874041 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 335/626] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:17:26.886819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3c643ac-96f3-4021-9570-0f0ae16d96b3 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.931169 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3c643ac-96f3-4021-9570-0f0ae16d96b3 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1541 microversion: 2.1 time: 0.048013 Oct 17 13:17:26.941606 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 336/627] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors?marker=452 => generated 1541 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:26.946892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80514c6e-8915-414c-af0d-f55e03f3d502 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.983854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80514c6e-8915-414c-af0d-f55e03f3d502 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.040770 Oct 17 13:17:26.984894 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 337/628] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:26.990502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:26.991119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:27.019812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.020485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.021316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:27.022176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:27.022637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:27.034691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.057599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.067548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.073114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.077973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa8dea86-a5fe-4403-871b-151a63129c3d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 1.091983 Oct 17 13:17:28.093275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 338/629] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:26 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:28.093275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f08ffffc-3ba6-4ed2-824d-87f2aeacd497 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:28.119191 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f08ffffc-3ba6-4ed2-824d-87f2aeacd497 tempest-FlavorsV2TestJSON-931737382 tempest-FlavorsV2TestJSON-931737382-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034448 Oct 17 13:17:28.120377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 339/630] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:17:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:28.136227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:28.137398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:28.155020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.160691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.161373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.163217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.165029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.165664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.854619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:28.855216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:28.855525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:28.856195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:28.856620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:28.894578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:28.895670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.896555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.897023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.906148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:28.909399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:28.911016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:28.922246 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f72eb351-b1f0-430e-8488-7450e5d70009 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.799481 Oct 17 13:17:28.944673 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 340/631] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:28 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:28.993249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Getting quotas for project dc11740e1af34fb89993b21d04f22d49. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:29.015589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Getting quotas for user 76b1fd5cee4248bbaf5f972c3fadea02 and project dc11740e1af34fb89993b21d04f22d49. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:29.072702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:29.075437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:29.109756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:29.110527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:29.132358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.133298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.133754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.134493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.135060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.135381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.260165 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39927579-cd15-4882-b8f3-ab7f902511a2 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.216485 Oct 17 13:17:29.260838 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 292/632] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:17:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 3218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:17:29.274302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-457dc761-7bae-4e5b-9b77-c5bf42290f75 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:29.292203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-457dc761-7bae-4e5b-9b77-c5bf42290f75 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:29.545626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-457dc761-7bae-4e5b-9b77-c5bf42290f75 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:29.558562 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-457dc761-7bae-4e5b-9b77-c5bf42290f75 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1264 microversion: 2.1 time: 0.287581 Oct 17 13:17:29.560156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 293/633] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:29 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1264 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:29.951832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:29.953276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:29.979963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.986909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.987631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:29.989628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:29.991422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:29.998964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:29.999430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.009811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:30.011979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:30.013505 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45b831e5-8368-45ab-b283-49ab031e0552 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.908889 Oct 17 13:17:30.022129 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 341/634] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:29 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:30.450980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-20509e46-9ebb-473b-9b04-40d4ab037aa2 req-d73a5788-cf6f-49fe-8cc6-fcfc0e76bf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7695663-7195-438d-be05-5c0e52665c89", "name": "network-vif-plugged", "status": "completed", "tag": "40da2ef7-39de-495c-ad80-f595dfbf584a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:30.484769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-20509e46-9ebb-473b-9b04-40d4ab037aa2 req-d73a5788-cf6f-49fe-8cc6-fcfc0e76bf54 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.495632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-20509e46-9ebb-473b-9b04-40d4ab037aa2 req-d73a5788-cf6f-49fe-8cc6-fcfc0e76bf54 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.500834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-20509e46-9ebb-473b-9b04-40d4ab037aa2 req-d73a5788-cf6f-49fe-8cc6-fcfc0e76bf54 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.578711 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-20509e46-9ebb-473b-9b04-40d4ab037aa2 req-d73a5788-cf6f-49fe-8cc6-fcfc0e76bf54 service nova] Creating event network-vif-plugged:40da2ef7-39de-495c-ad80-f595dfbf584a for instance f7695663-7195-438d-be05-5c0e52665c89 on n-h1-854121-14 Oct 17 13:17:30.599828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-20509e46-9ebb-473b-9b04-40d4ab037aa2 req-d73a5788-cf6f-49fe-8cc6-fcfc0e76bf54 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151312 Oct 17 13:17:30.603476 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 342/635] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:30.654957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:30.661063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:30.699108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.704717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.705550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.708801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:30.711878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:30.712613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:30.943611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:30.959448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1a2190b-5b00-4f5b-81ff-dc010a02ae47 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 1.009078 Oct 17 13:17:30.963232 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 294/636] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:29 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:31.001552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.012646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef0b57d9-be76-4226-b4b8-7b7017b6bc8f tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1268 microversion: 2.1 time: 0.407794 Oct 17 13:17:31.027866 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 343/637] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:30 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1268 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:31.051347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.051966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:31.079540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.080365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.080888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.082758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.094106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.102355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.526669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.539877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.542698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:31.544121 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0dd9e168-a53c-4373-98e4-01f47303fa16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 0.498643 Oct 17 13:17:31.568375 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 295/638] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:31 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:31.623833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:31.876133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-46f3b01c-4a5a-4215-929b-2521692e217d req-3b6ea9e5-e9d2-4947-978f-e13c42e0ab91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06cfa7a-43e5-4c28-930b-4999358934b2", "name": "network-vif-deleted", "tag": "e9077ca8-69e0-4d30-a803-019fb6f6b7a2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:31.919643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-46f3b01c-4a5a-4215-929b-2521692e217d req-3b6ea9e5-e9d2-4947-978f-e13c42e0ab91 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:31.921776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-46f3b01c-4a5a-4215-929b-2521692e217d req-3b6ea9e5-e9d2-4947-978f-e13c42e0ab91 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:31.926041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-46f3b01c-4a5a-4215-929b-2521692e217d req-3b6ea9e5-e9d2-4947-978f-e13c42e0ab91 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:31.954280 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-46f3b01c-4a5a-4215-929b-2521692e217d req-3b6ea9e5-e9d2-4947-978f-e13c42e0ab91 service nova] Creating event network-vif-deleted:e9077ca8-69e0-4d30-a803-019fb6f6b7a2 for instance f06cfa7a-43e5-4c28-930b-4999358934b2 on n-h2-854121-14 Oct 17 13:17:31.979160 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-46f3b01c-4a5a-4215-929b-2521692e217d req-3b6ea9e5-e9d2-4947-978f-e13c42e0ab91 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103634 Oct 17 13:17:31.984078 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 296/639] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:17:31.993209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:31.999310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.022025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.022799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.023537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.024732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.025900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.026481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.268684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7f0dee4-4349-415c-a0ba-61d790e6c157 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'create', calling method: .version_select at 0x7f419e0bfca0>, body: {"keypair": {"name": "tempest-keypair-1889660122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0J60/4/BWC1xyVlfObOVY3iCYpRXUrQwWtyNYNcimoZoFvB2kEX6ZpMXSxrFSQ5nSPW5ykPD0Bp0wq2qnpCwWZuSe9sgfcjhc0SsKhoa8tAOmxtLWPhB9QyhzAgLkXzg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:32.317333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b7f0dee4-4349-415c-a0ba-61d790e6c157 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:32.332590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b7f0dee4-4349-415c-a0ba-61d790e6c157 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for user 6ad84e1798394f69a409af3c96b6752c and project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:32.411336 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7f0dee4-4349-415c-a0ba-61d790e6c157 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.900666 Oct 17 13:17:32.419299 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 344/640] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:17:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:17:32.430309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.434951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.447727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.450931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.456542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.460744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.461501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.462096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.692496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.716787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-785973ed-003b-49da-9a96-6c64194e1779 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1322 microversion: 2.1 time: 0.294789 Oct 17 13:17:32.719640 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 345/641] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:32.743882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:32.765105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:32.770069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:32.812161 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07282be1-fa4a-4255-9614-da6a091148cd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.822970 Oct 17 13:17:32.812906 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 297/642] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:31 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:32.827341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.828258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.828909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:32.832972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:32.832972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:32.832972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.747476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.753702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:33.755414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:33.778400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.780701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.784824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.788313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.790245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:33.794619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.796977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.798336 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a3eccfa-935c-4702-a7a4-d0a318a9a3b4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1361 microversion: 2.25 time: 1.074717 Oct 17 13:17:33.803643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.805614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 346/643] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:32 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1361 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:33.844244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:33.844915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:33.872063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.878769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.879845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:33.882565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:33.883595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:33.885838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.139216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.153920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-716f736e-df3b-4266-bb82-933f2dc9430b tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1322 microversion: 2.1 time: 0.411100 Oct 17 13:17:34.173433 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 298/644] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:33 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:34.589060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:34.602091 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-941bb118-76bf-4062-8fec-81123d8e404a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.765187 Oct 17 13:17:34.623486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 347/645] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:33 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:17:34.834727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:34.836126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:34.855586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.862099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.862907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.863916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:34.864593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:34.865270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:34.914951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:35.283656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71cb6f11-2199-405c-864c-5a74b0638a5d tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Action: 'create', calling method: .version_select at 0x7f419e183550>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:36.753361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:36.781915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:36.789094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:36.793591 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ada29397-5c10-4462-9c9e-1d7966815d33 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1558 microversion: 2.25 time: 1.961745 Oct 17 13:17:36.803480 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 348/646] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:34 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1558 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:17:36.814311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1e205032-f3d1-4d96-a27d-4b2b25b34c94 req-308f60ff-8d44-4da8-978d-9013ea2da14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb237cbb-7c63-45de-a406-b73d6b221ac5", "name": "network-vif-plugged", "status": "completed", "tag": "d4bdd4ae-856b-4eb5-9670-e2ce1a62a781"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:36.844592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e205032-f3d1-4d96-a27d-4b2b25b34c94 req-308f60ff-8d44-4da8-978d-9013ea2da14b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.845913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e205032-f3d1-4d96-a27d-4b2b25b34c94 req-308f60ff-8d44-4da8-978d-9013ea2da14b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.846991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e205032-f3d1-4d96-a27d-4b2b25b34c94 req-308f60ff-8d44-4da8-978d-9013ea2da14b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.864840 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1e205032-f3d1-4d96-a27d-4b2b25b34c94 req-308f60ff-8d44-4da8-978d-9013ea2da14b service nova] Creating event network-vif-plugged:d4bdd4ae-856b-4eb5-9670-e2ce1a62a781 for instance eb237cbb-7c63-45de-a406-b73d6b221ac5 on n-h2-854121-14 Oct 17 13:17:36.872334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1e205032-f3d1-4d96-a27d-4b2b25b34c94 req-308f60ff-8d44-4da8-978d-9013ea2da14b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067317 Oct 17 13:17:36.873301 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 349/647] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:36.883903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:36.884627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:36.895407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.896476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.896933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:36.898259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:36.898758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:36.899186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.108677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.119403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33115791-aa18-4c51-9e40-38a29a452499 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1389 microversion: 2.1 time: 1.244694 Oct 17 13:17:38.129554 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 350/648] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:36 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1389 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:38.134471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:38.135088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:38.150138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.150662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.154481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.155483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:38.156287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:38.157538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:38.877366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:38.894752 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d595856a-10c5-41dd-beb6-6f71f9c0d9c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1311 microversion: 2.1 time: 0.763973 Oct 17 13:17:38.895342 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 351/649] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:38 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1311 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:38.938362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:39.210436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:39.211286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:39.240793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.241341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.241787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.242508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:39.242972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:39.243398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:39.550889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=28 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:39.751667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid f7695663-7195-438d-be05-5c0e52665c89 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:39.787425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d33a63c2-201b-4882-a8fc-3853011b655b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 2052 microversion: 2.25 time: 0.889026 Oct 17 13:17:39.791059 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 352/650] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:38 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 2052 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:39.799814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1925015995", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "409d5ac5-1afa-4a2d-b8d2-6def2794c056"}], "security_groups": [{"name": "tempest-securitygroup--1881070257"}], "key_name": "tempest-keypair-1889660122", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:40.056229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] validate_networks() for [('409d5ac5-1afa-4a2d-b8d2-6def2794c056', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:17:41.943470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:41.944723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:41.945470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:41.946395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:41.947831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:41.967384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.969569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.971227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:41.975375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:41.976166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:41.977010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.016789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:42.041396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:42.046586 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71cb6f11-2199-405c-864c-5a74b0638a5d tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.274424 Oct 17 13:17:42.056087 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 299/651] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:17:34 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:42.062732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for user 6ad84e1798394f69a409af3c96b6752c and project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:42.067621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.077321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.093956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.123013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.124848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:42.126571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.127536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.133866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.134652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.144075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:42.279687 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e7a124c-27c3-463f-b534-8ecdbc5dfe17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.487046 Oct 17 13:17:42.280787 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 353/652] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:17:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 2489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:17:42.289352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c7870d52-2b99-4b62-933c-f071ccff49ac req-f587d274-b862-4329-8ed8-f2a676d5bf6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f884c2-7af3-45cc-b3ec-c406e229c9ec", "tag": "9c627e86-a36a-4b90-94be-42caa190903d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:42.317455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7870d52-2b99-4b62-933c-f071ccff49ac req-f587d274-b862-4329-8ed8-f2a676d5bf6c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.318309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7870d52-2b99-4b62-933c-f071ccff49ac req-f587d274-b862-4329-8ed8-f2a676d5bf6c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.319024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7870d52-2b99-4b62-933c-f071ccff49ac req-f587d274-b862-4329-8ed8-f2a676d5bf6c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.351525 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c7870d52-2b99-4b62-933c-f071ccff49ac req-f587d274-b862-4329-8ed8-f2a676d5bf6c service nova] Creating event network-changed:9c627e86-a36a-4b90-94be-42caa190903d for instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec on n-h1-854121-14 Oct 17 13:17:42.383246 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c7870d52-2b99-4b62-933c-f071ccff49ac req-f587d274-b862-4329-8ed8-f2a676d5bf6c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100340 Oct 17 13:17:42.386014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 354/653] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:42.397872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.400974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.419926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.421756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.424751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.426092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.433971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.434955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.540865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:42.557737 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-143f15e9-7ad7-4b09-ad71-6e0213632b05 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1389 microversion: 2.1 time: 0.500038 Oct 17 13:17:42.570655 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 300/654] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1389 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:42.582167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:42.592695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:42.615293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.616029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.620407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.621088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:42.621541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:42.626633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:42.926528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid f7695663-7195-438d-be05-5c0e52665c89 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:42.957846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f8d29e1-c02c-4244-92ce-d9b8f7df1ac0 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 2052 microversion: 2.25 time: 0.569562 Oct 17 13:17:42.974268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 355/655] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 2052 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:42.997472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ac1dcf4-d54e-40fe-a68e-5d6fc6d3fd23 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Calling method '.version_select at 0x7f419e0d00d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.048153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:43.110840 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9bcfd1d-84af-4be0-b0c6-020cfd927501 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1493 microversion: 2.1 time: 0.533185 Oct 17 13:17:43.112359 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 301/656] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1493 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:43.136155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d86f0533-9666-4829-8b84-a6ffcff230d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.137220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d86f0533-9666-4829-8b84-a6ffcff230d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.307303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d86f0533-9666-4829-8b84-a6ffcff230d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:43.315645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d86f0533-9666-4829-8b84-a6ffcff230d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1239 microversion: 2.1 time: 0.193749 Oct 17 13:17:43.316240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 302/657] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1239 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:43.332656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.356107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.356610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.360154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.361006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.364808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.365432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.404271 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d462456-f834-4fd5-8898-cb9ee28304d6 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.086950 Oct 17 13:17:43.414072 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 303/658] 10.222.0.65 () {60 vars in 1217 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:17:43.465019 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ac1dcf4-d54e-40fe-a68e-5d6fc6d3fd23 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips/785df79d-5b6e-4fa8-a328-b9cac90d50dc" status: 200 len: 142 microversion: 2.1 time: 0.479972 Oct 17 13:17:43.473706 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 356/659] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:17:42 2022] GET /compute/v2.1/os-floating-ips/785df79d-5b6e-4fa8-a328-b9cac90d50dc => generated 142 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:43.473706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": "auto"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:43.477749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.504174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.504980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.507926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.513207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.516421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.519708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.584243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'flavor' on Instance uuid f7695663-7195-438d-be05-5c0e52665c89 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:43.648768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: f7695663-7195-438d-be05-5c0e52665c89] Going to try to live migrate instance to n-h2-854121-14 {{(pid=120698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:17:43.749815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:43.750432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:43.766482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.766985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.767499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:43.768233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:43.768692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:43.769124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:44.518010 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-acaed815-ba36-4eb1-9be2-88e6fef19bb8 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1646 microversion: 2.1 time: 1.102050 Oct 17 13:17:44.539782 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 304/660] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:43 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1646 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:44.558621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-724196df-bce9-4269-a3a8-bbdc949f0be6 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Calling method '.version_select at 0x7f419e121ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.053249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-724196df-bce9-4269-a3a8-bbdc949f0be6 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.511193 Oct 17 13:17:45.054868 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 305/661] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:17:44 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:45.067359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.067971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.085654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.086549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.090700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.091636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.092266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.096972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.484563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.497126 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa09bd09-5c18-4ed1-98a2-08ef3b08e090 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1389 microversion: 2.1 time: 0.441101 Oct 17 13:17:45.497842 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 306/662] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1389 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:45.515455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.528163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.544562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.557432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.559126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.560064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.563955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.564846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.726646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:45.735622 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6000c46f-98f9-45cb-a268-f6d3d36fcee8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1297 microversion: 2.1 time: 0.232524 Oct 17 13:17:45.737403 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 307/663] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1297 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:45.755511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:45.756541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:45.764293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.775175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.775648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:45.776433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:45.776866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:45.777333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:46.195956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-606d81f4-48e8-44ce-ba9f-afde856c1f80 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1646 microversion: 2.1 time: 0.457083 Oct 17 13:17:46.196584 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 308/664] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:45 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1646 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:46.201587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae875b9f-b477-409f-b6eb-815ae2a5efaf tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Calling method '.version_select at 0x7f419e121af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:47.755094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-627d13a9-d99f-4dfc-84d4-15fdc8a40326 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89/action" status: 202 len: 0 microversion: 2.25 time: 4.287186 Oct 17 13:17:47.755711 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 357/665] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:17:43 2022] POST /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89/action => generated 0 bytes in 4288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:17:47.760789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:47.771169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.771919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.772631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.773633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.774278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.774985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.864859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-615ed62a-a515-4f9d-b7cb-deea459d9b98 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.107598 Oct 17 13:17:47.866276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 358/666] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:17:47 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:47.878292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:47.880549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:47.897912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.898642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.901614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:47.902646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:47.905825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:47.906507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.600247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:48.619251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c9862c7-edc3-4aa8-bc56-9777127fdaba tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1389 microversion: 2.1 time: 0.751652 Oct 17 13:17:48.648732 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 359/667] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:47 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1389 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:48.669413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:48.670259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:48.685606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.690815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.701804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:48.702579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:48.703055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:48.703481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.815929 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae875b9f-b477-409f-b6eb-815ae2a5efaf tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/785df79d-5b6e-4fa8-a328-b9cac90d50dc" status: 202 len: 0 microversion: 2.1 time: 3.618003 Oct 17 13:17:49.816514 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 309/668] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:17:46 2022] DELETE /compute/v2.1/os-floating-ips/785df79d-5b6e-4fa8-a328-b9cac90d50dc => generated 0 bytes in 3619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:49.821439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:49.822233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:49.832083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.832413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:49.835221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.835894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.841401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.842120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.844029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.862062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2823d386-c239-4d8a-af84-ad5c0c5a2e5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1365 microversion: 2.1 time: 1.194450 Oct 17 13:17:49.867831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 360/669] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:48 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1365 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:49.891386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:49.896507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:49.915909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.916404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.916844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.922757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:49.925100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:49.925588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:49.959562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lazy-loading 'flavor' on Instance uuid eb237cbb-7c63-45de-a406-b73d6b221ac5 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:17:49.974207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Going to try to live migrate instance to n-h1-854121-14 {{(pid=120698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:17:50.454439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.473009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.477818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:50.478983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c91ecc5d-58cf-4436-b975-d89e58054a7c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.661277 Oct 17 13:17:50.483118 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 310/670] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:49 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:50.513084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fc91f2c5-8309-4fc8-b956-9c7efe98107d req-1b6ec6d2-3ea9-4ca4-a6b0-9903debc4ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f884c2-7af3-45cc-b3ec-c406e229c9ec", "name": "network-vif-plugged", "status": "completed", "tag": "9c627e86-a36a-4b90-94be-42caa190903d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:50.556442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fc91f2c5-8309-4fc8-b956-9c7efe98107d req-1b6ec6d2-3ea9-4ca4-a6b0-9903debc4ed2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.559310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fc91f2c5-8309-4fc8-b956-9c7efe98107d req-1b6ec6d2-3ea9-4ca4-a6b0-9903debc4ed2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.561697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fc91f2c5-8309-4fc8-b956-9c7efe98107d req-1b6ec6d2-3ea9-4ca4-a6b0-9903debc4ed2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.641911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fc91f2c5-8309-4fc8-b956-9c7efe98107d req-1b6ec6d2-3ea9-4ca4-a6b0-9903debc4ed2 service nova] Creating event network-vif-plugged:9c627e86-a36a-4b90-94be-42caa190903d for instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec on n-h1-854121-14 Oct 17 13:17:50.682735 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fc91f2c5-8309-4fc8-b956-9c7efe98107d req-1b6ec6d2-3ea9-4ca4-a6b0-9903debc4ed2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196302 Oct 17 13:17:50.715166 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 311/671] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:50.749926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:50.750946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:50.778403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.779036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.779486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:50.780225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:50.780687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:50.781112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:52.025254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:52.027858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=91 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:52.041533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8be651da-ece0-4920-9356-01b067706c68 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1389 microversion: 2.1 time: 1.324288 Oct 17 13:17:52.048943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 312/672] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:50 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1389 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:52.062783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10b62c0b-9650-4eb1-b17a-9eaf2421fd87 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Action: 'create', calling method: .version_select at 0x7f419e07a820>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:52.084642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:53.314913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:53.375586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:53.497743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a64945df-92f0-4b0e-a93f-a39cbe431e92 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5/action" status: 202 len: 0 microversion: 2.1 time: 3.614157 Oct 17 13:17:53.498538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 361/673] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:17:49 2022] POST /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5/action => generated 0 bytes in 3616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:17:53.504830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:53.505686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:53.512812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:53.513540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:53.514140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:53.514836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:53.515473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:53.515892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:54.032083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:54.043729 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d78e02d-d368-4508-8875-c7e85ee1da07 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1365 microversion: 2.1 time: 0.543558 Oct 17 13:17:54.048819 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 362/674] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:53 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1365 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:54.073804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:54.074473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:54.091201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:54.091705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:54.092147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:54.092868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:54.093357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:54.093784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:54.455101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:54.470100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:54.472193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:54.475233 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52d5aee7-66d1-46de-b54d-2485fe6506e6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.421335 Oct 17 13:17:54.497791 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 363/675] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:54 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:54.514555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c59b9f6a-56bb-4342-8a23-e1387908f53a req-aadb1605-6a0d-4f80-a49b-6bf2497489fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:54.539837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c59b9f6a-56bb-4342-8a23-e1387908f53a req-aadb1605-6a0d-4f80-a49b-6bf2497489fa service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:54.540328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c59b9f6a-56bb-4342-8a23-e1387908f53a req-aadb1605-6a0d-4f80-a49b-6bf2497489fa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:54.540766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c59b9f6a-56bb-4342-8a23-e1387908f53a req-aadb1605-6a0d-4f80-a49b-6bf2497489fa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:54.552097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:54.567657 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c59b9f6a-56bb-4342-8a23-e1387908f53a req-aadb1605-6a0d-4f80-a49b-6bf2497489fa service nova] Creating event network-changed:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:17:54.576765 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c59b9f6a-56bb-4342-8a23-e1387908f53a req-aadb1605-6a0d-4f80-a49b-6bf2497489fa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077584 Oct 17 13:17:54.582900 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 364/676] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:54.691833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2154c5e-8b29-4a26-90ab-dbcf684b56a8 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e0c48b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1978612654", "description": "tempest-description-2100228238"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:55.403796 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2154c5e-8b29-4a26-90ab-dbcf684b56a8 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.819074 Oct 17 13:17:55.404414 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 365/677] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:17:54 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:55.412785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:55.424187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:55.462969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.468437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.472908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.474099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.474692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.475276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.708342 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10b62c0b-9650-4eb1-b17a-9eaf2421fd87 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.658062 Oct 17 13:17:55.716493 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 313/678] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:17:52 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:55.722185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:55.723107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:55.742894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:55.751288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.752370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.752812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.753641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.753771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:55.754169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.754444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.774819 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a4c9fb9-d34e-4710-b296-104389b17560 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1589 microversion: 2.1 time: 0.365618 Oct 17 13:17:55.793343 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 366/679] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:55 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1589 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:55.816647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-20ae0917-2e5e-4611-af81-a0d649a25edc req-222666cf-9771-4239-a595-c8fd3ee3ed4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7695663-7195-438d-be05-5c0e52665c89", "name": "network-vif-unplugged", "status": "completed", "tag": "40da2ef7-39de-495c-ad80-f595dfbf584a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:55.856682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-20ae0917-2e5e-4611-af81-a0d649a25edc req-222666cf-9771-4239-a595-c8fd3ee3ed4e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:55.870882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-20ae0917-2e5e-4611-af81-a0d649a25edc req-222666cf-9771-4239-a595-c8fd3ee3ed4e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:55.872345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-20ae0917-2e5e-4611-af81-a0d649a25edc req-222666cf-9771-4239-a595-c8fd3ee3ed4e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:55.912934 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-20ae0917-2e5e-4611-af81-a0d649a25edc req-222666cf-9771-4239-a595-c8fd3ee3ed4e service nova] Creating event network-vif-unplugged:40da2ef7-39de-495c-ad80-f595dfbf584a for instance f7695663-7195-438d-be05-5c0e52665c89 on n-h1-854121-14 Oct 17 13:17:55.933630 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-20ae0917-2e5e-4611-af81-a0d649a25edc req-222666cf-9771-4239-a595-c8fd3ee3ed4e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138140 Oct 17 13:17:55.935671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 367/680] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:56.061755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1619714582", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "485e24b6-e427-4cdd-ae21-18e362301c4e"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:56.161674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] validate_networks() for [('485e24b6-e427-4cdd-ae21-18e362301c4e', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:17:56.229329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:56.238052 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a07f6f3-68bf-4ce8-b792-360b7c37bbf4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.520019 Oct 17 13:17:56.258195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 314/681] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:55 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:56.264706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:56.265567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:56.274333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:56.275804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:56.276659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:56.277570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:56.278181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:56.279533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.243591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:57.254137 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5f986eef-449f-4902-98ec-be322ea2a7e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1365 microversion: 2.1 time: 0.994417 Oct 17 13:17:57.255461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 315/682] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:56 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1365 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:57.262304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9de50f8d-2b59-4b17-91db-63119e1c185a tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e15c280>, body: {"security_group_rule": {"parent_group_id": "0b11e4b7-f555-46ec-9929-df690d21e1db", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:57.816135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:17:57.834064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:17:57.834715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:17:57.835780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:17:57.836733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:17:57.837568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:17:57.847190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.847670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.848101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.848819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.849318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.849732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.868499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Getting quotas for project e7e85eeff8fe4f27964f2063624827b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:57.874848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Getting quotas for user 6d37b800dbaf44f58c048fb2fef592f8 and project e7e85eeff8fe4f27964f2063624827b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:57.889843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:17:57.893390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:17:57.946518 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff576361-c839-40f3-91e0-c1b85941a3af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006052 Oct 17 13:17:57.953753 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 368/683] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:17:57.959793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:57.960830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:57.969684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.970745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.971476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:57.972343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:57.973104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:57.973728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.155202 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9de50f8d-2b59-4b17-91db-63119e1c185a tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.898378 Oct 17 13:17:58.155809 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 316/684] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:17:57 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:58.160549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ab08a9d-c898-4b60-aaeb-0bc0e30b0087 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Calling method '.version_select at 0x7f419e07aaf0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:58.385863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.396211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.398530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:58.400267 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24d47315-1eec-47ce-b652-d811287ec6ec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.444623 Oct 17 13:17:58.401092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 369/685] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:17:57 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:17:58.417869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:58.418682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:58.427780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.429127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.429764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.430934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.431592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.432275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.631913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d2353c6-0375-4370-a320-452a25364962 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.229482 Oct 17 13:17:58.632538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 370/686] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:17:58 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec/os-interface => generated 285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:58.808239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fdb02637-9afe-4203-b8d6-7c4768e55679 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Action: 'create', calling method: .version_select at 0x7f419e19f0d0>, body: {"keypair": {"name": "tempest-keypair-1874562394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL+YGdOfu6vGYPL2DyetzEHRwtDXHyIvvfgS+u7dT3P1ybFIbU9+yVzQdj6KP+sOiBEgBba5+o+ZSKgxOWPCxyJF8Z1yuWXPLMLTNyw5Q/hRlsCKgzBq4ekG/iWNn/oUQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:58.827321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fdb02637-9afe-4203-b8d6-7c4768e55679 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Getting quotas for project 1f0d21470cf449d1a0edab843f31ce7e. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:17:58.834525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fdb02637-9afe-4203-b8d6-7c4768e55679 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Getting quotas for user 0437fbd647094f76bba5f9bed9b6c053 and project 1f0d21470cf449d1a0edab843f31ce7e. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:17:58.879436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fdb02637-9afe-4203-b8d6-7c4768e55679 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.245807 Oct 17 13:17:58.881652 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 371/687] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:17:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:58.894564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:58.896900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:58.906073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.907170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.908703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:58.909680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:58.910204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:58.910826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.313387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:59.326405 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e914104-5860-46c7-80ed-336be5aeffdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.442217 Oct 17 13:17:59.344977 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 372/688] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:58 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:59.352780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:17:59.353886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:17:59.363045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:59.364173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:59.365006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.366284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:59.367185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:59.367904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.522029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:17:59.533918 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48dbebde-73c5-4a9b-9792-e8d929448393 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1276 microversion: 2.1 time: 0.186263 Oct 17 13:17:59.535111 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 373/689] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:17:59 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:17:59.545760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9e850d78-a4b0-47e5-a317-48d011b622b1 req-3ae6d705-0e3c-450e-b34b-9440735c658f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7695663-7195-438d-be05-5c0e52665c89", "tag": "40da2ef7-39de-495c-ad80-f595dfbf584a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:17:59.575158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9e850d78-a4b0-47e5-a317-48d011b622b1 req-3ae6d705-0e3c-450e-b34b-9440735c658f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:17:59.577265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9e850d78-a4b0-47e5-a317-48d011b622b1 req-3ae6d705-0e3c-450e-b34b-9440735c658f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:17:59.580807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9e850d78-a4b0-47e5-a317-48d011b622b1 req-3ae6d705-0e3c-450e-b34b-9440735c658f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:17:59.636862 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9e850d78-a4b0-47e5-a317-48d011b622b1 req-3ae6d705-0e3c-450e-b34b-9440735c658f service nova] Creating event network-changed:40da2ef7-39de-495c-ad80-f595dfbf584a for instance f7695663-7195-438d-be05-5c0e52665c89 on n-h1-854121-14 Oct 17 13:17:59.645551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9e850d78-a4b0-47e5-a317-48d011b622b1 req-3ae6d705-0e3c-450e-b34b-9440735c658f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104638 Oct 17 13:17:59.646852 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 374/690] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:17:59.657242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b44901fd-2d92-4db7-a9fd-78cb94cf1f15 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e043b80>, body: {"security_group_rule": {"parent_group_id": "0b11e4b7-f555-46ec-9929-df690d21e1db", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:00.225728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ab08a9d-c898-4b60-aaeb-0bc0e30b0087 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee" status: 202 len: 0 microversion: 2.1 time: 2.068465 Oct 17 13:18:00.232769 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 317/691] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:17:58 2022] DELETE /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee => generated 0 bytes in 2076 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:00.254721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:00.261978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:00.263801 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b44901fd-2d92-4db7-a9fd-78cb94cf1f15 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: This rule already exists in group 0b11e4b7-f555-46ec-9929-df690d21e1db Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b44901fd-2d92-4db7-a9fd-78cb94cf1f15 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 138 Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:00.278034 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: {"security_group_rule": {"parent_group_id": "0b11e4b7-f555-46ec-9929-df690d21e1db", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:18:00.279463 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: exception: This rule already exists in group 0b11e4b7-f555-46ec-9929-df690d21e1db Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0b11e4b7-f555-46ec-9929-df690d21e1db', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 0b11e4b7-f555-46ec-9929-df690d21e1db Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:00.280254 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 0b11e4b7-f555-46ec-9929-df690d21e1db Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 0b11e4b7-f555-46ec-9929-df690d21e1db Oct 17 13:18:00.281906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.285303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b44901fd-2d92-4db7-a9fd-78cb94cf1f15 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 400 to user: This rule already exists in group 0b11e4b7-f555-46ec-9929-df690d21e1db {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:00.286654 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b44901fd-2d92-4db7-a9fd-78cb94cf1f15 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.638112 Oct 17 13:18:00.287573 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 375/692] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:17:59 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 640 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:18:00.292712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.293658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.294116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:00.294960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:00.295123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.297279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.298002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.299168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.314112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.327255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.327790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.328653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.329895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.330666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.699503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:00.705781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:00.711511 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb95ad7c-8dab-4a92-ab23-9245b4d26285 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1365 microversion: 2.1 time: 0.475824 Oct 17 13:18:00.713275 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 318/693] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:00 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1365 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:00.718558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:00.719355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5ca5afb-1173-4878-80ad-e581535edba7 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Calling method '.version_select at 0x7f419e15c4c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:00.720385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:00.722196 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f48b974-65b7-4974-b11c-fe4b88a97ea2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.433396 Oct 17 13:18:00.730483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 376/694] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:00 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:00.736458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9203e97-7f60-4c98-bfec-7342c97c7415 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419e00c670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:00.786431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-a5ca5afb-1173-4878-80ad-e581535edba7 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3895a4e6-dde9-4abb-8119-b4f4c794b8ee could not be found", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:18:00.788464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a5ca5afb-1173-4878-80ad-e581535edba7 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] HTTP exception thrown: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5ca5afb-1173-4878-80ad-e581535edba7 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Request method failure captured: Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee HTTP/1.1 Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXueqML-uy139CaPP8gWH2hPyz3Liij4JMjVK0ftr9G-67ZFfsw06jVG8deRsyN_T-0j46YrauynRDX1griGxBwnVrHyo4MhBcVvRspkd1thHhf4knJEaRPiDK9sDWSxpYhXf9rVXd5A8FZ_lQ803K3hoRRPbs_7QiNruBYLVLYcpU Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: dd9dcb0236a746339dcec27b917e3c01 Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsTestJSON-1939173170 Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:00.791086 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsTestJSON-1939173170 Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: dd9dcb0236a746339dcec27b917e3c01 Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1939173170 Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsTestJSON-1939173170-project Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 305fe09043cb488bb62061d157413ae1 Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsTestJSON-1939173170-project Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: exception: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3895a4e6-dde9-4abb-8119-b4f4c794b8ee'} Oct 17 13:18:00.792428 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:18:00.793312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3895a4e6-dde9-4abb-8119-b4f4c794b8ee could not be found Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-58a935f1-d407-44b7-ace0-88cf9f8422cb'] Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee. Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:00.794479 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:00.795760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:00.796976 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:00.796976 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:00.799803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5ca5afb-1173-4878-80ad-e581535edba7 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Returning 404 to user: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:00.800953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5ca5afb-1173-4878-80ad-e581535edba7 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee" status: 404 len: 111 microversion: 2.1 time: 0.086510 Oct 17 13:18:00.801899 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 319/695] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:18:00 2022] GET /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:00.810446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:00.812076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:00.821192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.822183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.824272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:00.825441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:00.826126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:00.826772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.263134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.273341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e45393ce-904c-456e-9ebf-47b2542afc87 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.469208 Oct 17 13:18:01.289330 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 320/696] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:00 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:01.299233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:01.300137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:01.307260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.307996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.308605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.309569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.310219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.310808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.485254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:01.497186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30ef56ea-7101-4d95-9547-15f7cd11a27a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1282 microversion: 2.1 time: 0.206269 Oct 17 13:18:01.497758 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 321/697] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:01 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:01.508219 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9203e97-7f60-4c98-bfec-7342c97c7415 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-group-rules/f62400e5-7356-4899-810b-867f43b43f04" status: 202 len: 0 microversion: 2.1 time: 0.775908 Oct 17 13:18:01.508818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-82d932a9-47ca-4d71-9467-1da2c14e89ff req-df9f52ef-55dd-43d4-b6fd-dd436c28939d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-plugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:01.509329 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 377/698] 10.222.0.65 () {58 vars in 1287 bytes} [Mon Oct 17 13:18:00 2022] DELETE /compute/v2.1/os-security-group-rules/f62400e5-7356-4899-810b-867f43b43f04 => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:01.514339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8450517b-0e08-47a9-bade-56fb630af7e0 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Calling method '.version_select at 0x7f419dfc35e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:01.533767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-82d932a9-47ca-4d71-9467-1da2c14e89ff req-df9f52ef-55dd-43d4-b6fd-dd436c28939d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.534271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-82d932a9-47ca-4d71-9467-1da2c14e89ff req-df9f52ef-55dd-43d4-b6fd-dd436c28939d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.534714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-82d932a9-47ca-4d71-9467-1da2c14e89ff req-df9f52ef-55dd-43d4-b6fd-dd436c28939d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.559910 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-82d932a9-47ca-4d71-9467-1da2c14e89ff req-df9f52ef-55dd-43d4-b6fd-dd436c28939d service nova] Creating event network-vif-plugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:18:01.567016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-82d932a9-47ca-4d71-9467-1da2c14e89ff req-df9f52ef-55dd-43d4-b6fd-dd436c28939d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064303 Oct 17 13:18:01.568177 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 322/699] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:01.573660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:01.574555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:01.583730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.584527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.585457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.586354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.587156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.587848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.608385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-8450517b-0e08-47a9-bade-56fb630af7e0 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3895a4e6-dde9-4abb-8119-b4f4c794b8ee could not be found", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:18:01.609612 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-8450517b-0e08-47a9-bade-56fb630af7e0 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] HTTP exception thrown: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8450517b-0e08-47a9-bade-56fb630af7e0 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Request method failure captured: Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee HTTP/1.1 Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXueqML-uy139CaPP8gWH2hPyz3Liij4JMjVK0ftr9G-67ZFfsw06jVG8deRsyN_T-0j46YrauynRDX1griGxBwnVrHyo4MhBcVvRspkd1thHhf4knJEaRPiDK9sDWSxpYhXf9rVXd5A8FZ_lQ803K3hoRRPbs_7QiNruBYLVLYcpU Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dd9dcb0236a746339dcec27b917e3c01 Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FloatingIPsTestJSON-1939173170 Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:01.621400 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dd9dcb0236a746339dcec27b917e3c01"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FloatingIPsTestJSON-1939173170 Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dd9dcb0236a746339dcec27b917e3c01 Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1939173170 Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FloatingIPsTestJSON-1939173170-project Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 305fe09043cb488bb62061d157413ae1 Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FloatingIPsTestJSON-1939173170-project Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: exception: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3895a4e6-dde9-4abb-8119-b4f4c794b8ee'} Oct 17 13:18:01.622969 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:18:01.623801 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3895a4e6-dde9-4abb-8119-b4f4c794b8ee could not be found Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-732e53f5-a2ea-4be9-9309-d3c655e3bf93'] Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee. Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:01.624960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:01.628569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:01.631243 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee Oct 17 13:18:01.631243 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:01.631243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8450517b-0e08-47a9-bade-56fb630af7e0 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] Returning 404 to user: Floating IP not found for ID 3895a4e6-dde9-4abb-8119-b4f4c794b8ee {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:01.631243 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8450517b-0e08-47a9-bade-56fb630af7e0 tempest-FloatingIPsTestJSON-1939173170 tempest-FloatingIPsTestJSON-1939173170-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee" status: 404 len: 111 microversion: 2.1 time: 0.119863 Oct 17 13:18:01.638128 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 378/700] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:18:01 2022] DELETE /compute/v2.1/os-floating-ips/3895a4e6-dde9-4abb-8119-b4f4c794b8ee => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:01.649493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2b896018-4779-4d09-8491-cdac0f53773d req-4755e2b9-a409-4369-969d-ae1638be9f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f884c2-7af3-45cc-b3ec-c406e229c9ec", "tag": "9c627e86-a36a-4b90-94be-42caa190903d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:01.660800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2b896018-4779-4d09-8491-cdac0f53773d req-4755e2b9-a409-4369-969d-ae1638be9f9c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:01.661869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2b896018-4779-4d09-8491-cdac0f53773d req-4755e2b9-a409-4369-969d-ae1638be9f9c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:01.662461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2b896018-4779-4d09-8491-cdac0f53773d req-4755e2b9-a409-4369-969d-ae1638be9f9c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:01.674505 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2b896018-4779-4d09-8491-cdac0f53773d req-4755e2b9-a409-4369-969d-ae1638be9f9c service nova] Creating event network-changed:9c627e86-a36a-4b90-94be-42caa190903d for instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec on n-h1-854121-14 Oct 17 13:18:01.682021 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2b896018-4779-4d09-8491-cdac0f53773d req-4755e2b9-a409-4369-969d-ae1638be9f9c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049050 Oct 17 13:18:01.683300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 379/701] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:01.689804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbae9dd2-e339-4d92-99f7-01e931300eb5 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419dfc35e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1253392029", "description": "tempest-description-698436660"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:02.069920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.107008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8454e54-93aa-4b8f-bb82-58488e97ffb9 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1589 microversion: 2.1 time: 0.536165 Oct 17 13:18:02.108757 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 323/702] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:01 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1589 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:02.118770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb237cbb-7c63-45de-a406-b73d6b221ac5", "name": "network-vif-unplugged", "status": "completed", "tag": "d4bdd4ae-856b-4eb5-9670-e2ce1a62a781"}, {"name": "network-changed", "server_uuid": "eb237cbb-7c63-45de-a406-b73d6b221ac5", "tag": "d4bdd4ae-856b-4eb5-9670-e2ce1a62a781"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:02.136239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.136732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.137217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.150430 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] Creating event network-vif-unplugged:d4bdd4ae-856b-4eb5-9670-e2ce1a62a781 for instance eb237cbb-7c63-45de-a406-b73d6b221ac5 on n-h2-854121-14 Oct 17 13:18:02.151592 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] Creating event network-changed:d4bdd4ae-856b-4eb5-9670-e2ce1a62a781 for instance eb237cbb-7c63-45de-a406-b73d6b221ac5 on n-h2-854121-14 Oct 17 13:18:02.157036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9e9ab3f7-9134-49b3-98a0-6adc4b0967a8 req-d1f7979d-43a2-4f8e-957d-556503d19d6c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.046419 Oct 17 13:18:02.158316 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 324/703] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:02.164011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:02.164968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:02.172007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.172510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.172958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.173844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.174306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.174728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.381269 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbae9dd2-e339-4d92-99f7-01e931300eb5 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.696535 Oct 17 13:18:02.391922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 380/704] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:18:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:02.397367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:02.398412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:02.408383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.409487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.410331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.412445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.413409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.414217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.691960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.711840 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-14353b34-b101-4ecc-ae01-157ccceea2be tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1365 microversion: 2.1 time: 0.552089 Oct 17 13:18:02.712431 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 325/705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:02 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1365 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:02.744635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:02.746052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:02.754876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.755657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.756306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.757475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:02.758089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:02.758819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:02.825150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.844915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.847044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:02.848508 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-555c2227-3717-40cb-abe8-6da6a1b46da5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.455207 Oct 17 13:18:02.849588 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 381/706] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:02 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:02.856494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b58b7365-395a-4b59-9f66-09b56ce45e88 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e043dc0>, body: {"security_group_rule": {"parent_group_id": "cbd80a44-85e5-44c0-ae58-b739835f1a45", "ip_protocol": "tcp", "from_port": 1526632663, "to_port": 22}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:03.250259 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b58b7365-395a-4b59-9f66-09b56ce45e88 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Invalid port range 1526632663:22. Former value cannot be greater than the later Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b58b7365-395a-4b59-9f66-09b56ce45e88 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 146 Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:03.253590 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: {"security_group_rule": {"parent_group_id": "cbd80a44-85e5-44c0-ae58-b739835f1a45", "ip_protocol": "tcp", "from_port": 1526632663, "to_port": 22}} Oct 17 13:18:03.254977 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid port range 1526632663:22. Former value cannot be greater than the later Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbd80a44-85e5-44c0-ae58-b739835f1a45', 'ip_protocol': 'tcp', 'from_port': 1526632663, 'to_port': 22}}} Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1526632663:22. Former value cannot be greater than the later Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:03.255712 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1526632663:22. Former value cannot be greater than the later Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1526632663:22. Former value cannot be greater than the later Oct 17 13:18:03.258518 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.260573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b58b7365-395a-4b59-9f66-09b56ce45e88 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 400 to user: Invalid port range 1526632663:22. Former value cannot be greater than the later {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:03.260573 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b58b7365-395a-4b59-9f66-09b56ce45e88 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.403570 Oct 17 13:18:03.260573 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 382/707] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:18:02 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 409 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:18:03.269810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:03.270447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:03.278132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.278684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.279127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.279919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.280494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.281135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.424998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.435184 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f421af25-7d14-4169-bb14-6c39cb3ed037 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.699586 Oct 17 13:18:03.435938 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 326/708] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:02 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:03.442173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97e523d5-a020-4d56-8d84-f125f888921e tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e121af0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1878866701", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:03.444400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-97e523d5-a020-4d56-8d84-f125f888921e tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Security group id should be uuid Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97e523d5-a020-4d56-8d84-f125f888921e tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 131 Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:03.448058 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1878866701", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:03.449354 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group id should be uuid Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1878866701', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:03.450128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 17 13:18:03.451313 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:03.453923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97e523d5-a020-4d56-8d84-f125f888921e tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 400 to user: Security group id should be uuid {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:03.456981 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-97e523d5-a020-4d56-8d84-f125f888921e tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019618 Oct 17 13:18:03.458964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 327/709] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:18:03 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:18:03.468208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76223623-1615-4d73-8289-44a2eabd3c3a tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e07ae50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-903243826", "description": "tempest-description-585614080"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:03.657666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:03.666893 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8866a059-b07b-43eb-b1f8-dbfafb937f04 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1324 microversion: 2.1 time: 0.405835 Oct 17 13:18:03.667482 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 383/710] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:03 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:03.719542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fcbefc84-d070-4a60-b1d6-c891a307bb88 req-41be629c-10cc-4635-945b-b784f75681c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:03.738330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fcbefc84-d070-4a60-b1d6-c891a307bb88 req-41be629c-10cc-4635-945b-b784f75681c5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.739219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fcbefc84-d070-4a60-b1d6-c891a307bb88 req-41be629c-10cc-4635-945b-b784f75681c5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.739862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fcbefc84-d070-4a60-b1d6-c891a307bb88 req-41be629c-10cc-4635-945b-b784f75681c5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.769536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fcbefc84-d070-4a60-b1d6-c891a307bb88 req-41be629c-10cc-4635-945b-b784f75681c5 service nova] Creating event network-changed:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:18:03.784808 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fcbefc84-d070-4a60-b1d6-c891a307bb88 req-41be629c-10cc-4635-945b-b784f75681c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066713 Oct 17 13:18:03.785469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 384/711] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:03.797288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:03.799279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:03.807868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.808427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.808871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:03.809633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:03.810242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:03.810831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.018125 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76223623-1615-4d73-8289-44a2eabd3c3a tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.553784 Oct 17 13:18:04.019063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 328/712] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:18:03 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:18:04.027085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:04.027969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:04.036135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:04.036948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:04.037491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.038335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:04.038904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:04.039503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.135663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.144967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98ef4f37-3f3c-4320-a925-2bec253283e9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1365 microversion: 2.1 time: 0.357332 Oct 17 13:18:04.145924 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 385/713] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:03 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:04.158937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-943329288", "imageRef": "86e641d5-300a-4336-817f-6aaf7871744c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4a787575-14bd-4da1-b223-b99ac1b75d4c"}], "security_groups": [{"name": "tempest-securitygroup--1125679548"}], "key_name": "tempest-keypair-1874562394", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:04.279986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.290635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.292533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.293847 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e8e5008-73a1-435f-897d-1b56e152f859 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.273519 Oct 17 13:18:04.294757 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 329/714] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:04 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:04.299489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b1e52d7-e7cf-4158-b7f6-c648298b8720 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e121670>, body: {"security_group_rule": {"parent_group_id": "60bae80d-ca47-40ce-a615-c4d857646f85", "ip_protocol": "tempest-999-1536045361", "from_port": 22, "to_port": 22}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:04.339181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] validate_networks() for [('4a787575-14bd-4da1-b223-b99ac1b75d4c', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:18:04.469755 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-1b1e52d7-e7cf-4158-b7f6-c648298b8720 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Invalid IP protocol tempest-999-1536045361. Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b1e52d7-e7cf-4158-b7f6-c648298b8720 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 157 Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:04.471944 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: {"security_group_rule": {"parent_group_id": "60bae80d-ca47-40ce-a615-c4d857646f85", "ip_protocol": "tempest-999-1536045361", "from_port": 22, "to_port": 22}} Oct 17 13:18:04.473569 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid IP protocol tempest-999-1536045361. Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'security_group_rule': {'parent_group_id': '60bae80d-ca47-40ce-a615-c4d857646f85', 'ip_protocol': 'tempest-999-1536045361', 'from_port': 22, 'to_port': 22}}} Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1536045361. Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:04.474450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1536045361. Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1536045361. Oct 17 13:18:04.476042 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:04.478417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b1e52d7-e7cf-4158-b7f6-c648298b8720 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 400 to user: Invalid IP protocol tempest-999-1536045361. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:04.479332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b1e52d7-e7cf-4158-b7f6-c648298b8720 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.183655 Oct 17 13:18:04.479992 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 330/715] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:18:04 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:18:04.487973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:04.488585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:04.496138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:04.496640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:04.497066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.497849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:04.498367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:04.498797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:04.819608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:04.828235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2821b95-89da-487e-b290-da2df1f3e0d2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.347303 Oct 17 13:18:04.828820 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 331/716] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:04 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:04.834212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82cf6d45-4f3c-4cf3-ae4a-76e827b4d10a tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e121040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1218036138", "description": "tempest-description-1262437916"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:05.296156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:18:05.296740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:18:05.297043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:18:05.297476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:18:05.298798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:18:05.322378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.323133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.323765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.325010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.326092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.326666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.361606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Getting quotas for project 1f0d21470cf449d1a0edab843f31ce7e. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:18:05.368215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:05.369984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Getting quotas for user 0437fbd647094f76bba5f9bed9b6c053 and project 1f0d21470cf449d1a0edab843f31ce7e. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:18:05.381143 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82cf6d45-4f3c-4cf3-ae4a-76e827b4d10a tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.550351 Oct 17 13:18:05.391935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:18:05.392774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='86e641d5-300a-4336-817f-6aaf7871744c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:18:05.393241 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 332/717] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:18:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:05.401826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:05.402605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:05.410000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.410714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.411314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.412179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.412794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.413666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.466330 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f299125e-f29e-4a43-9b95-e90f940e1fc0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.311686 Oct 17 13:18:05.467480 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 386/718] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:18:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:18:05.473427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:05.474671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:05.482628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.483363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.484416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.485414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.486626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.487221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.852816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:05.867058 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03cd9318-6465-4364-8323-ce221e6653ce tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1324 microversion: 2.1 time: 0.471258 Oct 17 13:18:05.868146 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 333/719] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:05 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:05.888607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:05.889658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:05.905212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:05.920150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88f6faab-4a1e-468f-b6ae-0899eb095119 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1553 microversion: 2.1 time: 0.449754 Oct 17 13:18:05.922367 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 387/720] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:05 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1553 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:05.926464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.928746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.929471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.933992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:05.934710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:05.935399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:05.937397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7e639b9-403d-4683-b66e-b98533897de2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e0c4040>, body: {"security_group_rule": {"parent_group_id": "56f4827b-bdd9-49d7-b7eb-2b053eb72927", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:06.102859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e7e639b9-403d-4683-b66e-b98533897de2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7e639b9-403d-4683-b66e-b98533897de2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 138 Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:06.104506 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: {"security_group_rule": {"parent_group_id": "56f4827b-bdd9-49d7-b7eb-2b053eb72927", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 17 13:18:06.105921 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'security_group_rule': {'parent_group_id': '56f4827b-bdd9-49d7-b7eb-2b053eb72927', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:06.106938 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 17 13:18:06.108135 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:06.111779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7e639b9-403d-4683-b66e-b98533897de2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:06.111779 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7e639b9-403d-4683-b66e-b98533897de2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.179842 Oct 17 13:18:06.111779 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 388/721] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:18:05 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:18:06.113659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-580ac82f-abfa-438b-9741-9b9c125cb1b0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:06.114282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-580ac82f-abfa-438b-9741-9b9c125cb1b0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:06.211906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.222347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.223903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.225207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a876891-8b6d-4090-89ef-32fb31de592a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.355612 Oct 17 13:18:06.251934 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 334/722] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:05 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:06.265915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:06.266556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:06.280257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.280760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.281228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.281950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.282544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.283170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.294889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-580ac82f-abfa-438b-9741-9b9c125cb1b0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.306087 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-580ac82f-abfa-438b-9741-9b9c125cb1b0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1245 microversion: 2.1 time: 0.195801 Oct 17 13:18:06.306687 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 389/723] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:06 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1245 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:06.323314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:06.324216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:06.340244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.341908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.343552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.348356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.350722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.354375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.555788 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-050e3b30-3e81-4cc4-b920-87e9304603a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247599 Oct 17 13:18:06.557497 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 390/724] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:18:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/os-interface => generated 285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:06.562599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:06.563256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6c5edf5-b61e-4979-83a6-2faa28da01b2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e0c4430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-160289973", "description": "tempest-description-1930129545"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:06.573554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b854056c-eada-4a59-b207-cb18d23c19e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.317855 Oct 17 13:18:06.574970 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 335/725] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:06 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:06.896014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:06.896705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:06.936328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.936833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.940084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:06.942576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:06.943060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:06.943501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.566737 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6c5edf5-b61e-4979-83a6-2faa28da01b2 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.007592 Oct 17 13:18:07.574161 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 391/726] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:18:06 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:07.589264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.591049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:07.606614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.609640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.612296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.616653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.617534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.619638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.663842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.673894 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec3438b9-2bcd-4ed3-8cfb-cd1fdd4c2045 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1324 microversion: 2.1 time: 0.784378 Oct 17 13:18:07.674479 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 336/727] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:06 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1324 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:07.694762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:07.696136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:07.703002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.703832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.705213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.706398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:07.707067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:07.707790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:07.890527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:07.901831 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f535065-461d-46c5-8f39-756ae1636b24 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1297 microversion: 2.1 time: 0.215117 Oct 17 13:18:07.905469 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 337/728] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1297 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:07.918589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a630c74f-6b24-43d7-a87d-829ff9b03678 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e17a940>, body: {"security_group_rule": {"parent_group_id": "3aa8fb37-6e58-4163-9edf-763e9672cbcb", "ip_protocol": "tcp", "from_port": 22, "to_port": 2128351418}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:08.249819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:08.261081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:08.262577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:08.263769 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8acae7fa-897d-4010-9799-5b67564fb9ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.688464 Oct 17 13:18:08.264327 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 392/729] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:07 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:08.294273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:08.297032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:08.304333 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a630c74f-6b24-43d7-a87d-829ff9b03678 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Invalid port range 22:2128351418. Valid TCP ports should be between 1-65535 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a630c74f-6b24-43d7-a87d-829ff9b03678 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 146 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:08.307655 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: {"security_group_rule": {"parent_group_id": "3aa8fb37-6e58-4163-9edf-763e9672cbcb", "ip_protocol": "tcp", "from_port": 22, "to_port": 2128351418}} Oct 17 13:18:08.309107 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid port range 22:2128351418. Valid TCP ports should be between 1-65535 Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3aa8fb37-6e58-4163-9edf-763e9672cbcb', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2128351418}}} Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2128351418. Valid TCP ports should be between 1-65535 Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:08.309918 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2128351418. Valid TCP ports should be between 1-65535 Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2128351418. Valid TCP ports should be between 1-65535 Oct 17 13:18:08.311229 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.312440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a630c74f-6b24-43d7-a87d-829ff9b03678 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 400 to user: Invalid port range 22:2128351418. Valid TCP ports should be between 1-65535 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:08.312440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a630c74f-6b24-43d7-a87d-829ff9b03678 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.403029 Oct 17 13:18:08.312440 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 338/730] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:18:07 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:18:08.322141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.323973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-913b553c-3751-4801-a0c6-29560d01a0f5 req-a2be8a26-fe86-4bfe-9887-1d852ee61164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "name": "network-vif-plugged", "status": "completed", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:08.326722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.327751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.328945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.330407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.333096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.348448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-913b553c-3751-4801-a0c6-29560d01a0f5 req-a2be8a26-fe86-4bfe-9887-1d852ee61164 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.350818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-913b553c-3751-4801-a0c6-29560d01a0f5 req-a2be8a26-fe86-4bfe-9887-1d852ee61164 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.352180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-913b553c-3751-4801-a0c6-29560d01a0f5 req-a2be8a26-fe86-4bfe-9887-1d852ee61164 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.374332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-913b553c-3751-4801-a0c6-29560d01a0f5 req-a2be8a26-fe86-4bfe-9887-1d852ee61164 service nova] Creating event network-vif-plugged:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:18:08.382111 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-913b553c-3751-4801-a0c6-29560d01a0f5 req-a2be8a26-fe86-4bfe-9887-1d852ee61164 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070172 Oct 17 13:18:08.387835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 339/731] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:08.407997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Action: 'create', calling method: .version_select at 0x7f419e1210d0>, body: {"security_group_rule": {"parent_group_id": "3ce91dca-d8de-4dfd-972f-5e37ade456ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:08.536755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:18:08.537416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Neutron security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:18:08.537957 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.537957 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 138 Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:08.540048 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: {"security_group_rule": {"parent_group_id": "3ce91dca-d8de-4dfd-972f-5e37ade456ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 17 13:18:08.541685 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3ce91dca-d8de-4dfd-972f-5e37ade456ea', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:18:08.542579 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 17 13:18:08.551995 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] Oct 17 13:18:08.554854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 404 to user: Security group 3ce91dca-d8de-4dfd-972f-5e37ade456ea does not exist Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-3337b226-0648-46d0-90df-1b248347a217'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:08.557335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96f44b2e-3590-49f8-8cef-05b0dd4085ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.152902 Oct 17 13:18:08.558414 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 340/732] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:18:08 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:08.559489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419e15c310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:08.700317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:18:08.701707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Neutron security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc not found {{(pid=120697) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 17 13:18:08.703268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] HTTP exception thrown: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.703268 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Request method failure captured: Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-group-rules/a48d300d-5875-40d8-8471-d78bc9c0aafc HTTP/1.1 Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYAVivni3XYTHSGG1NiZWwpdA-1OyXgnyVZCRDe9xuSSEuSo3a-oAOQVkEsqtlbtM62C9wMhXM0ExUGWrs-bKX3AKPMzJ_NHUOkesUJ36Xyc6IUw1p5_mSQDF_wvhXz4y_c70PrbFy4xGFMxAe9K1cvEPbQjVBrbI-ztQ3pcc23l7g Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:08.705600 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8a993f29bad64e6a87860036205c9587"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8a993f29bad64e6a87860036205c9587"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8a993f29bad64e6a87860036205c9587"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 8a993f29bad64e6a87860036205c9587 Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288 Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4ae49e1186cc4f0bbca95948a21fab1d Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-742515288-project Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.707255 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a48d300d-5875-40d8-8471-d78bc9c0aafc'} Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.708200 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 17 13:18:08.710192 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.711623 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Returning 404 to user: Security group rule a48d300d-5875-40d8-8471-d78bc9c0aafc does not exist Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-028400b1-8566-4d89-a18d-20af2a4e9fac'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:08.713101 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15dd98e4-a229-49da-b5bb-63daea06fb28 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-group-rules/a48d300d-5875-40d8-8471-d78bc9c0aafc" status: 404 len: 199 microversion: 2.1 time: 0.159244 Oct 17 13:18:08.714890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 341/733] 10.222.0.65 () {58 vars in 1287 bytes} [Mon Oct 17 13:18:08 2022] DELETE /compute/v2.1/os-security-group-rules/a48d300d-5875-40d8-8471-d78bc9c0aafc => generated 199 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:18:08.722614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:08.723486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:08.730586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.731439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.731975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.732893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:08.733557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:08.734070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:08.793183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:08.984765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.005134 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-99f26572-577a-4479-b3f1-9aa32a108096 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.722991 Oct 17 13:18:09.007581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 393/734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:08 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:09.021306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c24ca1ee-a3b2-4132-8a84-2c8fc960c0d5 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419e245670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:09.366852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:09.382479 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bb306bc-6c0a-4634-a955-04e78ffbd690 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1324 microversion: 2.1 time: 0.666554 Oct 17 13:18:09.383630 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 342/735] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:08 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:09.410478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:09.411231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:09.428271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.441915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.442527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:09.443388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:09.443954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:09.444484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.218119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:10.227842 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6f24c9c-e0d5-4818-ac4b-e19245e76d72 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1303 microversion: 2.1 time: 0.829012 Oct 17 13:18:10.242047 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 343/736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:09 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1303 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:10.252775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:10.253621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:10.260916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.262282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.262905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.263878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.265074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.265791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.718708 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c24ca1ee-a3b2-4132-8a84-2c8fc960c0d5 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/3aa8fb37-6e58-4163-9edf-763e9672cbcb" status: 202 len: 0 microversion: 2.1 time: 1.708938 Oct 17 13:18:10.719297 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 394/737] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:18:09 2022] DELETE /compute/v2.1/os-security-groups/3aa8fb37-6e58-4163-9edf-763e9672cbcb => generated 0 bytes in 1711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:10.726565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:10.727772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:10.746619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.749813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.750572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:10.756435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:10.757437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:10.758167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.520226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.539106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.544189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.550581 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e96e0c8-612f-485a-a3fa-774be6a42b9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 1.307135 Oct 17 13:18:11.552456 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 344/738] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:10 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:11.568494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:11.570521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:11.605038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:11.625620 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85d83b8a-679b-45ba-9b73-b97931516e0e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1503 microversion: 2.1 time: 0.903553 Oct 17 13:18:11.627669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.628508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.628971 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 395/739] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:10 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1503 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:11.631186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.633443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:11.634080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:11.634683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:11.643459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37732172-c11f-474c-af82-9b112ce891ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419e00cca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.124592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:12.138560 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16effa29-c619-4ff2-b954-99e735b6f419 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1518 microversion: 2.1 time: 0.584107 Oct 17 13:18:12.155448 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 345/740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:11 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1518 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:12.167780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.168852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.179134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.179892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.180501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.181522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.182129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.183139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.261378 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37732172-c11f-474c-af82-9b112ce891ec tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/56f4827b-bdd9-49d7-b7eb-2b053eb72927" status: 202 len: 0 microversion: 2.1 time: 0.629012 Oct 17 13:18:12.263368 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 396/741] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:18:11 2022] DELETE /compute/v2.1/os-security-groups/56f4827b-bdd9-49d7-b7eb-2b053eb72927 => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:12.271193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-37514f63-a392-4e13-96cf-a6c70439328e req-78162d18-4ec8-4114-9e58-74f80cb08026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:12.314031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-37514f63-a392-4e13-96cf-a6c70439328e req-78162d18-4ec8-4114-9e58-74f80cb08026 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.316225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-37514f63-a392-4e13-96cf-a6c70439328e req-78162d18-4ec8-4114-9e58-74f80cb08026 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.327617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-37514f63-a392-4e13-96cf-a6c70439328e req-78162d18-4ec8-4114-9e58-74f80cb08026 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.369538 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-37514f63-a392-4e13-96cf-a6c70439328e req-78162d18-4ec8-4114-9e58-74f80cb08026 service nova] Creating event network-changed:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:18:12.390816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:12.403220 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98623b81-d318-4c44-affc-402305e23b59 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.246559 Oct 17 13:18:12.403818 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 346/742] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:12.423636 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-37514f63-a392-4e13-96cf-a6c70439328e req-78162d18-4ec8-4114-9e58-74f80cb08026 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158031 Oct 17 13:18:12.425315 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 397/743] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:12.430713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-767a07e4-c9c7-432c-83b6-f0aef9837ac3 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419dfe9940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.435993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ed4e175-776f-4dfd-b963-cbcf3e28f468 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'create', calling method: .version_select at 0x7f419e18dee0>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:12.820301 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-767a07e4-c9c7-432c-83b6-f0aef9837ac3 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/60bae80d-ca47-40ce-a615-c4d857646f85" status: 202 len: 0 microversion: 2.1 time: 0.394089 Oct 17 13:18:12.822093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 398/744] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:18:12 2022] DELETE /compute/v2.1/os-security-groups/60bae80d-ca47-40ce-a615-c4d857646f85 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:12.831033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:12.832168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:12.843431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.844360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.846664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:12.849553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:12.850303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:12.851674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.125130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.133453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:13.166319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.169475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.171966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86f8604a-14b5-4fcc-8c27-d8efc44572d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.346958 Oct 17 13:18:13.174360 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 399/745] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:12 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:13.180110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:13.181030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:13.202626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.203410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.203953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.206337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:13.206914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:13.207468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:13.577255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:13.586841 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd158997-5cbd-47e2-883d-6c174ca42792 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1493 microversion: 2.1 time: 0.410923 Oct 17 13:18:13.587498 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 400/746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:13 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1493 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:13.622041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c273aba-43df-41a0-8e68-319fc63120b9 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419df62af0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.243725 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c273aba-43df-41a0-8e68-319fc63120b9 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/cbd80a44-85e5-44c0-ae58-b739835f1a45" status: 202 len: 0 microversion: 2.1 time: 0.631322 Oct 17 13:18:14.248908 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 401/747] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:18:13 2022] DELETE /compute/v2.1/os-security-groups/cbd80a44-85e5-44c0-ae58-b739835f1a45 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:14.256955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.257616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:14.275626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.278486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.280479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.284139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.285091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.286233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.545638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:14.558037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1be16770-1485-4dc1-9043-5a201f807215 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.307848 Oct 17 13:18:14.559088 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 402/748] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:14.563877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc24643e-ce15-4889-a00b-6d629150d0c4 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '.version_select at 0x7f419df62c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.567645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24643e-ce15-4889-a00b-6d629150d0c4 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.568310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24643e-ce15-4889-a00b-6d629150d0c4 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.568933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24643e-ce15-4889-a00b-6d629150d0c4 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.613759 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc24643e-ce15-4889-a00b-6d629150d0c4 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 788 microversion: 2.1 time: 0.048357 Oct 17 13:18:14.615599 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 403/749] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/os-migrations => generated 788 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:14.628714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:14.647298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:14.671617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.672118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.672554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:14.677579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:14.681748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:14.682487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.141391 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ed4e175-776f-4dfd-b963-cbcf3e28f468 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.719570 Oct 17 13:18:15.153433 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 347/750] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:18:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:15.161601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a6ecb4f-4c5c-4e34-b104-c7a2ee4518a9 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] Calling method '.version_select at 0x7f419e034af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:15.206735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.216012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.217843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:15.219513 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77cec62b-46d6-400d-a5e3-6af0fd78c5d6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.602792 Oct 17 13:18:15.220878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 404/751] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:14 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:15.243772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:15.244655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:15.252900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.253687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.254861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.255821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.256280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.256869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.344698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:15.454220 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a6ecb4f-4c5c-4e34-b104-c7a2ee4518a9 tempest-SecurityGroupRulesNegativeTestJSON-742515288 tempest-SecurityGroupRulesNegativeTestJSON-742515288-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/0b11e4b7-f555-46ec-9929-df690d21e1db" status: 202 len: 0 microversion: 2.1 time: 0.310527 Oct 17 13:18:15.457145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 348/752] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:18:15 2022] DELETE /compute/v2.1/os-security-groups/0b11e4b7-f555-46ec-9929-df690d21e1db => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:15.471650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-2026030240", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "485e24b6-e427-4cdd-ae21-18e362301c4e"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:15.500011 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b649b24c-0576-403c-b48c-23713974fd8d tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1646 microversion: 2.1 time: 0.277266 Oct 17 13:18:15.501507 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 405/753] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:15 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1646 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:15.580278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:15.581113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:15.593238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.595368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.602220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.607242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:15.608546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:15.615762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:15.636912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] validate_networks() for [('485e24b6-e427-4cdd-ae21-18e362301c4e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:18:16.145826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:16.168055 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-230458b4-667b-46e0-b8ed-c34434fe9022 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.591885 Oct 17 13:18:16.168788 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 406/754] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:15 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:16.175961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-856341893", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "f00eb40b-7ce6-4995-9281-4d82713dfdfa"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:16.288220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] validate_networks() for [('f00eb40b-7ce6-4995-9281-4d82713dfdfa', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:18:16.300869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=18 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:16.775444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:18:16.775982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:18:16.776233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:18:16.776976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:18:16.777530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:18:16.804942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.805541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.805992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.808257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:16.809426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:16.809866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:16.856995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Getting quotas for project e7e85eeff8fe4f27964f2063624827b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:18:16.866291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Getting quotas for user 6d37b800dbaf44f58c048fb2fef592f8 and project e7e85eeff8fe4f27964f2063624827b6. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:18:16.885023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:18:16.887678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:18:17.000313 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15e95960-7f33-4ca3-a497-98812bcad026 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.537890 Oct 17 13:18:17.002483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 349/755] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:18:17.015134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.016409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:17.053641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.057863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.058999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.061575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.062274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.062985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.366021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:18:17.366507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:18:17.366926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:18:17.367409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:18:17.367729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:18:17.387126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.387617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.388046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.388769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.389287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.389665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.456402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:18:17.467731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for user 3d18129f56c24321aeff6fa609f78c87 and project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:18:17.505451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:18:17.512265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:18:17.525125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.537603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.539084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.542498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e64f206a-694e-4693-ba0b-0c2d04d36caf tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1568 microversion: 2.25 time: 0.538097 Oct 17 13:18:17.549218 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 350/756] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1568 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:17.553839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de5fae5d-9584-432a-9a8a-27cd3fcaf3d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.554452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de5fae5d-9584-432a-9a8a-27cd3fcaf3d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:17.598720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83e1af33-1ff3-466a-bfb0-50e9fe2e1b89 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.427302 Oct 17 13:18:17.599880 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 407/757] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:18:17.619383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.621633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:17.658595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.663053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.664387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.666071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:17.670136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:17.671827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:17.742737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de5fae5d-9584-432a-9a8a-27cd3fcaf3d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:17.750263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de5fae5d-9584-432a-9a8a-27cd3fcaf3d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1224 microversion: 2.1 time: 0.199975 Oct 17 13:18:17.754713 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 351/758] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1224 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:17.759501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f61917d5-84bd-4d66-9bf2-3b64fdbd93f4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:17.760095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f61917d5-84bd-4d66-9bf2-3b64fdbd93f4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.090849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f61917d5-84bd-4d66-9bf2-3b64fdbd93f4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:18.102591 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f61917d5-84bd-4d66-9bf2-3b64fdbd93f4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1210 microversion: 2.1 time: 0.346749 Oct 17 13:18:18.112001 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 352/759] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1210 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:18.354619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:18.380036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-411351cb-c820-4b9a-be1d-80b2dcd640a0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.778799 Oct 17 13:18:18.385528 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 408/760] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:17 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:18.584511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:18.585424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.604222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.605377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.606671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.609798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.612552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.613613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.779279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:18.779999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:18.816754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.821502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.822018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:18.822792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:18.829738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:18.835693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.214092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:19.225358 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-06974fc4-cb46-4b9a-9a47-364554c87133 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1276 microversion: 2.1 time: 0.452094 Oct 17 13:18:19.233540 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 409/761] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:18 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1276 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:19.239734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:19.241434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:19.258905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.262388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.264246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.265226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:19.265855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:19.266501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:19.953731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:19.965113 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c09d3812-2fc4-448a-a84a-67768bf22a4d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1206 microversion: 2.1 time: 0.730092 Oct 17 13:18:19.973582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 410/762] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:19 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1206 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:19.989727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:19.995735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.025105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.030979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.037928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.039355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.039855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.040351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.202272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.222206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.234320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.235958 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61cf4e6f-3e66-4dc4-8e06-d5ac525dbd3f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1558 microversion: 2.25 time: 1.663987 Oct 17 13:18:20.237028 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 353/763] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:18 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1558 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:18:20.263149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.264254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.280874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.286400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.290178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.291877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.294270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.295940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.529536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.540542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5e06a0bc-c1cf-48bb-a17a-6f66e69ab7d3 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1282 microversion: 2.1 time: 0.281427 Oct 17 13:18:20.548843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 354/764] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1282 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:20.562595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98d0b79d-e3fe-45fc-959c-c1e627e537ed tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '.version_select at 0x7f419e07aa60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.569792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98d0b79d-e3fe-45fc-959c-c1e627e537ed tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.570953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98d0b79d-e3fe-45fc-959c-c1e627e537ed tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.571605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98d0b79d-e3fe-45fc-959c-c1e627e537ed tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.598240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98d0b79d-e3fe-45fc-959c-c1e627e537ed tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 1352 microversion: 2.25 time: 0.047331 Oct 17 13:18:20.599648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 355/765] 10.222.0.65 () {60 vars in 1184 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/os-migrations => generated 1352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:20.620885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:20.621795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:20.628798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.629343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.632851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:20.637149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.637980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:20.641948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:20.642397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:20.647964 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83a02130-8ec4-46f1-8cc9-506bb40f722e tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.671303 Oct 17 13:18:20.652110 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 411/766] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:19 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:20.861904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid f7695663-7195-438d-be05-5c0e52665c89 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:20.877805 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90f11cee-8fa3-4c99-93c5-b261a51d2c5b tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 2052 microversion: 2.25 time: 0.261819 Oct 17 13:18:20.878706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 356/767] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 2052 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:18:21.002461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.004062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.020385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-929103489", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "86f87344-a5a0-44c6-9bd6-49c37a87ed65"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:21.023877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.025248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.026114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.027239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.028209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.029552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.086994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] validate_networks() for [('86f87344-a5a0-44c6-9bd6-49c37a87ed65', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:18:21.136523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.146082 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91573434-67e0-4da0-bd22-cd809bc80777 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1268 microversion: 2.1 time: 0.153984 Oct 17 13:18:21.147719 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 412/768] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:20 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:21.528974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:18:21.529701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:18:21.529979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:18:21.530382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:18:21.530789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:18:21.541044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.541557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.541985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.542703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.543182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.543598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.560512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:18:21.564168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.564786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.565933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for user d9b63e4efecd4b9a96fc3b2e51f625fb and project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:18:21.571002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.571781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.571940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.572838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.573512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.573944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.580374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:18:21.582600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:18:21.644422 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd19fcda-63d3-4514-b8c8-cb0d22abc616 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.629953 Oct 17 13:18:21.651260 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 357/769] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:18:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:18:21.656542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2405063e-4fd1-4ea0-9a1d-e400485693dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.659368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2405063e-4fd1-4ea0-9a1d-e400485693dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.662239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.678202 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bed4dcd4-f425-42a1-9b88-37477c4a82b9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1282 microversion: 2.1 time: 0.117690 Oct 17 13:18:21.694438 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 413/770] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:21 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:21.699610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:21.700532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:21.711303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.716665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.717476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.718475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:21.719159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:21.720467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:21.736536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2405063e-4fd1-4ea0-9a1d-e400485693dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.745954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2405063e-4fd1-4ea0-9a1d-e400485693dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.747427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2405063e-4fd1-4ea0-9a1d-e400485693dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.748551 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2405063e-4fd1-4ea0-9a1d-e400485693dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1261 microversion: 2.25 time: 0.096364 Oct 17 13:18:21.757323 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 358/771] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:21 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:21.879451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:21.888595 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8630d7e-1b9d-4418-a9e5-0061f79a5483 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.192650 Oct 17 13:18:21.889510 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 414/772] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:21 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.173879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.174617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.193225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.193730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.194164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.204621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.205243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.207781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.350118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:22.359641 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d7b5932-61c2-4599-be28-a1a4b5fdf5b3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1268 microversion: 2.1 time: 0.193409 Oct 17 13:18:22.364936 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 359/773] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.702151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.702909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.719164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.720139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.722236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.727677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.728471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.729092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.775521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.777019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.783037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:22.788527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.790199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.790199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.793988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.795549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.797549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.867450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:22.886052 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74388183-5606-4b78-95c0-2f3ee9cdb76c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1282 microversion: 2.1 time: 0.187851 Oct 17 13:18:22.886654 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 415/774] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:22.932217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:22.933547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:22.961081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.965387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.968112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:22.969041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:22.969659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:22.976918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.115548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.129196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.135028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.138232 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35af4bb5-c9bf-42f5-baae-54fae36ec9a3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1257 microversion: 2.25 time: 0.366631 Oct 17 13:18:23.142048 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 360/775] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1257 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:23.296580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.307507 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6f04ef0-6053-4dfc-94b6-a07bc80ba32a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.385813 Oct 17 13:18:23.308667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 416/776] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:22 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.386713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.387430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.396534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.397556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.398485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.399590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.400265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.400924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.482851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:23.497206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-17ab2ce6-97c9-44af-aeec-fb45bcc26606 req-dfdc7647-4478-40f5-b8ff-b077b4ee62fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61b456a-dc6e-47dc-bab8-88eb35727c92", "tag": "fe4d8477-ac01-4fd7-af4e-aedeb9b59502"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:23.505786 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e38b8c3c-dcab-4bac-a84f-835c82825412 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1268 microversion: 2.1 time: 0.122999 Oct 17 13:18:23.521413 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 361/777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1268 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:23.521669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-17ab2ce6-97c9-44af-aeec-fb45bcc26606 req-dfdc7647-4478-40f5-b8ff-b077b4ee62fd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.521669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-17ab2ce6-97c9-44af-aeec-fb45bcc26606 req-dfdc7647-4478-40f5-b8ff-b077b4ee62fd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.521669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-17ab2ce6-97c9-44af-aeec-fb45bcc26606 req-dfdc7647-4478-40f5-b8ff-b077b4ee62fd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.529301 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-17ab2ce6-97c9-44af-aeec-fb45bcc26606 req-dfdc7647-4478-40f5-b8ff-b077b4ee62fd service nova] Creating event network-changed:fe4d8477-ac01-4fd7-af4e-aedeb9b59502 for instance f61b456a-dc6e-47dc-bab8-88eb35727c92 on n-h2-854121-14 Oct 17 13:18:23.537537 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-17ab2ce6-97c9-44af-aeec-fb45bcc26606 req-dfdc7647-4478-40f5-b8ff-b077b4ee62fd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044585 Oct 17 13:18:23.538931 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 417/778] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:18:23.910481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:23.911697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:23.924495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.925251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.926860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:23.929819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:23.930503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:23.931099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.173658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.175063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.186590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.187423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.187928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.188878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.189361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.190351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.259408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.274237 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c6c1b346-3469-4834-a2cd-cdc1eef3b315 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.369282 Oct 17 13:18:24.292792 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 362/779] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:23 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:24.331021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.336862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.349009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.351753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.352898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.354677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.358094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.360734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.478510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.491129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.496586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.500379 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6bf485ed-397f-4017-b68f-ad22cd019e3e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1319 microversion: 2.25 time: 0.332476 Oct 17 13:18:24.503663 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 418/780] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:24.528617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:24.529649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:24.542988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.543493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.543943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.544672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:24.545088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:24.545564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:24.596167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:24.971802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:24.985751 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38d6bb3a-9493-4d5f-aa70-b7a58356b213 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.658351 Oct 17 13:18:24.986476 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 363/781] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:25.092880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.102633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1f79362-c7c3-4140-8552-d6275bb345f2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.578261 Oct 17 13:18:25.117837 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 419/782] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:24 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:25.309949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.310998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.336423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.338033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.338478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.342040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.342756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.343348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.528197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:25.528996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:25.542746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.543251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.543696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.544428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:25.544892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:25.548340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:25.757944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.773066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.774904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.776123 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6dacba40-2bdd-4c2a-b042-e7339eddbef0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1319 microversion: 2.25 time: 0.252105 Oct 17 13:18:25.776758 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 420/783] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:25.886368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:25.896716 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2c08abc-c6cb-48b4-be22-344e06ae028b tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.595586 Oct 17 13:18:25.909585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 364/784] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:25 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:26.008614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.009343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.020485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.038018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.038751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.039688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.040310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.040895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.130392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.131107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.144946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.146277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.146728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.147454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.147917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.167166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.423972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.432547 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3c2221c-5fae-4906-b76a-adb2400ce586 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.427709 Oct 17 13:18:26.445601 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 421/785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:26.595241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.600097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:26.609000 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b496d6d0-182c-4c1c-bdb0-93ea9469b0b0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.484965 Oct 17 13:18:26.610649 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 365/786] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:26.801720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.802340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.809647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.810251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.810827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.811598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.812148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.812651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.933046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:26.933713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:26.948034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.948522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.948951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.951119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:26.951574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:26.952001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:26.964787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.974036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.975619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:26.976864 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e457d836-fbdf-46f8-8f77-a800ee167f68 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.179703 Oct 17 13:18:26.990162 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 422/787] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:27.126004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.136036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0507462-f173-4ca8-9160-b1634360dfe6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.219224 Oct 17 13:18:27.149208 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 366/788] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:26 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:27.300277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-90b4198b-5e21-453d-8a0e-abd3e1a9a4d2 req-c76cb59f-28f2-4b28-b964-ffbd838a2b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11095f9-54ae-47bf-a710-017445641674", "tag": "18d14400-c6be-450b-b317-63953e7f90d4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:27.314740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90b4198b-5e21-453d-8a0e-abd3e1a9a4d2 req-c76cb59f-28f2-4b28-b964-ffbd838a2b34 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.315477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90b4198b-5e21-453d-8a0e-abd3e1a9a4d2 req-c76cb59f-28f2-4b28-b964-ffbd838a2b34 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.316090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90b4198b-5e21-453d-8a0e-abd3e1a9a4d2 req-c76cb59f-28f2-4b28-b964-ffbd838a2b34 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.329422 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-90b4198b-5e21-453d-8a0e-abd3e1a9a4d2 req-c76cb59f-28f2-4b28-b964-ffbd838a2b34 service nova] Creating event network-changed:18d14400-c6be-450b-b317-63953e7f90d4 for instance f11095f9-54ae-47bf-a710-017445641674 on n-h1-854121-14 Oct 17 13:18:27.334474 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-90b4198b-5e21-453d-8a0e-abd3e1a9a4d2 req-c76cb59f-28f2-4b28-b964-ffbd838a2b34 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044771 Oct 17 13:18:27.335273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 423/789] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:27.461898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:27.462529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.468806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.470185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.470940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.471651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.473030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.473030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.642625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:27.643598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:27.643892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.650166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:27.650860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:27.652680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.653200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.653974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.654651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:27.655110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:27.655537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:27.661009 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6249790b-6f08-4c6f-8690-8657e1c2f60c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.200592 Oct 17 13:18:27.662005 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 367/790] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:27 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:27.892160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:27.911789 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b117ccd2-ecc8-4c0d-9a45-0278afcd8193 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.281290 Oct 17 13:18:27.913822 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 424/791] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:27 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:28.003261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.004494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.017013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.017367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.017876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.018508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.018956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.019373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.162859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.163478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.175956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.176449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.176890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.180499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.180978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.181448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.767486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.777197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-341a0c24-f8aa-47ab-a2c4-c266c55436af tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.619090 Oct 17 13:18:28.792177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.792773 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 425/792] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:28.799927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.801207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.807008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.808268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.809296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.809777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:28.810246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.811636 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb265a98-4602-4169-ad74-0827b0a86aea tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.812256 Oct 17 13:18:28.812330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.812817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.813911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.814951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 368/793] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:27 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:28.936552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:28.937496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:28.944726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.945498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.946030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:28.947958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:28.949190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:28.949739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.252052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:29.266076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d25881c9-c029-4227-b652-275e80f5fdd5 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.472158 Oct 17 13:18:29.273316 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 426/794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:29.334566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:29.359174 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be88a342-7a8e-47f9-bb8d-6c187c70ca7b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.426938 Oct 17 13:18:29.373243 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 369/795] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:28 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:29.373704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-74b3959c-8afc-47d7-bc49-3d59a066055f req-ea86482b-87cb-43bb-a9f9-2edc9171a2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd", "tag": "76bd1a7e-0678-4c82-8b2b-3c87effe2275"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:29.387599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-74b3959c-8afc-47d7-bc49-3d59a066055f req-ea86482b-87cb-43bb-a9f9-2edc9171a2e0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.389436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-74b3959c-8afc-47d7-bc49-3d59a066055f req-ea86482b-87cb-43bb-a9f9-2edc9171a2e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.389890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-74b3959c-8afc-47d7-bc49-3d59a066055f req-ea86482b-87cb-43bb-a9f9-2edc9171a2e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.405532 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-74b3959c-8afc-47d7-bc49-3d59a066055f req-ea86482b-87cb-43bb-a9f9-2edc9171a2e0 service nova] Creating event network-changed:76bd1a7e-0678-4c82-8b2b-3c87effe2275 for instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd on n-h1-854121-14 Oct 17 13:18:29.412354 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-74b3959c-8afc-47d7-bc49-3d59a066055f req-ea86482b-87cb-43bb-a9f9-2edc9171a2e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043480 Oct 17 13:18:29.413791 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 427/796] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:18:29.800588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:29.801406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:29.814959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.819265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.820539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.824274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.824996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.826996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.848024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:29.849031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:29.857814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.858497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.859097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:29.860506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:29.861880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:29.862472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.352780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.362523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8428c98-f741-40e0-a3af-7a87a0142a42 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.566350 Oct 17 13:18:30.366756 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 370/797] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:29 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:30.376484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f4c13d3f-7800-4ed0-8727-005b4290db22 req-d33019c1-1c0b-4698-ad9f-0c60e5284683 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ea40f-54a7-4185-9cee-459f289abf28", "tag": "186d7cf2-0816-4f4a-bc90-ca4d191d66ba"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:30.398446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.406478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4c13d3f-7800-4ed0-8727-005b4290db22 req-d33019c1-1c0b-4698-ad9f-0c60e5284683 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.409525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4c13d3f-7800-4ed0-8727-005b4290db22 req-d33019c1-1c0b-4698-ad9f-0c60e5284683 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.410289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4c13d3f-7800-4ed0-8727-005b4290db22 req-d33019c1-1c0b-4698-ad9f-0c60e5284683 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.416096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.417684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.418849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f443684d-2127-4b61-8b6a-15746552e129 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.578302 Oct 17 13:18:30.425825 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 428/798] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:29 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:18:30.431370 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f4c13d3f-7800-4ed0-8727-005b4290db22 req-d33019c1-1c0b-4698-ad9f-0c60e5284683 service nova] Creating event network-changed:186d7cf2-0816-4f4a-bc90-ca4d191d66ba for instance 2d3ea40f-54a7-4185-9cee-459f289abf28 on n-h2-854121-14 Oct 17 13:18:30.439661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f4c13d3f-7800-4ed0-8727-005b4290db22 req-d33019c1-1c0b-4698-ad9f-0c60e5284683 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068650 Oct 17 13:18:30.441338 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 371/799] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:30.448594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:30.450346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:30.466359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.466975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.467508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.468309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.468992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.469966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.722161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.734489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2eb5cb0c-7992-416a-ab4f-062a127fb6e9 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.291226 Oct 17 13:18:30.736406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 372/800] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:30 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:30.742523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:30.743638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:30.756515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.758088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.758764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.759678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:30.760202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:30.760712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:30.889467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2205850-872c-441e-9e84-bd1bb9f76d0d tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Action: 'create', calling method: .version_select at 0x7f419e621820>, body: {"pool": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:30.982619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:30.997947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d45ccbaf-d433-4a5e-95d9-1ab2e21e27d3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.260086 Oct 17 13:18:31.008052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 373/801] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:30 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:31.392960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:31.393647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:31.403392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.405654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.408558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.416124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.416900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.417583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.552361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:31.746010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=18 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:31.803351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:31.813746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2084343-2da6-435b-937e-3ac14ff4d25e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.424882 Oct 17 13:18:31.815313 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 374/802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:31 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:31.828322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:31.829772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:31.838105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.838904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.839812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:31.841237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:31.842112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:31.842623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.121450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.131271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.133006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.134371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ced2fa72-3bc2-44e3-b138-876de2ff1225 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.317902 Oct 17 13:18:32.135430 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 375/803] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:31 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:32.140601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:32.141931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:32.149804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.150507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.151222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.152646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.153298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.153738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.493347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.513098 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbd19f6d-80b1-4169-b80d-b138c6d33ce0 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.376162 Oct 17 13:18:32.517480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 376/804] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:32 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:32.526700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:32.529635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:32.547951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.551072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.552503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.557583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.558610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.559134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.943191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:32.959517 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6aef6d03-b987-4745-a19f-60d1b03bc2e1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.439958 Oct 17 13:18:32.978070 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 377/805] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:32 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:32.978070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:32.978070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:32.987574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.988582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.989822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:32.991073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:32.991768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:32.992823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.036149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:18:33.062397 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2205850-872c-441e-9e84-bd1bb9f76d0d tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.635140 Oct 17 13:18:33.064129 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 429/806] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:18:30 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:33.069095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:33.069741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:33.083473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.084335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.084991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.085815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.086958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.087590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.175910 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-113f2dfc-5152-447a-967f-9b5aedd0b109 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 204 len: 0 microversion: 2.1 time: 0.210780 Oct 17 13:18:33.181123 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 378/807] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:32 2022] DELETE /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:33.187553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fcdfc24d-20a2-4012-93e1-1e0922aed6b4 req-843e97d6-6a77-4782-9591-0228a8d86631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61b456a-dc6e-47dc-bab8-88eb35727c92", "name": "network-vif-plugged", "status": "completed", "tag": "fe4d8477-ac01-4fd7-af4e-aedeb9b59502"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:33.199561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fcdfc24d-20a2-4012-93e1-1e0922aed6b4 req-843e97d6-6a77-4782-9591-0228a8d86631 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.200072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fcdfc24d-20a2-4012-93e1-1e0922aed6b4 req-843e97d6-6a77-4782-9591-0228a8d86631 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.201403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fcdfc24d-20a2-4012-93e1-1e0922aed6b4 req-843e97d6-6a77-4782-9591-0228a8d86631 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.220928 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fcdfc24d-20a2-4012-93e1-1e0922aed6b4 req-843e97d6-6a77-4782-9591-0228a8d86631 service nova] Creating event network-vif-plugged:fe4d8477-ac01-4fd7-af4e-aedeb9b59502 for instance f61b456a-dc6e-47dc-bab8-88eb35727c92 on n-h2-854121-14 Oct 17 13:18:33.227645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fcdfc24d-20a2-4012-93e1-1e0922aed6b4 req-843e97d6-6a77-4782-9591-0228a8d86631 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047771 Oct 17 13:18:33.228418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 379/808] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:33.234486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-79b94247-babb-40fc-af8a-a93b135f1728 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Action: 'create', calling method: .version_select at 0x7f419dff6b80>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:33.719839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:33.729427 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84ecd80e-3fec-4b53-868c-6bcb260742fa tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.664184 Oct 17 13:18:33.747009 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 430/809] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:33 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:33.753684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:33.754239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:33.760517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.761017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.761499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:33.762213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:33.762682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:33.763114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.142018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.173764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.176304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.179564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d4f84e7-6fa5-4fc8-b3ed-c0a553b9997d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.430381 Oct 17 13:18:34.197990 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 431/810] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:33 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:34.207778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.208444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.210911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:34.218545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.219742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.220716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.221917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.222571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.223163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.628544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76b1fd5cee4248bbaf5f972c3fadea02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc11740e1af34fb89993b21d04f22d49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.647969 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07db2a27-26c0-49cc-8046-5d447c4d0bda tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 200 len: 1714 microversion: 2.1 time: 0.452961 Oct 17 13:18:34.648571 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 432/811] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 1714 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:34.653416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.654295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.666653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.667297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.667822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.668767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.669399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.669826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.880689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:34.894011 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9fe64641-f6be-4adc-9e63-6b01bfaf9797 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1371 microversion: 2.1 time: 0.241436 Oct 17 13:18:34.906073 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 433/812] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1371 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:34.916783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:34.923367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:34.954816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.956575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.957499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:34.959161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:34.959784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:34.960376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.462702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:35.499735 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31879c91-5194-4e03-a8d9-26c5eb7ed743 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.589857 Oct 17 13:18:35.505290 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 434/813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:34 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:35.507181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:35.508725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:35.521793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.522355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.522805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:35.523591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:35.524060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:35.525204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.032828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.048321 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55db651a-fa81-44c5-b1d0-6cc1254aee70 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.545128 Oct 17 13:18:36.050475 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 435/814] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:35 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:36.061726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:36.066395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.077684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.080170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.083197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.084627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.085499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.086162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.758620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.768376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.769913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:36.771061 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21218ac6-a464-41ce-b3b6-0730545b5406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.719157 Oct 17 13:18:36.771830 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 436/815] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:36 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:36.784410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-431f4873-0007-43e6-8a30-bef886e212bf req-81875d5a-e571-45f2-a232-117b8dccef2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd", "name": "network-vif-plugged", "status": "completed", "tag": "76bd1a7e-0678-4c82-8b2b-3c87effe2275"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:36.803022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-431f4873-0007-43e6-8a30-bef886e212bf req-81875d5a-e571-45f2-a232-117b8dccef2d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.803529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-431f4873-0007-43e6-8a30-bef886e212bf req-81875d5a-e571-45f2-a232-117b8dccef2d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.804136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-431f4873-0007-43e6-8a30-bef886e212bf req-81875d5a-e571-45f2-a232-117b8dccef2d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.817301 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-431f4873-0007-43e6-8a30-bef886e212bf req-81875d5a-e571-45f2-a232-117b8dccef2d service nova] Creating event network-vif-plugged:76bd1a7e-0678-4c82-8b2b-3c87effe2275 for instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd on n-h1-854121-14 Oct 17 13:18:36.822935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-431f4873-0007-43e6-8a30-bef886e212bf req-81875d5a-e571-45f2-a232-117b8dccef2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050092 Oct 17 13:18:36.824058 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 437/816] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:36.829519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:36.830223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.836612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.837340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.837963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.838851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.839464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.840079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.862495 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec HTTP/1.1 Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:36.864431 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:36.866292 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '68f884c2-7af3-45cc-b3ec-c406e229c9ec'} Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:36.867260 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:36.868861 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:36.871151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:36.872190 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b453c86-e987-4a37-8e72-030e0a31c657 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 404 len: 111 microversion: 2.1 time: 0.046847 Oct 17 13:18:36.872949 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 438/817] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:36 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:36.880420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:36.881466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:36.888324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.889018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.889656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:36.890545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:36.892076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:36.892510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.196768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-79b94247-babb-40fc-af8a-a93b135f1728 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.966841 Oct 17 13:18:37.198134 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 380/818] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:18:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:37.204749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7c86d95a-63d7-405d-8cea-1e61b53be60b req-af93db8f-fe91-424b-a98a-4b3e1f3a94f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f884c2-7af3-45cc-b3ec-c406e229c9ec", "name": "network-vif-deleted", "tag": "9c627e86-a36a-4b90-94be-42caa190903d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:37.217449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7c86d95a-63d7-405d-8cea-1e61b53be60b req-af93db8f-fe91-424b-a98a-4b3e1f3a94f4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.218293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7c86d95a-63d7-405d-8cea-1e61b53be60b req-af93db8f-fe91-424b-a98a-4b3e1f3a94f4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.218829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7c86d95a-63d7-405d-8cea-1e61b53be60b req-af93db8f-fe91-424b-a98a-4b3e1f3a94f4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.233341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7c86d95a-63d7-405d-8cea-1e61b53be60b req-af93db8f-fe91-424b-a98a-4b3e1f3a94f4 service nova] Creating event network-vif-deleted:9c627e86-a36a-4b90-94be-42caa190903d for instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec on n-h1-854121-14 Oct 17 13:18:37.240255 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7c86d95a-63d7-405d-8cea-1e61b53be60b req-af93db8f-fe91-424b-a98a-4b3e1f3a94f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040699 Oct 17 13:18:37.241032 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 381/819] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:37.247944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.248900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.263926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.265409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.266791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:37.267461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.268544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.270402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.271287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.277230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:37.280692 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4f84349-988b-478a-8c4c-fa79a716bccf tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1556 microversion: 2.1 time: 0.406274 Oct 17 13:18:37.282104 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 439/820] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:36 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1556 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:37.288782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.289562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.301598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.302343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.302981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.303862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.304480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.305087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.322689 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 HTTP/1.1 Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:37.325747 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.327193 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f06cfa7a-43e5-4c28-930b-4999358934b2'} Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:37.328054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.329774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.332769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:37.332769 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c549b4f3-6642-42eb-b9db-de89f94da694 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 404 len: 111 microversion: 2.1 time: 0.043937 Oct 17 13:18:37.332769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 440/821] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:37 2022] DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:37.339124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.340025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.346172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.347579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.348101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.349218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.349729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.350312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.550336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:37.560191 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30cd186e-fcab-4026-ba14-8b0cb71d2630 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1310 microversion: 2.1 time: 0.317601 Oct 17 13:18:37.562319 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 382/822] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1310 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:37.570097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00604be8-a354-4733-a215-60d8a08acc20 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Action: 'create', calling method: .version_select at 0x7f419e121700>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:37.579608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:37.589046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-886c315f-2d95-4151-8a2b-32f83cf5433c tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.253613 Oct 17 13:18:37.590191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 441/823] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:37.595679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.596401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.618683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.619244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.619700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.620532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.621040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.621412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.795943 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1c3f03c-2e2b-422b-b8cf-71d023fc0718 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204332 Oct 17 13:18:37.796605 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 442/824] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:37.808930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.809603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.818706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.819207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.819652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.821879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.822346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.824117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.853945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 HTTP/1.1 Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:37.855634 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.857644 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f06cfa7a-43e5-4c28-930b-4999358934b2'} Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:37.858402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:37.859672 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:37.861346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:37.863673 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37081de8-3ac2-476d-ae3c-0ff467546144 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 404 len: 111 microversion: 2.1 time: 0.060682 Oct 17 13:18:37.864345 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 443/825] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:37.869618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:37.870398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:37.878220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.878697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.879130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:37.879834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:37.880280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:37.880702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:38.347480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:38.356208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:38.358131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:38.359629 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0473eb64-f0b0-4788-93fe-73aa715fa74d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.494195 Oct 17 13:18:38.361419 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 444/826] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:37 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:38.381832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55c0fbf1-aaa8-4477-93f2-ba0680ee0f8a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '.version_select at 0x7f419e12c040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:38.405629 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55c0fbf1-aaa8-4477-93f2-ba0680ee0f8a tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087051587" status: 202 len: 0 microversion: 2.1 time: 0.042342 Oct 17 13:18:38.408145 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 445/827] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:18:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087051587 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:38.584976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:38.585626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:38.592129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:38.592622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:38.593065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:38.596058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:38.596554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:38.596996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.231896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:39.240378 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36188b5a-e659-450d-a1aa-a2843e2ffcb8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1492 microversion: 2.1 time: 0.659666 Oct 17 13:18:39.253312 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 446/828] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:38 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1492 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:18:39.253312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:39.253312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:39.253654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.253938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.254587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.255452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.256099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.256746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.634127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:39.645908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1136a38-dbd8-4a56-8fcd-48bfc97429d9 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.400826 Oct 17 13:18:39.646566 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 447/829] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:39 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:39.656739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3755a178-dc95-4b04-9b52-39b9a158afba req-4cf06954-2cfc-40d1-8889-c5ea2f5ae176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11095f9-54ae-47bf-a710-017445641674", "name": "network-vif-plugged", "status": "completed", "tag": "18d14400-c6be-450b-b317-63953e7f90d4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:39.684322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3755a178-dc95-4b04-9b52-39b9a158afba req-4cf06954-2cfc-40d1-8889-c5ea2f5ae176 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.685001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3755a178-dc95-4b04-9b52-39b9a158afba req-4cf06954-2cfc-40d1-8889-c5ea2f5ae176 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.686658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3755a178-dc95-4b04-9b52-39b9a158afba req-4cf06954-2cfc-40d1-8889-c5ea2f5ae176 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.716908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3755a178-dc95-4b04-9b52-39b9a158afba req-4cf06954-2cfc-40d1-8889-c5ea2f5ae176 service nova] Creating event network-vif-plugged:18d14400-c6be-450b-b317-63953e7f90d4 for instance f11095f9-54ae-47bf-a710-017445641674 on n-h1-854121-14 Oct 17 13:18:39.735971 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3755a178-dc95-4b04-9b52-39b9a158afba req-4cf06954-2cfc-40d1-8889-c5ea2f5ae176 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088111 Oct 17 13:18:39.737460 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 448/830] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:39.742918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:39.743781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:39.751060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.751866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.752414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:39.753274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:39.753861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:39.754388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.109406 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e21dfc58-3f96-4d9d-890e-7463ff944363 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1645 microversion: 2.1 time: 0.365955 Oct 17 13:18:40.110970 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 449/831] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:39 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1645 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:40.125133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:40.126097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:40.132990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.146288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.146933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.147847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.148668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.149299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.516297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:40.541323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:40.542979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:40.544362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0660a5f9-c45a-4a71-8710-4491bfa0f52d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.432397 Oct 17 13:18:40.544950 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 450/832] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:40 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:40.550513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-afdd313b-49a9-419a-b5ed-e18e29410eb8 req-7cfb9f82-f667-41a9-8589-d831d3e77bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f61b456a-dc6e-47dc-bab8-88eb35727c92", "tag": "fe4d8477-ac01-4fd7-af4e-aedeb9b59502"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:40.567444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afdd313b-49a9-419a-b5ed-e18e29410eb8 req-7cfb9f82-f667-41a9-8589-d831d3e77bc3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.567901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afdd313b-49a9-419a-b5ed-e18e29410eb8 req-7cfb9f82-f667-41a9-8589-d831d3e77bc3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.568372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afdd313b-49a9-419a-b5ed-e18e29410eb8 req-7cfb9f82-f667-41a9-8589-d831d3e77bc3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.581281 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-afdd313b-49a9-419a-b5ed-e18e29410eb8 req-7cfb9f82-f667-41a9-8589-d831d3e77bc3 service nova] Creating event network-changed:fe4d8477-ac01-4fd7-af4e-aedeb9b59502 for instance f61b456a-dc6e-47dc-bab8-88eb35727c92 on n-h2-854121-14 Oct 17 13:18:40.587378 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-afdd313b-49a9-419a-b5ed-e18e29410eb8 req-7cfb9f82-f667-41a9-8589-d831d3e77bc3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041185 Oct 17 13:18:40.588600 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 451/833] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:40.595642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:40.596596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:40.609604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.611220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.611598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:40.612592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:40.613046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:40.613616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.123363 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00604be8-a354-4733-a215-60d8a08acc20 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.558084 Oct 17 13:18:41.124147 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 383/834] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:18:37 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:41.132317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f6ad5eb-74d3-4ac9-b21d-4d8569d399d3 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.170755 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4aaf0e8d-b8d9-4ff1-8d21-c17ecfd376fe tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1645 microversion: 2.1 time: 0.580342 Oct 17 13:18:41.172315 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 452/835] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:40 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1645 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.178398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.179858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:41.188244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.189047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.189713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.190654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.191269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.191813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f6ad5eb-74d3-4ac9-b21d-4d8569d399d3 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/588673018" status: 202 len: 0 microversion: 2.1 time: 0.066595 Oct 17 13:18:41.192016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.192624 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 384/836] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:18:41 2022] DELETE /compute/v2.1/flavors/588673018 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:41.208167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78a92f56-1a3b-490e-9ea0-a708ed0281b8 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Action: 'create', calling method: .version_select at 0x7f419dff6ee0>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:41.881792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:41.891540 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8c54d37-9a21-4163-a208-83a1b48f328a tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1324 microversion: 2.1 time: 0.717329 Oct 17 13:18:41.892721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 453/837] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1324 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.897480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc678e6a-0872-4142-a52e-2c320e6e05c0 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.921817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc678e6a-0872-4142-a52e-2c320e6e05c0 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.026878 Oct 17 13:18:41.923557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 454/838] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:41.928879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.932789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.933487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.934091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.935020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.935650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.936237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.978607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc0e81c2-9f69-429b-9d3d-2d6f4930532c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.053192 Oct 17 13:18:41.981750 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 455/839] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:41.987180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:41.987812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:41.994327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.994821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.995264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:41.995972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:41.996431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:41.996850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.487099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:42.495915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:42.497414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:42.498549 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8e64180-0543-4592-9306-b4e79144ecd3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.515597 Oct 17 13:18:42.499100 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 456/840] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:41 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:42.504829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ae1bca06-5a6a-4beb-b64e-e27b36a5409c req-ea58abaa-701c-4fa5-a653-09c592e62fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ea40f-54a7-4185-9cee-459f289abf28", "name": "network-vif-plugged", "status": "completed", "tag": "186d7cf2-0816-4f4a-bc90-ca4d191d66ba"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:42.515854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae1bca06-5a6a-4beb-b64e-e27b36a5409c req-ea58abaa-701c-4fa5-a653-09c592e62fa4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.516352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae1bca06-5a6a-4beb-b64e-e27b36a5409c req-ea58abaa-701c-4fa5-a653-09c592e62fa4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.516789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae1bca06-5a6a-4beb-b64e-e27b36a5409c req-ea58abaa-701c-4fa5-a653-09c592e62fa4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.529070 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ae1bca06-5a6a-4beb-b64e-e27b36a5409c req-ea58abaa-701c-4fa5-a653-09c592e62fa4 service nova] Creating event network-vif-plugged:186d7cf2-0816-4f4a-bc90-ca4d191d66ba for instance 2d3ea40f-54a7-4185-9cee-459f289abf28 on n-h2-854121-14 Oct 17 13:18:42.534678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ae1bca06-5a6a-4beb-b64e-e27b36a5409c req-ea58abaa-701c-4fa5-a653-09c592e62fa4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034425 Oct 17 13:18:42.535866 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 457/841] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:42.541639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0601c30d-577d-42a8-80cc-70b88545661d tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.560098 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0601c30d-577d-42a8-80cc-70b88545661d tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1734308731" status: 202 len: 0 microversion: 2.1 time: 0.022756 Oct 17 13:18:42.560671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 458/842] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:18:42 2022] DELETE /compute/v2.1/flavors/1734308731 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:42.566324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:42.566980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.573578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.574067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.574507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.575212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.575672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.576095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.665454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3cec224a-5517-4fb5-a985-0b23a2717c12 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd/action" status: 202 len: 0 microversion: 2.1 time: 0.103273 Oct 17 13:18:42.669579 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 459/843] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:42 2022] POST /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:42.675361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c7b86f9-8bad-4a29-8b03-f05e716099b4 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.699079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c7b86f9-8bad-4a29-8b03-f05e716099b4 tempest-ServersWithSpecificFlavorTestJSON-144102440 tempest-ServersWithSpecificFlavorTestJSON-144102440-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031457 Oct 17 13:18:42.700016 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 460/844] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:18:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:42.713831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:42.714638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:42.722379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.723081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.723548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:42.724263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:42.725021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:42.725155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.081784 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40095fb6-cfed-4c49-bdea-e8cb43d3d232 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1650 microversion: 2.1 time: 0.368215 Oct 17 13:18:43.083093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 461/845] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:42 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1650 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:43.093659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:43.095776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:43.101951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.102462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.102909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.103637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.104095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.104527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.129992 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec HTTP/1.1 Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:43.131988 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.133443 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '68f884c2-7af3-45cc-b3ec-c406e229c9ec'} Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:43.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.135744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.139174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:43.139174 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a3c6f99-86b5-4f8f-b457-dce9795461fa tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 404 len: 111 microversion: 2.1 time: 0.048330 Oct 17 13:18:43.139174 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 462/846] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:43 2022] DELETE /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:43.143157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:43.143775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:43.152748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.153299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.153731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.154444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.154899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.155325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.439975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:43.449984 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16a5d5d5-ee99-44ab-b2ff-662066cd2111 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 200 len: 1518 microversion: 2.1 time: 0.311847 Oct 17 13:18:43.450774 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 463/847] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:43 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 1518 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:43.476304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:43.477211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: 68f884c2-7af3-45cc-b3ec-c406e229c9ec] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:43.485713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.486849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.487504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.488484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.489206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.489836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.509875 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec HTTP/1.1 Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:18:43.511750 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.513493 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '68f884c2-7af3-45cc-b3ec-c406e229c9ec'} Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:43.514399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. Oct 17 13:18:43.516397 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:18:43.521602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance 68f884c2-7af3-45cc-b3ec-c406e229c9ec could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:43.522482 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b430a6e4-dc8c-4ce5-8c17-f534972b103e tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec" status: 404 len: 111 microversion: 2.1 time: 0.055917 Oct 17 13:18:43.526561 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 464/848] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:43 2022] GET /compute/v2.1/servers/68f884c2-7af3-45cc-b3ec-c406e229c9ec => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:43.534035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'action', calling method: .version_select at 0x7f41a0476b80>, body: {"addFloatingIp": {"address": "172.25.9.30"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:43.536797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:43.543723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.544310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.544736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.545498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:43.546084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:43.546789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:43.577247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:43.622973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:18:43.623381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquired lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:18:44.444150 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78a92f56-1a3b-490e-9ea0-a708ed0281b8 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.246247 Oct 17 13:18:44.452369 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 385/849] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:18:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:44.458251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:44.458869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:44.465090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.465607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.466035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.466729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.467352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.467921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.744295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:44.751290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:44.755196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:44.756983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:44.758360 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5341b294-3170-4fc3-a4cd-1768dd82a712 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1361 microversion: 2.25 time: 0.304955 Oct 17 13:18:44.773598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 386/850] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:44 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:44.782986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:44.783762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:44.791928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.792641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.793085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.793826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:44.794454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:44.794877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:44.811508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 HTTP/1.1 Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:44.813746 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:44.815431 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f06cfa7a-43e5-4c28-930b-4999358934b2'} Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:44.816345 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:44.817900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:44.820219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:44.821090 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-757fcc55-2341-42bb-8943-c9ad09e56d4d tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 404 len: 111 microversion: 2.1 time: 0.046409 Oct 17 13:18:44.821695 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 387/851] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:18:44 2022] DELETE /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:45.002662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d885afdf-b800-480a-a2b4-7993e4e75233 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Action: 'create', calling method: .version_select at 0x7f419e15cca0>, body: {"keypair": {"name": "tempest-keypair-612647919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcFfmFGwK3cTa6DtKtcZ0GkVFH+l797yq6p2SMsoeOgFbaC8WK1OOHebtxve5E90hE8T5VVREmbfUxGMXmjfDPHz3HCb8IWwiDDbXaEXsB4mat9r5/Yx3beKx9naKoTig=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:45.021576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-d885afdf-b800-480a-a2b4-7993e4e75233 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Getting quotas for project dca83ede7465446dad54fe79943fa68f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:18:45.028059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-d885afdf-b800-480a-a2b4-7993e4e75233 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Getting quotas for user 642e0a16be6b4a6d876b7187720f544a and project dca83ede7465446dad54fe79943fa68f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:18:45.063774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d885afdf-b800-480a-a2b4-7993e4e75233 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.239523 Oct 17 13:18:45.064383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 388/852] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:18:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:45.069655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:45.070581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:45.077375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.077882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.078892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.079616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.080080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.080518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.355243 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9085b005-c55a-4867-aa4b-3135cc4f14ab tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1630 microversion: 2.1 time: 0.289064 Oct 17 13:18:45.379533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 389/853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:45 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1630 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:45.385289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3531a8f-8a49-4ac8-af11-84068211d982 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419e022820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:45.766428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:18:45.782582 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3531a8f-8a49-4ac8-af11-84068211d982 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips/3a7a7fe1-543a-477f-8e09-9194cbc5700b" status: 200 len: 142 microversion: 2.1 time: 0.401268 Oct 17 13:18:45.786003 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 390/854] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:18:45 2022] GET /compute/v2.1/os-floating-ips/3a7a7fe1-543a-477f-8e09-9194cbc5700b => generated 142 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:45.795703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:45.802694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] [instance: f06cfa7a-43e5-4c28-930b-4999358934b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:45.810011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.810780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.811468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.813972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.815005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.815842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.839901 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] HTTP exception thrown: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Request method failure captured: Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 HTTP/1.1 Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVVtPvThfgbj8arzFXcf9i2ouDr9_j9ZmRrcgaeAn6Aq2kLJZYMh338Zukga3Tl4sTRUQkTFsqMVyywQBLSoZJnIsHZSIspTQsI2b6ynAqJLCMC60--sFshJK9dQpzr3twIBTJLLB_hpySc7nuC7eGIkZbmi7pNi51oR91crcMgZWMI Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:45.842623 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dc11740e1af34fb89993b21d04f22d49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: dc11740e1af34fb89993b21d04f22d49 Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589 Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 76b1fd5cee4248bbaf5f972c3fadea02 Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1849753589-project Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:45.843996 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f06cfa7a-43e5-4c28-930b-4999358934b2'} Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:45.844714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. Oct 17 13:18:45.846044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:45.847102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] Returning 404 to user: Instance f06cfa7a-43e5-4c28-930b-4999358934b2 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:45.848427 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee15ecab-06e9-478a-b5d4-10c4c3629179 tempest-ServersWithSpecificFlavorTestJSON-1849753589 tempest-ServersWithSpecificFlavorTestJSON-1849753589-project] 10.222.0.65 "GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2" status: 404 len: 111 microversion: 2.1 time: 0.060950 Oct 17 13:18:45.853019 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 391/855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:45 2022] GET /compute/v2.1/servers/f06cfa7a-43e5-4c28-930b-4999358934b2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:18:45.864264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:45.867000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:45.877906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.878401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.878838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.879551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:45.880006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:45.880429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:45.922515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lazy-loading 'flavor' on Instance uuid d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:45.951958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Going to try to live migrate instance to n-h2-854121-14 {{(pid=120697) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:18:46.553332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Updating instance_info_cache with network_info: [{"id": "b9fbf69a-dc59-48ce-a787-41040b034497", "address": "fa:16:3e:72:91:f6", "network": {"id": "485e24b6-e427-4cdd-ae21-18e362301c4e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-42038256-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7e85eeff8fe4f27964f2063624827b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9fbf69a-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:18:46.583205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Releasing lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:18:46.584079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7bf761c-7877-49a3-8e93-dfd4d7dcefd6 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action" status: 202 len: 0 microversion: 2.1 time: 3.056429 Oct 17 13:18:46.585014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 465/856] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:43 2022] POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action => generated 0 bytes in 3058 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:18:46.590033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-165c32e1-727f-432e-bcd7-c5bb529cf866 req-f8618243-d030-48bb-9b91-1cd92772d194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:46.606670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-165c32e1-727f-432e-bcd7-c5bb529cf866 req-f8618243-d030-48bb-9b91-1cd92772d194 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.607458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-165c32e1-727f-432e-bcd7-c5bb529cf866 req-f8618243-d030-48bb-9b91-1cd92772d194 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.608753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-165c32e1-727f-432e-bcd7-c5bb529cf866 req-f8618243-d030-48bb-9b91-1cd92772d194 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.638436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-165c32e1-727f-432e-bcd7-c5bb529cf866 req-f8618243-d030-48bb-9b91-1cd92772d194 service nova] Creating event network-changed:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:18:46.648929 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-165c32e1-727f-432e-bcd7-c5bb529cf866 req-f8618243-d030-48bb-9b91-1cd92772d194 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060526 Oct 17 13:18:46.650423 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 466/857] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:46.675622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:46.676494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:46.691105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.692830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.693529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.694273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:46.694767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:46.695190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:46.855593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:46.866606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:46.868454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:46.869777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba4bd45c-8f49-48b8-a123-f0811579057b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1557 microversion: 2.25 time: 0.217913 Oct 17 13:18:46.870414 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 467/858] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:46 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:46.876017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cb972d8-6b87-4a9d-9041-a5c450791779 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419e18df70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:47.748935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cb972d8-6b87-4a9d-9041-a5c450791779 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/3a7a7fe1-543a-477f-8e09-9194cbc5700b" status: 202 len: 0 microversion: 2.1 time: 0.877172 Oct 17 13:18:47.754971 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 468/859] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:18:46 2022] DELETE /compute/v2.1/os-floating-ips/3a7a7fe1-543a-477f-8e09-9194cbc5700b => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:47.765893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.30"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:47.769804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:47.779751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:47.780623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:47.781406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:47.782439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:47.783119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:47.783854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:47.815657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "refresh_cache-f11095f9-54ae-47bf-a710-017445641674" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:18:47.817345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquired lock "refresh_cache-f11095f9-54ae-47bf-a710-017445641674" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:18:48.776249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07b3b284-2965-4a66-84d2-ac992c569bae tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd/action" status: 202 len: 0 microversion: 2.1 time: 2.925534 Oct 17 13:18:48.779022 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 392/860] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:45 2022] POST /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd/action => generated 0 bytes in 2929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:48.787802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:48.789912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:48.803245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.804279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.804952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:48.806031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:48.806795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:48.807576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:49.216269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 2d3ea40f-54a7-4185-9cee-459f289abf28 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:49.242053 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bf2ee2d-0d27-4687-809f-b93da31e82c3 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 2051 microversion: 2.25 time: 0.461614 Oct 17 13:18:49.253557 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 393/861] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:48 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 2051 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:49.264162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8f9d06d-5881-4f61-8824-66551dbb2975 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419df69ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:49.744461 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8f9d06d-5881-4f61-8824-66551dbb2975 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.489392 Oct 17 13:18:49.745060 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 394/862] 10.222.0.65 () {58 vars in 1164 bytes} [Mon Oct 17 13:18:49 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:18:49.752250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:49.753146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:49.770638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:49.778685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:49.779255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:49.779896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:49.780358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:49.780792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:50.200499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:50.214168 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-871374b5-9cc7-4920-b8bc-13f94623c2d1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.467660 Oct 17 13:18:50.215517 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 395/863] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:49 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:50.221290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:50.222520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:50.231210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:50.232449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:50.233059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:50.234136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:50.235386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:50.235985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:50.763071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 2d3ea40f-54a7-4185-9cee-459f289abf28 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:50.792162 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4392e391-ced8-46d5-871d-a1389a6a3ede tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 2051 microversion: 2.25 time: 0.574867 Oct 17 13:18:50.794198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 396/864] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:50 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 2051 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:50.811901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b0ca5b3-16f8-4bd9-b43d-df1b8f0ee07f tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419dff6ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:51.395039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b0ca5b3-16f8-4bd9-b43d-df1b8f0ee07f tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips" status: 200 len: 395 microversion: 2.1 time: 0.599174 Oct 17 13:18:51.407389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 397/865] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:18:50 2022] GET /compute/v2.1/os-floating-ips => generated 395 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:51.412566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:51.416706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:51.426569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:51.427433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:51.428452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:51.429267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:51.429984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:51.504834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1ecf8fb-1633-484b-bd6d-8f50f0ebbf8c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.095911 Oct 17 13:18:51.505577 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 398/866] 10.222.0.65 () {60 vars in 1217 bytes} [Mon Oct 17 13:18:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:18:51.517531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:51.518436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:51.537395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:51.538166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:51.539463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:51.541473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:51.542101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:51.544239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:51.638010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.neutron [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] re-assign floating IP 172.25.9.30 from instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 Oct 17 13:18:51.739043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:18:51.945270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:52.568261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:52.581003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3135774-263c-4a81-adaa-1e75118b491c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 1.073761 Oct 17 13:18:52.585431 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 399/867] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:51 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:52.626005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-340f9d4b-9af8-4915-8f75-e6c7407b701a tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419df709d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:53.638054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Updating instance_info_cache with network_info: [{"id": "b9fbf69a-dc59-48ce-a787-41040b034497", "address": "fa:16:3e:72:91:f6", "network": {"id": "485e24b6-e427-4cdd-ae21-18e362301c4e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-42038256-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7e85eeff8fe4f27964f2063624827b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9fbf69a-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:18:53.659393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:18:54.611096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-340f9d4b-9af8-4915-8f75-e6c7407b701a tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/b4ad0f4c-c9d5-43f0-a891-6d0ce3440cec" status: 202 len: 0 microversion: 2.1 time: 2.023677 Oct 17 13:18:54.611685 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 400/868] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:18:52 2022] DELETE /compute/v2.1/os-floating-ips/b4ad0f4c-c9d5-43f0-a891-6d0ce3440cec => generated 0 bytes in 2025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:54.619757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b9565ebc-a308-464e-9964-9109d2dc8b09 req-d41c4c79-e327-432a-b307-18dbb4a9c1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:54.639487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:54.644795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b9565ebc-a308-464e-9964-9109d2dc8b09 req-d41c4c79-e327-432a-b307-18dbb4a9c1b0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.645341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b9565ebc-a308-464e-9964-9109d2dc8b09 req-d41c4c79-e327-432a-b307-18dbb4a9c1b0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.645790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b9565ebc-a308-464e-9964-9109d2dc8b09 req-d41c4c79-e327-432a-b307-18dbb4a9c1b0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.685575 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b9565ebc-a308-464e-9964-9109d2dc8b09 req-d41c4c79-e327-432a-b307-18dbb4a9c1b0 service nova] Creating event network-changed:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:18:54.692272 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b9565ebc-a308-464e-9964-9109d2dc8b09 req-d41c4c79-e327-432a-b307-18dbb4a9c1b0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076242 Oct 17 13:18:54.693565 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 401/869] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:54.701236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:54.702284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:54.717482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.718237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.719526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.720543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.721306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.721847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.849226 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7a2bfd1-28d8-4416-a144-f5ebb225d68f tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28/action" status: 202 len: 0 microversion: 2.25 time: 0.151524 Oct 17 13:18:54.853627 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 402/870] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:18:54 2022] POST /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:54.867271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:54.868460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:54.883924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.885318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.885932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.887175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:54.889097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:54.889770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:54.899220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Updating instance_info_cache with network_info: [{"id": "18d14400-c6be-450b-b317-63953e7f90d4", "address": "fa:16:3e:9c:e0:5b", "network": {"id": "485e24b6-e427-4cdd-ae21-18e362301c4e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-42038256-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7e85eeff8fe4f27964f2063624827b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18d14400-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:18:54.934608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Releasing lock "refresh_cache-f11095f9-54ae-47bf-a710-017445641674" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:18:54.935704 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1776934b-1135-4c26-911f-363ba81c8204 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674/action" status: 202 len: 0 microversion: 2.1 time: 7.175421 Oct 17 13:18:54.936628 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 469/871] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:47 2022] POST /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674/action => generated 0 bytes in 7179 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:18:54.943059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-470cd80f-2e13-48d7-a5ec-c797eb70ac17 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419e055dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:55.042738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:55.215099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:55.226402 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec25f084-ea88-405a-858f-422cd1d78752 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.368869 Oct 17 13:18:55.227184 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 403/872] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:54 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:55.241018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:55.241922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:55.256922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:55.258376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:55.261289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:55.262206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:55.263986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:55.264482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:55.611603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 2d3ea40f-54a7-4185-9cee-459f289abf28 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:55.643794 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ab7a95b-50b6-44e4-ae95-28100dfe511c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 2036 microversion: 2.25 time: 0.415335 Oct 17 13:18:55.671598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 404/873] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:55 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 2036 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:18:55.677984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'action', calling method: .version_select at 0x7f41a04878b0>, body: {"removeFloatingIp": {"address": "172.25.9.30"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:56.042495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:56.057799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.059001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.060642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.061745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.065879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.066644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.615038 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-470cd80f-2e13-48d7-a5ec-c797eb70ac17 tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/fcfda450-ceb4-4d8f-aa37-b5b58db50368" status: 202 len: 0 microversion: 2.1 time: 1.675766 Oct 17 13:18:56.619015 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 470/874] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:18:54 2022] DELETE /compute/v2.1/os-floating-ips/fcfda450-ceb4-4d8f-aa37-b5b58db50368 => generated 0 bytes in 1680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:56.623338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854121-14", "block_migration": "auto"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:56.626567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:56.636319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] HTTP exception thrown: Floating IP 172.25.9.30 is not associated with instance 908e20d4-8f51-484e-bc34-8a94d1f380e8. Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Request method failure captured: Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action HTTP/1.1 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 48 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYBkxU6iowKbuYbyhuS6bOuUZudsu7IeOE_MlaUxwI-XOLredjVG0KYcKyzzljqyPDsAOKCutksKPZP_nSLW7Kar8nLkKL9KyWovgM9ri62l6MRJNFqmzJEa3Wap_OCGhWDg7gBiSNM-Bz5OFod1rtWGtPJjH8W3nqRC4w6OzCNQ30 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:18:56.638586 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6d37b800dbaf44f58c048fb2fef592f8 Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: {"removeFloatingIp": {"address": "172.25.9.30"}} Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:18:56.640240 n-d-854121-14 devstack@n-api.service[120697]: exception: Floating IP 172.25.9.30 is not associated with instance 908e20d4-8f51-484e-bc34-8a94d1f380e8. Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '908e20d4-8f51-484e-bc34-8a94d1f380e8', 'body': {'removeFloatingIp': {'address': '172.25.9.30'}}} Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.30 is not associated with instance 908e20d4-8f51-484e-bc34-8a94d1f380e8. Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.642852 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:18:56.647445 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:18:56.647445 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:18:56.647445 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:18:56.647445 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:18:56.647445 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.30 is not associated with instance 908e20d4-8f51-484e-bc34-8a94d1f380e8. Oct 17 13:18:56.647445 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:18:56.651963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Returning 409 to user: Floating IP 172.25.9.30 is not associated with instance 908e20d4-8f51-484e-bc34-8a94d1f380e8. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:18:56.654396 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bacc9c0-29e8-41bb-93d5-64f9b17f8730 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action" status: 409 len: 145 microversion: 2.1 time: 0.980416 Oct 17 13:18:56.658911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.660682 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 405/875] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:55 2022] POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action => generated 145 bytes in 988 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:18:56.664745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.665323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.666094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.666568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.666763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:56.667005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.667720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:56.675874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.676620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.677242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.678135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:56.679286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:56.683403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:56.699123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'flavor' on Instance uuid 2d3ea40f-54a7-4185-9cee-459f289abf28 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:18:56.716608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Going to try to live migrate instance to n-h1-854121-14 {{(pid=120698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:18:56.979200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:56.996441 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07e76fdd-e73e-4305-8112-bebec6163032 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.332659 Oct 17 13:18:57.012602 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 406/876] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:56 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:57.012602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1bc7466-f847-4e1f-8c4a-4f8b46acefbb tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] Calling method '.version_select at 0x7f419e121040>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:58.881761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1bc7466-f847-4e1f-8c4a-4f8b46acefbb tempest-FloatingIPDetailsTestJSON-1665797711 tempest-FloatingIPDetailsTestJSON-1665797711-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/123bd6d5-bf47-42fe-9400-7034b4546a20" status: 202 len: 0 microversion: 2.1 time: 1.882677 Oct 17 13:18:58.883286 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 407/877] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:18:56 2022] DELETE /compute/v2.1/os-floating-ips/123bd6d5-bf47-42fe-9400-7034b4546a20 => generated 0 bytes in 1885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:18:58.896668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.30"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:58.996911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc84b499-e22b-4c9e-9249-a041d3cca22d tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28/action" status: 202 len: 0 microversion: 2.25 time: 2.377962 Oct 17 13:18:59.001092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 471/878] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:18:56 2022] POST /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28/action => generated 0 bytes in 2383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:18:59.007198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11095f9-54ae-47bf-a710-017445641674", "tag": "18d14400-c6be-450b-b317-63953e7f90d4"}, {"server_uuid": "d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd", "name": "network-vif-unplugged", "status": "completed", "tag": "76bd1a7e-0678-4c82-8b2b-3c87effe2275"}, {"name": "network-changed", "server_uuid": "d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd", "tag": "76bd1a7e-0678-4c82-8b2b-3c87effe2275"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:18:59.025126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.025635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.027395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.045540 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Creating event network-changed:18d14400-c6be-450b-b317-63953e7f90d4 for instance f11095f9-54ae-47bf-a710-017445641674 on n-h1-854121-14 Oct 17 13:18:59.046310 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Creating event network-vif-unplugged:76bd1a7e-0678-4c82-8b2b-3c87effe2275 for instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd on n-h1-854121-14 Oct 17 13:18:59.047577 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] Creating event network-changed:76bd1a7e-0678-4c82-8b2b-3c87effe2275 for instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd on n-h1-854121-14 Oct 17 13:18:59.057197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-548de274-31ef-48ec-a4a2-d35d5bf9decf req-177d13aa-6d32-404a-aa2f-2d43f95618b4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.054290 Oct 17 13:18:59.058511 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 472/879] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:18:59.064080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:59.065614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:59.087855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.088623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.089318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.090254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.090938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.091941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.264416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:59.280879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.281844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.282743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.283665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.284628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.285391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.318732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:18:59.353014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:59.363318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88176881-6c21-4839-9cf2-0306053f1558 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.303150 Oct 17 13:18:59.370555 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 473/880] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:18:59 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:18:59.382122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:18:59.384343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:18:59.395649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.396676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.397581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.398409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:18:59.399463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:18:59.400024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:18:59.649948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:59.667004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:59.668878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "refresh_cache-f11095f9-54ae-47bf-a710-017445641674" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:18:59.669349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquired lock "refresh_cache-f11095f9-54ae-47bf-a710-017445641674" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:18:59.671060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:18:59.673683 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36157e65-3f81-4ea0-a3b4-9ea5e91be8a9 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 0.301085 Oct 17 13:18:59.677346 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 474/881] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:18:59 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:00.393664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:00.395215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:00.403852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:00.404762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:00.405680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:00.407286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:00.408116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:00.408915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.011592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:01.024850 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8659442f-91bd-4a42-985c-f2a2f939819f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.635079 Oct 17 13:19:01.028273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 475/882] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:00 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:01.034951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:01.035934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:01.051742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.052517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.053126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.054189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.054887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.055499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.286750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Building network info cache for instance {{(pid=120697) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:19:01.336376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:01.346337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:01.348841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:01.349041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f4db82e-6947-400d-a27b-2a1c7a9effb3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 0.319258 Oct 17 13:19:01.358159 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 476/883] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:01 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:01.385408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-98ef601f-29f7-4605-a7f1-4dd6a186b268 req-fb227699-cc3f-4ea6-8cf7-6b655bf0faab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11095f9-54ae-47bf-a710-017445641674", "tag": "18d14400-c6be-450b-b317-63953e7f90d4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:01.411221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-98ef601f-29f7-4605-a7f1-4dd6a186b268 req-fb227699-cc3f-4ea6-8cf7-6b655bf0faab service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:01.411806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-98ef601f-29f7-4605-a7f1-4dd6a186b268 req-fb227699-cc3f-4ea6-8cf7-6b655bf0faab service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:01.412135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-98ef601f-29f7-4605-a7f1-4dd6a186b268 req-fb227699-cc3f-4ea6-8cf7-6b655bf0faab service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:01.431684 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-98ef601f-29f7-4605-a7f1-4dd6a186b268 req-fb227699-cc3f-4ea6-8cf7-6b655bf0faab service nova] Creating event network-changed:18d14400-c6be-450b-b317-63953e7f90d4 for instance f11095f9-54ae-47bf-a710-017445641674 on n-h1-854121-14 Oct 17 13:19:01.451087 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-98ef601f-29f7-4605-a7f1-4dd6a186b268 req-fb227699-cc3f-4ea6-8cf7-6b655bf0faab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069843 Oct 17 13:19:01.452026 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 477/884] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:01.463532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:02.055390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:02.056574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:02.067224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:02.073340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.076236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.079565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.080572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.081251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.083593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.700098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:02.710418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f4731ee-b5bf-4a32-adeb-c129d59aff17 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.660427 Oct 17 13:19:02.718754 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 478/885] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:02 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:02.742235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6533a247-443b-4c1f-a110-5f2912b92557 req-887755fa-7528-42c9-ad1b-c1f6d8b38ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ea40f-54a7-4185-9cee-459f289abf28", "name": "network-vif-unplugged", "status": "completed", "tag": "186d7cf2-0816-4f4a-bc90-ca4d191d66ba"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:02.769286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6533a247-443b-4c1f-a110-5f2912b92557 req-887755fa-7528-42c9-ad1b-c1f6d8b38ed4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.770505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6533a247-443b-4c1f-a110-5f2912b92557 req-887755fa-7528-42c9-ad1b-c1f6d8b38ed4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.771211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6533a247-443b-4c1f-a110-5f2912b92557 req-887755fa-7528-42c9-ad1b-c1f6d8b38ed4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.799612 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6533a247-443b-4c1f-a110-5f2912b92557 req-887755fa-7528-42c9-ad1b-c1f6d8b38ed4 service nova] Creating event network-vif-unplugged:186d7cf2-0816-4f4a-bc90-ca4d191d66ba for instance 2d3ea40f-54a7-4185-9cee-459f289abf28 on n-h2-854121-14 Oct 17 13:19:02.810033 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6533a247-443b-4c1f-a110-5f2912b92557 req-887755fa-7528-42c9-ad1b-c1f6d8b38ed4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085691 Oct 17 13:19:02.811011 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 479/886] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:02.847402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:02.852951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:02.868367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.868984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.873786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:02.876264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:02.878111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:02.878867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:03.865094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:03.887654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:03.898168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:03.902994 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26197ff3-1f24-4b24-8d00-f464930b36ab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 1.084980 Oct 17 13:19:03.906800 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 480/887] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:02 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:03.919377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b0967aa4-f3fd-4cee-9017-db8373f90ab8 req-ea13b3c6-7c0d-4fb3-bb74-9811fba2b12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd", "name": "network-vif-plugged", "status": "completed", "tag": "76bd1a7e-0678-4c82-8b2b-3c87effe2275"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:03.948076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Updating instance_info_cache with network_info: [{"id": "18d14400-c6be-450b-b317-63953e7f90d4", "address": "fa:16:3e:9c:e0:5b", "network": {"id": "485e24b6-e427-4cdd-ae21-18e362301c4e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-42038256-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7e85eeff8fe4f27964f2063624827b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18d14400-c6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120697) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:19:03.983806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b0967aa4-f3fd-4cee-9017-db8373f90ab8 req-ea13b3c6-7c0d-4fb3-bb74-9811fba2b12a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:03.985678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b0967aa4-f3fd-4cee-9017-db8373f90ab8 req-ea13b3c6-7c0d-4fb3-bb74-9811fba2b12a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:03.987212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b0967aa4-f3fd-4cee-9017-db8373f90ab8 req-ea13b3c6-7c0d-4fb3-bb74-9811fba2b12a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.019967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b0967aa4-f3fd-4cee-9017-db8373f90ab8 req-ea13b3c6-7c0d-4fb3-bb74-9811fba2b12a service nova] Creating event network-vif-plugged:76bd1a7e-0678-4c82-8b2b-3c87effe2275 for instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd on n-h1-854121-14 Oct 17 13:19:04.027523 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b0967aa4-f3fd-4cee-9017-db8373f90ab8 req-ea13b3c6-7c0d-4fb3-bb74-9811fba2b12a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119206 Oct 17 13:19:04.033686 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 481/888] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:04.044853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:04.049578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:04.067551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.068462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.070867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.071890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.073760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.074456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.088595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:04.375877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Releasing lock "refresh_cache-f11095f9-54ae-47bf-a710-017445641674" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:19:04.377048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-364ccd8b-bbcd-4d45-b319-34758bf41f38 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674/action" status: 202 len: 0 microversion: 2.1 time: 5.492084 Oct 17 13:19:04.378362 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 408/889] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:18:58 2022] POST /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674/action => generated 0 bytes in 5494 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:19:04.386807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:04.387574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:04.395845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.396627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.397257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.398193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.398796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.399409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.438117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:04.450786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:19:04.452464 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4327e2f5-814b-45de-bb14-9039d513fa32 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1502 microversion: 2.1 time: 0.416331 Oct 17 13:19:04.470807 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 482/890] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:04 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1502 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:04.683621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c930ac7-3da4-4cc3-bfda-95834dc2fc46 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 204 len: 0 microversion: 2.1 time: 0.299791 Oct 17 13:19:04.686266 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 409/891] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:19:04 2022] DELETE /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:04.700441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.30"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:04.703771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:04.711398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.712190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.712794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.713868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.714470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.715300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.792286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:19:04.793676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquired lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:19:04.932384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a0b23036-9042-4989-910c-73a19baf0132 req-71a8ad90-03cb-44e5-88ee-970b1d9c2093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d3ea40f-54a7-4185-9cee-459f289abf28", "tag": "186d7cf2-0816-4f4a-bc90-ca4d191d66ba"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:04.964008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0b23036-9042-4989-910c-73a19baf0132 req-71a8ad90-03cb-44e5-88ee-970b1d9c2093 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:04.965287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0b23036-9042-4989-910c-73a19baf0132 req-71a8ad90-03cb-44e5-88ee-970b1d9c2093 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:04.965908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0b23036-9042-4989-910c-73a19baf0132 req-71a8ad90-03cb-44e5-88ee-970b1d9c2093 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:04.984236 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a0b23036-9042-4989-910c-73a19baf0132 req-71a8ad90-03cb-44e5-88ee-970b1d9c2093 service nova] Creating event network-changed:186d7cf2-0816-4f4a-bc90-ca4d191d66ba for instance 2d3ea40f-54a7-4185-9cee-459f289abf28 on n-h2-854121-14 Oct 17 13:19:05.003980 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a0b23036-9042-4989-910c-73a19baf0132 req-71a8ad90-03cb-44e5-88ee-970b1d9c2093 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076988 Oct 17 13:19:05.004616 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 410/892] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:05.013113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:05.013989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:05.024220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:05.025091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:05.026028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:05.027089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:05.027736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:05.028649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:05.959329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:05.967982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:05.970932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:05.972338 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb4aebeb-2a94-4082-9af2-1ad21e6a69aa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 0.966214 Oct 17 13:19:05.973428 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 411/893] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:05 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:06.300690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-06b34a2e-e9f5-4a1e-8aa2-6ded1c282afa tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1662191029", "id": 2002018935, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:06.342343 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-06b34a2e-e9f5-4a1e-8aa2-6ded1c282afa tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.357615 Oct 17 13:19:06.342921 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 412/894] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:19:05 2022] POST /compute/v2.1/flavors => generated 471 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:06.380324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:06.381699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:06.394082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:06.394863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:06.395975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:06.396707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:06.397191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:06.397616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:06.797140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:06.810129 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08ef6a1d-eac9-4570-a28b-d37be525d891 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1477 microversion: 2.1 time: 0.465634 Oct 17 13:19:06.810923 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 413/895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:06 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1477 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:06.825616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34b41db8-c989-4ddc-833b-13b00f947a09 tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:07.175443 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34b41db8-c989-4ddc-833b-13b00f947a09 tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors/2002018935/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.363038 Oct 17 13:19:07.176123 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 414/896] 10.222.0.65 () {62 vars in 1265 bytes} [Mon Oct 17 13:19:06 2022] POST /compute/v2.1/flavors/2002018935/os-extra_specs => generated 62 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:07.181598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-951dd292-939f-4e7f-990a-c53195746a8f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '.version_select at 0x7f419e121b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:07.187685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-951dd292-939f-4e7f-990a-c53195746a8f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.188182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-951dd292-939f-4e7f-990a-c53195746a8f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.188628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-951dd292-939f-4e7f-990a-c53195746a8f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:07.204551 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-951dd292-939f-4e7f-990a-c53195746a8f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 1564 microversion: 2.1 time: 0.026949 Oct 17 13:19:07.205349 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 415/897] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:19:07 2022] GET /compute/v2.1/os-migrations => generated 1564 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:07.210293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:07.211087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:07.222995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.223610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.224065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:07.224853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.225526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.226014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:07.606156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:07.620852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:07.627062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:07.629832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc196868-2eac-4b18-9c8d-83e572e008b1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 0.423332 Oct 17 13:19:07.654223 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 416/898] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:07 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:07.654223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0919e01f-beea-4155-be76-607893bbfc7c req-568b31f0-10d2-4271-a26a-3abc0c34a484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11095f9-54ae-47bf-a710-017445641674", "name": "network-vif-deleted", "tag": "18d14400-c6be-450b-b317-63953e7f90d4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:07.677222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0919e01f-beea-4155-be76-607893bbfc7c req-568b31f0-10d2-4271-a26a-3abc0c34a484 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.677222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0919e01f-beea-4155-be76-607893bbfc7c req-568b31f0-10d2-4271-a26a-3abc0c34a484 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.677222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0919e01f-beea-4155-be76-607893bbfc7c req-568b31f0-10d2-4271-a26a-3abc0c34a484 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:07.710386 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0919e01f-beea-4155-be76-607893bbfc7c req-568b31f0-10d2-4271-a26a-3abc0c34a484 service nova] Creating event network-vif-deleted:18d14400-c6be-450b-b317-63953e7f90d4 for instance f11095f9-54ae-47bf-a710-017445641674 on n-h1-854121-14 Oct 17 13:19:07.724424 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0919e01f-beea-4155-be76-607893bbfc7c req-568b31f0-10d2-4271-a26a-3abc0c34a484 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085047 Oct 17 13:19:07.728110 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 417/899] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:07.741774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0485008a-8466-4f7f-940b-54ecdce414f8 tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:07.794319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0485008a-8466-4f7f-940b-54ecdce414f8 tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2002018935" status: 202 len: 0 microversion: 2.86 time: 0.062685 Oct 17 13:19:07.798271 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 418/900] 10.222.0.65 () {60 vars in 1202 bytes} [Mon Oct 17 13:19:07 2022] DELETE /compute/v2.1/flavors/2002018935 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:07.811645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:07.813050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:07.831737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.832251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.832728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:07.833525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:07.833986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:07.834438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:08.239158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:19:08.243368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec11262b-2f19-4270-9257-9f847946cc15 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1630 microversion: 2.1 time: 0.439428 Oct 17 13:19:08.244012 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 419/901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:07 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1630 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:08.284766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce11e63f-ce2a-471b-97f2-16b8a47c9dd4 tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:08.339837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce11e63f-ce2a-471b-97f2-16b8a47c9dd4 tempest-FlavorMetadataValidation-1493512994 tempest-FlavorMetadataValidation-1493512994-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.093350 Oct 17 13:19:08.353198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 420/902] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:19:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:08.355537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8b15503e-ee8a-4275-bb83-963c35bade29 req-dbe17bf7-5269-446d-8d21-2be5a9728375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:08.383990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8b15503e-ee8a-4275-bb83-963c35bade29 req-dbe17bf7-5269-446d-8d21-2be5a9728375 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:08.384488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8b15503e-ee8a-4275-bb83-963c35bade29 req-dbe17bf7-5269-446d-8d21-2be5a9728375 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:08.384932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8b15503e-ee8a-4275-bb83-963c35bade29 req-dbe17bf7-5269-446d-8d21-2be5a9728375 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:08.441052 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8b15503e-ee8a-4275-bb83-963c35bade29 req-dbe17bf7-5269-446d-8d21-2be5a9728375 service nova] Creating event network-changed:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:19:08.453774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8b15503e-ee8a-4275-bb83-963c35bade29 req-dbe17bf7-5269-446d-8d21-2be5a9728375 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110728 Oct 17 13:19:08.458054 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 421/903] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:08.473705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-430c2458-2ae9-4a83-914b-601d1f924a78 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Action: 'create', calling method: .version_select at 0x7f419e07a4c0>, body: {"keypair": {"name": "tempest-keypair-495570568", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXH5YQQet3vQpHiui+/tCS9Vgqbfqjih6Q1ITSHHBfoBpqL0SmaHU/UIzHt47ZkOogW7Lr2M2eP/3c2HFsz1nT5Qow30srg8RGmx3kWvL+xi6d9CQRZdDb003zTW60AmQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:08.600142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-430c2458-2ae9-4a83-914b-601d1f924a78 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for project d24e295f59e54ff384c107e1ff637e4b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:08.615547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-430c2458-2ae9-4a83-914b-601d1f924a78 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for user 3d18129f56c24321aeff6fa609f78c87 and project d24e295f59e54ff384c107e1ff637e4b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:08.684943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-430c2458-2ae9-4a83-914b-601d1f924a78 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.223516 Oct 17 13:19:08.694845 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 422/904] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:19:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:08.700371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:08.701049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:08.712842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:08.713392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:08.714733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:08.715841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:08.716307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:08.716736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:09.844886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:09.854273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:09.855740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:09.865988 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25b2ca3c-c4fe-4dc7-8b65-b42ac43a9394 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 1.169725 Oct 17 13:19:09.866897 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 423/905] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:08 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:10.818098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Updating instance_info_cache with network_info: [{"id": "b9fbf69a-dc59-48ce-a787-41040b034497", "address": "fa:16:3e:72:91:f6", "network": {"id": "485e24b6-e427-4cdd-ae21-18e362301c4e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-42038256-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7e85eeff8fe4f27964f2063624827b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9fbf69a-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:19:10.840508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Releasing lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:19:10.843667 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95cda630-3cc7-4ade-980c-85e2fa9f1019 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action" status: 202 len: 0 microversion: 2.1 time: 6.146679 Oct 17 13:19:10.857955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be594f5b-ed07-4a3e-9110-d450c232e384 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '.version_select at 0x7f419e8a6c10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:10.865320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 483/906] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:04 2022] POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action => generated 0 bytes in 6167 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:19:10.895565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:10.896309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:10.903457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:10.904007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:10.904449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:10.905195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:10.906308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:10.906748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:11.269580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:11.286781 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be594f5b-ed07-4a3e-9110-d450c232e384 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips/27c58809-f4d2-4ee7-b5cf-a7ba20e8785b" status: 200 len: 183 microversion: 2.1 time: 0.435333 Oct 17 13:19:11.287560 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 424/907] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:19:10 2022] GET /compute/v2.1/os-floating-ips/27c58809-f4d2-4ee7-b5cf-a7ba20e8785b => generated 183 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:11.288722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:11.290972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:11.293041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54ec143c-0514-4350-8c19-7aabf54d52ac tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 0.404929 Oct 17 13:19:11.293718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 484/908] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:10 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:11.302871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.30"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:11.514466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:11.522604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:11.523484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:11.523953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:11.524852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:11.525526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:11.526130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:11.863747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:19:11.864753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquired lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:19:12.326290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:12.326963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:12.339687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:12.348762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:12.352085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:12.354566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:12.356674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:12.357592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:12.698936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:12.717284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:12.719409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:12.721632 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3dbb08fc-7079-4e72-81e9-3211d97db6ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1567 microversion: 2.25 time: 0.402105 Oct 17 13:19:12.722779 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 485/909] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:12 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:12.813371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1917635144", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "f00eb40b-7ce6-4995-9281-4d82713dfdfa"}], "security_groups": [{"name": "tempest-securitygroup--1699289904"}], "key_name": "tempest-keypair-495570568", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:12.937486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Building network info cache for instance {{(pid=120697) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:19:13.196341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] validate_networks() for [('f00eb40b-7ce6-4995-9281-4d82713dfdfa', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:14.223387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Updating instance_info_cache with network_info: [{"id": "b9fbf69a-dc59-48ce-a787-41040b034497", "address": "fa:16:3e:72:91:f6", "network": {"id": "485e24b6-e427-4cdd-ae21-18e362301c4e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-42038256-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7e85eeff8fe4f27964f2063624827b6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb9fbf69a-dc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120697) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:19:14.241731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:14.242205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:14.242764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:14.243346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:14.244168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:14.244294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Releasing lock "refresh_cache-908e20d4-8f51-484e-bc34-8a94d1f380e8" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:19:14.245732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3bb5b864-6825-41ee-92fb-dbfbd41e367e tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action" status: 202 len: 0 microversion: 2.1 time: 2.949695 Oct 17 13:19:14.250103 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 425/910] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:11 2022] POST /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8/action => generated 0 bytes in 2951 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 17 13:19:14.255843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-80a29fa8-f611-4882-86e0-920a1d994ae9 req-9f2805a0-db46-4ec4-ba76-a015f7431fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:14.269476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.270271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.270876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.271764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-80a29fa8-f611-4882-86e0-920a1d994ae9 req-9f2805a0-db46-4ec4-ba76-a015f7431fae service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.271914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.272562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-80a29fa8-f611-4882-86e0-920a1d994ae9 req-9f2805a0-db46-4ec4-ba76-a015f7431fae service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.272699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.273292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.273641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-80a29fa8-f611-4882-86e0-920a1d994ae9 req-9f2805a0-db46-4ec4-ba76-a015f7431fae service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.298372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-80a29fa8-f611-4882-86e0-920a1d994ae9 req-9f2805a0-db46-4ec4-ba76-a015f7431fae service nova] Creating event network-changed:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:19:14.329555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-80a29fa8-f611-4882-86e0-920a1d994ae9 req-9f2805a0-db46-4ec4-ba76-a015f7431fae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062145 Oct 17 13:19:14.334451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 426/911] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:14.351131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:14.357396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.358232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:14.368289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for user 3d18129f56c24321aeff6fa609f78c87 and project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:14.375453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.375960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.376406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.382502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.387281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.389149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.395023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:14.397786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:14.472200 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce8b78eb-6a0f-427f-a695-b6608487ba00 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.664389 Oct 17 13:19:14.473249 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 486/912] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:19:14.478903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.479692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:14.487068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.487908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.488540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.489623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.490263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.490897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.512647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] HTTP exception thrown: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Request method failure captured: Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 HTTP/1.1 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVYBkxU6iowKbuYbyhuS6bOuUZudsu7IeOE_MlaUxwI-XOLredjVG0KYcKyzzljqyPDsAOKCutksKPZP_nSLW7Kar8nLkKL9KyWovgM9ri62l6MRJNFqmzJEa3Wap_OCGhWDg7gBiSNM-Bz5OFod1rtWGtPJjH8W3nqRC4w6OzCNQ30 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:19:14.515571 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6d37b800dbaf44f58c048fb2fef592f8 Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.517464 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f11095f9-54ae-47bf-a710-017445641674'} Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:14.518412 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.520009 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.523031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Returning 404 to user: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:14.524067 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c6d9128-2574-4174-a54c-5cc1af23c3f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 404 len: 111 microversion: 2.1 time: 0.049712 Oct 17 13:19:14.528013 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 487/913] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:19:14 2022] DELETE /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:19:14.536195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-999c65fa-9974-4643-b276-972b113ba595 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.539850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-999c65fa-9974-4643-b276-972b113ba595 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:14.671060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:14.683629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:14.690071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-999c65fa-9974-4643-b276-972b113ba595 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:14.691024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:14.693181 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-934e148a-d263-4735-8c5d-19f4436a2dfb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1542 microversion: 2.25 time: 0.355777 Oct 17 13:19:14.695019 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 427/914] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:14 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1542 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:14.698821 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-999c65fa-9974-4643-b276-972b113ba595 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1234 microversion: 2.1 time: 0.169344 Oct 17 13:19:14.713367 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 488/915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:14 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1234 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:14.728843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.729495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: f11095f9-54ae-47bf-a710-017445641674] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:14.760343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.760845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.761324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.762054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.762513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.762943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.810786 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] HTTP exception thrown: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Request method failure captured: Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 HTTP/1.1 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYBkxU6iowKbuYbyhuS6bOuUZudsu7IeOE_MlaUxwI-XOLredjVG0KYcKyzzljqyPDsAOKCutksKPZP_nSLW7Kar8nLkKL9KyWovgM9ri62l6MRJNFqmzJEa3Wap_OCGhWDg7gBiSNM-Bz5OFod1rtWGtPJjH8W3nqRC4w6OzCNQ30 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:19:14.819943 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6d37b800dbaf44f58c048fb2fef592f8 Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.822005 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f11095f9-54ae-47bf-a710-017445641674'} Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:14.823949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. Oct 17 13:19:14.828934 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:14.844670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Returning 404 to user: Instance f11095f9-54ae-47bf-a710-017445641674 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:14.845598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca3dcc44-feec-4f69-81d9-99eccec4af43 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674" status: 404 len: 111 microversion: 2.1 time: 0.149342 Oct 17 13:19:14.848039 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 428/916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:14 2022] GET /compute/v2.1/servers/f11095f9-54ae-47bf-a710-017445641674 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:19:14.860398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10f77482-e7e8-493e-b74f-263f00a27878 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '.version_select at 0x7f419e07a4c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.871168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10f77482-e7e8-493e-b74f-263f00a27878 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:14.891431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10f77482-e7e8-493e-b74f-263f00a27878 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:14.892259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10f77482-e7e8-493e-b74f-263f00a27878 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:14.928314 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10f77482-e7e8-493e-b74f-263f00a27878 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 1712 microversion: 2.25 time: 0.066398 Oct 17 13:19:14.933806 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 429/917] 10.222.0.65 () {60 vars in 1184 bytes} [Mon Oct 17 13:19:14 2022] GET /compute/v2.1/os-migrations => generated 1712 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:14.956046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdc98b8c-38db-41b4-96db-0a979b8fceef tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '.version_select at 0x7f419dfa58b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:14.994500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f0b8077-155d-45c1-914e-7fcd9c5eafa5 tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1179972950", "id": 706035891, "os-flavor-access:is_public": "True"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:15.035542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f0b8077-155d-45c1-914e-7fcd9c5eafa5 tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.322012 Oct 17 13:19:15.044646 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 489/918] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:19:14 2022] POST /compute/v2.1/flavors => generated 446 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:15.060306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:15.064663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:15.078158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:15.078760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:15.079220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:15.079950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:15.088195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:15.091476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.063684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 2d3ea40f-54a7-4185-9cee-459f289abf28 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:16.099868 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c109f98e-3365-447d-8544-ebee83e11877 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 2036 microversion: 2.25 time: 1.059612 Oct 17 13:19:16.105330 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 490/919] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:15 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 2036 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:16.346097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e4e8732-8b17-4a00-90f1-75f37c8b4d3a tempest-FlavorsV255TestJSON-1821014020 tempest-FlavorsV255TestJSON-1821014020-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:16.363695 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e4e8732-8b17-4a00-90f1-75f37c8b4d3a tempest-FlavorsV255TestJSON-1821014020 tempest-FlavorsV255TestJSON-1821014020-project] 10.222.0.65 "GET /compute/v2.1/flavors/706035891" status: 200 len: 446 microversion: 2.55 time: 0.257303 Oct 17 13:19:16.380516 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 491/920] 10.222.0.65 () {60 vars in 1196 bytes} [Mon Oct 17 13:19:16 2022] GET /compute/v2.1/flavors/706035891 => generated 446 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:16.400680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:16.407351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:16.430464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.431316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.434723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.436134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:16.439691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:16.440876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:16.619297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:16.645903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ccdb5bc8-3c91-4da6-a78c-4e71842d55b2 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1286 microversion: 2.1 time: 0.261277 Oct 17 13:19:16.647196 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 492/921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:16 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1286 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:16.656779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-27dd1f42-5cfd-4bb0-a4d8-ec8ad284dbec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Action: 'create', calling method: .version_select at 0x7f419deec8b0>, body: {"keypair": {"name": "tempest-keypair-1638427564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZxLClnPVSetRX1jJccipZBEvtYDW4ySvcGYCV/SIADWfv0kxqXWM1nI7aF/w8KydyldkqDoc3lN0d6nBhcc0nENDdrah3oEzxB1z7EW+GeZGxkTyvS/c3ozRg/4aJ4ww=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:16.689792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-27dd1f42-5cfd-4bb0-a4d8-ec8ad284dbec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for project 0e454a0d18b54711bc621a802aaa239c. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:16.704278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-27dd1f42-5cfd-4bb0-a4d8-ec8ad284dbec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for user d9b63e4efecd4b9a96fc3b2e51f625fb and project 0e454a0d18b54711bc621a802aaa239c. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:16.772883 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-27dd1f42-5cfd-4bb0-a4d8-ec8ad284dbec tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.123129 Oct 17 13:19:16.773940 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 493/922] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:19:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:19:16.791692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96939ed9-317c-48a2-9a10-429698d69216 tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] Action: 'update', calling method: .version_select at 0x7f419fbfab80>, body: {"flavor": {"description": "new"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:16.878173 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96939ed9-317c-48a2-9a10-429698d69216 tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] 10.222.0.65 "PUT /compute/v2.1/flavors/706035891" status: 200 len: 447 microversion: 2.55 time: 0.102902 Oct 17 13:19:16.887934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 494/923] 10.222.0.65 () {62 vars in 1216 bytes} [Mon Oct 17 13:19:16 2022] PUT /compute/v2.1/flavors/706035891 => generated 447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:16.893547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e4a4f00-c822-4988-8c85-997ebdb5941a tempest-FlavorsV255TestJSON-1821014020 tempest-FlavorsV255TestJSON-1821014020-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:16.925508 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e4a4f00-c822-4988-8c85-997ebdb5941a tempest-FlavorsV255TestJSON-1821014020 tempest-FlavorsV255TestJSON-1821014020-project] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.035934 Oct 17 13:19:16.938333 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 495/924] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:19:16 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:16.949672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c434e35d-67b8-4100-a597-cd288f607a47 tempest-FlavorsV255TestJSON-1821014020 tempest-FlavorsV255TestJSON-1821014020-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:16.985222 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c434e35d-67b8-4100-a597-cd288f607a47 tempest-FlavorsV255TestJSON-1821014020 tempest-FlavorsV255TestJSON-1821014020-project] 10.222.0.65 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.039670 Oct 17 13:19:16.997234 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 496/925] 10.222.0.65 () {60 vars in 1166 bytes} [Mon Oct 17 13:19:16 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:17.004370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-586138a4-28ce-43d5-a4c7-9411050de666 tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:17.044232 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-586138a4-28ce-43d5-a4c7-9411050de666 tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/706035891" status: 202 len: 0 microversion: 2.55 time: 0.042023 Oct 17 13:19:17.044888 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 497/926] 10.222.0.65 () {60 vars in 1199 bytes} [Mon Oct 17 13:19:16 2022] DELETE /compute/v2.1/flavors/706035891 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:19:17.061290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-251fd6cb-4d1d-406d-a8fb-5d3ad7352c8c tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:17.100468 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-251fd6cb-4d1d-406d-a8fb-5d3ad7352c8c tempest-FlavorsV255TestJSON-1092670801 tempest-FlavorsV255TestJSON-1092670801-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.051005 Oct 17 13:19:17.113752 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 498/927] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:19:17 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:17.150020 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cdc98b8c-38db-41b4-96db-0a979b8fceef tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/27c58809-f4d2-4ee7-b5cf-a7ba20e8785b" status: 202 len: 0 microversion: 2.1 time: 2.215061 Oct 17 13:19:17.150921 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 430/928] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:19:14 2022] DELETE /compute/v2.1/os-floating-ips/27c58809-f4d2-4ee7-b5cf-a7ba20e8785b => generated 0 bytes in 2216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:19:17.161005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:17.161642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:17.169930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:17.170434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:17.170882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:17.171647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:17.172583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:17.173203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:17.207638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:19:17.322646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-237b36ab-05ea-40cf-ac51-c8104f143866 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "DELETE /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 204 len: 0 microversion: 2.1 time: 0.165840 Oct 17 13:19:17.330513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 499/929] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:19:17 2022] DELETE /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:17.335764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:17.336386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:17.350325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:17.350821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:17.351265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:17.351990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:17.352446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:17.352881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:17.683043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:17.683889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:17.703775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:17.704613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:17.705003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:17.705858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:17.706419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:17.706943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:17.881585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:17.886669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:17.898353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-912b4e80-7b1d-4254-b799-18e9ef7087f5 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1524 microversion: 2.1 time: 0.566449 Oct 17 13:19:17.901478 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce65d497-0904-4ee3-a9f1-59405c14180a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1292 microversion: 2.1 time: 0.221719 Oct 17 13:19:17.902471 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 500/930] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:17 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1292 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:17.902730 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 431/931] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:17 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1524 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:18.935364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:18.936402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:18.937079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:18.937770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:18.949269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:18.953995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.958184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.958693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.959141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.959872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.960338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.960776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.969445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.969967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:18.970727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:18.971229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:18.971707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:19.114511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:19.129784 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3bcf29ce-881d-4712-81ef-3e0172954c65 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1292 microversion: 2.1 time: 0.196817 Oct 17 13:19:19.130369 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 501/932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:18 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1292 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:19.282993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:19.293066 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9c25831-7f31-4359-95b7-77391c96a762 tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1524 microversion: 2.1 time: 0.361346 Oct 17 13:19:19.293771 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 432/933] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:18 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1524 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:19.415044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-104421026", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9a19b51c-2953-45aa-a92f-3288dd465df1"}], "security_groups": [{"name": "tempest-securitygroup--1032558281"}], "key_name": "tempest-keypair-612647919", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "83e1da78-c3c8-4284-b937-7332324f3f2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:19.745716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] validate_networks() for [('9a19b51c-2953-45aa-a92f-3288dd465df1', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:20.162014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.162820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:20.172586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.173533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.174187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.175135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.175802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.176438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.216245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:20.908073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:20.917649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb06e08d-d8a1-4f5e-9f72-bde8dfba092a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1360 microversion: 2.1 time: 0.760695 Oct 17 13:19:20.921646 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 433/934] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1360 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:20.934642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:20.935588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:20.949332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.950856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.951327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.960756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:20.963038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:20.964172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:20.993658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Getting quotas for project dca83ede7465446dad54fe79943fa68f. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:21.001461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:21.010555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Getting quotas for user 642e0a16be6b4a6d876b7187720f544a and project dca83ede7465446dad54fe79943fa68f. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:21.062415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:21.062879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:21.063701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:21.064287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:21.064859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:21.068146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.069532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.070560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.071273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lazy-loading 'fault' on Instance uuid 908e20d4-8f51-484e-bc34-8a94d1f380e8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:21.079021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.079513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.079954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.080686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.083451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.083931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.130655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Getting quotas for project dca83ede7465446dad54fe79943fa68f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:21.146563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Getting quotas for user 642e0a16be6b4a6d876b7187720f544a and project dca83ede7465446dad54fe79943fa68f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:21.153899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d37b800dbaf44f58c048fb2fef592f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7e85eeff8fe4f27964f2063624827b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:21.165198 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3c7eeeb-48ac-4c12-a3d5-d19b3c4344fd tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 200 len: 1314 microversion: 2.1 time: 0.240991 Oct 17 13:19:21.182492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 434/935] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:20 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:21.191713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1090a9bf-c4c0-427e-9395-f7117d1741af req-6a1dd2a6-cd49-4391-b502-f89a26151dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908e20d4-8f51-484e-bc34-8a94d1f380e8", "name": "network-vif-deleted", "tag": "b9fbf69a-dc59-48ce-a787-41040b034497"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:21.217556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1090a9bf-c4c0-427e-9395-f7117d1741af req-6a1dd2a6-cd49-4391-b502-f89a26151dd8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.223191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1090a9bf-c4c0-427e-9395-f7117d1741af req-6a1dd2a6-cd49-4391-b502-f89a26151dd8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.223774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1090a9bf-c4c0-427e-9395-f7117d1741af req-6a1dd2a6-cd49-4391-b502-f89a26151dd8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.254198 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1090a9bf-c4c0-427e-9395-f7117d1741af req-6a1dd2a6-cd49-4391-b502-f89a26151dd8 service nova] Creating event network-vif-deleted:b9fbf69a-dc59-48ce-a787-41040b034497 for instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 on n-h1-854121-14 Oct 17 13:19:21.267225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1090a9bf-c4c0-427e-9395-f7117d1741af req-6a1dd2a6-cd49-4391-b502-f89a26151dd8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080731 Oct 17 13:19:21.270087 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 435/936] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:21.272307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:21.274791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83e1da78-c3c8-4284-b937-7332324f3f2d',volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:21.528643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-667673419", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "86f87344-a5a0-44c6-9bd6-49c37a87ed65"}], "security_groups": [{"name": "tempest-securitygroup--953599494"}], "key_name": "tempest-keypair-1638427564", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:21.530052 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc21cae8-9bd4-4a29-8bce-853464910e45 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.119541 Oct 17 13:19:21.531992 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 502/937] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:19 2022] POST /compute/v2.1/servers => generated 407 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:19:21.543039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8feb3249-27dc-4d64-9209-0cddd8ad1189 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:21.544982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8feb3249-27dc-4d64-9209-0cddd8ad1189 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:21.648807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8feb3249-27dc-4d64-9209-0cddd8ad1189 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:21.659511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8feb3249-27dc-4d64-9209-0cddd8ad1189 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1120 microversion: 2.1 time: 0.120481 Oct 17 13:19:21.660324 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 503/938] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:21 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1120 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:21.783834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] validate_networks() for [('86f87344-a5a0-44c6-9bd6-49c37a87ed65', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:21.946988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:21.948157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:21.960300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.961463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.962555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:21.963837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:21.964842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:21.965770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.482599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:22.496915 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7f7dd89-f3e1-410d-9953-417b248f6014 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1360 microversion: 2.1 time: 0.557175 Oct 17 13:19:22.505802 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 504/939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:21 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1360 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:22.529374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:22.530945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] [instance: 908e20d4-8f51-484e-bc34-8a94d1f380e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:22.553734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.555350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.557852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.560051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.561477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.563078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.619845 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] HTTP exception thrown: Instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 could not be found. Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Request method failure captured: Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 HTTP/1.1 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVYBkxU6iowKbuYbyhuS6bOuUZudsu7IeOE_MlaUxwI-XOLredjVG0KYcKyzzljqyPDsAOKCutksKPZP_nSLW7Kar8nLkKL9KyWovgM9ri62l6MRJNFqmzJEa3Wap_OCGhWDg7gBiSNM-Bz5OFod1rtWGtPJjH8W3nqRC4w6OzCNQ30 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:19:22.622035 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e7e85eeff8fe4f27964f2063624827b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: e7e85eeff8fe4f27964f2063624827b6 Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-393557565 Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6d37b800dbaf44f58c048fb2fef592f8 Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-393557565-project Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 could not be found. Oct 17 13:19:22.624008 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '908e20d4-8f51-484e-bc34-8a94d1f380e8'} Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 could not be found. Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:22.625600 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 could not be found. Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 could not be found. Oct 17 13:19:22.627163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:22.629619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] Returning 404 to user: Instance 908e20d4-8f51-484e-bc34-8a94d1f380e8 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:22.634489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef0c718f-072f-44eb-905e-8b858d8f84ad tempest-FloatingIPsAssociationTestJSON-393557565 tempest-FloatingIPsAssociationTestJSON-393557565-project] 10.222.0.65 "GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8" status: 404 len: 111 microversion: 2.1 time: 0.115077 Oct 17 13:19:22.635239 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 505/940] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:22 2022] GET /compute/v2.1/servers/908e20d4-8f51-484e-bc34-8a94d1f380e8 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:19:22.689205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:22.690238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:22.706236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.709431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.711214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.718188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:22.720142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:22.720910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:22.903719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:22.914421 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74bc361b-0605-404c-8715-925fe879cd07 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1162 microversion: 2.1 time: 0.230814 Oct 17 13:19:22.915906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 506/941] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:22 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1162 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:23.061594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Calling method '.version_select at 0x7f419e1709d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.063746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.064447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.065091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.079760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.080539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.081236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.095665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.097042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.097782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.105919 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5a8a3b6-897c-4c46-ac90-9c6f2f9d602d tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.188639 Oct 17 13:19:23.107144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 507/942] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:19:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:23.119270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Calling method '.version_select at 0x7f419ddf1280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.121046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.121559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.121995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.136776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.137319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.137750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.142428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:23.143044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:23.143824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:23.144493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:23.145221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:23.150047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:23.158895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.159572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.160984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.162182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.162727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:23.163162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.163671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.188211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:23.192027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.192676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.193129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.195923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for user d9b63e4efecd4b9a96fc3b2e51f625fb and project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:23.201989 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-226fd16d-f07d-4f18-a421-10d136b98f47 tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/n-h1-854121-14/servers" status: 200 len: 355 microversion: 2.1 time: 0.086288 Oct 17 13:19:23.203468 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 508/943] 10.222.0.65 () {58 vars in 1215 bytes} [Mon Oct 17 13:19:23 2022] GET /compute/v2.1/os-hypervisors/n-h1-854121-14/servers => generated 355 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:19:23.214148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:23.216126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Calling method '.version_select at 0x7f419e0bf1f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.217644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:23.218484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.219260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.219781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.236490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.236988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.237480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.250511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.251143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.251594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.258876 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c3fc79e-13ca-483a-99f2-0e84a23271df tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.046717 Oct 17 13:19:23.259489 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 509/944] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:19:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:19:23.271080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Calling method '.version_select at 0x7f419ddf1700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.272914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.273433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.273869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.287367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.287861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.288295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.289579 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c70e60a-2bf9-4f90-8e20-20ba03892b9a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.765369 Oct 17 13:19:23.290967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 436/945] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:19:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 13:19:23.295195 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8df7581a-77ff-4386-b373-e3f15bffd9fa tempest-HypervisorAdminUnderV252Test-1129684032 tempest-HypervisorAdminUnderV252Test-1129684032-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors/n-h1-854121-14/search" status: 200 len: 105 microversion: 2.1 time: 0.028546 Oct 17 13:19:23.297121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8e8d1a58-453f-4192-a520-62231f35ae0f req-31033182-22a0-4a9a-84fe-80127a76eec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ff27cf-dee5-48e5-938c-f98c803813be", "tag": "96bcfefd-87dc-40b2-a430-c8b8458e604e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:23.303708 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 510/946] 10.222.0.65 () {58 vars in 1212 bytes} [Mon Oct 17 13:19:23 2022] GET /compute/v2.1/os-hypervisors/n-h1-854121-14/search => generated 105 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:19:23.309871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b672a61-e78e-490b-b2b4-c63511035a73 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.310578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b672a61-e78e-490b-b2b4-c63511035a73 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:23.331720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e8d1a58-453f-4192-a520-62231f35ae0f req-31033182-22a0-4a9a-84fe-80127a76eec1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.332212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e8d1a58-453f-4192-a520-62231f35ae0f req-31033182-22a0-4a9a-84fe-80127a76eec1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.336348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e8d1a58-453f-4192-a520-62231f35ae0f req-31033182-22a0-4a9a-84fe-80127a76eec1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.362186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8e8d1a58-453f-4192-a520-62231f35ae0f req-31033182-22a0-4a9a-84fe-80127a76eec1 service nova] Creating event network-changed:96bcfefd-87dc-40b2-a430-c8b8458e604e for instance 45ff27cf-dee5-48e5-938c-f98c803813be on n-h1-854121-14 Oct 17 13:19:23.369432 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8e8d1a58-453f-4192-a520-62231f35ae0f req-31033182-22a0-4a9a-84fe-80127a76eec1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076767 Oct 17 13:19:23.376703 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 437/947] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:23.533848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:23.534891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:23.548043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.550098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.553814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:23.555089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:23.555681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:23.556354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.023755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b672a61-e78e-490b-b2b4-c63511035a73 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:24.039678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b672a61-e78e-490b-b2b4-c63511035a73 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:24.047078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b672a61-e78e-490b-b2b4-c63511035a73 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:24.048357 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b672a61-e78e-490b-b2b4-c63511035a73 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1285 microversion: 2.25 time: 0.743059 Oct 17 13:19:24.049073 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 511/948] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:23 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1285 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:24.058573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:24.060466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:24.075023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.075832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.076466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.077393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:24.078452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:24.079085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:24.342892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:24.354594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:24.371720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9abe3d83-b289-446a-af25-d53517fa43f7 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1236 microversion: 2.1 time: 0.321316 Oct 17 13:19:24.375308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e705ad7-c5ba-4dac-93cb-cefc30c6ebf6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1360 microversion: 2.1 time: 0.847495 Oct 17 13:19:24.376483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 438/949] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:23 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1360 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:24.377210 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 512/950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:24 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1236 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:25.074203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:25.074827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:25.088904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.089503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.089927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.090654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.091114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.091538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.402580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:25.404079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:25.424158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.429203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.429677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.430431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.438501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.439432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.553356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:25.569447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:25.571000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:25.572171 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6990cf0f-dcf8-4997-add8-03fa041ebffb tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1345 microversion: 2.25 time: 0.501924 Oct 17 13:19:25.588258 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 439/951] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:25 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1345 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:25.588258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:25.588258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:25.602086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.602591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.603030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.603756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:25.604209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:25.609852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:25.725486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:25.739767 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-daa9ebd6-21cf-46d4-9fa1-ca3688d41c04 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1236 microversion: 2.1 time: 0.342765 Oct 17 13:19:25.745557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 513/952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:25 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1236 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:26.375337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:26.383281 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6364d81-8b44-4b53-8d86-df8683837c3e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1360 microversion: 2.1 time: 0.803510 Oct 17 13:19:26.383881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 440/953] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:25 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1360 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:26.599669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:26.600357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:26.617506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.617925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.635508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.635508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.635508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.635508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.775349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:26.777124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:26.794530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.799543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.803545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:26.804764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:26.805493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:26.809619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.022026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:27.037530 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-449e3f5d-f855-4f80-9e13-3522dab65dd1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1236 microversion: 2.1 time: 0.274542 Oct 17 13:19:27.038279 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 441/954] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:26 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1236 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:27.071775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-aa28fa5e-7bad-49c2-8f3a-37e0c6b3f1a6 req-e4d2908e-17b4-428e-9d50-b1e81cbfd737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ff27cf-dee5-48e5-938c-f98c803813be", "name": "network-vif-plugged", "status": "completed", "tag": "96bcfefd-87dc-40b2-a430-c8b8458e604e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:27.099144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aa28fa5e-7bad-49c2-8f3a-37e0c6b3f1a6 req-e4d2908e-17b4-428e-9d50-b1e81cbfd737 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.099911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aa28fa5e-7bad-49c2-8f3a-37e0c6b3f1a6 req-e4d2908e-17b4-428e-9d50-b1e81cbfd737 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.100587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aa28fa5e-7bad-49c2-8f3a-37e0c6b3f1a6 req-e4d2908e-17b4-428e-9d50-b1e81cbfd737 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.119047 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-aa28fa5e-7bad-49c2-8f3a-37e0c6b3f1a6 req-e4d2908e-17b4-428e-9d50-b1e81cbfd737 service nova] Creating event network-vif-plugged:96bcfefd-87dc-40b2-a430-c8b8458e604e for instance 45ff27cf-dee5-48e5-938c-f98c803813be on n-h1-854121-14 Oct 17 13:19:27.119255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:27.138002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-aa28fa5e-7bad-49c2-8f3a-37e0c6b3f1a6 req-e4d2908e-17b4-428e-9d50-b1e81cbfd737 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098211 Oct 17 13:19:27.142024 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 442/955] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:27.149371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:27.164610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:27.174339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8109f3c-96c3-43d1-abf3-a6d5a6a11fd6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1410 microversion: 2.25 time: 0.578679 Oct 17 13:19:27.201903 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 514/956] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:26 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1410 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:27.420096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:27.423779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:27.435624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.438651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.439340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.446746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.448699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.449335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.871704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-03f3fe2a-0d00-4ce3-ad08-fc8d6c4e9372 req-211c292f-ef05-4b6b-888f-8584f029cac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d428abc-b9a2-4d64-8f09-26a50e66508b", "tag": "02dbf2c9-b939-4f06-afc1-f39e8fd74372"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:27.897563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-03f3fe2a-0d00-4ce3-ad08-fc8d6c4e9372 req-211c292f-ef05-4b6b-888f-8584f029cac8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:27.898055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-03f3fe2a-0d00-4ce3-ad08-fc8d6c4e9372 req-211c292f-ef05-4b6b-888f-8584f029cac8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:27.904703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-03f3fe2a-0d00-4ce3-ad08-fc8d6c4e9372 req-211c292f-ef05-4b6b-888f-8584f029cac8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:27.934927 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-03f3fe2a-0d00-4ce3-ad08-fc8d6c4e9372 req-211c292f-ef05-4b6b-888f-8584f029cac8 service nova] Creating event network-changed:02dbf2c9-b939-4f06-afc1-f39e8fd74372 for instance 5d428abc-b9a2-4d64-8f09-26a50e66508b on n-h1-854121-14 Oct 17 13:19:27.943555 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-03f3fe2a-0d00-4ce3-ad08-fc8d6c4e9372 req-211c292f-ef05-4b6b-888f-8584f029cac8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075683 Oct 17 13:19:27.945778 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 515/957] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:28.070865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:28.071561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:28.087136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.089483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.090396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.091818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.095024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.096410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.640564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:28.651845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6254bc53-882d-480a-8d9a-96ae4ee268b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1360 microversion: 2.1 time: 1.244459 Oct 17 13:19:28.653123 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 443/958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:27 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1360 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:28.664804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:28.669119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:28.681150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.681681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.682130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:28.683292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:28.684344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:28.684786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.036574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:29.048338 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f8c85b8-a05d-4775-b43e-7999e2a9ddea tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1304 microversion: 2.1 time: 0.991818 Oct 17 13:19:29.050518 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 516/959] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:28 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1304 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:29.303699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:29.320354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:29.324276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:29.328039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-24da71a3-58f8-45e8-b773-5319a164639c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1410 microversion: 2.25 time: 0.671087 Oct 17 13:19:29.328810 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 444/960] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:28 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1410 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:29.818682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1824ac54-4884-43c2-8cea-d7ec5dda9bea tempest-InstanceUsageAuditLogTestJSON-209431055 tempest-InstanceUsageAuditLogTestJSON-209431055-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:29.896282 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1824ac54-4884-43c2-8cea-d7ec5dda9bea tempest-InstanceUsageAuditLogTestJSON-209431055 tempest-InstanceUsageAuditLogTestJSON-209431055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17 13:19:29" status: 200 len: 318 microversion: 2.1 time: 0.439200 Oct 17 13:19:29.902936 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 517/961] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:19:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-17%2013%3A19%3A29 => generated 318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:29.918418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:29.919981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:29.944224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.945581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1437042551", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "c64945a6-1527-421a-8b9c-d3ac046e1a62"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:29.948798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.949675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:29.950433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:29.950906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:29.959575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.054985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] validate_networks() for [('c64945a6-1527-421a-8b9c-d3ac046e1a62', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:30.502661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:30.511762 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a700126b-a25b-407a-a031-5f77c349415a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1543 microversion: 2.1 time: 0.607609 Oct 17 13:19:30.525964 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 518/962] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:29 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1543 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:30.536511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75922d30-81b3-495d-a9df-94335b161e94 tempest-InstanceUsageAuditLogTestJSON-209431055 tempest-InstanceUsageAuditLogTestJSON-209431055-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:30.551360 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75922d30-81b3-495d-a9df-94335b161e94 tempest-InstanceUsageAuditLogTestJSON-209431055 tempest-InstanceUsageAuditLogTestJSON-209431055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.023174 Oct 17 13:19:30.552316 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 519/963] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 13:19:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:30.557286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:30.558196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:30.582035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.582900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.587607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:30.588742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:30.589470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:30.593478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.100235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:31.109287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.129717 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f1ede88-8e11-4d2b-a1eb-a935ad173042 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1304 microversion: 2.1 time: 0.567530 Oct 17 13:19:31.130646 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 520/964] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:30 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1304 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:31.145247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:31.146122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:31.160858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.161407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.161855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.162577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.163034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.163463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.687842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:31.688437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:31.688932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:31.689400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:31.690674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:31.729055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.730999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.734652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.736062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.736574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.739137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.795409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for project 97f2a1e99d30456384a574e0641513a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:31.818715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for user aba657aa5e344ba3b3a61d9096941a52 and project 97f2a1e99d30456384a574e0641513a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:31.860449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:31.863855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.867203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:31.876428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.881093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:31.884540 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59eb8b14-b396-4522-b1e7-0fb81f2cfb8b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1410 microversion: 2.25 time: 0.752612 Oct 17 13:19:31.887247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 521/965] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:31 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1410 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:31.895512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:31.896261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:31.913357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.914638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.916167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:31.919552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:31.920345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:31.921796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.016690 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e723410c-b633-47e9-aa83-8aef894767c2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.429523 Oct 17 13:19:32.029027 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 445/966] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:19:32.056403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-adf4412e-ce51-4b80-8321-05aded415ab7 req-1b9a794f-a1fd-42c0-82ec-28936b4c8ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f2435d-e49a-476d-aa52-b26661881968", "tag": "d35f956f-fdca-49b3-927e-ac42ddc23a28"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:32.081052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-adf4412e-ce51-4b80-8321-05aded415ab7 req-1b9a794f-a1fd-42c0-82ec-28936b4c8ab7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.088157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-adf4412e-ce51-4b80-8321-05aded415ab7 req-1b9a794f-a1fd-42c0-82ec-28936b4c8ab7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.089600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-adf4412e-ce51-4b80-8321-05aded415ab7 req-1b9a794f-a1fd-42c0-82ec-28936b4c8ab7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.139395 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-adf4412e-ce51-4b80-8321-05aded415ab7 req-1b9a794f-a1fd-42c0-82ec-28936b4c8ab7 service nova] Creating event network-changed:d35f956f-fdca-49b3-927e-ac42ddc23a28 for instance a5f2435d-e49a-476d-aa52-b26661881968 on n-h2-854121-14 Oct 17 13:19:32.170903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-adf4412e-ce51-4b80-8321-05aded415ab7 req-1b9a794f-a1fd-42c0-82ec-28936b4c8ab7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140270 Oct 17 13:19:32.177429 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 446/967] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:32.194517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9f78078-efdc-456b-a7df-d404373d3daf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:32.202659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9f78078-efdc-456b-a7df-d404373d3daf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:32.289783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89eb2cba-c6c3-4f1b-934e-8841fe6ec1af tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.401155 Oct 17 13:19:32.290718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 522/968] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:19:31 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-interface => generated 285 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:32.303688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:32.304316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:32.318045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.319149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.321548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.324690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.326194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.327708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.537581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9f78078-efdc-456b-a7df-d404373d3daf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:32.557581 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9f78078-efdc-456b-a7df-d404373d3daf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1225 microversion: 2.1 time: 0.377850 Oct 17 13:19:32.559015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 447/969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:32 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1225 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:32.915081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:32.916548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:32.933402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.933911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.934360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:32.935091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:32.935559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:32.935999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.210140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.215114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.225229 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed4989f3-d402-4d47-a83b-97ce043bfeef tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1304 microversion: 2.1 time: 1.932925 Oct 17 13:19:34.226094 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 523/970] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:32 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1304 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:34.231433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.233931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.235356 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35e4765e-1f71-4415-b2bf-0e99972934b8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1410 microversion: 2.25 time: 1.324263 Oct 17 13:19:34.236753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 448/971] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:32 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1410 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:34.246148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8b8e7666-8c0d-41df-b732-230c27f5a274 req-42a7b511-950e-4122-8b89-3e7d0b65f315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d428abc-b9a2-4d64-8f09-26a50e66508b", "name": "network-vif-plugged", "status": "completed", "tag": "02dbf2c9-b939-4f06-afc1-f39e8fd74372"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:34.258267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:34.260059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:34.277897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8b8e7666-8c0d-41df-b732-230c27f5a274 req-42a7b511-950e-4122-8b89-3e7d0b65f315 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.279409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8b8e7666-8c0d-41df-b732-230c27f5a274 req-42a7b511-950e-4122-8b89-3e7d0b65f315 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.280942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8b8e7666-8c0d-41df-b732-230c27f5a274 req-42a7b511-950e-4122-8b89-3e7d0b65f315 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.281777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.282291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.282754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.283468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:34.283910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:34.284323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:34.320106 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8b8e7666-8c0d-41df-b732-230c27f5a274 req-42a7b511-950e-4122-8b89-3e7d0b65f315 service nova] Creating event network-vif-plugged:02dbf2c9-b939-4f06-afc1-f39e8fd74372 for instance 5d428abc-b9a2-4d64-8f09-26a50e66508b on n-h1-854121-14 Oct 17 13:19:34.334228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8b8e7666-8c0d-41df-b732-230c27f5a274 req-42a7b511-950e-4122-8b89-3e7d0b65f315 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105751 Oct 17 13:19:34.338503 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 524/972] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:34.437351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:34.450237 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1476c7e-c00b-4e37-93d3-f894a846108b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1277 microversion: 2.1 time: 0.210921 Oct 17 13:19:34.465224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 449/973] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:34 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:35.235538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5b698d6e-ab19-4929-a0d3-ce795a5fbedb req-c126e830-d718-4cee-92cb-d9d94e605ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ff27cf-dee5-48e5-938c-f98c803813be", "tag": "96bcfefd-87dc-40b2-a430-c8b8458e604e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:35.251011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5b698d6e-ab19-4929-a0d3-ce795a5fbedb req-c126e830-d718-4cee-92cb-d9d94e605ddb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.251472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:35.252186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:35.252624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5b698d6e-ab19-4929-a0d3-ce795a5fbedb req-c126e830-d718-4cee-92cb-d9d94e605ddb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.253242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5b698d6e-ab19-4929-a0d3-ce795a5fbedb req-c126e830-d718-4cee-92cb-d9d94e605ddb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.265767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.266680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5b698d6e-ab19-4929-a0d3-ce795a5fbedb req-c126e830-d718-4cee-92cb-d9d94e605ddb service nova] Creating event network-changed:96bcfefd-87dc-40b2-a430-c8b8458e604e for instance 45ff27cf-dee5-48e5-938c-f98c803813be on n-h1-854121-14 Oct 17 13:19:35.268458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.269134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.271746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.272242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.273121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.273825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5b698d6e-ab19-4929-a0d3-ce795a5fbedb req-c126e830-d718-4cee-92cb-d9d94e605ddb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046839 Oct 17 13:19:35.274836 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 525/974] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:35.283278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:35.283986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:35.291490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.292320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.293066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.294094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.294797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.295561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.624633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.642673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.649031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.680293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d46410cc-708b-4dc2-8020-cec76bc038bc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1410 microversion: 2.25 time: 0.400705 Oct 17 13:19:35.692384 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 526/975] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:35 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1410 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:35.707990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:35.716135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:35.735344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.735856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.736300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.737030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:35.737510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:35.742806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:35.804161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.816770 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07f3a89f-c4ce-4bd7-a7fd-6a2256f91e5e tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.570415 Oct 17 13:19:35.825523 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 450/976] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:35 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:35.898131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:35.909832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f0c1b42-1055-4376-a9a1-9487a8d9052f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1277 microversion: 2.1 time: 0.212694 Oct 17 13:19:35.926794 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 527/977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:35 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:36.718601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:36.718601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:36.725296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.726220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.726880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.727814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.728489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.729222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.840740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:36.843830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:36.859176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.860000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.860667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:36.861661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:36.862334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:36.863145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.071107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.088347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.095158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.096389 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fbcd2b4-35a3-4b79-8491-78ec95c8de8d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1607 microversion: 2.25 time: 0.384746 Oct 17 13:19:37.103797 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 451/978] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:36 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1607 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:37.109089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:37.113038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:37.126763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.130148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.134235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.139874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ceec14f-9bc1-4272-b133-031fc396abf6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.302749 Oct 17 13:19:37.141016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.142287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.142972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.144607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.149510 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 528/979] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:36 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:37.155173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:37.171868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:37.190234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.193032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.194869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.196935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.197668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.198344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.259503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:37.271329 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e1488a6-cc6a-4b9e-a53c-9b8f12f834ac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1283 microversion: 2.1 time: 0.166296 Oct 17 13:19:37.272172 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 452/980] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:37 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1283 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:37.372244 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da93dac7-3c77-4d3f-8efe-dcbb9a55f440 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.221141 Oct 17 13:19:37.374628 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 529/981] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:19:37 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-interface => generated 285 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:37.527331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7b0d7b0-61f4-4607-acef-5cf864231810 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '.version_select at 0x7f419df4eb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:37.630436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7b0d7b0-61f4-4607-acef-5cf864231810 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3" status: 200 len: 371 microversion: 2.1 time: 0.287414 Oct 17 13:19:37.631042 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 453/982] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:19:37 2022] GET /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3 => generated 371 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:37.644057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Action: 'update', calling method: .version_select at 0x7f419e170430>, body: {"quota_set": {"ram": "5120"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:37.733733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=35 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:37.736618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.737113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.737777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.738534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:37.738981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:37.739605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:37.813212 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e289222-b743-4781-b96a-c28f169327cb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3" status: 200 len: 328 microversion: 2.1 time: 0.173453 Oct 17 13:19:37.813870 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 530/983] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:19:37 2022] PUT /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3 => generated 328 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:37.831108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6b7a2bb-2a54-4156-88c0-d329fd328223 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:37.851881 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6b7a2bb-2a54-4156-88c0-d329fd328223 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3" status: 202 len: 0 microversion: 2.1 time: 0.026522 Oct 17 13:19:37.852919 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 454/984] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:19:37 2022] DELETE /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:19:37.861776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ab4b087-cf11-40a5-a0db-8a2cd2f59203 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '.version_select at 0x7f419de268b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:38.004666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ab4b087-cf11-40a5-a0db-8a2cd2f59203 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3" status: 200 len: 371 microversion: 2.1 time: 0.147217 Oct 17 13:19:38.012413 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 531/985] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:19:37 2022] GET /compute/v2.1/os-quota-sets/974e28ff5c854644bb4740e65ca3a1e3 => generated 371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:38.172512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:38.174729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:38.189393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b28aa66c-662c-4b7f-8b31-9241fb1178fb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '.version_select at 0x7f419ddcd9d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:38.190141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.190929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.191582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.192706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.193452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.194137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.482526 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b28aa66c-662c-4b7f-8b31-9241fb1178fb tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.297684 Oct 17 13:19:38.484421 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 532/986] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:19:38 2022] GET /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c/defaults => generated 371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:38.489909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:38.491011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:38.494808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:38.503963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.505012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.505715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:38.506801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:38.507486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:38.508606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.034366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:39.038185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:39.042945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:39.045511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f5aba72-db71-49b9-91d1-f66facfa5295 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.559611 Oct 17 13:19:39.047433 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 533/987] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:38 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:39.057578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Action: 'update', calling method: .version_select at 0x7f419de97a60>, body: {"quota_set": {"ram": "5120"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:39.066914 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b15fd3eb-531f-4732-90e1-34fb3545b859 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.900460 Oct 17 13:19:39.068167 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 455/988] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:38 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:39.151482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:39.152386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:39.158899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.159671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.160302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.161278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.161945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.162605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.276544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.277059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.277711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.278653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.279278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.279941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.392624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9e83181-3e4b-435c-8952-d55f88c78e0c tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685" status: 200 len: 328 microversion: 2.1 time: 0.341876 Oct 17 13:19:39.394647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 534/989] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:19:39 2022] PUT /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685 => generated 328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:39.410187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '.version_select at 0x7f419ddfeee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:39.431806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:39.451154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:39.455866 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b90ab4d-2d77-476b-ac86-773f69b4841f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.308224 Oct 17 13:19:39.463382 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 456/990] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:39 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:39.484834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:39.486328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:39.497367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.497916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.498285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.499171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.499988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.500402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.510587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.512004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.512652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.513691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.514931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.515634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.541645 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f76d6761-69d9-4d53-b8af-586b30d390cc tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685/detail" status: 200 len: 916 microversion: 2.1 time: 0.137091 Oct 17 13:19:39.542948 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 535/991] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:19:39 2022] GET /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685/detail => generated 916 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:39.797929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c47313f8-d3cf-4abe-8554-bc16993734b1 req-d6497a40-7688-4a81-b6c7-98a5d3948ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d428abc-b9a2-4d64-8f09-26a50e66508b", "tag": "02dbf2c9-b939-4f06-afc1-f39e8fd74372"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:39.817220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c47313f8-d3cf-4abe-8554-bc16993734b1 req-d6497a40-7688-4a81-b6c7-98a5d3948ee7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.819890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c47313f8-d3cf-4abe-8554-bc16993734b1 req-d6497a40-7688-4a81-b6c7-98a5d3948ee7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.821085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c47313f8-d3cf-4abe-8554-bc16993734b1 req-d6497a40-7688-4a81-b6c7-98a5d3948ee7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.848584 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c47313f8-d3cf-4abe-8554-bc16993734b1 req-d6497a40-7688-4a81-b6c7-98a5d3948ee7 service nova] Creating event network-changed:02dbf2c9-b939-4f06-afc1-f39e8fd74372 for instance 5d428abc-b9a2-4d64-8f09-26a50e66508b on n-h1-854121-14 Oct 17 13:19:39.849444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:39.868860 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c47313f8-d3cf-4abe-8554-bc16993734b1 req-d6497a40-7688-4a81-b6c7-98a5d3948ee7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076645 Oct 17 13:19:39.871731 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 536/992] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:39.879120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Action: 'update', calling method: .version_select at 0x7f419de26820>, body: {"quota_set": {"ram": "2048"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:39.888388 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ea480f7-b8ac-428e-a997-29c967bada2f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.410724 Oct 17 13:19:39.893347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 457/993] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:39 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:39.918485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:39.919371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:39.927524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.930045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.930803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:39.942804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:39.945371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:39.946683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.030726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.034081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.036345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.053567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.056910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.058797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.119425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.120701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.121524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.122376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.122902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.123397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.232483 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6bc1cbd-0408-4521-a1f9-12353742b2b6 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685?user_id=f5b936cade4949d38b03b853979204aa" status: 200 len: 328 microversion: 2.1 time: 0.358783 Oct 17 13:19:40.235547 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 537/994] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:19:39 2022] PUT /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685?user_id=f5b936cade4949d38b03b853979204aa => generated 328 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:40.246319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:40.247578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:40.259601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.260664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.261393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.263558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.265432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.266099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.685648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:40.698865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec88dfe4-4bb0-4c65-8095-69b6ac1a845c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.785531 Oct 17 13:19:40.699726 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 458/995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:39 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:40.717256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:40.720235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:40.726889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.727634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.728562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.729556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.730237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.730885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.741952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:40.750593 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a8ae1b9-6b26-433d-95a0-63ad13621fc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.513433 Oct 17 13:19:40.751195 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 538/996] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:40 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:40.769924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66745212-fcfc-4403-8706-5c4138653cad tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '.version_select at 0x7f419de051f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:40.943510 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66745212-fcfc-4403-8706-5c4138653cad tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685?user_id=f5b936cade4949d38b03b853979204aa" status: 200 len: 370 microversion: 2.1 time: 0.191194 Oct 17 13:19:40.958076 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 539/997] 10.222.0.65 () {58 vars in 1323 bytes} [Mon Oct 17 13:19:40 2022] GET /compute/v2.1/os-quota-sets/d6417be3017540dbb70036bc1f053685?user_id=f5b936cade4949d38b03b853979204aa => generated 370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:40.965361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-138791734"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:40.970347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:40.988038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.989993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.990943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:40.992006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:40.992767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:40.993392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.097999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:41.115191 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb55fb60-2802-4b67-a3e0-8f9019d48dc8 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.407686 Oct 17 13:19:41.115789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 459/998] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:40 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:41.297848 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc99064b-df08-47cf-b783-470e7623be7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.336854 Oct 17 13:19:41.299237 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 540/999] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:40 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:19:41.413091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54e54808-a949-4963-823a-2219716714ab tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Calling method '.version_select at 0x7f419e121b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:41.768052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:41.777727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:41.779193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:41.793760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.794513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.795135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.796065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.796672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.797940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.846422 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54e54808-a949-4963-823a-2219716714ab tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.437578 Oct 17 13:19:41.847019 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 460/1000] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:19:41 2022] GET /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c/defaults => generated 371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:41.866386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Action: 'update', calling method: .version_select at 0x7f419df4e820>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:41.960278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.960765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.961408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:41.962296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:41.963180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:41.963809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.075590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:42.089921 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fc72789-abd5-46fd-bec7-ea9e2b2ea9e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.317761 Oct 17 13:19:42.091292 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 541/1001] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:41 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:42.092292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=12,nova_api:DELETE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:42.103147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-94144793-351a-4f64-a4b4-db62567ba9b1 req-26c9eac6-f0d3-4c79-9160-7aa18ff3bc87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e91c51f1-75cd-46a1-bf5d-a084e2948c41", "tag": "d93a3b8c-ae8d-4803-a267-5d0a008043e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:42.117996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-94144793-351a-4f64-a4b4-db62567ba9b1 req-26c9eac6-f0d3-4c79-9160-7aa18ff3bc87 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.118762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-94144793-351a-4f64-a4b4-db62567ba9b1 req-26c9eac6-f0d3-4c79-9160-7aa18ff3bc87 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.119377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-94144793-351a-4f64-a4b4-db62567ba9b1 req-26c9eac6-f0d3-4c79-9160-7aa18ff3bc87 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.137425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-94144793-351a-4f64-a4b4-db62567ba9b1 req-26c9eac6-f0d3-4c79-9160-7aa18ff3bc87 service nova] Creating event network-changed:d93a3b8c-ae8d-4803-a267-5d0a008043e0 for instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 on n-h2-854121-14 Oct 17 13:19:42.145497 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-94144793-351a-4f64-a4b4-db62567ba9b1 req-26c9eac6-f0d3-4c79-9160-7aa18ff3bc87 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051345 Oct 17 13:19:42.151025 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 542/1002] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:42.157902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:42.159112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:42.166494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.167307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.167933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.169468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.170121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.171360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.238330 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-650af599-f830-4e0c-bbc7-b823a59be77e tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c" status: 200 len: 329 microversion: 2.1 time: 0.382882 Oct 17 13:19:42.239304 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 461/1003] 10.222.0.65 () {60 vars in 1263 bytes} [Mon Oct 17 13:19:41 2022] PUT /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c => generated 329 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:42.253438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Action: 'update', calling method: .version_select at 0x7f419e15c8b0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:42.336957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.337581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.337912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.338675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:42.339301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:42.339722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:42.398889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:42.414438 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e080b24d-07de-445d-81de-182285eeb97b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.261613 Oct 17 13:19:42.415974 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 543/1004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:42 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:42.716331 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c6b0c87-d904-45c9-8ae9-9a5833c15620 tempest-QuotasAdminTestJSON-975523055 tempest-QuotasAdminTestJSON-975523055-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c" status: 200 len: 329 microversion: 2.1 time: 0.468486 Oct 17 13:19:42.717356 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 462/1005] 10.222.0.65 () {60 vars in 1263 bytes} [Mon Oct 17 13:19:42 2022] PUT /compute/v2.1/os-quota-sets/894ac18df82845fda135e6af4a5c954c => generated 329 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:43.118783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:43.119586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:43.128763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.129289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.129735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.130446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.136962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.137460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.410069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:43.419152 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85af0322-c14f-4a75-85cf-5cf0ac20363d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.307100 Oct 17 13:19:43.419738 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 544/1006] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:43 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:43.437854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:43.438317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:43.444716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.445238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.445882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.446748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:43.447367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:43.447976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:43.729029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:43.743477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf7d4e9e-0816-4990-a152-6a25b7c02a32 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.310270 Oct 17 13:19:43.748224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 463/1007] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:43 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:44.336126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4f33005-e9a6-458a-a5d2-e4d06701ca5d tempest-FloatingIPDetailsNegativeTestJSON-53122572 tempest-FloatingIPDetailsNegativeTestJSON-53122572-project] Calling method '.version_select at 0x7f419ddc8550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:44.445880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:44.447409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:44.456810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.457782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.458620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.459748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.460446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.461056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.685084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-c4f33005-e9a6-458a-a5d2-e4d06701ca5d tempest-FloatingIPDetailsNegativeTestJSON-53122572 tempest-FloatingIPDetailsNegativeTestJSON-53122572-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 could not be found", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:19:44.685920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c4f33005-e9a6-458a-a5d2-e4d06701ca5d tempest-FloatingIPDetailsNegativeTestJSON-53122572 tempest-FloatingIPDetailsNegativeTestJSON-53122572-project] HTTP exception thrown: Floating IP not found for ID 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4f33005-e9a6-458a-a5d2-e4d06701ca5d tempest-FloatingIPDetailsNegativeTestJSON-53122572 tempest-FloatingIPDetailsNegativeTestJSON-53122572-project] Request method failure captured: Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-floating-ips/0ef7eff4-1dd2-4206-96e3-f16c51dbd879 HTTP/1.1 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZviqZPHUx832am2mnoNfsNNOnYqFwrNizq-4Uo-Yhi8QclcAnNdmUSNlato126SSvDqSrHm7WgwqUEIPMk8jfTp6FeDTfcVYYKWG3ViwUA22fNCio9ZOZuJ78rPcAR8jnA9EzYI-Wn4nlHO4Yu1iH2FzIRGAi5KLhyk6ZM2LPZ8vQ Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 45262a737e3d4017bbbdeca6d0c18aa1 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-53122572 Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:19:44.688103 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/45262a737e3d4017bbbdeca6d0c18aa1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/45262a737e3d4017bbbdeca6d0c18aa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/45262a737e3d4017bbbdeca6d0c18aa1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_45262a737e3d4017bbbdeca6d0c18aa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-53122572 Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 45262a737e3d4017bbbdeca6d0c18aa1 Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-53122572 Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-53122572-project Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6bf90eaf58014983b5d7d39400af1d6b Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-53122572-project Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: exception: Floating IP not found for ID 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 Oct 17 13:19:44.689726 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0ef7eff4-1dd2-4206-96e3-f16c51dbd879'} Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:19:44.690635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 could not be found Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f30495e2-5e01-4b31-93a6-0a9e0a26b967'] Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 0ef7eff4-1dd2-4206-96e3-f16c51dbd879. Oct 17 13:19:44.691891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:44.693779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:44.695587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:44.695587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 Oct 17 13:19:44.695587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:44.695587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4f33005-e9a6-458a-a5d2-e4d06701ca5d tempest-FloatingIPDetailsNegativeTestJSON-53122572 tempest-FloatingIPDetailsNegativeTestJSON-53122572-project] Returning 404 to user: Floating IP not found for ID 0ef7eff4-1dd2-4206-96e3-f16c51dbd879 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:44.695587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4f33005-e9a6-458a-a5d2-e4d06701ca5d tempest-FloatingIPDetailsNegativeTestJSON-53122572 tempest-FloatingIPDetailsNegativeTestJSON-53122572-project] 10.222.0.65 "GET /compute/v2.1/os-floating-ips/0ef7eff4-1dd2-4206-96e3-f16c51dbd879" status: 404 len: 111 microversion: 2.1 time: 0.648358 Oct 17 13:19:44.695587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 545/1008] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:19:44 2022] GET /compute/v2.1/os-floating-ips/0ef7eff4-1dd2-4206-96e3-f16c51dbd879 => generated 111 bytes in 650 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:19:44.774956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:44.775765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:44.784836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.785806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.786515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.787588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:44.788280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:44.788927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:44.803221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:44.813774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e88fb7f-7bc9-4cc3-ab74-317f37b799be tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.371729 Oct 17 13:19:44.825945 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 464/1009] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:44 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:44.955960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:44.964015 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af6d3ba2-ac76-43c3-8857-7b8fbcb262d9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.192811 Oct 17 13:19:44.964581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 546/1010] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:44 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:45.838132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:45.838920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:45.851096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.852215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.852741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.853553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:45.854079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:45.854710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:45.989281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:45.989891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:46.032023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.032956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.034365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.037832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.039540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.040049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.153685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:46.174702 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1424bd8d-c19e-4945-b2d6-8f01ac851716 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.341111 Oct 17 13:19:46.175166 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 465/1011] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:45 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:46.292621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:46.304271 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ec7c9c1-4932-44fd-8639-e5983c319006 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.319408 Oct 17 13:19:46.318110 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 547/1012] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:45 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:46.694495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Action: 'update', calling method: .version_select at 0x7f419e6388b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:46.771235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.772736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.773418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.774371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.775053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.775574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.800439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:INSERT=22,nova_api:SELECT=64,nova_api:UPDATE=14 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:46.856449 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-56bea7f0-da43-45fa-910d-4e3960e8f008 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9" status: 200 len: 148 microversion: 2.57 time: 0.296754 Oct 17 13:19:46.861441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 466/1013] 10.222.0.65 () {62 vars in 1303 bytes} [Mon Oct 17 13:19:46 2022] PUT /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9 => generated 148 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:46.869221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Calling method '.version_select at 0x7f419e5bf0d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:46.943380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.943875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.944367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.945131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:46.945621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:46.946061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:46.966961 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4afe8821-87b4-4277-9d4f-e625e5828f9f tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9/detail" status: 200 len: 463 microversion: 2.57 time: 0.101341 Oct 17 13:19:46.967944 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 548/1014] 10.222.0.65 () {60 vars in 1304 bytes} [Mon Oct 17 13:19:46 2022] GET /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9/detail => generated 463 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:47.147725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Action: 'update', calling method: .version_select at 0x7f419e756dc0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:47.198298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:47.199506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:47.207867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.208616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.209240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.210486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.211093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.211684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.236251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.237583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.238197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.239131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.239696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.240596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.284386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.284979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.285601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.289582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.290242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.291175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.359120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:47.401060 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bef5c462-bae8-46a0-84c2-79b36749c578 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9?user_id=a28a09ac51a5473b9fef9b16c326678e" status: 200 len: 148 microversion: 2.57 time: 0.257104 Oct 17 13:19:47.401755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 467/1015] 10.222.0.65 () {62 vars in 1384 bytes} [Mon Oct 17 13:19:47 2022] PUT /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9?user_id=a28a09ac51a5473b9fef9b16c326678e => generated 148 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:47.412873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:47.413543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:47.428519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.432166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.433049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.434700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:47.435088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:47.435772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:47.437361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:47.445754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54c72a9f-d891-40d8-b9c7-2a45c87e9391 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.251155 Oct 17 13:19:47.446390 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 549/1016] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:47 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:47.462472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4327649a-0289-4533-88e7-b93d9f883350 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] Calling method '.version_select at 0x7f419dd6cc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:47.619429 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4327649a-0289-4533-88e7-b93d9f883350 tempest-QuotasAdminTestV257-759754291 tempest-QuotasAdminTestV257-759754291-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9?user_id=a28a09ac51a5473b9fef9b16c326678e" status: 200 len: 190 microversion: 2.57 time: 0.171941 Oct 17 13:19:47.620337 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 550/1017] 10.222.0.65 () {60 vars in 1364 bytes} [Mon Oct 17 13:19:47 2022] GET /compute/v2.1/os-quota-sets/99f7c9771d6a435fa883370807d415d9?user_id=a28a09ac51a5473b9fef9b16c326678e => generated 190 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:47.640116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:47.649021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-97cf947a-0497-4f6e-aa7a-91bb5df261af tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.246023 Oct 17 13:19:47.666382 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 468/1018] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:47 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:48.472912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:48.473587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:48.487584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.488075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.488507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.489299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.489694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.490114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.690255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:48.690876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:48.699034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.699785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.700556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.702246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.703245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.704062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.829209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:48.841806 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c98c6da8-cf43-4752-8aa7-3fcc2e78365b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.372764 Oct 17 13:19:48.843837 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 551/1019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:48 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:48.849332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c25b107a-5739-45d7-a0ae-0267aa43a1bb req-5b498a4d-8952-425d-83db-07d09b64d2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5f2435d-e49a-476d-aa52-b26661881968", "name": "network-vif-plugged", "status": "completed", "tag": "d35f956f-fdca-49b3-927e-ac42ddc23a28"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:48.872211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c25b107a-5739-45d7-a0ae-0267aa43a1bb req-5b498a4d-8952-425d-83db-07d09b64d2f2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:48.873150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c25b107a-5739-45d7-a0ae-0267aa43a1bb req-5b498a4d-8952-425d-83db-07d09b64d2f2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:48.875151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c25b107a-5739-45d7-a0ae-0267aa43a1bb req-5b498a4d-8952-425d-83db-07d09b64d2f2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:48.896251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c25b107a-5739-45d7-a0ae-0267aa43a1bb req-5b498a4d-8952-425d-83db-07d09b64d2f2 service nova] Creating event network-vif-plugged:d35f956f-fdca-49b3-927e-ac42ddc23a28 for instance a5f2435d-e49a-476d-aa52-b26661881968 on n-h2-854121-14 Oct 17 13:19:48.904126 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c25b107a-5739-45d7-a0ae-0267aa43a1bb req-5b498a4d-8952-425d-83db-07d09b64d2f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058192 Oct 17 13:19:48.906018 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 552/1020] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:49.023811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:49.032680 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8e04a63-7499-4391-83b3-6c5eb1a8ed15 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.347865 Oct 17 13:19:49.046097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 469/1021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:48 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:49.869495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:49.870200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:49.877862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:49.877862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:49.881644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:49.883084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:49.883559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:49.883995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.044592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:50.053500 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4b4661e-2eaf-4e08-a945-75a52753dbb3 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.188916 Oct 17 13:19:50.054774 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 553/1022] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:49 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:50.058244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:50.059129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:50.075468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.076066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.077273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.078096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:50.078824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:50.079351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:50.228709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:50.239961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ac6a314-6340-455b-a278-b907244257b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.187458 Oct 17 13:19:50.240849 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 470/1023] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:50 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:51.077190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:51.077749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:51.085405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.085918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.086351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.087259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.087723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.088174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.246598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:51.263657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:51.264585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:51.266287 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a8ffaad-137c-4b0e-b5d3-33f710978cfb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.184573 Oct 17 13:19:51.279148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.279148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.279148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.279148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.279614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.279614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.282306 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 554/1024] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:51 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:51.429531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:51.439296 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a389600b-6f40-4ef3-a8f6-785ab5333eba tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1292 microversion: 2.1 time: 0.179773 Oct 17 13:19:51.453838 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 471/1025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:51 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1292 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:51.576428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-db87f7a5-32d3-4a65-acda-891d2325d64c req-811dd0c4-0779-45b6-ae7f-f4be6f6bd3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91c51f1-75cd-46a1-bf5d-a084e2948c41", "name": "network-vif-plugged", "status": "completed", "tag": "d93a3b8c-ae8d-4803-a267-5d0a008043e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:51.587697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-db87f7a5-32d3-4a65-acda-891d2325d64c req-811dd0c4-0779-45b6-ae7f-f4be6f6bd3ea service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.588668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-db87f7a5-32d3-4a65-acda-891d2325d64c req-811dd0c4-0779-45b6-ae7f-f4be6f6bd3ea service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.589389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-db87f7a5-32d3-4a65-acda-891d2325d64c req-811dd0c4-0779-45b6-ae7f-f4be6f6bd3ea service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.603237 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-db87f7a5-32d3-4a65-acda-891d2325d64c req-811dd0c4-0779-45b6-ae7f-f4be6f6bd3ea service nova] Creating event network-vif-plugged:d93a3b8c-ae8d-4803-a267-5d0a008043e0 for instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 on n-h2-854121-14 Oct 17 13:19:51.616596 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-db87f7a5-32d3-4a65-acda-891d2325d64c req-811dd0c4-0779-45b6-ae7f-f4be6f6bd3ea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045244 Oct 17 13:19:51.617919 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 555/1026] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:51.799997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1322818256", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:51.871661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:51.877888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:51.878759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:51.879318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:51.879937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:51.890378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.891245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.891980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.892953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:51.893654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:51.894304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:51.912947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Getting quotas for project 3ae8d7b55ffd4806b385a96033410164. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:51.918833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Getting quotas for user 77530dc1aed441e486925375db5d69e7 and project 3ae8d7b55ffd4806b385a96033410164. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:51.934802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:51.941537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:51.997466 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa9cfb2d-7fb7-4b80-a7d1-1d8d038874e9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.362798 Oct 17 13:19:51.998690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 472/1027] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:19:52.011155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57e06366-f2dd-4dd4-8b20-f8bb40ef65fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:52.012260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57e06366-f2dd-4dd4-8b20-f8bb40ef65fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:52.120235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57e06366-f2dd-4dd4-8b20-f8bb40ef65fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.129460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57e06366-f2dd-4dd4-8b20-f8bb40ef65fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.132813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57e06366-f2dd-4dd4-8b20-f8bb40ef65fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.142903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57e06366-f2dd-4dd4-8b20-f8bb40ef65fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1454 microversion: 2.91 time: 0.136262 Oct 17 13:19:52.143794 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 556/1028] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:52 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:52.289913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:52.291314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:52.299528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.300411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.301233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.302523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.303149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.306174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.465020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:52.465964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:52.479786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.480858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.481543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.482863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.483653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.484242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.512471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.526609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00219979-2493-456f-b0cc-922e14b045c4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.240522 Oct 17 13:19:52.527496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 473/1029] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:52 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:52.695647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:52.699280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:52.706415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ef8ad7f-d582-4a5e-ab09-9f23133aa5e6 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1482 microversion: 2.1 time: 0.246440 Oct 17 13:19:52.707353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 557/1030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:52 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1482 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:52.731980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:52.732838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:52.739291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.739812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.740347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.740948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:52.741455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:52.742192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:52.870768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e5fcdf0-0dbe-4562-8be1-453926a1cda9 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143144 Oct 17 13:19:52.874632 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 474/1031] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:19:52 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:53.173228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:53.174473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:53.188351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:53.190510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.191068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.196610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.197872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.198413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.199098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.331032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.339413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.340849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:53.349936 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc09151a-70cf-4850-9371-c6497f61b476 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1506 microversion: 2.91 time: 0.180905 Oct 17 13:19:53.371753 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 558/1032] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:53 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:53.559011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:53.559795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:53.573265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.573768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.574211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:53.574938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:53.575395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:53.575819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.179919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:54.190376 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b7a3226-c4c2-4894-8428-a841d82ed67e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1325 microversion: 2.1 time: 0.635775 Oct 17 13:19:54.191372 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 475/1033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:53 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1325 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:54.381277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:54.381889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:54.388911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.393079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.393725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.394639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.395245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.395825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.511273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:54.525595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:54.527076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:54.542235 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d30d8ed1-35d4-4a62-927b-919d190d0bbd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1512 microversion: 2.91 time: 0.164957 Oct 17 13:19:54.544015 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 559/1034] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:54 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:54.802127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0d5219a1-928d-4af8-986d-b95b0331b0c2 req-dedc28a3-3f37-47b3-a847-ee2b4a4c37a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5f2435d-e49a-476d-aa52-b26661881968", "tag": "d35f956f-fdca-49b3-927e-ac42ddc23a28"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:54.803339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:54.803974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:54.815802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0d5219a1-928d-4af8-986d-b95b0331b0c2 req-dedc28a3-3f37-47b3-a847-ee2b4a4c37a5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.816688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0d5219a1-928d-4af8-986d-b95b0331b0c2 req-dedc28a3-3f37-47b3-a847-ee2b4a4c37a5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.817586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0d5219a1-928d-4af8-986d-b95b0331b0c2 req-dedc28a3-3f37-47b3-a847-ee2b4a4c37a5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.821359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.821864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.822330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.823200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:54.823485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:54.823919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:54.836189 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0d5219a1-928d-4af8-986d-b95b0331b0c2 req-dedc28a3-3f37-47b3-a847-ee2b4a4c37a5 service nova] Creating event network-changed:d35f956f-fdca-49b3-927e-ac42ddc23a28 for instance a5f2435d-e49a-476d-aa52-b26661881968 on n-h2-854121-14 Oct 17 13:19:54.846263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0d5219a1-928d-4af8-986d-b95b0331b0c2 req-dedc28a3-3f37-47b3-a847-ee2b4a4c37a5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047130 Oct 17 13:19:54.847902 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 560/1035] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:55.066055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.082729 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a828f3c-c236-4cc9-92c8-a1d34a77d591 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1482 microversion: 2.1 time: 0.294487 Oct 17 13:19:55.085141 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 476/1036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:54 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1482 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:55.215715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:55.216797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:55.224988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.225692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.226435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.230525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.231195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.232044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.510205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:55.531836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-316229be-5006-4d9f-a16b-2e77d03333cd tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.320122 Oct 17 13:19:55.549189 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 561/1037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:55 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:55.555180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:55.556077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:55.563078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.563637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.564079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.564785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.565513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.566108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.578819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:55.579435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:55.599075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.599543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.600173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:55.601053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:55.601820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:55.602431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.089624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.107119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.112947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.122628 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-065f6da9-0ab0-47cf-9cc1-181a6461dd5d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1512 microversion: 2.91 time: 0.548196 Oct 17 13:19:56.124680 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 562/1038] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:55 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1512 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:56.195330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.208194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:56.211506 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-500ad91d-9779-4180-9c46-885df9c758ab tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.659912 Oct 17 13:19:56.212198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 477/1039] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:55 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:56.223449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a6fe82d0-502b-45f3-afdd-255f24ab0f2e req-4fca13ac-3986-4ebe-8493-44022f5908a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-plugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:56.236808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37e151c7-b56c-44df-b593-47b609a9d6c9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1930030412", "metadata": {"": ""}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:56.237274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6fe82d0-502b-45f3-afdd-255f24ab0f2e req-4fca13ac-3986-4ebe-8493-44022f5908a6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.237900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6fe82d0-502b-45f3-afdd-255f24ab0f2e req-4fca13ac-3986-4ebe-8493-44022f5908a6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.238432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6fe82d0-502b-45f3-afdd-255f24ab0f2e req-4fca13ac-3986-4ebe-8493-44022f5908a6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37e151c7-b56c-44df-b593-47b609a9d6c9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action HTTP/1.1 Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 107 Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:19:56.241544 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1930030412", "metadata": {"": ""}}} Oct 17 13:19:56.243255 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1930030412', 'metadata': {'': ''}}}} Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'': ''} Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:56.244327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.246010 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:56.247553 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:56.247553 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:56.247553 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:19:56.247553 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:19:56.247553 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.247553 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.249396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37e151c7-b56c-44df-b593-47b609a9d6c9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:56.250629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37e151c7-b56c-44df-b593-47b609a9d6c9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action" status: 400 len: 170 microversion: 2.1 time: 0.018355 Oct 17 13:19:56.251716 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 478/1040] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Oct 17 13:19:56 2022] POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:19:56.262703 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a6fe82d0-502b-45f3-afdd-255f24ab0f2e req-4fca13ac-3986-4ebe-8493-44022f5908a6 service nova] Creating event network-vif-plugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:19:56.265560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:56.268636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:56.270448 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a6fe82d0-502b-45f3-afdd-255f24ab0f2e req-4fca13ac-3986-4ebe-8493-44022f5908a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055697 Oct 17 13:19:56.271764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 563/1041] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:19:56.282604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.283266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.283862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.284742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.286239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.286823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.562091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.571553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53ca9be0-68f2-4712-aec8-5c2f0d445a14 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.311394 Oct 17 13:19:56.572697 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 479/1042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:56 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:56.598728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:56.600076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:56.627026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.627757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.628409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.629372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.635711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.635711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.864757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:56.877301 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ee3f913-9ce6-4016-9975-cc9dfc5ef81f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.284317 Oct 17 13:19:56.881196 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 564/1043] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:56 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:56.900420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-566c40b5-f127-4feb-b2d9-8ecd8b4bd7e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-210609410", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-566c40b5-f127-4feb-b2d9-8ecd8b4bd7e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action HTTP/1.1 Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 618 Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:19:56.905604 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:56.907422 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:19:56.908475 n-d-854121-14 devstack@n-api.service[120697]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-210609410", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 17 13:19:56.908475 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:19:56.908475 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-210609410', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 17 13:19:56.908803 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:56.909864 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.911534 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:56.912660 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:56.912660 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:56.912660 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:19:56.912660 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:19:56.912660 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:19:56.912660 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:19:56.913890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-566c40b5-f127-4feb-b2d9-8ecd8b4bd7e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:56.913890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-566c40b5-f127-4feb-b2d9-8ecd8b4bd7e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action" status: 400 len: 938 microversion: 2.1 time: 0.010855 Oct 17 13:19:56.913890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 480/1044] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Oct 17 13:19:56 2022] POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action => generated 938 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:19:56.915838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:56.916456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:56.923302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.923802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.924244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.924945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:56.925604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:56.926197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:56.958372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=13 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:57.063885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1345208376", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "de69c07b-99ae-49cb-9b55-cd78d1700008"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:57.077335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.085751 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0cade659-8867-4977-816b-335b691a3b15 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.173520 Oct 17 13:19:57.086383 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 565/1045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:56 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:57.110757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.111458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.117928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.118540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.118979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.119671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.120112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.120658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.122119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] validate_networks() for [('de69c07b-99ae-49cb-9b55-cd78d1700008', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:19:57.369841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.378292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff8c90d1-0388-4178-8506-f97239549de4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.272794 Oct 17 13:19:57.382949 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 566/1046] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:19:57.384151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.384878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.391863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.392594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.393293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.394249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.394924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.395584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.515218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.524965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.526772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:57.533139 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cfcbcfe-d331-489c-a8b6-680237cb422a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1533 microversion: 2.91 time: 0.152707 Oct 17 13:19:57.534013 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 567/1047] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1533 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:57.553658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a494c49-248a-440c-8e9e-4debfe0c0490 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a494c49-248a-440c-8e9e-4debfe0c0490 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action HTTP/1.1 Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 285 Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:19:57.559000 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:19:57.560422 n-d-854121-14 devstack@n-api.service[120698]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:19:57.565884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:19:57.566559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:19:57.567808 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:19:57.568668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:19:57.568668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:57.568668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a494c49-248a-440c-8e9e-4debfe0c0490 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:57.568668 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a494c49-248a-440c-8e9e-4debfe0c0490 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action" status: 400 len: 619 microversion: 2.1 time: 0.025232 Oct 17 13:19:57.568967 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 568/1048] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Oct 17 13:19:57 2022] POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:19:57.637841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.637841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.661519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.662488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.663415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.664604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.665191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.665727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.699059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:19:57.699565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:19:57.702942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:19:57.703551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:19:57.704238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:19:57.715458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.715955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.716402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.717669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.718136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.718642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.739369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:19:57.750975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for user c2effa2bc1674d20a064b40849b85df1 and project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:19:57.751598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lazy-loading 'services' on Instance uuid c681d09b-d520-40d3-90a6-4cc5e3d169d8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:57.771157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:19:57.773426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:19:57.776873 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-715d0b8a-cf83-4c67-b8d6-8e94cdb4640e tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1940 microversion: 2.91 time: 0.214306 Oct 17 13:19:57.777614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 569/1049] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1940 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:57.790743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.791686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.798453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.804776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.805550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.807265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.807975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.808647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.860600 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5eceec0b-795b-49af-b7db-c919d9781e1a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.851972 Oct 17 13:19:57.868748 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 481/1050] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:19:57.878157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:57.879025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:57.912218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.912720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.919243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:57.920020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:57.923304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:57.923775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.085574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lazy-loading 'services' on Instance uuid c681d09b-d520-40d3-90a6-4cc5e3d169d8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:58.128658 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4512f8f6-05f5-4e4b-944b-2039a1d8d9ec tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1940 microversion: 2.91 time: 0.255293 Oct 17 13:19:58.142144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.145846 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 482/1051] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1940 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:19:58.155332 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c481513-27b1-46ae-8ce1-d37f2fdc5eac tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.376593 Oct 17 13:19:58.156132 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 570/1052] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:57 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:58.163874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.173148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03609772-d7b8-45ae-934e-4354dab82f29 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.180220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-03609772-d7b8-45ae-934e-4354dab82f29 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.184457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.184931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.185404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.186988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.187445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.187872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.260334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92fd7c86-f09d-469c-8d3c-76618f2f0447 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.100308 Oct 17 13:19:58.262507 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 571/1053] 10.222.0.65 () {60 vars in 1217 bytes} [Mon Oct 17 13:19:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:19:58.278312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.280283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.289389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.290133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.290848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.292110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.293261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.294012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.324380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-03609772-d7b8-45ae-934e-4354dab82f29 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.333502 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03609772-d7b8-45ae-934e-4354dab82f29 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1208 microversion: 2.1 time: 0.186017 Oct 17 13:19:58.334703 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 483/1054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:58 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1208 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:58.340101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:58.342067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.351453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.356841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.357818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.360798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.361672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.364095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.411543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lazy-loading 'flavor' on Instance uuid c681d09b-d520-40d3-90a6-4cc5e3d169d8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:19:58.482982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.493600 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a555012e-e073-4282-b327-995c40147195 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.219864 Oct 17 13:19:58.494347 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 572/1055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:58 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:58.522205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-83242954"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:58.525000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.532835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.533507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.534048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.535225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.535532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.536293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.745146 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72a73ff9-31b9-4bc9-be4a-6868670b7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action" status: 202 len: 0 microversion: 2.91 time: 0.408484 Oct 17 13:19:58.746609 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 484/1056] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:19:58 2022] POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:58.765356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.766525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.777331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.778736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.779779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.780810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.781497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.781672 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d894e07-3921-460c-93ff-f2dddba3ab07 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action" status: 202 len: 0 microversion: 2.1 time: 0.264129 Oct 17 13:19:58.782638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.788906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 573/1057] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:58 2022] POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 13:19:58.796210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1974346354"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:19:58.798712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:58.805062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.805597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.806042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.806756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:58.807211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:58.807646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:58.858629 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Cannot 'createImage' instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 while it is in task_state image_snapshot_pending Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action HTTP/1.1 Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 85 Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:19:58.860849 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1974346354"}} Oct 17 13:19:58.862626 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'createImage' instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 while it is in task_state image_snapshot_pending Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1974346354'}}} Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:19:58.863460 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 while it is in task_state image_snapshot_pending Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 while it is in task_state image_snapshot_pending Oct 17 13:19:58.864872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:19:58.866377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 409 to user: Cannot 'createImage' instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 while it is in task_state image_snapshot_pending {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:19:58.866377 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e43c14f4-d409-44d3-97d0-d6667b228596 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action" status: 409 len: 167 microversion: 2.1 time: 0.071775 Oct 17 13:19:58.866377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 574/1058] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:19:58 2022] POST /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41/action => generated 167 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:19:58.874331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d7af185b-a83b-4bb0-8ae3-3982ef2e0497 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '.version_select at 0x7f419e4c7820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:58.888303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.903680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.906468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:58.913809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9edf2e4-07f1-4853-9552-37915f4d5760 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.161797 Oct 17 13:19:58.914525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 485/1059] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:58 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:19:59.031315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d7af185b-a83b-4bb0-8ae3-3982ef2e0497 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/images/95bf6eb6-c397-4a8d-9dc8-ca667eef3423" status: 204 len: 0 microversion: 2.1 time: 0.162951 Oct 17 13:19:59.031914 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 575/1060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:58 2022] DELETE /compute/v2.1/images/95bf6eb6-c397-4a8d-9dc8-ca667eef3423 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:19:59.040926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:59.041694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:59.049452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.050026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.050543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.051331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.051870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.052373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.195568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:59.203670 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c161c26f-ffa4-43c2-90db-c47115c71b49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1534 microversion: 2.1 time: 0.167453 Oct 17 13:19:59.204256 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 486/1061] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:59 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1534 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:59.356544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:59.357187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:59.364702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.365200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.365636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.366326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.366773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.367189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.434762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:19:59.438962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:59.443942 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4cea45c3-7775-4413-b0e1-bb48533e2197 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1260 microversion: 2.1 time: 0.091907 Oct 17 13:19:59.444525 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 576/1062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:19:59 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1260 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:19:59.941581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:19:59.942839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:19:59.945959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:19:59.950022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.950369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.950809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:19:59.951556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:19:59.952076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:19:59.952501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.026471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.035867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.037448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.058316 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dbee938c-b657-4460-a982-bf5a36d4baac tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.121267 Oct 17 13:20:00.074194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 487/1063] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:19:59 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:00.227461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:00.228082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:00.238023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.239197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.239831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.240731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.241384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.242083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.468769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:00.469426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:00.484680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.485282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.487076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.487916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:00.488988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:00.491306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:00.512469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.525062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84e6775a-e3de-4c86-a1b2-9e243e49e013 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1534 microversion: 2.1 time: 0.300374 Oct 17 13:20:00.526974 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 577/1064] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:00 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1534 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:00.736736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:00.751455 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-699892c6-7243-4402-9038-a6a67e4dda23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.287593 Oct 17 13:20:00.762437 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 488/1065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:00 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:01.088467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:01.089091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:01.106700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.107214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.108055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.108784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.109277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.109715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.200992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.211244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.213037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.220260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29a90239-8c9c-4fd2-914f-9bc1a9ef4ae5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.136568 Oct 17 13:20:01.221530 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 578/1066] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:01 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:01.330972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2e4efcd7-8c89-4ebb-a41f-b9b6d29c31cc req-0ea45f88-025e-4488-843b-b1da33489785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400a5ed2-2c32-40d4-a873-280ea80a26b9", "tag": "e296cb29-d84f-491e-a728-94d731413df7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:01.357124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2e4efcd7-8c89-4ebb-a41f-b9b6d29c31cc req-0ea45f88-025e-4488-843b-b1da33489785 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.361053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2e4efcd7-8c89-4ebb-a41f-b9b6d29c31cc req-0ea45f88-025e-4488-843b-b1da33489785 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.361538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2e4efcd7-8c89-4ebb-a41f-b9b6d29c31cc req-0ea45f88-025e-4488-843b-b1da33489785 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.384105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2e4efcd7-8c89-4ebb-a41f-b9b6d29c31cc req-0ea45f88-025e-4488-843b-b1da33489785 service nova] Creating event network-changed:e296cb29-d84f-491e-a728-94d731413df7 for instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 on n-h1-854121-14 Oct 17 13:20:01.394451 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2e4efcd7-8c89-4ebb-a41f-b9b6d29c31cc req-0ea45f88-025e-4488-843b-b1da33489785 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068543 Oct 17 13:20:01.395737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 489/1067] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:01.549419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:01.550148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:01.556840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.569840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.570434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.571286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.571837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.572342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.788556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:01.792467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:01.805061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.806097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.806820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.809471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:01.810154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:01.811310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:01.841191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:01.851712 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21423ea2-922c-4de2-9c51-c4b4a34bddef tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1534 microversion: 2.1 time: 0.305513 Oct 17 13:20:01.865256 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 579/1068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:01 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1534 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:02.046446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:02.056562 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d2373c4-51a4-49a2-9b7d-d0a7be51e210 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.272286 Oct 17 13:20:02.058015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 490/1069] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:01 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:02.249564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:02.250546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:02.254288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=43 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:02.265706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.266578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.267255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.268583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.270724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.271466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.375807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:02.385211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:02.386659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:02.393192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07c17613-902f-45d9-b88a-18e528d05cf8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.148925 Oct 17 13:20:02.393780 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 580/1070] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:02 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:02.879178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:02.879778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:02.886465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.887192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.887639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:02.888483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:02.888983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:02.889430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.039179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.048826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17b71bb0-034d-4572-9939-8a0bb74f4b91 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1540 microversion: 2.1 time: 0.174277 Oct 17 13:20:03.050085 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 491/1071] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:02 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1540 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:03.080870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:03.082494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:03.090020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.090655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.091358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.092365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.093775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.094507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.253518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.262425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00b46e2d-036f-499f-bef7-00572bc739fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.186367 Oct 17 13:20:03.262999 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 581/1072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:03 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:03.424362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:03.425323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:03.438454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.439308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.440056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.441112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:03.444484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:03.445212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:03.548331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.559924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.563210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:03.570287 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-501bee22-d210-429e-9ad7-2a548506f968 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.151314 Oct 17 13:20:03.582500 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 492/1073] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:03 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:04.074431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.075258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.081563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.082760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.083359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.084250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.084949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.085609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.254136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.262293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c04d0ff-3583-4842-9591-b1fd0aef9f49 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1540 microversion: 2.1 time: 0.191936 Oct 17 13:20:04.262885 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 582/1074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1540 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:04.290420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.291248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.299256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.300275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.300830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.301537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.302010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.303208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.500177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.508098 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-157e25ce-e86e-4352-b913-43e89c142560 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.221652 Oct 17 13:20:04.508913 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 493/1075] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:04.601213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:04.602165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:04.613751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.614252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.615085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.615814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:04.616281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:04.616957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:04.834704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.847036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.849396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:04.855962 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cbf4e36-df21-4733-ab18-852ae5637f4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.258471 Oct 17 13:20:04.856926 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 583/1076] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:04 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:05.288762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:05.289599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:05.304220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.305506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.306160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.307115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.307755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.308400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.460956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.470225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8af98c9-ecd6-468e-87e6-3b1f6dafa680 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1540 microversion: 2.1 time: 0.186796 Oct 17 13:20:05.470826 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 494/1077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:05 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1540 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:05.532670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:05.534086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:05.542167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.542600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.543053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.545445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.545445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.545445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.602825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-91aab769-b482-40f0-b363-69db7a5afb0d req-37820598-b991-4420-8cb5-7d97a534d0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91c51f1-75cd-46a1-bf5d-a084e2948c41", "name": "network-vif-plugged", "status": "completed", "tag": "d93a3b8c-ae8d-4803-a267-5d0a008043e0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:05.639948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-91aab769-b482-40f0-b363-69db7a5afb0d req-37820598-b991-4420-8cb5-7d97a534d0e4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.640482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-91aab769-b482-40f0-b363-69db7a5afb0d req-37820598-b991-4420-8cb5-7d97a534d0e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.640993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-91aab769-b482-40f0-b363-69db7a5afb0d req-37820598-b991-4420-8cb5-7d97a534d0e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.680782 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-91aab769-b482-40f0-b363-69db7a5afb0d req-37820598-b991-4420-8cb5-7d97a534d0e4 service nova] Creating event network-vif-plugged:d93a3b8c-ae8d-4803-a267-5d0a008043e0 for instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 on n-h2-854121-14 Oct 17 13:20:05.689436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-91aab769-b482-40f0-b363-69db7a5afb0d req-37820598-b991-4420-8cb5-7d97a534d0e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092695 Oct 17 13:20:05.691375 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 495/1078] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:05.752036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.760999 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-679a2922-e753-4a8e-b847-466919d76fea tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.233648 Oct 17 13:20:05.762168 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 584/1079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:05 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:05.888480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:05.889216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:05.895913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.896409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.896851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.897605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:05.898106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:05.898531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:05.971680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.981901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.984582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:05.991633 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-332a8e5f-dac3-439d-98da-f70961b61450 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.107581 Oct 17 13:20:05.992356 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 496/1080] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:05 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:06.493832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:06.494373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:06.501373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.501864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.502309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.503011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.503463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.503885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.651761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:06.660435 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1bcce9b-9557-43e1-91fa-b394f8dbf788 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1540 microversion: 2.1 time: 0.170528 Oct 17 13:20:06.661016 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 585/1081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:06 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:06.688122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:06.688876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:06.695865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.696359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.696804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.697557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.698081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.698544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.701900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:06.785498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:06.786594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:06.792974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.794052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.794489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.795730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.796469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.797143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.951340 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d01a559b-8be9-459b-a261-49dbbdb7598f tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1815 microversion: 2.1 time: 0.267571 Oct 17 13:20:06.952143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 497/1082] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:06 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1815 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:06.981058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:06.984402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:06.989059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.989890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.990428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.991262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:06.991787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:06.992418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:06.995358 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6dc903a-6202-4af2-b86e-f0a4e882275d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.215077 Oct 17 13:20:06.996033 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 586/1083] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:06 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:07.020311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:07.021061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:07.028070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.028563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.029310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.031082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.031828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.032246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.049406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d685c9f-532b-41bf-ac17-7ab90b407f82 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.076872 Oct 17 13:20:07.053205 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 498/1084] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:20:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:07.105636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:07.114663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:07.116114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:07.122706 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7916a86-1e43-477f-ab69-7bdbf0c88e6f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.106297 Oct 17 13:20:07.123862 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 587/1085] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:07 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:07.686705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:07.688040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:07.710832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.711767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b2a0e5d2-8aa8-44be-b180-836efc89390e req-f71161ce-a543-4e0b-8c18-ff34e94675df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400a5ed2-2c32-40d4-a873-280ea80a26b9", "name": "network-vif-plugged", "status": "completed", "tag": "e296cb29-d84f-491e-a728-94d731413df7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:07.718474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.724021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.725326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b2a0e5d2-8aa8-44be-b180-836efc89390e req-f71161ce-a543-4e0b-8c18-ff34e94675df service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.726181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b2a0e5d2-8aa8-44be-b180-836efc89390e req-f71161ce-a543-4e0b-8c18-ff34e94675df service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.726479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:07.726961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b2a0e5d2-8aa8-44be-b180-836efc89390e req-f71161ce-a543-4e0b-8c18-ff34e94675df service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.727175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:07.727771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:07.741403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b2a0e5d2-8aa8-44be-b180-836efc89390e req-f71161ce-a543-4e0b-8c18-ff34e94675df service nova] Creating event network-vif-plugged:e296cb29-d84f-491e-a728-94d731413df7 for instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 on n-h1-854121-14 Oct 17 13:20:07.748576 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b2a0e5d2-8aa8-44be-b180-836efc89390e req-f71161ce-a543-4e0b-8c18-ff34e94675df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040596 Oct 17 13:20:07.749602 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 588/1086] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:20:08.026030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:08.027278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:08.049007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.049418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.052698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.053367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.054414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.055080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.055891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.058609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57b58017-20b9-45ba-bb68-d49630ee4598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1540 microversion: 2.1 time: 0.377792 Oct 17 13:20:08.060313 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 499/1087] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:07 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1540 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:08.157768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:08.158549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:08.179275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.179775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.186451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.187522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:08.188090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:08.188950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:08.236401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:08.330110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=18 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:08.370951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.381995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.387011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.391024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:08.400121 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f2e441f-692b-4eb7-b227-70274d7851f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1308 microversion: 2.1 time: 0.380605 Oct 17 13:20:08.400578 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 589/1088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:08 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:08.419631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-341d60d8-0430-4d33-8318-4b02f4b2f4d3 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.267304 Oct 17 13:20:08.437793 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 500/1089] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:08 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:09.083147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:09.083895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.100058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.100532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.100954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.101678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.102129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.102537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.252782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.260759 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec941aa8-9ce8-4105-88a1-365a3752b372 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1540 microversion: 2.1 time: 0.181746 Oct 17 13:20:09.261750 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 590/1090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:09 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1540 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:09.426999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:09.427604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.434829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.436237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.437270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.438632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.439149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.439811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.449269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:09.449887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.458876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.461928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.462577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.463632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.464253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.464868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.590277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.603342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.605664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.611981 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02dcb06d-345f-4ee0-8c58-7c2844658b2f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.166819 Oct 17 13:20:09.613150 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 591/1091] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:09 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:09.618142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72cd4f5d-3578-4059-9f31-c198a7e2033b", "device": "/dev/xvdb"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:09.621439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.628103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.628947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.629596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.630580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.631193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.631787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.679187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:09.694021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-074209b1-c555-4f5e-8fae-2bb4b5eb1e44 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1488 microversion: 2.1 time: 0.270877 Oct 17 13:20:09.694615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 501/1092] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:09 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1488 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:09.717550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:09.718398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.728100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.728407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.729257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.729989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.730451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.730882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.834082 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac67bee9-caef-40d5-aa1c-d7ecbce740c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9/action" status: 202 len: 0 microversion: 2.1 time: 0.121041 Oct 17 13:20:09.837294 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 502/1093] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:09 2022] POST /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:20:09.846617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:09.847350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:09.856400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.856823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.857995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:09.858761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:09.859426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:09.859849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.033026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:10.041567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:10.055334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba098608-e9a7-4ac8-8f05-6f680e51cbae tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "POST /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439840 Oct 17 13:20:10.059205 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 592/1094] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:20:09 2022] POST /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 194 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:10.078823 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e823d0e0-0ad9-4eab-86f5-d872a0d81289 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1493 microversion: 2.1 time: 0.236460 Oct 17 13:20:10.100326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 503/1095] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:09 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1493 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:10.286849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:10.287712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:10.299884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.300476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.300988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.301949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.302656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.303325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.461627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:10.474120 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7fe45dd4-9b58-4b8c-8153-abcc61089f3b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1535 microversion: 2.1 time: 0.191826 Oct 17 13:20:10.475371 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 593/1096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:10 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1535 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:10.658810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:10.659425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:10.666657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.667405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.668036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.668914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:10.669579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:10.670965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:10.831669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:10.855537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:10.859272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:10.869136 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-47bab389-032b-4453-bc81-41a2d764e8b8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.213867 Oct 17 13:20:10.870617 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 504/1097] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:10 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:11.108763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:11.109710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.136035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.136864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.137667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.138611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.139266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.139906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.338863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:11.351686 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0dc6fb42-a19e-47e2-b16f-20263a7d56bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 200 len: 1473 microversion: 2.1 time: 0.247509 Oct 17 13:20:11.352960 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 594/1098] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:11 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:11.378540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-689003263"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:11.384361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.392552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.393184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.393717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.394515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.395048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.395554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.500039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:11.500961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.518238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.518935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.519554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.520470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.521086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.521695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.785430 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2ff533f-13b1-4dc8-af93-4ef3e9abd5f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9/action" status: 202 len: 0 microversion: 2.1 time: 0.410583 Oct 17 13:20:11.795351 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 505/1099] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:11 2022] POST /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:20:11.801465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c184e7fd-641c-46bf-82b8-167fea2d6738 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dec3f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:11.805441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:11.821551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46094842-c850-4971-ac5f-dbe747354755 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1522 microversion: 2.1 time: 0.325071 Oct 17 13:20:11.822642 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 595/1100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:11 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:11.866007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:11.867539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.883564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.884059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.884742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.893919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.896267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.896798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.914071 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c184e7fd-641c-46bf-82b8-167fea2d6738 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.116995 Oct 17 13:20:11.914743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 506/1101] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:11 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:11.921041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:11.925643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:11.935804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.936759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.947564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.948626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:11.951806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:11.952448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:11.965766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:12.058435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.072546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.073571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.082718 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e28c2bb-1c89-44c0-b987-1e541587329e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.166809 Oct 17 13:20:12.083536 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 507/1102] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:11 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:12.111317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:12.121593 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6bcce4ac-1530-412b-85ff-fb9b08278551 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 204 len: 0 microversion: 2.1 time: 0.272807 Oct 17 13:20:12.122381 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 596/1103] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:11 2022] DELETE /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:12.132107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:12.132935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:12.140068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.140667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.141195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.141982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:12.142550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:12.143053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:12.316097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:12.325242 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4ca36fb-b9da-4a23-b6dc-ce4ab79b5e56 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1528 microversion: 2.1 time: 0.197134 Oct 17 13:20:12.327687 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 508/1104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:12 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1528 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:12.931597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4f91bfa-06cd-4449-86d2-66fe793883c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddb3940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:12.991263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4f91bfa-06cd-4449-86d2-66fe793883c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.064578 Oct 17 13:20:13.000992 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 597/1105] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:12 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:13.114188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:13.114899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:13.125058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.125844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.126747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.128300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.128956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.129625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.231180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:13.241791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:13.243652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:13.250163 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d12132e9-f607-4f95-84af-a49bc2200550 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.140570 Oct 17 13:20:13.250938 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 509/1106] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:13 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:13.354013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:13.356227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:13.366092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.366601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.367051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.367775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.368238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.368669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.549491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:13.558580 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18ceffec-8f24-4ab8-bb30-b3cf3ab1ba00 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1528 microversion: 2.1 time: 0.208204 Oct 17 13:20:13.560215 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 598/1107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:13 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1528 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:13.608673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c165716a-cc8d-4e7a-a2e9-4f4753e22290 req-6cedfca2-b20b-44cb-b9cb-8c14d93bd443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91c51f1-75cd-46a1-bf5d-a084e2948c41", "name": "network-vif-unplugged", "status": "completed", "tag": "d93a3b8c-ae8d-4803-a267-5d0a008043e0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:13.630000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c165716a-cc8d-4e7a-a2e9-4f4753e22290 req-6cedfca2-b20b-44cb-b9cb-8c14d93bd443 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:13.630489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c165716a-cc8d-4e7a-a2e9-4f4753e22290 req-6cedfca2-b20b-44cb-b9cb-8c14d93bd443 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:13.636652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c165716a-cc8d-4e7a-a2e9-4f4753e22290 req-6cedfca2-b20b-44cb-b9cb-8c14d93bd443 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:13.648924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c165716a-cc8d-4e7a-a2e9-4f4753e22290 req-6cedfca2-b20b-44cb-b9cb-8c14d93bd443 service nova] Creating event network-vif-unplugged:d93a3b8c-ae8d-4803-a267-5d0a008043e0 for instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 on n-h2-854121-14 Oct 17 13:20:13.654920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c165716a-cc8d-4e7a-a2e9-4f4753e22290 req-6cedfca2-b20b-44cb-b9cb-8c14d93bd443 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055013 Oct 17 13:20:13.655797 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 510/1108] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:14.007516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3daa7ebe-8ea5-41a9-9760-9bcb8d6a6136 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dd3f310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.055130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3daa7ebe-8ea5-41a9-9760-9bcb8d6a6136 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.051539 Oct 17 13:20:14.055707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 599/1109] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:14.278545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.279715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.286837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.287323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.287754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.288461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.288921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.289379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.361655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.370147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.371616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.376642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9f18e5e-1ce1-4340-9c8a-fbd6e7118eb4 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.102620 Oct 17 13:20:14.377239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 511/1110] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:14.540959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.541729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.548685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.549386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.549789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.550490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.550943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.551361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.595300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.596374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.602949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.610167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.610950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.611944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.612621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.613411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.755422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.771414 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c8040a2-ae95-4b5f-8acd-0b59ab018b71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.234344 Oct 17 13:20:14.791325 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 600/1111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:14.825082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:14.834529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4957c793-3123-4122-8860-463c283b01a9 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1528 microversion: 2.1 time: 0.255252 Oct 17 13:20:14.835759 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 512/1112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1528 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:14.835899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:14.836401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:14.845922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.849588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.850861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:14.853285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:14.854912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:14.855360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.061563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 5d428abc-b9a2-4d64-8f09-26a50e66508b {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:15.077843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65d0906b-2929-4b97-817b-9fe8443cf344 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419decf550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.123541 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65e7398a-773e-4883-be18-b8680c9289df tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 2346 microversion: 2.25 time: 0.293076 Oct 17 13:20:15.158142 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 601/1113] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:14 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 2346 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:15.166632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.172392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.173075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.173711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.174590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.175203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.175813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.213663 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2cc5f5b-e49c-4a4e-9b7c-4a142214eb93 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.051017 Oct 17 13:20:15.240078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 602/1114] 10.222.0.65 () {60 vars in 1217 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:20:15.324294 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65d0906b-2929-4b97-817b-9fe8443cf344 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.252485 Oct 17 13:20:15.334427 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 513/1115] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:15.406499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.407115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:15.417253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.417754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.418178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.418884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.419341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.420286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.611174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:15.627277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:15.631351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:15.644179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0beb3b7e-3874-465d-8a59-67aee5d12135 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.241650 Oct 17 13:20:15.663779 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 603/1116] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:15.804925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.806049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:15.827019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.827709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.828332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.829273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.830306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.832367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.860067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:15.861090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:15.871565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.874465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.876387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:15.877948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:15.880636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:15.881941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.152060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:16.155793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:16.165037 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-602b4e07-752c-4745-88ab-a2293e3dd1cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.364138 Oct 17 13:20:16.173820 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 514/1117] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:16.200437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1842086890"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:16.204523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:16.220676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.221236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.221692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.222463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.222914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.223351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.246891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:16.273582 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e64d6fe6-2d11-4824-a6b4-9369f69ef68e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1528 microversion: 2.1 time: 0.415016 Oct 17 13:20:16.276696 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 604/1118] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:15 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1528 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:16.346522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-888a7fb0-9402-4fae-bb72-3e0e5c5d04b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dd3f310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:16.668587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-888a7fb0-9402-4fae-bb72-3e0e5c5d04b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.331188 Oct 17 13:20:16.670528 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 605/1119] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:16 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:16.758358 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c50b0876-bf5d-43f0-96d5-95c29e545ca4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.561799 Oct 17 13:20:16.759059 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 515/1120] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:16 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 17 13:20:16.778317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:16.803657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:16.825032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.825629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.826803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.827765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.828380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.828985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.872162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d01b6018-b4fc-4f0f-88fd-7bcab2d146e0 req-1538b818-a3f3-47e5-87b8-1276fcd81d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e91c51f1-75cd-46a1-bf5d-a084e2948c41", "name": "network-vif-deleted", "tag": "d93a3b8c-ae8d-4803-a267-5d0a008043e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:16.896887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d01b6018-b4fc-4f0f-88fd-7bcab2d146e0 req-1538b818-a3f3-47e5-87b8-1276fcd81d80 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:16.898278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d01b6018-b4fc-4f0f-88fd-7bcab2d146e0 req-1538b818-a3f3-47e5-87b8-1276fcd81d80 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:16.898982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d01b6018-b4fc-4f0f-88fd-7bcab2d146e0 req-1538b818-a3f3-47e5-87b8-1276fcd81d80 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:16.928147 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d01b6018-b4fc-4f0f-88fd-7bcab2d146e0 req-1538b818-a3f3-47e5-87b8-1276fcd81d80 service nova] Creating event network-vif-deleted:d93a3b8c-ae8d-4803-a267-5d0a008043e0 for instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 on n-h2-854121-14 Oct 17 13:20:16.939486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d01b6018-b4fc-4f0f-88fd-7bcab2d146e0 req-1538b818-a3f3-47e5-87b8-1276fcd81d80 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267268 Oct 17 13:20:16.943357 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 606/1121] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:17.013072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.021240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=17 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:17.042437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.050962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.080124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa3314c4-9b82-4a5d-b09d-0649baae2ec9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.305892 Oct 17 13:20:17.084264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 516/1122] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:16 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:17.247252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-975ee887-e434-4651-837a-797faf0425c3 req-e9ab3a3c-e6a3-4f53-abd1-5cb951e6ff2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400a5ed2-2c32-40d4-a873-280ea80a26b9", "name": "network-vif-plugged", "status": "completed", "tag": "e296cb29-d84f-491e-a728-94d731413df7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:17.275265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-975ee887-e434-4651-837a-797faf0425c3 req-e9ab3a3c-e6a3-4f53-abd1-5cb951e6ff2c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.275951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-975ee887-e434-4651-837a-797faf0425c3 req-e9ab3a3c-e6a3-4f53-abd1-5cb951e6ff2c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.276498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-975ee887-e434-4651-837a-797faf0425c3 req-e9ab3a3c-e6a3-4f53-abd1-5cb951e6ff2c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.307806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:17.309060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:17.331173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.331573 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-975ee887-e434-4651-837a-797faf0425c3 req-e9ab3a3c-e6a3-4f53-abd1-5cb951e6ff2c service nova] Creating event network-vif-plugged:e296cb29-d84f-491e-a728-94d731413df7 for instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 on n-h1-854121-14 Oct 17 13:20:17.334978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.335560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.336409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.337449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.339136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.351025 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-975ee887-e434-4651-837a-797faf0425c3 req-e9ab3a3c-e6a3-4f53-abd1-5cb951e6ff2c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101783 Oct 17 13:20:17.351925 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 607/1123] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:17.447181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:17.447783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:17.448313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:17.449007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lazy-loading 'fault' on Instance uuid e91c51f1-75cd-46a1-bf5d-a084e2948c41 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:17.526677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:17.536748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab7e343a-55d2-4393-8c40-e6ffede4b134 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 200 len: 1315 microversion: 2.1 time: 0.234659 Oct 17 13:20:17.545877 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 517/1124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:17 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:17.686859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e263afc-0928-4902-baa1-ebc383fb7501 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddb3670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:17.755035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e263afc-0928-4902-baa1-ebc383fb7501 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.072721 Oct 17 13:20:17.756241 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 608/1125] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:17 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:18.109872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.110461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.118954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.119661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.121985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.123596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.124224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.124854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.185014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cf773ee-1735-4ac2-a052-ff2e4c0119ec", "device": "/dev/xvdb"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:18.189138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.196769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.197523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.198148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.199030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.203334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.204005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.208387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:18.219695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:18.221459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:18.227182 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b729a8bd-14b3-4ca4-b9e4-74b26aac65b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.122694 Oct 17 13:20:18.227897 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 518/1126] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:18.483978 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba7503cc-3635-4803-a97c-56f7440cc160 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "POST /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.302951 Oct 17 13:20:18.484893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 609/1127] 10.222.0.65 () {62 vars in 1364 bytes} [Mon Oct 17 13:20:18 2022] POST /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:20:18.570796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.573067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:18.581341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.581955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.582467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.583281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:18.583937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:18.584583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:18.617492 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 HTTP/1.1 Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:20:18.619621 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:20:18.621420 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41'} Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:18.622515 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:20:18.624477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:18.626919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:18.628070 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ab7d2d4-3366-495a-be63-27200a3ce985 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 404 len: 111 microversion: 2.1 time: 0.062667 Oct 17 13:20:18.628963 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 519/1128] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:18.644529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08dba44a-1084-4488-b487-714766083981 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'create', calling method: .version_select at 0x7f419dcf70d0>, body: {"keypair": {"name": "tempest-keypair-438762774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2HfawdtyK4rxu9KyVoZ5l/GdaIcI20HIOnXJ3Dqg1AGU0AsicAnaalQ7xaoWJ8tApwxggkQNO959YEwNHCBRAJJwKiHK1Cmp4/5/aFBtOBNdLyM6mlqzoirbElzM3a2Q=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:18.689952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-08dba44a-1084-4488-b487-714766083981 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for project 97f2a1e99d30456384a574e0641513a5. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:20:18.697100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-08dba44a-1084-4488-b487-714766083981 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for user aba657aa5e344ba3b3a61d9096941a52 and project 97f2a1e99d30456384a574e0641513a5. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:20:18.740895 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08dba44a-1084-4488-b487-714766083981 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102173 Oct 17 13:20:18.741590 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 610/1129] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:20:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:18.774457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d33373e8-dd69-46c0-a904-0f74bdce88a7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419decf5e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:18.846469 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d33373e8-dd69-46c0-a904-0f74bdce88a7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.077053 Oct 17 13:20:18.847324 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 520/1130] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:18 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:19.265236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:19.265906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:19.284027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.285052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.285773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.286731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.289972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.290676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.388943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-4b8ea70f-1069-4857-b105-b4ebf53fa551 req-6512e2db-d9a6-4c54-b132-2c38c87984d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:19.414113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4b8ea70f-1069-4857-b105-b4ebf53fa551 req-6512e2db-d9a6-4c54-b132-2c38c87984d8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:19.414610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4b8ea70f-1069-4857-b105-b4ebf53fa551 req-6512e2db-d9a6-4c54-b132-2c38c87984d8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:19.415050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4b8ea70f-1069-4857-b105-b4ebf53fa551 req-6512e2db-d9a6-4c54-b132-2c38c87984d8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:19.448581 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-4b8ea70f-1069-4857-b105-b4ebf53fa551 req-6512e2db-d9a6-4c54-b132-2c38c87984d8 service nova] Creating event network-vif-unplugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:20:19.474716 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-4b8ea70f-1069-4857-b105-b4ebf53fa551 req-6512e2db-d9a6-4c54-b132-2c38c87984d8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089810 Oct 17 13:20:19.475959 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 521/1131] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:20:19.523739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:19.543210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:19.544881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:19.557069 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92602b6a-17de-49dc-a752-f61182bf42a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.296464 Oct 17 13:20:19.558597 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 611/1132] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:19 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:19.868362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12a1b696-174f-4745-90d5-c1b88238ba2c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e59fc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:20.011803 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12a1b696-174f-4745-90d5-c1b88238ba2c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.150057 Oct 17 13:20:20.012867 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 522/1133] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:19 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:20.603175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:20.604547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:20.631396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:20.632917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:20.638471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:20.642499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:20.667714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:20.668508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:20.812564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:20.826381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:20.828108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:20.838062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70e41a6a-5772-45c8-afa4-31b31a861345 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.239470 Oct 17 13:20:20.845346 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 612/1134] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:20 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:21.032840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa5a6598-9176-42ba-b6b7-5e1aa216100f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419df4e820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:21.160394 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa5a6598-9176-42ba-b6b7-5e1aa216100f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.133361 Oct 17 13:20:21.171865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 523/1135] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:21 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:21.473806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1147267174", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:21.575492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] validate_networks() for [('c64945a6-1527-421a-8b9c-d3ac046e1a62', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:20:21.875018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:21.875876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:21.888296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:21.894059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:21.894353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:21.895309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:21.901776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:21.902246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.239168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:22.257002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:22.261662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:22.274649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d0e359d-90a3-4734-a5a6-3b217964c2af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.404888 Oct 17 13:20:22.277767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 524/1136] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:21 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:22.288253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-06051a11-1896-4dea-b29c-0857cadc8a78 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e4edca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.341419 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-06051a11-1896-4dea-b29c-0857cadc8a78 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.062302 Oct 17 13:20:22.342608 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 525/1137] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:22 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:22.470631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:20:22.471170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:20:22.471556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:20:22.471973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:20:22.472415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:20:22.483359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.484203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.484910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.485929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:22.486727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:22.487406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:22.498740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:22.514520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for project 97f2a1e99d30456384a574e0641513a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:20:22.520795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for user aba657aa5e344ba3b3a61d9096941a52 and project 97f2a1e99d30456384a574e0641513a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:20:22.536376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:20:22.539120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:20:22.593116 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7948dc84-0701-4bcf-84ed-6aeabe0677e5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.125006 Oct 17 13:20:22.594721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 613/1138] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:20:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:20:22.606897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-191e403b-b32a-465e-96cd-359356197f3e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:22.608665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-191e403b-b32a-465e-96cd-359356197f3e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:22.681348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-191e403b-b32a-465e-96cd-359356197f3e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:22.693978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-191e403b-b32a-465e-96cd-359356197f3e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1225 microversion: 2.1 time: 0.091626 Oct 17 13:20:22.695290 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 526/1139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:22 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:23.221539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7259e058-a06a-4ef8-8625-263b12276654"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:23.225510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:23.243263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.243933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.244620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.246101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.251559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.253845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.316619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:23.317218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:23.334442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.346068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.347440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.350361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.350853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.353590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.459889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:23.475244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:23.476992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:23.487506 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b559887-d320-4986-a958-b0699392de2e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.175224 Oct 17 13:20:23.495798 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 527/1140] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:23 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:23.511702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3129c097-0bbd-4df5-970f-ef35bad98d89 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419df7c550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:23.603498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3129c097-0bbd-4df5-970f-ef35bad98d89 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.103664 Oct 17 13:20:23.610120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 528/1141] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:23 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:23.727917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:23.738498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:23.754424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:23.759300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.760874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.761837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.764357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:23.764987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:23.766210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:23.792721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df5fe2bb-4424-423c-8437-cbd87033de57 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "POST /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578314 Oct 17 13:20:23.801692 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 614/1142] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:20:23 2022] POST /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:23.913523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:23.932965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8d33f08-1148-439a-b572-f83839e20414 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1221 microversion: 2.1 time: 0.219783 Oct 17 13:20:23.934078 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 529/1143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:23 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:24.168278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-77c6f875-2d0d-49c7-b0fc-ac9f0dc562e1 req-d4d1d2ca-f253-43f7-aab4-834597747829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-plugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:24.201870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-77c6f875-2d0d-49c7-b0fc-ac9f0dc562e1 req-d4d1d2ca-f253-43f7-aab4-834597747829 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.201870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-77c6f875-2d0d-49c7-b0fc-ac9f0dc562e1 req-d4d1d2ca-f253-43f7-aab4-834597747829 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.207568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-77c6f875-2d0d-49c7-b0fc-ac9f0dc562e1 req-d4d1d2ca-f253-43f7-aab4-834597747829 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.227235 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-77c6f875-2d0d-49c7-b0fc-ac9f0dc562e1 req-d4d1d2ca-f253-43f7-aab4-834597747829 service nova] Creating event network-vif-plugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:20:24.238585 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-77c6f875-2d0d-49c7-b0fc-ac9f0dc562e1 req-d4d1d2ca-f253-43f7-aab4-834597747829 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074495 Oct 17 13:20:24.244393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 615/1144] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:24.523251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:24.525872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.537293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.538325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.539372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.541414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.542265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.543011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.629094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7fa8d48-577e-4f4d-aadb-ae8b7cda6b69 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dcf7e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:24.672036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:24.689584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:24.692001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:24.715249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6fbeb3b8-a887-443f-a97b-868474bff092 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.196215 Oct 17 13:20:24.716719 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 530/1145] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:24 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:24.723251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7fa8d48-577e-4f4d-aadb-ae8b7cda6b69 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.101419 Oct 17 13:20:24.723888 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 616/1146] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:24 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:24.963303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:24.963935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:24.975408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.975922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.976373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:24.979431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:24.981791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:24.983866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.233410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:25.262234 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-daa1a0f2-935c-4fbd-8e82-8258ad2c6595 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1295 microversion: 2.1 time: 0.304447 Oct 17 13:20:25.262842 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 531/1147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:24 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1295 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:25.740206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5999346-5165-42a9-98f7-d5aba6153544 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419de051f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:25.745294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:25.746057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:25.754885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.755529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.756345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.757630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:25.758645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:25.759427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:25.815010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5999346-5165-42a9-98f7-d5aba6153544 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.079559 Oct 17 13:20:25.815603 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 617/1148] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:25 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:25.869680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:25.881236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:25.883384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:25.891437 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-115894ba-05fa-4fe9-bb40-2742449c7140 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.150927 Oct 17 13:20:25.892527 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 532/1149] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:25 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:26.341988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:26.343226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:26.352621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.358009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.360111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.360934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.361487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.361898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.560896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:26.576750 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f9d3bc3-116a-443d-9c50-3a35f46afce2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.238677 Oct 17 13:20:26.577690 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 618/1150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:26 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:26.831699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28451545-7d9c-436f-aaab-db76c41b8892 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dec3790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:26.924294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:26.924918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:26.930839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28451545-7d9c-436f-aaab-db76c41b8892 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.103097 Oct 17 13:20:26.936645 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 533/1151] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:26 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:26.943603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.949104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.950171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:26.953111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:26.954307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:26.954979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.080097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:27.098585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:27.104435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:27.114628 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61e4ab9c-201d-4086-a44a-36f2c26891fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.195869 Oct 17 13:20:27.115522 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 619/1152] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:26 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:27.266392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6b0ff533-d682-4fed-ae43-b0a4886c2a9b req-2eb89703-d3b1-4170-82cd-1605083ab217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bab135-352c-4a58-932b-d2624d52cc15", "tag": "a0563ed8-9a3b-4299-86a4-2c34a36d20a0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:27.274067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:27.274948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:27.286697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.289964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.291447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.292424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.295372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6b0ff533-d682-4fed-ae43-b0a4886c2a9b req-2eb89703-d3b1-4170-82cd-1605083ab217 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.296164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.296818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.299024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6b0ff533-d682-4fed-ae43-b0a4886c2a9b req-2eb89703-d3b1-4170-82cd-1605083ab217 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.301055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6b0ff533-d682-4fed-ae43-b0a4886c2a9b req-2eb89703-d3b1-4170-82cd-1605083ab217 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.325466 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6b0ff533-d682-4fed-ae43-b0a4886c2a9b req-2eb89703-d3b1-4170-82cd-1605083ab217 service nova] Creating event network-changed:a0563ed8-9a3b-4299-86a4-2c34a36d20a0 for instance 71bab135-352c-4a58-932b-d2624d52cc15 on n-h2-854121-14 Oct 17 13:20:27.360160 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6b0ff533-d682-4fed-ae43-b0a4886c2a9b req-2eb89703-d3b1-4170-82cd-1605083ab217 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097343 Oct 17 13:20:27.366065 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 534/1153] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:27.525896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a8df759-b09c-4ea2-95ea-fde945bab2f6 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1861 microversion: 2.1 time: 0.256523 Oct 17 13:20:27.528895 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 620/1154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:27 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1861 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:27.550628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": true, "disk_over_commit": false}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:27.554504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:27.568989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.569522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.569970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.571241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.571715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.572147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.606077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:27.606712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:27.616533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.617036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.617502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.618216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:27.622351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:27.623450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:27.628798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lazy-loading 'flavor' on Instance uuid 45ff27cf-dee5-48e5-938c-f98c803813be {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:27.652115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Going to try to live migrate instance to n-h2-854121-14 {{(pid=120697) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:20:27.902352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:27.914934 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b44fd0fe-e1c1-4be6-b083-9e12f501a222 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.313267 Oct 17 13:20:27.918436 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 621/1155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:27 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:27.952031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e268e69-1b45-4e54-a05b-43255ea7415a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dd3f040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:28.035289 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e268e69-1b45-4e54-a05b-43255ea7415a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.087248 Oct 17 13:20:28.038130 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 622/1156] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:27 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:28.144895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:28.145836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:28.164657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:28.165351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:28.166057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:28.167119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:28.171001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:28.171588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:28.243121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:28.252456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:28.254255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:28.260657 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7772ccb-ffb5-443e-af9c-a24e20e568f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.119640 Oct 17 13:20:28.261346 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 623/1157] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:28 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:28.941624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:28.942510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:28.949636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:28.952266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:28.953459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:28.954394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:28.955277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:28.955956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.131094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.145577 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-684cbe03-a60d-4b22-ac62-cd6f1fc75e7e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.208172 Oct 17 13:20:29.157638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 624/1158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:28 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:29.163928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cf0fc82-caf4-4601-88b9-5dc14c64f8b2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddc8dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:29.223212 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cf0fc82-caf4-4601-88b9-5dc14c64f8b2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.064005 Oct 17 13:20:29.223945 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 625/1159] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:29 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:29.290526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:29.291140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:29.302001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:29.303700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:29.305149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.306249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:29.307037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:29.307781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:29.407262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.418857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.423134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:29.433912 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79133719-5033-478a-824e-0b3371bd1517 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.147063 Oct 17 13:20:29.434593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 626/1160] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:29 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:30.172029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:30.173449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:30.182452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.183527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.184366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.185980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.186671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.187270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.470683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:30.480593 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e489a221-4777-4713-b0d4-8a98005c696e tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.314502 Oct 17 13:20:30.482621 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 627/1161] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:30 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:30.488214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8394aa9e-6865-4b01-9101-d6f2efd6e9de tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e4c7820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:30.545019 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8394aa9e-6865-4b01-9101-d6f2efd6e9de tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1411 microversion: 2.1 time: 0.058860 Oct 17 13:20:30.545433 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 628/1162] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:30 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1411 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:30.551751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:30.552357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:30.560634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.561483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.562340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.563422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:30.564047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:30.564656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:30.673357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:30.694418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:30.695381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:30.702153 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5569e468-99c3-40c0-a686-95f7d4d4efa5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1560 microversion: 2.91 time: 0.155352 Oct 17 13:20:30.702807 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 629/1163] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:30 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:31.506208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:31.506950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:31.524301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.526286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.528081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:31.538609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:31.545674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:31.549575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:31.893465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:31.911706 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f71a46f-e7af-49f7-8629-ccb4d90855ba tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.410671 Oct 17 13:20:31.917191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 630/1164] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:31 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:31.925650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8fd65f1-c3bf-420f-9a80-2ed119eaf9f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419de26b80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:32.499002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:32.530564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:32.531265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2855ead-6e85-4a5a-bd46-9b56923db676 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/action" status: 202 len: 0 microversion: 2.1 time: 4.984581 Oct 17 13:20:32.534943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 535/1165] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:27 2022] POST /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/action => generated 0 bytes in 4990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:20:32.540281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:32.541270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:32.551187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:32.553704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:32.554455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.556042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:32.556749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:32.557462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.677595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.684145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:32.689678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:32.698530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.701696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.710151 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8cc75d55-de3f-4f20-ae89-f11e8b694556 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.173787 Oct 17 13:20:32.726913 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 536/1166] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:32 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:32.741475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:32.742597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:32.751160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:32.751951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:32.752576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.753494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:32.754118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:32.754710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:32.984855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:32.995517 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3fb2d602-89bb-49e0-8205-cc4ddecd5ead tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.266755 Oct 17 13:20:33.011933 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 537/1167] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:32 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:33.020636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:33.022156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:33.039735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.040488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.041192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.042687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.043322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.043908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.423673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:33.433186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe6c45bd-98c1-4386-b16e-06c6fdfb2aaa tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.423700 Oct 17 13:20:33.434128 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 538/1168] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:33 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:33.446314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:33.446942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:33.465212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.466051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.467517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:33.468664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:33.469389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:33.469998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.321665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 5d428abc-b9a2-4d64-8f09-26a50e66508b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:34.398108 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bad5c496-9d10-4110-80c0-85dc1a178579 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 2424 microversion: 2.25 time: 0.952774 Oct 17 13:20:34.405727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 539/1169] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:33 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 2424 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:34.423535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:34.442630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:34.515648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.518194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.518880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.520469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.524819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.539187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.681998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.708026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.712585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:34.729494 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1ca283e-df68-475f-92d7-617704823819 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.322297 Oct 17 13:20:34.734789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 540/1170] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:34 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:34.768875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:34.776568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:34.798325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.798825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.799269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:34.799987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:34.800439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:34.809987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:35.078426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:35.095268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e2d1977-2765-4773-b90a-355b6dfb11e4 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.352741 Oct 17 13:20:35.125718 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 541/1171] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:34 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:35.141599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": "auto"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:35.144573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:35.164235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:35.165291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:35.165743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:35.167508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:35.170450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:35.170895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:35.246234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'flavor' on Instance uuid 5d428abc-b9a2-4d64-8f09-26a50e66508b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:35.275055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Going to try to live migrate instance to n-h2-854121-14 {{(pid=120697) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:20:37.692115 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b562407-86a5-422f-99da-29a472b08b15 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/action" status: 202 len: 0 microversion: 2.25 time: 2.565079 Oct 17 13:20:37.696640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 542/1172] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:20:35 2022] POST /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/action => generated 0 bytes in 2570 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:37.703104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:37.704052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:37.736829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:37.737579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:37.740443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:37.742436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:37.743339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:37.745119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:37.990795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.006942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c6a8c704-bb84-44cd-a7aa-75c864f1c166 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.307441 Oct 17 13:20:38.008696 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 543/1173] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:37 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:38.021091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-62c47f41-1f24-497c-9b36-b20bb45141b4 req-0aaffa85-8810-480b-8933-d3bd22352250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bab135-352c-4a58-932b-d2624d52cc15", "name": "network-vif-plugged", "status": "completed", "tag": "a0563ed8-9a3b-4299-86a4-2c34a36d20a0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:38.064539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62c47f41-1f24-497c-9b36-b20bb45141b4 req-0aaffa85-8810-480b-8933-d3bd22352250 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.065453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62c47f41-1f24-497c-9b36-b20bb45141b4 req-0aaffa85-8810-480b-8933-d3bd22352250 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.066133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62c47f41-1f24-497c-9b36-b20bb45141b4 req-0aaffa85-8810-480b-8933-d3bd22352250 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.079022 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-62c47f41-1f24-497c-9b36-b20bb45141b4 req-0aaffa85-8810-480b-8933-d3bd22352250 service nova] Creating event network-vif-plugged:a0563ed8-9a3b-4299-86a4-2c34a36d20a0 for instance 71bab135-352c-4a58-932b-d2624d52cc15 on n-h2-854121-14 Oct 17 13:20:38.095439 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-62c47f41-1f24-497c-9b36-b20bb45141b4 req-0aaffa85-8810-480b-8933-d3bd22352250 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077383 Oct 17 13:20:38.096761 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 544/1174] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:38.103485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.107560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.115920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.116809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.117545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.118649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.119468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.120149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.196705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.208108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.210266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.218210 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db3d92a2-6bab-4888-a99e-2d694c71695a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.119761 Oct 17 13:20:38.219490 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 545/1175] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:38.246828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.247632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.254796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.255506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.256046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.256874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.257457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.258043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.504740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.522306 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e332caf3-4133-45f2-a437-f0e64ce011e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.279706 Oct 17 13:20:38.523134 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 546/1176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:38.551576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.552197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.573353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.573857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.574299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.576117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.576652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.577086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:38.916846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.924755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.937826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:38.938967 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f22487e1-0841-4709-937a-45fb3fec3e99 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.412000 Oct 17 13:20:38.939860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 547/1177] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:38.976872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:38.991359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:38.998503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:38.999150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:38.999672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.000461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.000993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.001567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.063516 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5cb8f7f-268c-4a08-b8b9-2c74d1ed9c33 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090516 Oct 17 13:20:39.073877 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 548/1178] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:20:38 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:39.080402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:39.090064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:39.098443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.099216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.100013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.101861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.102728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.105262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.396877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:39.410880 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0e6a432-c413-497e-b0d4-efed832086fb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1325 microversion: 2.1 time: 0.335634 Oct 17 13:20:39.426201 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 549/1179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:39 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:39.446501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:39.446959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:39.471280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.471874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.472392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.473232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:39.473765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:39.474278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:39.901372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lazy-loading 'services' on Instance uuid f61b456a-dc6e-47dc-bab8-88eb35727c92 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:40.086457 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eeeb95d7-4cf3-455e-b289-6a1a631a9a12 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments/7259e058-a06a-4ef8-8625-263b12276654" status: 202 len: 0 microversion: 2.1 time: 0.658181 Oct 17 13:20:40.088231 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 550/1180] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:20:39 2022] DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments/7259e058-a06a-4ef8-8625-263b12276654 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:20:40.132515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:40.136781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:40.161223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.165426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.167261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.170416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.171393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.173619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.235776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:40.368770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.380262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.382290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.389292 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da2f61f2-2d6a-45cc-b672-cec6e05601c9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.298358 Oct 17 13:20:40.401144 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 551/1181] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:40 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:40.417557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:40.418262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:40.426032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.426634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.427108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.427894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.428407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.429295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.603378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.621193 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ad63690-d214-42cb-8363-fc191a05ee20 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.219497 Oct 17 13:20:40.649579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 552/1182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:40 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:40.654949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:40.655633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:40.662934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.663525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.664033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.664816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:40.665442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:40.665948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:40.916666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.946791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.949204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:40.953414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6341364d-4796-4681-84c8-51149e1b8e16 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.298986 Oct 17 13:20:40.953414 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 553/1183] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:40 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:41.098268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f37c9c16-4ce8-4e72-9710-e14a08c75da7 req-d18bffc5-5c36-4a43-b193-d01848c0097b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400a5ed2-2c32-40d4-a873-280ea80a26b9", "name": "network-vif-unplugged", "status": "completed", "tag": "e296cb29-d84f-491e-a728-94d731413df7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:41.110792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f37c9c16-4ce8-4e72-9710-e14a08c75da7 req-d18bffc5-5c36-4a43-b193-d01848c0097b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.111277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f37c9c16-4ce8-4e72-9710-e14a08c75da7 req-d18bffc5-5c36-4a43-b193-d01848c0097b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.111854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f37c9c16-4ce8-4e72-9710-e14a08c75da7 req-d18bffc5-5c36-4a43-b193-d01848c0097b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.125268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f37c9c16-4ce8-4e72-9710-e14a08c75da7 req-d18bffc5-5c36-4a43-b193-d01848c0097b service nova] Creating event network-vif-unplugged:e296cb29-d84f-491e-a728-94d731413df7 for instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 on n-h1-854121-14 Oct 17 13:20:41.130351 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f37c9c16-4ce8-4e72-9710-e14a08c75da7 req-d18bffc5-5c36-4a43-b193-d01848c0097b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142871 Oct 17 13:20:41.131780 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 554/1184] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:41.136729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:41.137470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:41.145729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.146215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.146649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.147358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.147807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.148230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.516363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.517730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:41.641575 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92cb0c0a-3d10-420d-a214-0457ea7a62fe tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1521 microversion: 2.1 time: 0.460707 Oct 17 13:20:41.641575 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 555/1185] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:41 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:41.641575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:41.641575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:41.648094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.648988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.652375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.654126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.654858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.655526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.749408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.761187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.763439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:41.770503 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83a62189-31c1-4b0e-a842-73bff0a1323b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.175582 Oct 17 13:20:41.771694 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 556/1186] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:41 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:41.777231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:41.778079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:41.785783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.787705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.788348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.790573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:41.791219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:41.791824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:41.897747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:42.053714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.063840 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e80b133-7053-4342-af7b-e208c23f32d7 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1521 microversion: 2.1 time: 0.290909 Oct 17 13:20:42.073194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 557/1187] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:41 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:42.073194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:42.073194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.086059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.086059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.086059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.086059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.086846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.086846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.348451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.362387 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb764ead-24bb-4d92-aa04-5749c9242dcd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.296339 Oct 17 13:20:42.362993 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 558/1188] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:42 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:42.373018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:42.373714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.386028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.388849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.389305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.391778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.392254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.392693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.758251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.776072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.777669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:42.783251 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2b110a4-da52-4123-b06f-93b402af4383 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.418903 Oct 17 13:20:42.784618 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 559/1189] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:42 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:42.790047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-464005801"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:42.797302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:42.804560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.805055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.805669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:42.806382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:42.806835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:42.807266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.455063 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8fd65f1-c3bf-420f-9a80-2ed119eaf9f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1420 microversion: 2.1 time: 14.533814 Oct 17 13:20:46.467798 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 631/1190] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:31 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1420 bytes in 14550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:46.476053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:46.478160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:46.489803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.495532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.496201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.497672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.498343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.498939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.570088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.580477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.584007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.590647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b85e5aca-4808-4023-ba85-fa588e4e00f0 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.121469 Oct 17 13:20:46.592657 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 632/1191] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:46 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:46.598027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:46.599116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:46.619354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.620334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.621006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.622033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.622653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.623272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.778428 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18496ecd-e8ee-41d9-b079-695c93b7afed tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15/action" status: 202 len: 0 microversion: 2.1 time: 3.991749 Oct 17 13:20:46.784773 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 560/1192] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:42 2022] POST /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15/action => generated 0 bytes in 3995 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:20:46.790643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:46.791354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:46.798728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.799196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.799867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.800759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.801407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.802044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.828592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.838115 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-618fe33b-c7cc-4a67-9edd-3fe2e245524b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.244124 Oct 17 13:20:46.842774 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 633/1193] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:46 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:46.850688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:46.863022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:46.864087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Searching by: {'deleted': False, 'project_id': 'dca83ede7465446dad54fe79943fa68f'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:20:46.872612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.873567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.874178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.875087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:46.875722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:46.876319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:46.991904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:20:47.061675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.071530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.074089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.076246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90626c97-29b8-4749-8f51-583951d5e1f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.289680 Oct 17 13:20:47.077539 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 561/1194] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:46 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:47.082969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8dce0401-82e0-403d-aebe-a88486d7b067 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddbb430>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.151259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8dce0401-82e0-403d-aebe-a88486d7b067 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 200 len: 1420 microversion: 2.1 time: 0.072053 Oct 17 13:20:47.153100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 562/1195] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:47.158794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e20ac9b3-d161-41d9-9225-e7481808b568 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '.version_select at 0x7f419dde4670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.165911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-919ed978-5600-4ca8-ac11-bb08f13b2940 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.321728 Oct 17 13:20:47.166954 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 634/1196] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:20:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:47.172266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-961c3a3e-e1f6-4aaf-aece-32376cfce19b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dd938b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.389240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e20ac9b3-d161-41d9-9225-e7481808b568 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b" status: 204 len: 0 microversion: 2.1 time: 0.234149 Oct 17 13:20:47.389987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 563/1197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:47 2022] DELETE /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:47.395578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:47.402044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.407814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Searching by: {'deleted': False, 'project_id': 'dca83ede7465446dad54fe79943fa68f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:20:47.427197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.427859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.429532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.430414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.431859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.432384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.569390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:20:47.721595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:47.730153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:47.730939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:47.732087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:47.900904 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78382ed5-583e-4cb3-9911-6dd973c956c3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.509800 Oct 17 13:20:47.901860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 564/1198] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:47.910354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66bafc0c-fc26-40a6-afc6-bb89cbc38fea tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '.version_select at 0x7f419de5a310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.011984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-66bafc0c-fc26-40a6-afc6-bb89cbc38fea tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Image not found. Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66bafc0c-fc26-40a6-afc6-bb89cbc38fea tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b HTTP/1.1 Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:20:48.020394 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b503365e-5406-4065-9833-1292f50b3c2b'} Oct 17 13:20:48.022502 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:20:48.028811 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b503365e-5406-4065-9833-1292f50b3c2b Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:20:48.030522 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b503365e-5406-4065-9833-1292f50b3c2b could not be found. Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:20:48.032216 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:48.033711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66bafc0c-fc26-40a6-afc6-bb89cbc38fea tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:48.035003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66bafc0c-fc26-40a6-afc6-bb89cbc38fea tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b" status: 404 len: 62 microversion: 2.1 time: 0.115847 Oct 17 13:20:48.035003 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 565/1199] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:20:47 2022] GET /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b => generated 62 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:20:48.035003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.035003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.037134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.037795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.038247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.038962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.039573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.040136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.049975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-961c3a3e-e1f6-4aaf-aece-32376cfce19b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 204 len: 0 microversion: 2.1 time: 0.881756 Oct 17 13:20:48.053900 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 635/1200] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:47 2022] DELETE /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:48.056568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.057563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.065012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.065879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.066438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.067449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.068015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.068666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.122187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.131456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.133142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.139535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d75e851b-15f5-46f3-9b59-758fb7718de8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1537 microversion: 2.91 time: 0.114806 Oct 17 13:20:48.140235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 566/1201] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:48.145037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3180316-6db0-4fee-a639-585413659736 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.155285 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3180316-6db0-4fee-a639-585413659736 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013590 Oct 17 13:20:48.156095 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 567/1202] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:48.167437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.168161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.174726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.175296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.175813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.176569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.177096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.177820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.232528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.243672 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93ecb63b-2e23-4476-9551-9334244e1485 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.191407 Oct 17 13:20:48.244718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 636/1203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:48.253141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.254062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.262763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.263341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.263876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.264659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.265205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.265707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.354691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.363537 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b28835a-325e-4714-9a57-7d7b56838c14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.201991 Oct 17 13:20:48.369621 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 568/1204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:48.369621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.371201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.385486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.385978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.386414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.387120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.387612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.388080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.415228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:48.426648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.435526 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be3d0b14-804d-4010-a1bd-ecf2826a7adf tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1533 microversion: 2.1 time: 0.188984 Oct 17 13:20:48.436210 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 637/1205] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1533 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:48.440952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.441812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.442269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:48.449497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.450295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.450970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.451890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.452456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.452945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.496678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:48.504886 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac319683-1c04-4857-be7d-85db7e516757 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 204 len: 0 microversion: 2.1 time: 0.138712 Oct 17 13:20:48.505862 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 569/1206] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:48 2022] DELETE /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:48.562028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1892501950", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "de69c07b-99ae-49cb-9b55-cd78d1700008"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:48.620548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.628286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] validate_networks() for [('de69c07b-99ae-49cb-9b55-cd78d1700008', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:20:48.641806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.643473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:48.644735 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61c3c640-3888-4b27-aaa0-34ad223c7870 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.207377 Oct 17 13:20:48.645347 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 638/1207] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:48.654260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.654260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.659066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.659651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.660166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.661680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.662217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.665383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.696478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:48.786868 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9c6689a-37cd-468a-8c4f-dff7e0a405d4 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 204 len: 0 microversion: 2.1 time: 0.140312 Oct 17 13:20:48.787469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 639/1208] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:48 2022] DELETE /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:48.796675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:48.797416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:48.805821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.806591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.807252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:48.808052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:48.808633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:48.809270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.025019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.034072 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d04b583-162a-4b8d-972d-4752f73d0bb5 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1607 microversion: 2.1 time: 0.242207 Oct 17 13:20:49.034667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 640/1209] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:48 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1607 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:49.039364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.041578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.047897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.048377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.048818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.049552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.050007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.050599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.081642 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4888613-fd00-4ed8-839f-b151378c152a tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045843 Oct 17 13:20:49.082331 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 641/1210] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:20:49.119550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:20:49.120051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:20:49.120640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:20:49.121293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:20:49.122184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:20:49.132102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.132587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.133029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.133798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.134254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.134681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.147530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.149698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.154024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:20:49.156536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.156986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.157455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.158165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.158624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.159046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.159378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for user c2effa2bc1674d20a064b40849b85df1 and project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:20:49.171922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:20:49.174380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:20:49.188451 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d929a994-633f-4690-a217-7921efbccf47 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044664 Oct 17 13:20:49.189205 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 642/1211] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:20:49.199203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.199811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.208268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.208764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.209250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.209938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.210387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.210958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.227331 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a195fc2-165e-4fa9-96fc-10fb95f062be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670230 Oct 17 13:20:49.228415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 570/1212] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:20:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:20:49.240823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36f138ea-7385-4586-8983-40ce4ea2b766 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.241797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36f138ea-7385-4586-8983-40ce4ea2b766 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.303951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.314758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.316409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.321211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-36f138ea-7385-4586-8983-40ce4ea2b766 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.323783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dead611d-4109-4adb-98e0-4a38fc314c4f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1537 microversion: 2.91 time: 0.129579 Oct 17 13:20:49.324365 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 643/1213] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1537 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:49.331117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.332601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.335134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36f138ea-7385-4586-8983-40ce4ea2b766 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1208 microversion: 2.1 time: 0.098803 Oct 17 13:20:49.336210 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 571/1214] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1208 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:49.341114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.342320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.349226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.349727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.350169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.350321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.350675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.350931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.351646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.352110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.352541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.352659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.353093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.353556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.383432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:20:49.492639 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-016a1fcd-aa82-4344-92ea-17404130891c tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 204 len: 0 microversion: 2.1 time: 0.164968 Oct 17 13:20:49.493444 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 644/1215] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:20:49 2022] DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:20:49.499260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.499962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.506161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.506857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.507271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.507428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.508106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.508423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.508845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.518179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-43153056-3e0f-4b0c-b885-dfefd2405bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.180596 Oct 17 13:20:49.518933 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 572/1216] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:49.523676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.524467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.530672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.531301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.531836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.532626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.533393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.533846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.734146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.738801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:49.739246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.744475 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a91d7ae8-4551-4137-a96a-9d6d972bea3d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.249885 Oct 17 13:20:49.745155 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 645/1217] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:49.748606 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9eeb697-d25e-456c-9745-2e47487e3783 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1533 microversion: 2.1 time: 0.228218 Oct 17 13:20:49.753308 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 573/1218] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1533 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:49.753470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.753470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.758418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.758644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:49.758909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.759348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.759741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.760042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.760641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.761066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.766861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.767380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.767977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.768679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.769135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.769593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.966880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.970964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.975693 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7d5db5a-b0ba-4502-bf5a-9315bc3c6d19 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1680 microversion: 2.1 time: 0.229305 Oct 17 13:20:49.976278 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 646/1219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:49.992576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.992742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-425668773"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:49.992872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:49.992872 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e716519b-ebd8-45f8-8f1b-ed002e4b0bc2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.232391 Oct 17 13:20:49.992872 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 574/1220] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:49 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:49.993153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:49.993153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.993153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.993153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:49.993547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:49.993547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:49.993547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.057513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.058129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.064493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.064987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.065456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.066155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.066611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.067041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.232709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab68d70c-1284-4dfe-9aa0-b3e45db61819 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.254505 Oct 17 13:20:50.233761 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 647/1221] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:20:49 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 17 13:20:50.242985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.243678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.244245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.250452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.251142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.251581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.252404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.252539 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c84e256-14c3-48e4-ae64-1a15400fc968 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1607 microversion: 2.1 time: 0.199047 Oct 17 13:20:50.253195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.255037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.264051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 575/1222] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1607 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:50.355531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.357196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.364828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.365618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.366293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.367694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.368490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.369254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.413433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.422511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2faee0be-3903-42c7-92b0-7d0c61e9ba45 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.183706 Oct 17 13:20:50.423381 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 648/1223] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:50.431219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.432060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.446671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.450781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.452023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.452571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.454201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.455638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.456204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.456394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.457987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.463624 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8430d1f-d461-4a64-aab0-785827cb4c48 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1540 microversion: 2.91 time: 0.114591 Oct 17 13:20:50.464562 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 576/1224] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1540 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:50.496528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:50.500775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.508177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.508982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.509597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.510211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.510664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.511173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.533277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.542799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abddb868-6677-4ae7-8f6f-023d03f5a243 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1204 microversion: 2.1 time: 0.118231 Oct 17 13:20:50.543432 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 649/1225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1204 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:50.548162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.548777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.556265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.556750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.557201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.557903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.558354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.558776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.587644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-854121-14". {{(pid=120697) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:20:50.698348 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd324a14-9dd4-45aa-adee-04c79dd55f90 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action" status: 202 len: 0 microversion: 2.91 time: 0.206337 Oct 17 13:20:50.699297 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 577/1226] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:20:50 2022] POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:20:50.711339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.711965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.725512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.726441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.726954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.729193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.733610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.734924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.758236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.783085 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fad6e45-c2b7-47c1-8c07-575ddba83e75 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.224684 Oct 17 13:20:50.784355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 650/1227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:50.793277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:50.794848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:50.808048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.808544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.808981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.809787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:50.810243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:50.810669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:50.820888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.835334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.841378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:50.855251 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68126ac5-78fa-405c-b020-49eab45024f7 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1548 microversion: 2.91 time: 0.148530 Oct 17 13:20:50.869023 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 578/1228] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:51.000702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.002413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.009767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.014345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.017198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.018339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.021109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.029023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.030219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.032448 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b860be0a-5a70-4c13-8375-e326366b6598 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1539 microversion: 2.1 time: 0.246845 Oct 17 13:20:51.035445 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 651/1229] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1539 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:51.040430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.041039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.049897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.050387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.050818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.051524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.051978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.052399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.320088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.331807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5fdb409-a223-4ca3-b825-a3156798ff9f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1680 microversion: 2.1 time: 0.335542 Oct 17 13:20:51.332565 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 579/1230] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:50 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:20:51.338281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a5d28fd7-0a80-4e58-82e1-0c3233b58ca8 req-2e9b8069-98c1-4c64-b417-5f9a6544c058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400a5ed2-2c32-40d4-a873-280ea80a26b9", "name": "network-vif-deleted", "tag": "e296cb29-d84f-491e-a728-94d731413df7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:51.349308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.356780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a5d28fd7-0a80-4e58-82e1-0c3233b58ca8 req-2e9b8069-98c1-4c64-b417-5f9a6544c058 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.357298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a5d28fd7-0a80-4e58-82e1-0c3233b58ca8 req-2e9b8069-98c1-4c64-b417-5f9a6544c058 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.357823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a5d28fd7-0a80-4e58-82e1-0c3233b58ca8 req-2e9b8069-98c1-4c64-b417-5f9a6544c058 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.362904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.364370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.365622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-964ff670-54c4-4a65-b3de-dd8597d1b25c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.328992 Oct 17 13:20:51.366191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 652/1231] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:51.371509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.372828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.375870 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a5d28fd7-0a80-4e58-82e1-0c3233b58ca8 req-2e9b8069-98c1-4c64-b417-5f9a6544c058 service nova] Creating event network-vif-deleted:e296cb29-d84f-491e-a728-94d731413df7 for instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 on n-h1-854121-14 Oct 17 13:20:51.378992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.379651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.380608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.381601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.381888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a5d28fd7-0a80-4e58-82e1-0c3233b58ca8 req-2e9b8069-98c1-4c64-b417-5f9a6544c058 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047814 Oct 17 13:20:51.382455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.383061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.386155 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 580/1232] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:51.448787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.449659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.456322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.457077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.457604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.458375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.458900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.459390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.565844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.586836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0461935-c4e2-4f45-b69f-e83105568437 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1607 microversion: 2.1 time: 0.219084 Oct 17 13:20:51.604783 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 653/1233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1607 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:51.609708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.611142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.634076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.635318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.636117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.637248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.638042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.638799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.659746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.677586 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-584125fe-c2aa-4e47-afb5-b780d1b03746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.232974 Oct 17 13:20:51.681845 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 581/1234] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:51.726239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.735922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24a1a8d6-e564-4f90-a482-a9442eaea3d7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1268 microversion: 2.1 time: 0.136151 Oct 17 13:20:51.749838 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 654/1235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:51.807981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.808810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.816465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.817247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.818017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.818953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.819618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.820227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.891796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:51.892426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:51.899356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.902171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.902171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.902171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:51.902171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:51.902592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:51.987847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.992988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.997786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:51.999414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.002129 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6c221a8-4658-458b-a747-9314ab323353 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.198104 Oct 17 13:20:52.002932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 582/1236] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:52.006374 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13a4132f-8628-4096-84ec-f4df36567b1f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1490 microversion: 2.91 time: 0.119036 Oct 17 13:20:52.006374 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 655/1237] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:51 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1490 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:52.057869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.058606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.066193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.066754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.067272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.068064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.068515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.069000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.241054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.253373 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ee65254-d0f8-4e8d-abdc-d48ed2760553 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1539 microversion: 2.1 time: 0.199389 Oct 17 13:20:52.253968 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 583/1238] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1539 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:52.357541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.358534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.367480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.372465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.372929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.373719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.374328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.374826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.392296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.393015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.410423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.410930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.411378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.412091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.426633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.427096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.795487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.800014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.805188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.806664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:52.807850 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5af1b7c-4fde-4871-b19b-aa150e0b947a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.419649 Oct 17 13:20:52.813542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9a08238-3b61-4561-a68f-e3bcf2c2b3ca tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1680 microversion: 2.1 time: 0.461400 Oct 17 13:20:52.814887 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 656/1239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1680 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:52.821981 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 584/1240] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:20:52.839404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.840340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.847461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:52.848015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.848201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:52.849273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.850334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.851217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.852004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.852603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.863013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.863595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.864254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:52.865187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:52.867459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:52.868077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.144615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.155830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2312c1ef-16ad-449e-9c9c-55bacfbdb8ca tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.325618 Oct 17 13:20:53.166174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.174846 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 585/1241] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:53.178155 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ebf5150c-4166-4317-a828-5619d536f13f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1607 microversion: 2.1 time: 0.361750 Oct 17 13:20:53.179483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 657/1242] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:52 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1607 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:53.181976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.182616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:53.184181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ee48d2c6-d00e-427e-8ad2-9886c05a5280 req-16952e71-42f8-4eab-97ff-45392fee804a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:53.189464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.190156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.190775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.191634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.192246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.192896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.193980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ee48d2c6-d00e-427e-8ad2-9886c05a5280 req-16952e71-42f8-4eab-97ff-45392fee804a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.194639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ee48d2c6-d00e-427e-8ad2-9886c05a5280 req-16952e71-42f8-4eab-97ff-45392fee804a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.195233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ee48d2c6-d00e-427e-8ad2-9886c05a5280 req-16952e71-42f8-4eab-97ff-45392fee804a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.210292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:53.221310 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ee48d2c6-d00e-427e-8ad2-9886c05a5280 req-16952e71-42f8-4eab-97ff-45392fee804a service nova] Creating event network-vif-unplugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:20:53.226941 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ee48d2c6-d00e-427e-8ad2-9886c05a5280 req-16952e71-42f8-4eab-97ff-45392fee804a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045887 Oct 17 13:20:53.229600 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 658/1243] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:53.236730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.238228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:53.245602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.246376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.246848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.247797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.248479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.249180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.492106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.509963 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d34d694-6350-4c6f-8f9a-78aa68bc4c1d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.333678 Oct 17 13:20:53.510580 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 586/1244] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:53.515523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.516126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:53.522519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.522798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.523739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.524705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.525364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.526038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.623304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.643984 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7402467-cb99-4ab7-aed1-dc3351ef1d84 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.413092 Oct 17 13:20:53.644847 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 659/1245] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:53.650021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.663807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:53.686973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.687598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.691344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.692202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.692679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.693116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.811799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.828764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.838135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:53.854606 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4c9ffdb-cf63-45f6-a98b-db82a750be85 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.342955 Oct 17 13:20:53.860603 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 587/1246] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:53.890536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-21ba141c-f441-4aff-a76f-a458c4650700 req-62158cdb-53b7-4208-9246-3bf08ad86390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9252e01a-a8b6-4774-9ff3-2078a1dbace7", "tag": "aa255119-5098-49f5-b78a-938942f7184d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:53.921899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-21ba141c-f441-4aff-a76f-a458c4650700 req-62158cdb-53b7-4208-9246-3bf08ad86390 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:53.922489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-21ba141c-f441-4aff-a76f-a458c4650700 req-62158cdb-53b7-4208-9246-3bf08ad86390 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:53.923043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-21ba141c-f441-4aff-a76f-a458c4650700 req-62158cdb-53b7-4208-9246-3bf08ad86390 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:53.956758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-21ba141c-f441-4aff-a76f-a458c4650700 req-62158cdb-53b7-4208-9246-3bf08ad86390 service nova] Creating event network-changed:aa255119-5098-49f5-b78a-938942f7184d for instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 on n-h1-854121-14 Oct 17 13:20:53.972059 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-21ba141c-f441-4aff-a76f-a458c4650700 req-62158cdb-53b7-4208-9246-3bf08ad86390 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097644 Oct 17 13:20:53.975582 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 588/1247] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:53.991118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:53.994383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.013782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.014295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.014747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.015494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.015952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.016629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.154319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.165873 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e57cc991-e8bb-4530-928d-24920ca8f20d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1539 microversion: 2.1 time: 0.519446 Oct 17 13:20:54.183063 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 660/1248] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1539 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:54.194823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:54.195700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.207699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.208196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.211289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.212035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.212507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.212941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.302113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.312177 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-44ea87eb-88b8-4e7e-8708-73488a93f214 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1680 microversion: 2.1 time: 0.335130 Oct 17 13:20:54.313475 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 589/1249] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:53 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:54.333370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:54.334395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.342672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.343831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.344288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.345026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.345522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.345955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.602335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.607123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:54.624769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.627288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.628788 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d52a3f6-6f1a-470d-b688-bdcd762136a7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.444417 Oct 17 13:20:54.655617 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 661/1250] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:54 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:54.663270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:54.664279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.672699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.673609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.674291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.675244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.676051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.676776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.911536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:54.924358 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c077b58-a264-4b89-8b62-e932c798bf6e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.609601 Oct 17 13:20:54.925276 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 590/1251] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:54 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:54.954432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:54.955420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:54.972383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.973086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.973701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:54.974574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:54.975388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:54.976044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.038651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:55.047531 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c74e10c6-1bdb-4de4-9adf-023ba16a4f28 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1607 microversion: 2.1 time: 0.390389 Oct 17 13:20:55.053808 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 662/1252] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:54 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1607 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:55.058904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:55.065321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:55.079347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.081801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.082526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:55.083486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:55.086955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:55.087624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.786288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:56.802778 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce911b24-7ea8-484d-b368-60369ee475cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 1.862364 Oct 17 13:20:56.805936 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 591/1253] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:54 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:56.819866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:56.820759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:56.840085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.840876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.841510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.844175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:56.848622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:56.852378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:56.925307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:57.073483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.099728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.102372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.104779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.114062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6c9abf0-3a58-48dd-967b-b22a47505f70 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 2.058830 Oct 17 13:20:57.121550 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 663/1254] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:55 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:57.127166 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2e4f01f-1ff7-4449-8dbf-a8dbb6524145 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.317470 Oct 17 13:20:57.133812 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 592/1255] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:56 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:57.134171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:57.135080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:57.142699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bab135-352c-4a58-932b-d2624d52cc15", "name": "network-vif-plugged", "status": "completed", "tag": "a0563ed8-9a3b-4299-86a4-2c34a36d20a0"}, {"server_uuid": "a5f2435d-e49a-476d-aa52-b26661881968", "name": "network-vif-unplugged", "status": "completed", "tag": "d35f956f-fdca-49b3-927e-ac42ddc23a28"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:57.147062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.148534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.152389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.153368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.153918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.154420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.158992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.159876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.160537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.178356 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] Creating event network-vif-plugged:a0563ed8-9a3b-4299-86a4-2c34a36d20a0 for instance 71bab135-352c-4a58-932b-d2624d52cc15 on n-h2-854121-14 Oct 17 13:20:57.179377 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] Creating event network-vif-unplugged:d35f956f-fdca-49b3-927e-ac42ddc23a28 for instance a5f2435d-e49a-476d-aa52-b26661881968 on n-h2-854121-14 Oct 17 13:20:57.188253 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7fe7babc-fcda-490e-b183-eea02f3d5638 req-ce0f513c-979c-4a69-a265-d696ace933c0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051466 Oct 17 13:20:57.189861 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 593/1256] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:57.195513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:57.196700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:57.205576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.206387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.207208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.208254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.208883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.209504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.280194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.282300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.285796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.286575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lazy-loading 'fault' on Instance uuid f61b456a-dc6e-47dc-bab8-88eb35727c92 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:20:57.646331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0437fbd647094f76bba5f9bed9b6c053', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d21470cf449d1a0edab843f31ce7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:57.655525 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f34bac40-1b45-4404-8831-4ad240f9f2c7 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 200 len: 1331 microversion: 2.1 time: 0.464129 Oct 17 13:20:57.658566 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 594/1257] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:57 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 1331 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:57.856004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bde3f491-db75-4e51-9cdb-82c280acbac1 req-d1b0a331-80e2-4336-9c47-c42499b1623c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ff27cf-dee5-48e5-938c-f98c803813be", "name": "network-vif-unplugged", "status": "completed", "tag": "96bcfefd-87dc-40b2-a430-c8b8458e604e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:57.882447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bde3f491-db75-4e51-9cdb-82c280acbac1 req-d1b0a331-80e2-4336-9c47-c42499b1623c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.885519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bde3f491-db75-4e51-9cdb-82c280acbac1 req-d1b0a331-80e2-4336-9c47-c42499b1623c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.886422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bde3f491-db75-4e51-9cdb-82c280acbac1 req-d1b0a331-80e2-4336-9c47-c42499b1623c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.915019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bde3f491-db75-4e51-9cdb-82c280acbac1 req-d1b0a331-80e2-4336-9c47-c42499b1623c service nova] Creating event network-vif-unplugged:96bcfefd-87dc-40b2-a430-c8b8458e604e for instance 45ff27cf-dee5-48e5-938c-f98c803813be on n-h1-854121-14 Oct 17 13:20:57.925447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bde3f491-db75-4e51-9cdb-82c280acbac1 req-d1b0a331-80e2-4336-9c47-c42499b1623c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.258161 Oct 17 13:20:57.929143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 595/1258] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:57.939601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:57.941151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:57.953827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.955593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.957298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:57.958288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:57.959022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:57.959629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.012243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.033944 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30eb8537-79d8-4407-88dc-389585321f21 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1539 microversion: 2.1 time: 0.908703 Oct 17 13:20:58.036586 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 664/1259] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:57 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1539 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:58.053336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:58.062077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:58.080432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.081118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.081953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.083195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.083997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.084893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.713000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.742863 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c294693-6519-46dd-bc9a-db75ae2ad0b6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1689 microversion: 2.1 time: 0.699444 Oct 17 13:20:58.748554 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 665/1260] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:58 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1689 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:58.753113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.770784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.776472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:58.777459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:58.780700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.781990 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc4606d1-ff96-4dd0-9c5b-b6005bc82d66 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.850603 Oct 17 13:20:58.782783 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 596/1261] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:57 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:58.789010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.789612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.790176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.791232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.792076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.792628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.842146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bcd4657a-b8ea-4f8a-a8c2-bb838b1f0beb req-50e3d55b-d651-4dce-bb91-b5fcc689dd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f61b456a-dc6e-47dc-bab8-88eb35727c92", "name": "network-vif-deleted", "tag": "fe4d8477-ac01-4fd7-af4e-aedeb9b59502"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:20:58.884284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bcd4657a-b8ea-4f8a-a8c2-bb838b1f0beb req-50e3d55b-d651-4dce-bb91-b5fcc689dd1d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.885029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bcd4657a-b8ea-4f8a-a8c2-bb838b1f0beb req-50e3d55b-d651-4dce-bb91-b5fcc689dd1d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.886046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bcd4657a-b8ea-4f8a-a8c2-bb838b1f0beb req-50e3d55b-d651-4dce-bb91-b5fcc689dd1d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.912185 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bcd4657a-b8ea-4f8a-a8c2-bb838b1f0beb req-50e3d55b-d651-4dce-bb91-b5fcc689dd1d service nova] Creating event network-vif-deleted:fe4d8477-ac01-4fd7-af4e-aedeb9b59502 for instance f61b456a-dc6e-47dc-bab8-88eb35727c92 on n-h2-854121-14 Oct 17 13:20:58.924491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:58.941680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0fdbf6b0-0247-4f6d-817f-3b826d656ff3 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1539 microversion: 2.1 time: 0.189235 Oct 17 13:20:58.941845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bcd4657a-b8ea-4f8a-a8c2-bb838b1f0beb req-50e3d55b-d651-4dce-bb91-b5fcc689dd1d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114491 Oct 17 13:20:58.942989 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 666/1262] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:58 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1539 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:58.963834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:58.964839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:58.966425 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 597/1263] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:20:58.972709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:58.974159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:58.978122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.979283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.979873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.980681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.981993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.982719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.982943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.983696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.984126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:58.984821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:58.985295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:58.985715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.144711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:59.292328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.294175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.303373 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d88dbfc5-df16-477e-adf1-ea74da758bfe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.358278 Oct 17 13:20:59.304066 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 667/1264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:58 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:59.306792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-feb5225b-b2d4-4372-a524-3e8a313707a7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.335874 Oct 17 13:20:59.309008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.309699 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 598/1265] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:58 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:59.314135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.318635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.319448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.328835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.329572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.330089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.331050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.331795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.331934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:20:59.332230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.339566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.340054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.341087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.347106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.349849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.350295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.373349 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] HTTP exception thrown: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Request method failure captured: Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 HTTP/1.1 Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW97KKUFsQ92Rk-dgDwj4F4SI_F0PD-MOKdHYiz2yllEgnov5Z72EONG_ehLmmnt6H8lFenJdRJX6YCIJfOfkedBUJb7seJtCpVYoob59TElG1YvvnFmvPXF35wjZHm5ShceQSkIEHS_-ss_VHomhJfJE1dRsm6LTp2RS1dDvIRd1s Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1f0d21470cf449d1a0edab843f31ce7e Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:20:59.376230 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1f0d21470cf449d1a0edab843f31ce7e Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachSCSIVolumeTestJSON-1744368663-project Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 0437fbd647094f76bba5f9bed9b6c053 Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1744368663-project Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:20:59.378015 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f61b456a-dc6e-47dc-bab8-88eb35727c92'} Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:20:59.379025 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:20:59.380654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:20:59.382663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Returning 404 to user: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:20:59.382663 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee995359-d40a-45bc-89c3-f3e5d8b2c09f tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 404 len: 111 microversion: 2.1 time: 0.066890 Oct 17 13:20:59.382663 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 599/1266] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:20:59.386313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.387022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.396686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.397814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.398258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.400583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.400963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.402663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.408763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.430198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.433923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.455126 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0610823-524d-4060-ace1-e54e30e9f87d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.149682 Oct 17 13:20:59.455737 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 668/1267] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:20:59.477745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0264a72d-2485-4977-9053-2e4aa5858d99 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '.version_select at 0x7f419dbe2ee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.505758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0264a72d-2485-4977-9053-2e4aa5858d99 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874562394" status: 202 len: 0 microversion: 2.1 time: 0.048127 Oct 17 13:20:59.506375 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 669/1268] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:20:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874562394 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:20:59.679224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:20:59.688302 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3449b1ac-d332-41f3-8218-fcdac16304e8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1539 microversion: 2.1 time: 0.307720 Oct 17 13:20:59.705690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 600/1269] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1539 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:20:59.776017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.777063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.793026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.794036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.794814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.795958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.796593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.797210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.820241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:20:59.820915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:20:59.855899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.859050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.859505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:20:59.860246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:20:59.860706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:20:59.861130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.392964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:00.407854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1ba1302-30f6-4ffd-9f65-d27292e96ecf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1689 microversion: 2.1 time: 0.635337 Oct 17 13:21:00.412574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:00.425017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 670/1270] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1689 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:00.433384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:00.436974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:00.439858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:00.444105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c36b4fc9-20d4-4947-9bc1-224c0903cd15 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.630211 Oct 17 13:21:00.445116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:00.447570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 601/1271] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:20:59 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:00.464847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:00.467417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.467942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45ff27cf-dee5-48e5-938c-f98c803813be", "tag": "96bcfefd-87dc-40b2-a430-c8b8458e604e"}, {"server_uuid": "a5f2435d-e49a-476d-aa52-b26661881968", "name": "network-vif-deleted", "tag": "d35f956f-fdca-49b3-927e-ac42ddc23a28"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:00.478179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.481114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.482341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.483063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.484102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.501867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.504524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.505292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.557901 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] Creating event network-changed:96bcfefd-87dc-40b2-a430-c8b8458e604e for instance 45ff27cf-dee5-48e5-938c-f98c803813be on n-h1-854121-14 Oct 17 13:21:00.558944 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] Creating event network-vif-deleted:d35f956f-fdca-49b3-927e-ac42ddc23a28 for instance a5f2435d-e49a-476d-aa52-b26661881968 on n-h2-854121-14 Oct 17 13:21:00.589801 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-441f935f-96c9-45c2-8099-b6f6d387d4a5 req-b5fcac72-7ea1-4c9c-95ca-c8aec22ec949 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139505 Oct 17 13:21:00.595361 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 602/1272] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:00.618637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:00.619346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:00.637961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.638616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.639061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.639785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.640236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.640659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.699568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:00.713997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba90e67c-84da-4a3f-968e-15d92fac15a0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1251 microversion: 2.1 time: 0.284453 Oct 17 13:21:00.716535 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 671/1273] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:00 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1251 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:00.729604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:00.730608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:00.746123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.747050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.748191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:00.750004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:00.771877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:00.772660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.118927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.136438 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77a31436-9b1e-4d3b-a56c-c6a1f5ea38b5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.538184 Oct 17 13:21:01.156072 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 603/1274] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:00 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:01.166945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:01.173817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:01.182143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:01.187174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.188033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.189917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.190905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.197844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.199031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.251654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.275257 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-971f6b93-3cb8-465f-9e0a-478d2f85a7b5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.556853 Oct 17 13:21:01.275865 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 672/1275] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:00 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:01.302936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:01.303822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:01.333698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.334206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.334647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.342413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.344104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.344563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.442717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.458231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.459927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:01.484359 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d324ab1-f358-43fe-8a87-45d6035c7641 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.326392 Oct 17 13:21:01.486308 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 604/1276] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:01 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:01.520316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:01.521104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:01.531805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.532718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.533437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.545321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:01.546193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:01.546858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:01.981798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.003950 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f58d5ecc-28e0-4fae-8fe1-6b5b1420e84b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1539 microversion: 2.1 time: 0.708415 Oct 17 13:21:02.004909 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 673/1277] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:01 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1539 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:02.018728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.022261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.042700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.045085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.045901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.048182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.051270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.055179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.183662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.199111 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69335cd8-2ee1-412f-8cc6-42008fbb0929 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1689 microversion: 2.1 time: 0.695052 Oct 17 13:21:02.200570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 605/1278] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:01 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1689 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:02.210968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.211739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.229958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.236753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.237498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.238922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.239849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.241101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.397614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.400582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:02.426867 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1ee085f-6d5b-440a-9f53-8f4f7a84199b tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1251 microversion: 2.1 time: 0.222155 Oct 17 13:21:02.427715 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 606/1279] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1251 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:02.433282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-00b7c816-ff19-4ee9-9556-bd10130437fc req-60fbc6e3-896b-417b-9edd-96af0fe93c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-plugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:02.445645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-00b7c816-ff19-4ee9-9556-bd10130437fc req-60fbc6e3-896b-417b-9edd-96af0fe93c0b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.446841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-00b7c816-ff19-4ee9-9556-bd10130437fc req-60fbc6e3-896b-417b-9edd-96af0fe93c0b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.447478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-00b7c816-ff19-4ee9-9556-bd10130437fc req-60fbc6e3-896b-417b-9edd-96af0fe93c0b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.464062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-00b7c816-ff19-4ee9-9556-bd10130437fc req-60fbc6e3-896b-417b-9edd-96af0fe93c0b service nova] Creating event network-vif-plugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:21:02.472455 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-00b7c816-ff19-4ee9-9556-bd10130437fc req-60fbc6e3-896b-417b-9edd-96af0fe93c0b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042928 Oct 17 13:21:02.473541 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 607/1280] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:02.482879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.484043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.491969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.492809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.493644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.494608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.495339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.496014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.781855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.800974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.802955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.804400 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a88efca8-7081-46d3-b806-805064b652a8 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.796312 Oct 17 13:21:02.805083 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 674/1281] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:02.821121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.821779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.837615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.838057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.838599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.839542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.840102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.841217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.914915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:02.924533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b91e657-61c9-484e-bb3c-65ff18c864ee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.449477 Oct 17 13:21:02.953418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 608/1282] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:02.958923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:02.960812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:02.972921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.973870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.974602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:02.975609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:02.976318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:02.976977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.126953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.144798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.147709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.159233 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c59efc3-e07f-4309-a35d-db04d8a5bc5a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.204231 Oct 17 13:21:03.174127 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 609/1283] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:03.184169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.185221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.189810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.202126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.202827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.204072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.207407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.208568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.209674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.227468 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d119ee29-3581-442c-a77d-711872fccbf9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.410807 Oct 17 13:21:03.245208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 675/1284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:02 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:03.254364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.255130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.271338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.272157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.273472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.275974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.276456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.276892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.552434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.564045 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-194d277a-5415-4a6e-8580-f86ccaa4d313 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1534 microversion: 2.1 time: 0.387106 Oct 17 13:21:03.569467 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 610/1285] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:03 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1534 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:03.577980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.578954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.588914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.589706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.590456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.591347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.591981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.592571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.645781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.657077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f57edea2-c698-4a95-aef5-e1d7021bd64c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1689 microversion: 2.1 time: 0.424076 Oct 17 13:21:03.682535 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 676/1286] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:03 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1689 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:03.730162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:03.745112 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a43a436-6abc-475b-933a-8940119a6181 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1251 microversion: 2.1 time: 0.173798 Oct 17 13:21:03.760464 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 611/1287] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:03 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1251 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:03.831120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.831727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.840163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.841196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.841978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.842699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.843153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.843572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.959972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:03.961271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:03.976288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.979276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.979737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:03.980629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:03.981676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:03.982436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.111098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.125781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.127592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.128997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eca12647-db61-49d8-92e9-9e53345d4334 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.301870 Oct 17 13:21:04.130050 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 677/1288] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:03 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:04.188130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:04.189049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:04.205349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.206598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.207288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.208813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.209745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.210545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.258167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.270123 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-572a0e7d-0d6e-4204-830b-21a7be06161a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.313928 Oct 17 13:21:04.281184 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 612/1289] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:03 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:04.281184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:04.281184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:04.293498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.293498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.293498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.293498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.294707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.294707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.308229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.316933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.318829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.325217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14e70565-1d62-45a8-9651-5f04ae38e1fb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.141407 Oct 17 13:21:04.325975 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 678/1290] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:04 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:04.435825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:04.444347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6f53178-73b4-4b90-8ec9-8bdd8ac18557 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.171993 Oct 17 13:21:04.444921 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 613/1291] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:04 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:04.493677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-72fc9f4a-3794-4b2d-a05a-a2da979b221e req-5ff7a560-6626-4221-adc4-07f3c2a2cf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9252e01a-a8b6-4774-9ff3-2078a1dbace7", "name": "network-vif-plugged", "status": "completed", "tag": "aa255119-5098-49f5-b78a-938942f7184d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:04.503299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-72fc9f4a-3794-4b2d-a05a-a2da979b221e req-5ff7a560-6626-4221-adc4-07f3c2a2cf5c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.503770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-72fc9f4a-3794-4b2d-a05a-a2da979b221e req-5ff7a560-6626-4221-adc4-07f3c2a2cf5c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.504190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-72fc9f4a-3794-4b2d-a05a-a2da979b221e req-5ff7a560-6626-4221-adc4-07f3c2a2cf5c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.515977 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-72fc9f4a-3794-4b2d-a05a-a2da979b221e req-5ff7a560-6626-4221-adc4-07f3c2a2cf5c service nova] Creating event network-vif-plugged:aa255119-5098-49f5-b78a-938942f7184d for instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 on n-h1-854121-14 Oct 17 13:21:04.522036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-72fc9f4a-3794-4b2d-a05a-a2da979b221e req-5ff7a560-6626-4221-adc4-07f3c2a2cf5c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031994 Oct 17 13:21:04.522884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 679/1292] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:04.591004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:04.591823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:04.598443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.599321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.599987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.600894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.601670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.602350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.682386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:04.683236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:04.689668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.690152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.690644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.691337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:04.691783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:04.692193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:04.698333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:05.074055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.083270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-292fbc3f-4243-4a15-bdf4-8f29f492adc8 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1521 microversion: 2.1 time: 0.496618 Oct 17 13:21:05.087355 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 614/1293] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:04 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:05.089240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.090034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.097634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.098438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.099077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.099964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.100587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.101233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.130379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.160878 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72a3e75e-3253-42c2-aed9-b65f921746dd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1689 microversion: 2.1 time: 0.482562 Oct 17 13:21:05.169764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 680/1294] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:04 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1689 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:05.169764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.169764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.173384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.174090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.174724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.175608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.177109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.177779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.179480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.188373 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cca89cd4-c15a-4639-af4f-fff3b7c04ab1 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1251 microversion: 2.1 time: 0.103088 Oct 17 13:21:05.189180 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 615/1295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1251 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:05.193685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.194406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.201423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.201900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.202343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.203065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.203510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.203931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.218625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:21:05.316092 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d85778b7-e328-4f24-8a9d-afe850c406cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 204 len: 0 microversion: 2.1 time: 0.153292 Oct 17 13:21:05.320534 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 681/1296] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:21:05 2022] DELETE /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:05.326284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.326889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.334134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.334628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.335117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.335886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.336653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.336786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.354845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.365700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.367345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.368640 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88507a52-5658-4670-a886-026d396d228b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.178587 Oct 17 13:21:05.369580 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 616/1297] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:05.375949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.376803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.383906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.384627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.385283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.386177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.386798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.387960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.573707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.583466 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb73f0c6-6dea-4351-9e91-b9cd5d37ac4a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.264655 Oct 17 13:21:05.584430 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 682/1298] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:05.589793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.590562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.598802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.599299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.599741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.600451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.600906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.601364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.626830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.640034 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0122e4ed-90c1-45a4-a49b-b7a78324c961 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1527 microversion: 2.1 time: 0.269141 Oct 17 13:21:05.640949 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 617/1299] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1527 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:05.645889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:05.658109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:05.664178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.664786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.665349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.666287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:05.666997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:05.667611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:05.678160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.687249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.688718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.693790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9812f810-1a70-4582-b09e-ae5f284ea044 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.107597 Oct 17 13:21:05.694371 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 683/1300] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:05.818520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:05.828709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fbe6b1a0-38a1-41f5-bd5a-d3db66079bf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.186273 Oct 17 13:21:05.833211 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 618/1301] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:05 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:06.184902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.185460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.191985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.192467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.192907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.193629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.194085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.194508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.211982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.212618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.219381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.219873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.220298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.220991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.221458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.221877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.290549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.299311 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b8ec13e3-7017-4e8e-9d88-e9bb4562443c tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1251 microversion: 2.1 time: 0.091095 Oct 17 13:21:06.300079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 619/1302] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1251 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:06.361128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.369105 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7964518e-a88f-44d8-834d-349de75cdd38 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1689 microversion: 2.1 time: 0.188779 Oct 17 13:21:06.369707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 684/1303] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:06.395921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.396527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.402531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.403665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.404107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.404806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.405289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.405716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.539944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.548970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.550454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.551629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9fbc0b91-18c0-4bc9-a5b9-1a10ef0de4b6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.159716 Oct 17 13:21:06.552199 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 620/1304] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:06.611732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.612236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.619159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.619638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.620078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.620784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.621274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.622264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.663390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.664000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.675918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.677292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.679007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.680029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.680727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.681395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.865488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.868711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:06.877865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3fb8331f-2dd8-41aa-95d9-438bcafcbc11 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1527 microversion: 2.1 time: 0.218648 Oct 17 13:21:06.878782 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 621/1305] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1527 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:06.881399 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db18ae32-bb19-4f56-b521-f9ed37f5d2d8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1308 microversion: 2.1 time: 0.273671 Oct 17 13:21:06.882149 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 685/1306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:06.888348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.888951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.895325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.895825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.896263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.896705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:06.896969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.897445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.897871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.905233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:06.918142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.923202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.923562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:06.924310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:06.924776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:06.925229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.051150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.061102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.062690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.070585 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c023340-bf75-4d74-855e-eff0ea40ec3e tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.190453 Oct 17 13:21:07.085183 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 622/1307] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:07.132162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.142601 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49ce8f11-a443-4612-afd8-6b306cc163f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.259591 Oct 17 13:21:07.143532 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 686/1308] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:06 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:07.321925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:07.322610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:07.341865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.343000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.343891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.344978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.345791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.346342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.392320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:07.392931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:07.408746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.409267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.409709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.416747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.417379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.417826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.445639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642e0a16be6b4a6d876b7187720f544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca83ede7465446dad54fe79943fa68f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.471712 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f9aa5a0-b4f8-4d39-aeeb-4c4cc48e6548 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 200 len: 1251 microversion: 2.1 time: 0.153293 Oct 17 13:21:07.474289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 623/1309] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:07 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 1251 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:07.589096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:07.589863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:07.602207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.604654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.608111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.609628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.611631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.613884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.630369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:07.815482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:07.825849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e742cf6-5de1-47cd-94be-50850e2352c9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.437222 Oct 17 13:21:07.829985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 687/1310] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:07 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:07.851626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-15eecf29-d817-4bff-a48d-ecb79f0dd47b req-9ef97a68-257e-4cdd-9713-febe8aba6f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bab135-352c-4a58-932b-d2624d52cc15", "name": "network-vif-unplugged", "status": "completed", "tag": "a0563ed8-9a3b-4299-86a4-2c34a36d20a0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:07.873793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15eecf29-d817-4bff-a48d-ecb79f0dd47b req-9ef97a68-257e-4cdd-9713-febe8aba6f9d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.874671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15eecf29-d817-4bff-a48d-ecb79f0dd47b req-9ef97a68-257e-4cdd-9713-febe8aba6f9d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.875408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15eecf29-d817-4bff-a48d-ecb79f0dd47b req-9ef97a68-257e-4cdd-9713-febe8aba6f9d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.890974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-15eecf29-d817-4bff-a48d-ecb79f0dd47b req-9ef97a68-257e-4cdd-9713-febe8aba6f9d service nova] Creating event network-vif-unplugged:a0563ed8-9a3b-4299-86a4-2c34a36d20a0 for instance 71bab135-352c-4a58-932b-d2624d52cc15 on n-h2-854121-14 Oct 17 13:21:07.898087 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-15eecf29-d817-4bff-a48d-ecb79f0dd47b req-9ef97a68-257e-4cdd-9713-febe8aba6f9d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064386 Oct 17 13:21:07.899648 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 688/1311] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:07.909285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:07.910462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:07.917330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.918159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.919191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:07.920843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:07.922266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:07.923905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.017681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.035892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.037373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.038556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19577d89-fb5a-4afc-b8e9-25f5b4f201ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.464744 Oct 17 13:21:08.067556 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 624/1312] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:07 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:08.082309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:08.084360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:08.092761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.094924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.095660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.097021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.097841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.098447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.386541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.402547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96bdc913-a5fc-4202-9390-09a183d59395 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1488 microversion: 2.1 time: 0.332642 Oct 17 13:21:08.404022 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 625/1313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:08 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1488 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:08.412767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:08.413420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:08.456665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.457755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.458550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.459731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.460942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.461699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.647835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.657573 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-016cc8bc-4ac4-4043-ad62-4d8c123d8645 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1527 microversion: 2.1 time: 0.756285 Oct 17 13:21:08.674385 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 689/1314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:07 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1527 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:08.674385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:08.674385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:08.686522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.688141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.689419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.690101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.691262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.697309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.698857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.709130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.712930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:08.720991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-acc618ea-334e-407e-a714-7ecfa3b2ef77 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1533 microversion: 2.91 time: 0.315827 Oct 17 13:21:08.722258 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 626/1315] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:08 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1533 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:08.734918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b60cff8-a0b8-426d-87c7-04a3777b3adc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:08.750751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b60cff8-a0b8-426d-87c7-04a3777b3adc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:08.753320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b60cff8-a0b8-426d-87c7-04a3777b3adc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:08.754018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b60cff8-a0b8-426d-87c7-04a3777b3adc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:08.950728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b60cff8-a0b8-426d-87c7-04a3777b3adc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:21:09.069501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b60cff8-a0b8-426d-87c7-04a3777b3adc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7/action" status: 202 len: 0 microversion: 2.1 time: 0.341416 Oct 17 13:21:09.081884 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 627/1316] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:21:08 2022] POST /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:21:09.100999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:09.102228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] [instance: a5f2435d-e49a-476d-aa52-b26661881968] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:09.115097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.115597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.116034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.124084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.124599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.125051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.171635 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] HTTP exception thrown: Instance a5f2435d-e49a-476d-aa52-b26661881968 could not be found. Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Request method failure captured: Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 HTTP/1.1 Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVYzUEby6bgMzUIZFvbL_o0UmivozSmrJaEPdl0mhZ51XFB-a8yJ9Tw0ChrWL1v1uNNuQVvtWYCWJ9b8GpS5NcbvNHdy-biMqFB7ZJYBUl5S_kWeoK4953rSo3jso-P5JeFJ0-sk40R-Iswj15Y3uDClL9oVLtvS-4hlrWMzrojx534 Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: dca83ede7465446dad54fe79943fa68f Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestBootFromVolume-1080760360 Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:21:09.173699 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dca83ede7465446dad54fe79943fa68f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dca83ede7465446dad54fe79943fa68f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dca83ede7465446dad54fe79943fa68f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dca83ede7465446dad54fe79943fa68f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestBootFromVolume-1080760360 Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: dca83ede7465446dad54fe79943fa68f Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1080760360 Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestBootFromVolume-1080760360-project Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 642e0a16be6b4a6d876b7187720f544a Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestBootFromVolume-1080760360-project Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance a5f2435d-e49a-476d-aa52-b26661881968 could not be found. Oct 17 13:21:09.175472 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a5f2435d-e49a-476d-aa52-b26661881968'} Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5f2435d-e49a-476d-aa52-b26661881968 could not be found. Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:09.176510 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5f2435d-e49a-476d-aa52-b26661881968 could not be found. Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5f2435d-e49a-476d-aa52-b26661881968 could not be found. Oct 17 13:21:09.178128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:09.179659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:09.190184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Returning 404 to user: Instance a5f2435d-e49a-476d-aa52-b26661881968 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:09.198761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-56694e4c-39bf-4e6b-9563-5748aa7394b0 tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968" status: 404 len: 111 microversion: 2.1 time: 0.115155 Oct 17 13:21:09.199980 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 628/1317] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:09 2022] GET /compute/v2.1/servers/a5f2435d-e49a-476d-aa52-b26661881968 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:09.200172 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc711b59-77a2-47ba-be2f-68da21a92c46 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.534556 Oct 17 13:21:09.205587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 690/1318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:08 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:09.220103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:09.220103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:09.220103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.220103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.220455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.220455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.220455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.220455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.238493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:09.239472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:09.255120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.255973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.256614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.257581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.258351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.258967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.462617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lazy-loading 'services' on Instance uuid c681d09b-d520-40d3-90a6-4cc5e3d169d8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:09.510194 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba65abed-b8ae-4b47-90ad-948af7d6d05f tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1940 microversion: 2.91 time: 0.308707 Oct 17 13:21:09.511219 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 629/1319] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:09 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1940 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:09.524445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:09.525432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:09.535848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.538783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.539371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.541789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.543315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.544692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.855879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:09.868351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-849b987d-b412-4bc9-b3ce-4a55ec1969c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.660906 Oct 17 13:21:09.871325 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 691/1320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:09 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:09.895026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:09.896660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:09.936205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.940618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.941687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:09.942679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:09.943351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:09.945500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.123952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:10.150453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:10.151906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:10.153725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a40b2ca-b427-4931-a6a2-ddba17819335 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.632977 Oct 17 13:21:10.154291 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 630/1321] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:09 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:10.174538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-028b6236-efec-4a11-94ec-ebb02891cb4f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] Calling method '.version_select at 0x7f419dc1d280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.215001 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-028b6236-efec-4a11-94ec-ebb02891cb4f tempest-ServersTestBootFromVolume-1080760360 tempest-ServersTestBootFromVolume-1080760360-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-612647919" status: 202 len: 0 microversion: 2.1 time: 0.059572 Oct 17 13:21:10.216935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 631/1322] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-612647919 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:21:10.228189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:10.228593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.246184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.246642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.247084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.247806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.248856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.249325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.310771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lazy-loading 'flavor' on Instance uuid c681d09b-d520-40d3-90a6-4cc5e3d169d8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:10.325366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:10.362701 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91860f81-f17f-472d-a608-484bb14e854d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.487591 Oct 17 13:21:10.363503 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 692/1323] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:09 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:10.377398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.379162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.406259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.406936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.409525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.415128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.415932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.418417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.508156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.508923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.510007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.510973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lazy-loading 'fault' on Instance uuid 71bab135-352c-4a58-932b-d2624d52cc15 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:10.580149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:10.604038 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab842dda-a856-4051-8b3b-7eec7b9d5311 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1315 microversion: 2.1 time: 0.238840 Oct 17 13:21:10.625540 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 693/1324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:10 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:10.643096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e1d5953c-de32-4223-bd28-061a3a1fb0cf req-c3cf2149-34a4-45c4-903e-8bfb7ef56473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bab135-352c-4a58-932b-d2624d52cc15", "name": "network-vif-deleted", "tag": "a0563ed8-9a3b-4299-86a4-2c34a36d20a0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:10.658964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e1d5953c-de32-4223-bd28-061a3a1fb0cf req-c3cf2149-34a4-45c4-903e-8bfb7ef56473 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.660688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e1d5953c-de32-4223-bd28-061a3a1fb0cf req-c3cf2149-34a4-45c4-903e-8bfb7ef56473 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.661644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e1d5953c-de32-4223-bd28-061a3a1fb0cf req-c3cf2149-34a4-45c4-903e-8bfb7ef56473 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.682854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e1d5953c-de32-4223-bd28-061a3a1fb0cf req-c3cf2149-34a4-45c4-903e-8bfb7ef56473 service nova] Creating event network-vif-deleted:a0563ed8-9a3b-4299-86a4-2c34a36d20a0 for instance 71bab135-352c-4a58-932b-d2624d52cc15 on n-h2-854121-14 Oct 17 13:21:10.700192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e1d5953c-de32-4223-bd28-061a3a1fb0cf req-c3cf2149-34a4-45c4-903e-8bfb7ef56473 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073040 Oct 17 13:21:10.715688 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 694/1325] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:10.717447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea156b3d-2954-4e72-b345-4826f307c984 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action" status: 202 len: 0 microversion: 2.91 time: 0.498651 Oct 17 13:21:10.718203 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 632/1326] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:21:10 2022] POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:10.727788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.730345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.731607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.732433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.745703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.748643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.749582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.750993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.751975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.752762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.753693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.754546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.755225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.756188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.758176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.758851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.794142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] HTTP exception thrown: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Request method failure captured: Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 HTTP/1.1 Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW97KKUFsQ92Rk-dgDwj4F4SI_F0PD-MOKdHYiz2yllEgnov5Z72EONG_ehLmmnt6H8lFenJdRJX6YCIJfOfkedBUJb7seJtCpVYoob59TElG1YvvnFmvPXF35wjZHm5ShceQSkIEHS_-ss_VHomhJfJE1dRsm6LTp2RS1dDvIRd1s Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1f0d21470cf449d1a0edab843f31ce7e Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:21:10.796781 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1f0d21470cf449d1a0edab843f31ce7e Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachSCSIVolumeTestJSON-1744368663-project Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 0437fbd647094f76bba5f9bed9b6c053 Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1744368663-project Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:10.798323 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f61b456a-dc6e-47dc-bab8-88eb35727c92'} Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:10.799153 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:10.800489 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:10.805595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Returning 404 to user: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:10.807674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d83af1f4-9e8c-4aed-99f5-bd158298956d tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 404 len: 111 microversion: 2.1 time: 0.088230 Oct 17 13:21:10.813616 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 633/1327] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:21:10 2022] DELETE /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:10.819711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:10.823072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:10.847284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.848657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.849413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.850408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:10.856988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:10.857849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:10.990998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.004720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.006455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.019896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78d44d6b-193c-4076-9703-ac4004fd114d tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.204720 Oct 17 13:21:11.022618 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 634/1328] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:10 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:11.029750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.033925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] [instance: f61b456a-dc6e-47dc-bab8-88eb35727c92] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.057053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.057745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.058295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.060314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.062779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.063355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.072815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.083195 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3df739e-b57c-4ff6-8da7-4d8b76315b7c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.362225 Oct 17 13:21:11.107309 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 695/1329] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:10 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:11.107309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.107309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.107782 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] HTTP exception thrown: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Request method failure captured: Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 HTTP/1.1 Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW97KKUFsQ92Rk-dgDwj4F4SI_F0PD-MOKdHYiz2yllEgnov5Z72EONG_ehLmmnt6H8lFenJdRJX6YCIJfOfkedBUJb7seJtCpVYoob59TElG1YvvnFmvPXF35wjZHm5ShceQSkIEHS_-ss_VHomhJfJE1dRsm6LTp2RS1dDvIRd1s Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1f0d21470cf449d1a0edab843f31ce7e Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:21:11.108807 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1f0d21470cf449d1a0edab843f31ce7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1f0d21470cf449d1a0edab843f31ce7e Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1744368663 Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachSCSIVolumeTestJSON-1744368663-project Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 0437fbd647094f76bba5f9bed9b6c053 Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1744368663-project Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:11.110388 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f61b456a-dc6e-47dc-bab8-88eb35727c92'} Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:11.111277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. Oct 17 13:21:11.112619 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:11.115479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] Returning 404 to user: Instance f61b456a-dc6e-47dc-bab8-88eb35727c92 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:11.117074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2d32949-e3ff-47b1-b1b2-5b190e657948 tempest-AttachSCSIVolumeTestJSON-1744368663 tempest-AttachSCSIVolumeTestJSON-1744368663-project] 10.222.0.65 "GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92" status: 404 len: 111 microversion: 2.1 time: 0.093290 Oct 17 13:21:11.118082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.118838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.120234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.120716 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 635/1330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:11 2022] GET /compute/v2.1/servers/f61b456a-dc6e-47dc-bab8-88eb35727c92 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:11.121788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.122478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.130498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.148100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:11.188945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.189769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.200635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.206955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.207699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.208551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.214282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.214984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.715350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.731994 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02bdf423-6bdd-4c6a-a054-059f70fbd1a6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.635187 Oct 17 13:21:11.735872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 696/1331] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:11 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:11.743886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.751645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.775221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.776367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.780244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.782986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.783980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.784462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.784900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.801075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.801075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:11.801075 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df9abfbc-9f92-4943-b703-0cb9d7a47474 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.610532 Oct 17 13:21:11.829916 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 636/1332] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:11 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:21:11.846972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:11.849441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:11.881936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.886818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.888258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.890956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.897122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.898581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.988211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:11.988932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:11.989738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:11.990533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lazy-loading 'fault' on Instance uuid 71bab135-352c-4a58-932b-d2624d52cc15 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:12.197499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.213951 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a108b04-8d0f-4685-8db6-89bb2605b62b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 200 len: 1315 microversion: 2.1 time: 0.386454 Oct 17 13:21:12.213951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 637/1333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:11 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:12.226372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:12.227045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:12.251173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.251673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.252114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.252838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.253343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.253779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.326514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.349458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8ab49c4-7123-43e6-9251-b5359f70e97d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.610353 Oct 17 13:21:12.350920 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 697/1334] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:11 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:12.356674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:12.357597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:12.364338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.365031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.365710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.366608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.367219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.368564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.385246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.396883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.414186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.443575 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-daee3c5c-b649-41d5-9c69-ed4f5ec039ee tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.229372 Oct 17 13:21:12.445365 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 638/1335] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:12 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:12.765570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:12.766485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:12.780581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.781487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.782094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.783001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:12.783621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:12.784213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:12.956756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:12.972278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b0a5ebf-4b57-4f48-8201-24c65397a3d6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.615051 Oct 17 13:21:12.973049 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 698/1336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:12 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:12.981027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:12.988499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:12.999805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.003026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.004455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.008798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.009593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.010264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.692920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.707152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.728038 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db9023ec-8070-4be0-97bb-bdbfc29d1bfc tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.966707 Oct 17 13:21:13.734327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.736191 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 639/1337] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:12 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:13.743840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:13.745996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:13.770862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:13.771304 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42a91892-310b-4ba3-bd1f-26e0cc6d6a00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.795149 Oct 17 13:21:13.795805 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 699/1338] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:12 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:13.798177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.799144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.799797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.800949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.803695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.804421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.817553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:13.819201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:13.825583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:13.854374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.856492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.857436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.863408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.864254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.864950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.871064 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 HTTP/1.1 Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:21:13.873035 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:21:13.874854 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '71bab135-352c-4a58-932b-d2624d52cc15'} Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:13.875847 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:21:13.877478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:21:13.892661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:13.894077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3e5dc63-9929-48d5-bc73-124addd5c1f4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 404 len: 111 microversion: 2.1 time: 0.156115 Oct 17 13:21:13.904943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 640/1339] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:13 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:13.934691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:13.935344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:13.955440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.955956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.956417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:13.957143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:13.957639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:13.958072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:14.179891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:14.197303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:14.201052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:14.218719 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30834fe8-d214-4dc4-bec7-d2819e3186b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.299401 Oct 17 13:21:14.224540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 641/1340] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:13 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:14.231882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:14.232446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:14.260684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:14.261102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:14.261577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:14.262339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:14.262799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:14.263332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:14.853835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:14.871846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0738df77-399d-4001-a1ce-364364725d25 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 1.073907 Oct 17 13:21:14.876318 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 700/1341] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:13 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:14.895629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-724652729", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:15.041952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] validate_networks() for [('c64945a6-1527-421a-8b9c-d3ac046e1a62', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:21:15.769612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:15.788403 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b85881a-c2d1-4c3a-a02b-1b1a20440bec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 1.559583 Oct 17 13:21:15.792306 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 642/1342] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:14 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:15.819222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:15.819867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:15.846431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:15.849663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:15.850124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:15.850878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:15.859025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:15.859531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.299030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.323467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddaca31b-7c67-49fe-b213-be53bc151ffb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.525763 Oct 17 13:21:16.330328 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 643/1343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:15 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:16.342391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:16.343338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:16.353494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:16.355344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.359489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.360286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.361335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.361979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.362612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.458450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:21:16.458943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:21:16.459351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:21:16.459768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:21:16.483760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:21:16.499174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.499938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.500545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.501538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.502177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.502780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.556379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for project 97f2a1e99d30456384a574e0641513a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:21:16.579521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Getting quotas for user aba657aa5e344ba3b3a61d9096941a52 and project 97f2a1e99d30456384a574e0641513a5. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:21:16.596729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:21:16.601293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:21:16.682693 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f767b118-cf80-4553-9a88-f2d12399f3c1 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.803770 Oct 17 13:21:16.684677 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 701/1344] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:21:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:21:16.690558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:16.691813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:16.698965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.700745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.701804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.702731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:16.703352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:16.703952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:16.845104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.860326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.878750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.904614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.915281 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29dae0b7-1f2a-4682-9978-935222f2707c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.228927 Oct 17 13:21:16.916182 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 702/1345] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:16 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:16.923393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.933771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:16.938782 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90742904-474c-4c81-b3d1-5e28bc9d89ca tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.604581 Oct 17 13:21:16.939364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:16.939996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:16.943148 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 644/1346] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:16 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:16.954713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-354f37af-391f-429e-b6fc-3e47feae66cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:16.960925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-354f37af-391f-429e-b6fc-3e47feae66cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:17.000813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.001657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.002255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.003941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.005707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.006343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.398793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-354f37af-391f-429e-b6fc-3e47feae66cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:17.412629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-354f37af-391f-429e-b6fc-3e47feae66cb tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1224 microversion: 2.1 time: 0.466776 Oct 17 13:21:17.418958 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 645/1347] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:16 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1224 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:17.445105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:17.446778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:17.447455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:17.459925 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63ae8012-b4e1-4e08-ac99-59aff28ccab6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.539067 Oct 17 13:21:17.464606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.466758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.481146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.484578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.484734 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 703/1348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:16 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:17.485475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.487367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.489436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:17.490048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:17.519958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.524399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.528469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:17.531175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:17.531925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:17.532610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.294680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.311200 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e97a2d5-f82f-48da-93a9-a58fc6f4aea7 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.874658 Oct 17 13:21:18.314754 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 646/1349] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:17 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:18.328826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:18.331436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:18.351469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.353686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.354455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.355462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.356654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.357553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.636766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.648310 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84dec175-fc89-4d93-b08c-ee63ff2af79b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 1.162529 Oct 17 13:21:18.649092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 704/1350] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:17 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:18.657076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.659485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:18.664461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:18.667747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.672625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.686797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-616aebea-09fb-4a5d-ace2-2c6c7e1b1be1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.370656 Oct 17 13:21:18.702022 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 647/1351] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:18 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:18.720052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.720714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.721689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.722989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.723697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.724361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.725961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:18.732271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:18.745261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.745757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.746768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.747594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.748044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.748465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.917337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:18.929967 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c15ff42-4f6b-44ca-919e-d9b0e996585b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1276 microversion: 2.1 time: 0.226469 Oct 17 13:21:18.955750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 648/1352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:18 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:18.965883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:18.966827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:18.976167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.977522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.978125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.979025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:18.979635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:18.981338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:18.995262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:19.006653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:19.022401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:19.024991 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e30f2176-db47-4c03-81eb-9d26776d3974 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.374742 Oct 17 13:21:19.041190 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 705/1353] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:18 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:19.338788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:19.339664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:19.354948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.357789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.358847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:19.366597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.367359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.368267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:19.900864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:19.928443 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc68987f-d4fc-4b8e-a000-88f8afbab45e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.971036 Oct 17 13:21:19.938217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 649/1354] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:18 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:19.960680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:19.961701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:19.981861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.983132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.984676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:19.986704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:19.987917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:19.989022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.395899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.419610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b704e66a-bb7b-4f37-8cd9-8970138af5f8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 1.086512 Oct 17 13:21:20.426445 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 706/1355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:19 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:20.432909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:20.436406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:20.445465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:20.449956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:20.451861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:20.452501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.453441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:20.454243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:20.454849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.604153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.624301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.628376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.651443 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed544d46-af58-490d-bace-b7f69c80f810 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.221442 Oct 17 13:21:20.652318 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 707/1356] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:20 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:20.673493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:20.675417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:20.685038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:20.686012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:20.686796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.687728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:20.688531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:20.689500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.707403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:20.728289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ef1c797-6fdb-45d0-9161-4a521c6660a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.788241 Oct 17 13:21:20.741565 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 650/1357] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:19 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:20.757195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:20.758690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:20.767050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:20.767810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:20.768443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:20.769383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:20.769997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:20.771284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.042147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:21.058126 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20e56d89-a75b-418b-a0ee-56b426dd9328 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1282 microversion: 2.1 time: 0.395844 Oct 17 13:21:21.060116 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 708/1358] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:20 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1282 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:21.069613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:21.072489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:21.088875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.090152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.091456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.093138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.094070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.094764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.523355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:21.541507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:21.544613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:21.547170 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f03b767a-e792-4ec5-827a-b420cad89287 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.803883 Oct 17 13:21:21.548076 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 651/1359] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:20 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:21.555208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:21.556391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:21.564552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.565569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.566730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.568501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.569743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.570447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.832652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:21.856343 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d47fca92-1998-47e1-b176-a1ffc84d301c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.792316 Oct 17 13:21:21.857339 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 709/1360] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:21 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:21.868152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:21.870268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:21.885104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.885904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.886607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:21.888148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:21.888648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:21.889069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.066905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.075607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.077346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.083972 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c59018f4-4841-4d1c-9ef2-cb65b4b61e4a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.225281 Oct 17 13:21:22.089035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.104986 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 710/1361] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:21 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:22.112871 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49902f97-9549-4407-8a27-991918b96e07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1718 microversion: 2.1 time: 0.563447 Oct 17 13:21:22.113430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:22.113842 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 652/1362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:21 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1718 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:22.119036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:22.122720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:22.126102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:22.137763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.138590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.139212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.140089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.140707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.141397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.144740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.145284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.145817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.146800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.147171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.147613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.335177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.349965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a483017-bf0b-43a6-84ba-73f8afbe53c5 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1282 microversion: 2.1 time: 0.234762 Oct 17 13:21:22.351116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 653/1363] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:22 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:22.503893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:22.513365 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0587658-7646-4387-b3fb-9df3bbc0a75d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.406214 Oct 17 13:21:22.513898 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 711/1364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:22 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:22.579573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:22.580239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:22.599187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.600246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.600735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.601821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.602449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.603046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.922251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:22.925800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:22.950475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.951354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.952128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:22.953301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:22.953988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:22.961126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.179603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.193242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.215641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.221079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-09150d11-38b1-444c-8b12-1e67f57eb93e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.645233 Oct 17 13:21:23.226753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 654/1365] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:22 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:23.239673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:23.242200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:23.259910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.260577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.261035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.261846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.262461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.266236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.894686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.907821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.912128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:23.924862 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3eedc2dd-07ed-4298-a4a0-bf0f864c57f9 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.694418 Oct 17 13:21:23.926926 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 655/1366] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:23 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:23.936865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:23.938252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:23.953779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.955873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.956508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:23.958121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:23.959327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:23.960960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.073494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:24.083915 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac13d4be-0df0-42b2-95f0-637c979f26fb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 1.184428 Oct 17 13:21:24.091000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 712/1367] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:22 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:24.109495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:24.110127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:24.122613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.123163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.123797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.124677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.125199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.125732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.178162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:24.482408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:24.496748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38c850b2-538b-47de-9a17-a8ddf7c6a121 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1708 microversion: 2.1 time: 0.568578 Oct 17 13:21:24.497493 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 656/1368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:23 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1708 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:24.511375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:24.512550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:24.523115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.523942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.524702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.526863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.535463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.536427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.591338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:24.624372 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e5f2193-1d7c-4ca9-8155-49ed37c3cdd2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.532000 Oct 17 13:21:24.625066 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 713/1369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:24 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:24.646356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:24.647391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:24.661772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.662999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.663617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:24.664525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:24.665147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:24.665782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.169328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.180153 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38cc9fcb-9413-4c2c-aa4d-55ab0d4ef19c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.681379 Oct 17 13:21:25.181969 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 657/1370] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:24 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:25.190314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0f699d1-5df3-4c07-8cac-c1e286e6276e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '.version_select at 0x7f419f6c28b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:25.195955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0f699d1-5df3-4c07-8cac-c1e286e6276e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.197400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0f699d1-5df3-4c07-8cac-c1e286e6276e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.198416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0f699d1-5df3-4c07-8cac-c1e286e6276e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.203146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.212972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0f699d1-5df3-4c07-8cac-c1e286e6276e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 2339 microversion: 2.1 time: 0.029519 Oct 17 13:21:25.222671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.225242 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 658/1371] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:21:25 2022] GET /compute/v2.1/os-migrations => generated 2339 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:25.228492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.240929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:25.243039 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e3448f8-4860-4a02-b3ac-c01758aee123 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.605724 Oct 17 13:21:25.243566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:25.243945 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 714/1372] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:24 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:25.260437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.261245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.262089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.263529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.264298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.276706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.287184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:25.290245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:25.303190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:25.331440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.332209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.344480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.345706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.346356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.346946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.418513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.447337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.449349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.460299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc56de79-e7f4-45a7-9199-f906440dc028 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.233559 Oct 17 13:21:25.462709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 659/1373] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:25 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:25.494418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:25.495046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:25.503718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.504492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.505099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.506006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.506652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.507246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.935733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:25.948332 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9cbeb1f3-46c8-44da-909e-1db0c504dc3f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.690358 Oct 17 13:21:25.966029 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 715/1374] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:25 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:25.972454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:25.973436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:25.980876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.981896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.982573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:25.983753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:25.984454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:25.985306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.111297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2d69c09-1995-442a-a468-2ba80e51cf33 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1861 microversion: 2.1 time: 0.647081 Oct 17 13:21:26.112500 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 660/1375] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:25 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1861 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:26.138414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:26.139285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:26.155799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.156299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.156735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.157602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.158058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.158499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.515300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:26.589675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:26.704922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:26.717005 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4079eb1-0eaf-497c-8707-e43e8f006960 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.749113 Oct 17 13:21:26.717674 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 716/1376] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:25 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:26.732602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:26.734649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:26.747629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.748128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.748732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.750625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:26.751412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:26.754190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:26.963825 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ed2731c-f8cd-47fb-98e6-8e020184ab37 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1861 microversion: 2.1 time: 0.828943 Oct 17 13:21:26.967484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 661/1377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:26 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1861 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:26.977881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:26.981944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:27.000960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.003592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.008152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.010932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.011708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.013728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.394320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.406751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:27.420844 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d936385f-c743-477e-a6d8-ee8413a490b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.702018 Oct 17 13:21:27.426498 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 717/1378] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:26 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:27.460604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:27.467041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:27.483947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.485780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.486460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.490120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.492501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.493996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.743694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.759027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.769188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:27.785805 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed470c30-da83-40a3-8c32-91b9ac92fe16 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.356940 Oct 17 13:21:27.788751 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 718/1379] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:27 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:27.815523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:27.818069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:27.841625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.842521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.844023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:27.845030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:27.846669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:27.847351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.072570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:28.087983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:28.094374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:28.095705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28ff2eb9-0b4b-4f67-96ad-9b337bab7c13 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 1.126949 Oct 17 13:21:28.096856 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 662/1380] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:26 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:28.101649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d6e7d85f-ee9a-4528-b863-2ed36b7f5336 req-afef0154-2a14-48eb-865c-a24a0b1dac40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a864c636-4238-4a92-91d4-7cd5d4422893", "tag": "e103cc3d-b441-4566-aa59-38c5349af038"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:28.128839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d6e7d85f-ee9a-4528-b863-2ed36b7f5336 req-afef0154-2a14-48eb-865c-a24a0b1dac40 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.135279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d6e7d85f-ee9a-4528-b863-2ed36b7f5336 req-afef0154-2a14-48eb-865c-a24a0b1dac40 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.136014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d6e7d85f-ee9a-4528-b863-2ed36b7f5336 req-afef0154-2a14-48eb-865c-a24a0b1dac40 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.163349 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d6e7d85f-ee9a-4528-b863-2ed36b7f5336 req-afef0154-2a14-48eb-865c-a24a0b1dac40 service nova] Creating event network-changed:e103cc3d-b441-4566-aa59-38c5349af038 for instance a864c636-4238-4a92-91d4-7cd5d4422893 on n-h2-854121-14 Oct 17 13:21:28.182956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d6e7d85f-ee9a-4528-b863-2ed36b7f5336 req-afef0154-2a14-48eb-865c-a24a0b1dac40 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084797 Oct 17 13:21:28.189379 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 663/1381] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:28.201249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:28.207580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:28.219152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.220373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.227929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.228997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.229670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.231261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.400456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:28.409919 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14313a4d-4866-49f4-a8f7-0905101e9955 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.618034 Oct 17 13:21:28.410509 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 719/1382] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:27 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:28.460182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:28.460821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:28.473540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.474043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.474491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.475216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.475671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.476256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.492319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lazy-loading 'services' on Instance uuid 45ff27cf-dee5-48e5-938c-f98c803813be {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:21:28.655159 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6d8e634-1b42-421b-b2b1-78ee14799b5b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "DELETE /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments/72cd4f5d-3578-4059-9f31-c198a7e2033b" status: 202 len: 0 microversion: 2.1 time: 0.462591 Oct 17 13:21:28.660298 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 664/1383] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:21:28 2022] DELETE /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments/72cd4f5d-3578-4059-9f31-c198a7e2033b => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:21:28.669396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:28.671953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:28.682691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.683538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.685322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:28.687215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:28.693349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:28.695012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.116718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:29.129957 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8347b8b-e1df-407f-a029-e490233c3b46 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.712284 Oct 17 13:21:29.130238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:29.131061 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 720/1384] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:28 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:29.137578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:29.140419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:29.147634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.148644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.149339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.150331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.151037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.151802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.159614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af44d122-154b-4564-b8fe-d360168b493f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.497581 Oct 17 13:21:29.160220 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 665/1385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:28 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:29.178561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:29.179531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:29.187004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.190305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.198247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.199438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.200120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.200745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.242766 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb64d904-902b-43c7-ba77-1c747f49350a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110426 Oct 17 13:21:29.244769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 721/1386] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:29 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:29.263792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:29.264477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:29.291182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.291710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.292144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.293463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:29.293936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:29.294369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:29.974234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:29.988869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:29.992968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.010907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00067205-0914-49b5-9242-1d4b6c5efccc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.836148 Oct 17 13:21:30.012864 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 666/1387] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:29 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:30.031823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:30.034351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:30.054098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.055540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.056216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.059501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.060311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.062110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.346285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.364400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b93f2d4-1ec3-457a-934e-89c83c922b15 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.343086 Oct 17 13:21:30.377198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 667/1388] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:30 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:30.377475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.377941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:30.377941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:30.379262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.379772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.380214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.384035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.384035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.384035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.401033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.405955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.407671 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de0443f2-128b-46d9-ae51-f54ab56a038e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 1.161685 Oct 17 13:21:30.438728 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 722/1389] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:29 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:30.450675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:30.451744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:30.459903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.460797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.461536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.462881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.463623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.464302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.814818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.826510 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcf91d64-1b8c-4e9d-9644-d64058620136 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.459877 Oct 17 13:21:30.827434 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 668/1390] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:30 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:30.834009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:30.834929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:30.838266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:30.851052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.851870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.852475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.853392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:30.853931 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d3f3d64-86a5-4186-8ea1-4f9f976b59b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 0.412619 Oct 17 13:21:30.863565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:30.866565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:30.868422 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 723/1391] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:30 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:30.959332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6ccb679-61b3-425f-abd9-fc4ea4390f07 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127967 Oct 17 13:21:30.962392 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 669/1392] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:30 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:31.044567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:31.045519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:31.061465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.061884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.062333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:31.063058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.063517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.063971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:31.255649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:31.267685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:31.269897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:31.312218 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61b61bf7-af5e-487f-9f2b-50b8f7c937ff tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.260991 Oct 17 13:21:31.334590 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 724/1393] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:31 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:31.392299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:31.392924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:31.407615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.408469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.408911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:31.409653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.410111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.410530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:31.440309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:31.441879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:31.458059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.459966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.462980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:31.468343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:31.470820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:31.471464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:32.273294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:32.294601 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-13b1be00-6192-4ac2-81cc-98ddabff1b31 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.904134 Oct 17 13:21:32.298964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 670/1394] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:31 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:32.313915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:32.315716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:32.336523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:32.338828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:32.339543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:32.341043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:32.343836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:32.344735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:32.435564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:32.453600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:32.466190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:32.471416 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3b61ca44-5bfa-4529-97a1-3de2fd80c30f tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 1.033277 Oct 17 13:21:32.476882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 725/1395] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:31 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:32.498732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:32.499530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:32.517939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:32.519001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:32.521810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:32.522768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:32.523477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:32.525612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:32.999230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.027915 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58f3b046-bc32-4401-aa67-360e9eacf5af tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.726186 Oct 17 13:21:33.043286 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 671/1396] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:32 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:33.055285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:33.057542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:33.074916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.075421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.075955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.076969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.077135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.081811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.162167 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad8cdd03-0db2-4907-8af6-343f61e5db8e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117308 Oct 17 13:21:33.164004 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 672/1397] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:33 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:33.174131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:33.175016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:33.184298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.185267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.185903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.186862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.188487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.204711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.440003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.455678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.457913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.470818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2053e653-5766-4add-8cef-ef7ce18f8e01 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.304949 Oct 17 13:21:33.471421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 673/1398] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:33 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:33.484699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:33.487865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:33.502805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.503294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.503733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.504437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.504884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.507967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.540795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:33.557302 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2416a56-1875-403e-b8c4-eefd59baf19e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1684 microversion: 2.1 time: 1.077576 Oct 17 13:21:33.559536 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 726/1399] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:32 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1684 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:33.577186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:33.577818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:33.594470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.595148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.595601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:33.596322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:33.596780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:33.597222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.189692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.201149 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1d27dee2-95a0-41b3-9d2b-2200c38bf9af tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.728616 Oct 17 13:21:34.203509 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 674/1400] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:33 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:34.209991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:34.210955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:34.224715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.230137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.231457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.232694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.233412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.234327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.264357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.279589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.281560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.283344 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0147cd75-b840-4e83-a994-54f13037fd58 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.720271 Oct 17 13:21:34.284549 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 727/1401] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:33 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:34.290384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:34.294274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:34.301779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.302845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.303752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.304739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.305423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.306231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.402857 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e87b600-2c2f-4887-bfce-4f5d4c447b54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116196 Oct 17 13:21:34.407238 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 728/1402] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:34 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:34.492050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.501571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:34.503956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8471eb77-2095-424d-a2be-d19a0e9b335f tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.299376 Oct 17 13:21:34.504577 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 675/1403] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:34 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:34.509595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:34.510284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:34.530046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.530626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.531068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.531916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.532363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.532898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.590456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:34.591526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:34.600621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.601533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.602768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.603900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:34.604601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:34.605319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:34.722846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.738322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.748245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.773376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e6552b1-075f-48b1-90a3-75a90d22c1b2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.263818 Oct 17 13:21:34.774031 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 729/1404] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:34 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:34.943072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:34.984241 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca68e06d-72d8-4265-8428-13fc7f2fdd34 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.399722 Oct 17 13:21:34.987392 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 676/1405] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:34 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:35.105497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:35.106198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:35.118212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.119012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.119636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.120727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.122169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.123880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.130936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:35.230003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:35.231454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:35.241930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.242770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.243547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.244451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.245096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.245735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.450892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:35.462298 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9b0f25c-9cdc-4012-bd98-31b600c70250 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.361975 Oct 17 13:21:35.474018 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 730/1406] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:35 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:35.480961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:35.494732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a81cbbe7-a539-4430-aa61-77788b0e7e1e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.270768 Oct 17 13:21:35.502763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:35.504570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 677/1407] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:35 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:35.506221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:35.526101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:35.531905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.533907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.534464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.536395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:35.537790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.538392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.541865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.544928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.545735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.546577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.549700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.550908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.551693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.616235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-956cb257-a4ca-4899-8bcf-2b4cf8558532 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101806 Oct 17 13:21:35.616946 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 678/1408] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:35 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:35.627057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:35.628805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:35.645450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.646162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.646830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:35.647741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:35.651620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:35.652845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.227854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.253475 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ccdcd1ce-666e-4082-ad13-adfa9a0b2458 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.630786 Oct 17 13:21:36.255264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 679/1409] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:35 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:36.290539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:36.292354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:36.312614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.316072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.319386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.321729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.324588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.330398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.363737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.384432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.386456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.390878 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3667f204-5707-401c-88f0-53c81d06e16b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.905951 Oct 17 13:21:36.392076 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 731/1410] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:35 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:36.512273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.524054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:36.524668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:36.558026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.558770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.567252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:36.570292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.571028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.572008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.572752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.574531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.591533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-839a6eaa-cc30-4276-812d-9526dd262233 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.314084 Oct 17 13:21:36.595531 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 680/1411] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:36 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:36.614268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c3a44fac-c3e3-4112-9052-e638ee280d47 req-aa800ba3-58ad-4521-9cb6-6c3dbe33e0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a864c636-4238-4a92-91d4-7cd5d4422893", "name": "network-vif-plugged", "status": "completed", "tag": "e103cc3d-b441-4566-aa59-38c5349af038"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:36.683347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c3a44fac-c3e3-4112-9052-e638ee280d47 req-aa800ba3-58ad-4521-9cb6-6c3dbe33e0c2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.687480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c3a44fac-c3e3-4112-9052-e638ee280d47 req-aa800ba3-58ad-4521-9cb6-6c3dbe33e0c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.690175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c3a44fac-c3e3-4112-9052-e638ee280d47 req-aa800ba3-58ad-4521-9cb6-6c3dbe33e0c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.723025 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c3a44fac-c3e3-4112-9052-e638ee280d47 req-aa800ba3-58ad-4521-9cb6-6c3dbe33e0c2 service nova] Creating event network-vif-plugged:e103cc3d-b441-4566-aa59-38c5349af038 for instance a864c636-4238-4a92-91d4-7cd5d4422893 on n-h2-854121-14 Oct 17 13:21:36.730273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c3a44fac-c3e3-4112-9052-e638ee280d47 req-aa800ba3-58ad-4521-9cb6-6c3dbe33e0c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133020 Oct 17 13:21:36.730904 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 681/1412] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:36.741554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:36.749488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:36.768154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.770543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.771002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.771741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:36.772203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:36.772632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:36.844814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d87c75a0-8275-4b44-8d49-1a60e372110d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109753 Oct 17 13:21:36.858117 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 682/1413] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:36 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:37.092828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.107132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3afd001b-c0b1-4e6a-b729-56bf61a6b3a2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.587781 Oct 17 13:21:37.109123 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 732/1414] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:36 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:37.286051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:37.286897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:37.298898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.304964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.305653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.306555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.308902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.311634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.498363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c6ffe9a3-e346-47eb-9c8c-a349c7af6454 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Action: 'create', calling method: .version_select at 0x7f419db4bd30>, body: {"keypair": {"name": "tempest-keypair-2007155954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAz2G11mg1HiDmYgnKwiHtOVBCXEOcFEgXbr0/ZdX633vpmLigoF5R2xdFdzU9IRhPgFdko2mDTmZpGkbzlubUEJM1gF6uSshxLW70ASBg2c7MnE3fYtVry2tufhMoMFQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:37.507012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.521067 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1777b114-2758-40d3-97f9-cfbc23e0246a tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.241444 Oct 17 13:21:37.524103 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 733/1415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:37 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:37.536436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:37.537511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:37.554929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.555430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.555925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.556569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.557017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.557471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.559870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c6ffe9a3-e346-47eb-9c8c-a349c7af6454 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Getting quotas for project 2da28ea822bd4a92bed60c259b24067d. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:21:37.570098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c6ffe9a3-e346-47eb-9c8c-a349c7af6454 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Getting quotas for user 676131cb58654000b52e2493aa159cb5 and project 2da28ea822bd4a92bed60c259b24067d. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:21:37.603724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:37.614472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c6ffe9a3-e346-47eb-9c8c-a349c7af6454 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370325 Oct 17 13:21:37.615753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 683/1416] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:21:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:37.640914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:37.644765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:37.662170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.662532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.662965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.663669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.664116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.664535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.832055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.858563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.864062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.886636 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5936aee-0c6d-4a54-85d5-cd187f67d3af tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.255632 Oct 17 13:21:37.892894 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 684/1417] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:37 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:37.921733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:37.929215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:37.946748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.952114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.954912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.956786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:37.959689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:37.960690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.962202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:37.972875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.977702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:37.979307 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-717021c4-d7c7-47bb-b370-868807bc8536 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.454167 Oct 17 13:21:37.983100 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 734/1418] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:37 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:38.060239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:38.061078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:38.067629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fc3118f-c109-477b-afb2-32c766b14234 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172812 Oct 17 13:21:38.068319 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 685/1419] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:37 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:38.083144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.083665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.084112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.085031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.085560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.085999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.134561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:38.135537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:38.156217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.157024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.157851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.158727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.159344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.160085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.311829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:38.325234 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12e3c59d-4bd8-4d2c-85ca-5932c690b1e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.269071 Oct 17 13:21:38.327980 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 735/1420] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:38 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:38.352190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:38.352909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:38.363905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.364408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.364854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.368516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.370326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.371333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.520898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:38.533210 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5e846fb-dbf5-4bb8-a363-5fa97dfd239b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1498 microversion: 2.1 time: 0.402711 Oct 17 13:21:38.533823 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 686/1421] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:38 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1498 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:38.553418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:38.554397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:38.571255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.572231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.572780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.573717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.576508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.577795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.702889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:38.717600 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc0ef058-8fe0-4a7d-a5bf-0911bb1687a4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.369498 Oct 17 13:21:38.733189 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 736/1422] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:38 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:38.742741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:38.743650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:38.750848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.751435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.751930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:38.752646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:38.753095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:38.753538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.095072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:39.104186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63e3163b-6d38-43f4-b922-a5803c04d891 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1324 microversion: 2.1 time: 0.559675 Oct 17 13:21:39.107036 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 687/1423] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:38 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1324 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:39.115946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:39.129396 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-04e74933-0ccc-413b-8722-6cfbdff67f43 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.390772 Oct 17 13:21:39.131390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6948db8e-bd96-410e-a8f6-5c0e569a3b45 req-f73bea67-ca01-4016-9b26-645034bea155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-unplugged", "status": "completed", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:39.131691 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 737/1424] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:38 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:21:39.163681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:39.168496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:39.178715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6948db8e-bd96-410e-a8f6-5c0e569a3b45 req-f73bea67-ca01-4016-9b26-645034bea155 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.179516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6948db8e-bd96-410e-a8f6-5c0e569a3b45 req-f73bea67-ca01-4016-9b26-645034bea155 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.180591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6948db8e-bd96-410e-a8f6-5c0e569a3b45 req-f73bea67-ca01-4016-9b26-645034bea155 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.187653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.190680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.191263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.193628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.194339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.196167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.212855 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6948db8e-bd96-410e-a8f6-5c0e569a3b45 req-f73bea67-ca01-4016-9b26-645034bea155 service nova] Creating event network-vif-unplugged:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:21:39.230979 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6948db8e-bd96-410e-a8f6-5c0e569a3b45 req-f73bea67-ca01-4016-9b26-645034bea155 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121312 Oct 17 13:21:39.234900 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 688/1425] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:39.242028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:39.248837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:39.268894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.269826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.270607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.271554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.272720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.274290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.341050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:39.351300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:39.353480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:39.360256 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45ec500a-f2ea-4ee9-8db1-a42e53a51b7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.213102 Oct 17 13:21:39.361492 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 738/1426] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:39 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:39.378343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:39.381592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:39.392269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.393046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.393809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.395068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.396023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.396623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.444874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c3d1092-4665-42ca-9492-dcfad0d08f54 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080832 Oct 17 13:21:39.446268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 739/1427] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:39 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:39.453854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:39.457091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:39.475758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.476119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.476669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.477711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.478421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.478867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.596964 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3131531a-422d-4fa2-b76e-48b4e6934afd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.149116 Oct 17 13:21:39.601422 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 740/1428] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:21:39 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:21:39.608969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:39.610113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:39.622183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.623090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.625264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.626866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:39.627561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:39.628199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:39.999777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.021997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.029817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.031649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e4ce5f6-729c-4738-9feb-9f3877da68d0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.795389 Oct 17 13:21:40.032239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 689/1429] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:39 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:40.048158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:40.049675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:40.067945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.068498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.069022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.070797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.071266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.071766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.552044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.570060 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-276f1e7c-a0b1-4cee-8500-ec4fe9abac88 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 200 len: 1475 microversion: 2.1 time: 0.966388 Oct 17 13:21:40.571010 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 741/1430] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:39 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 1475 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:40.579601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:40.580218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:40.598092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.598588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.600447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.601982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.602457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.603166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.891000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:40.904302 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ba19971-6743-444a-8104-8bbf8d6dde5f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1673 microversion: 2.1 time: 0.868759 Oct 17 13:21:40.907769 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 690/1431] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:40 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1673 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:40.912723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:40.916380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:40.929098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.929903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.930511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:40.931386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:40.932005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:40.932596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.068355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:41.090861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:41.092367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:41.111642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6513275b-1df9-4a0a-8b2a-1336cc8e40c2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.202561 Oct 17 13:21:41.112868 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 691/1432] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:40 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:41.130337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:41.135142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:41.144881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.151519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:41.160525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.164004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.165855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.167129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.171505 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-981ce37e-24c0-4f9a-8154-679ec6a530b4 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1521 microversion: 2.1 time: 0.597383 Oct 17 13:21:41.174054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.176975 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 742/1433] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:40 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1521 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:41.197473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-426261029"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:41.208260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:41.243848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.244358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.252563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.253428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.256394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.257699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.284900 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82241b69-6a5c-47c2-bfc9-6f5809692e02 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170632 Oct 17 13:21:41.293273 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 692/1434] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:41 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:41.298488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:41.299570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:41.319823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.321443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.322180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.324834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.326596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.327295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.681273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c05a63d5-f0fd-4481-bac7-2362b7078cd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7/action" status: 202 len: 0 microversion: 2.1 time: 0.502171 Oct 17 13:21:41.688605 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 743/1435] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:21:41 2022] POST /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:21:41.695229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:41.695830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:41.710758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.711247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.712947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.714121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:41.718654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:41.719625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:41.757623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:41.770794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:21:41.957501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e8e6d3a-95c0-42e5-8875-45608ae8b895 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 204 len: 0 microversion: 2.1 time: 0.265525 Oct 17 13:21:41.958937 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 744/1436] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:21:41 2022] DELETE /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:21:41.975525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a17f2f1-b252-46e8-b5f0-c9a5c040af42 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a215dc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:42.053828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a17f2f1-b252-46e8-b5f0-c9a5c040af42 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3" status: 200 len: 1411 microversion: 2.1 time: 0.087485 Oct 17 13:21:42.062982 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 745/1437] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:21:41 2022] GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:42.068897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:42.069821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:42.095192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.095700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.096149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.098771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.099530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.100140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.543441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.560802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.566500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.568187 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b2c67c5-a420-4055-bf9a-5ee32d1994fa tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 1.273617 Oct 17 13:21:42.570345 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 693/1438] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:41 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:42.593781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:42.594521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:42.624398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.626531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.627624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.639403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.642348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.643017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.903362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:42.923927 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-71f01e7a-8bbb-4e8c-bf26-6e41cefed635 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1673 microversion: 2.1 time: 0.856039 Oct 17 13:21:42.925389 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 746/1439] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:42 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1673 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:42.935997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:42.936886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:42.946030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.948499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.949879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:42.951158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:42.951862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:42.952770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:43.259413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:43.276625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:43.279098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:43.291057 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5f02350-d386-4768-aa12-0310851b26ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.364225 Oct 17 13:21:43.297281 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 747/1440] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:42 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:43.297454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:43.309475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:43.329204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:43.332589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:43.336296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:43.340388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:43.346791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:43.347558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:43.349799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:43.388430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:43.395810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:43.406302 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a96a07a1-9ac3-4f13-834d-4a79bc9d4f48 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1527 microversion: 2.1 time: 0.827450 Oct 17 13:21:43.406962 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 694/1441] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:42 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1527 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:43.411073 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21e73b51-9e91-4368-b170-08df8b9dcaf5 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116261 Oct 17 13:21:43.411874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 748/1442] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:21:43 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be/os-volume_attachments => generated 25 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:21:43.421062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70a041f2-fb48-4ef6-80cd-a482a9620ffa tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419db528b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:43.433471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1677505717", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9b539187-636f-4841-b042-bcade19ef488"}], "security_groups": [{"name": "tempest-securitygroup--1567830168"}], "key_name": "tempest-keypair-2007155954", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:43.591518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70a041f2-fb48-4ef6-80cd-a482a9620ffa tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3" status: 200 len: 1411 microversion: 2.1 time: 0.183267 Oct 17 13:21:43.593554 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 695/1443] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:21:43 2022] GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 => generated 1411 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:43.628082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:43.631307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:43.670906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:43.671573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:43.672318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:43.675252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:43.675825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:43.681256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:44.257144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] validate_networks() for [('9b539187-636f-4841-b042-bcade19ef488', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:21:44.576755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:44.596131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:44.600414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:44.602716 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-499398a5-2367-4265-9fad-3e498cde44fc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.986423 Oct 17 13:21:44.643939 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 696/1444] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:43 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:44.649088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:44.649989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:44.659824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:44.660633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:44.661390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:44.662827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:44.663578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:44.664234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.571618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:45.584437 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6ab72dc-c509-4597-ae7d-278d149f06e7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1678 microversion: 2.1 time: 0.938959 Oct 17 13:21:45.598111 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 697/1445] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:44 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1678 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:45.604523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:45.606006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:45.617588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:45.618350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:45.619040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.623613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:45.625047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:45.625741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.773072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:45.783971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:45.793133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:45.799683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f1b8433-e5a5-415d-a52d-42e6588c9127 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.199719 Oct 17 13:21:45.800931 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 698/1446] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:45 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:45.806589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:45.807569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:45.815295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:45.816155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:45.816864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.817848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:45.818537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:45.819191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:45.989015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aba657aa5e344ba3b3a61d9096941a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97f2a1e99d30456384a574e0641513a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:46.000966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-79759507-b7aa-417a-8900-ef9a7304682b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 200 len: 1485 microversion: 2.1 time: 0.198713 Oct 17 13:21:46.006315 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 699/1447] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:45 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 1485 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:46.015547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9786514a-036a-4ea9-baf7-8f9f70ea4820 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc9ad30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:46.351842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Getting quotas for project 2da28ea822bd4a92bed60c259b24067d. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:21:46.368439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Getting quotas for user 676131cb58654000b52e2493aa159cb5 and project 2da28ea822bd4a92bed60c259b24067d. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:21:46.431831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:21:46.432581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:21:46.438795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:21:46.439979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:21:46.441369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:21:46.467964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:46.471536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:46.472269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:46.474666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:46.476652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:46.481393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:46.526504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Getting quotas for project 2da28ea822bd4a92bed60c259b24067d. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:21:46.537530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Getting quotas for user 676131cb58654000b52e2493aa159cb5 and project 2da28ea822bd4a92bed60c259b24067d. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:21:46.555279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:21:46.568059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:21:46.727790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac5a8568-9481-43c7-9551-dd6942adb1c8 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.313512 Oct 17 13:21:46.728765 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 749/1448] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:21:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 3315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:21:46.737738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:46.738658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:46.747632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:46.748479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:46.749152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:46.750167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:46.750822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:46.751436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:47.178318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:47.192207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:47.194377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:47.195582 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ff49c57-4dad-4ccd-9038-1e8fcfccf469 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.465486 Oct 17 13:21:47.209192 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 750/1449] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:46 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:47.209192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-dcb0a6a3-22d2-48ee-82c9-3ce6b23ebf31 req-9d788501-da2d-4e36-8f16-dcc560348d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a864c636-4238-4a92-91d4-7cd5d4422893", "name": "network-vif-deleted", "tag": "e103cc3d-b441-4566-aa59-38c5349af038"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:47.260587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dcb0a6a3-22d2-48ee-82c9-3ce6b23ebf31 req-9d788501-da2d-4e36-8f16-dcc560348d49 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.261066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dcb0a6a3-22d2-48ee-82c9-3ce6b23ebf31 req-9d788501-da2d-4e36-8f16-dcc560348d49 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.261620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dcb0a6a3-22d2-48ee-82c9-3ce6b23ebf31 req-9d788501-da2d-4e36-8f16-dcc560348d49 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:47.286217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-dcb0a6a3-22d2-48ee-82c9-3ce6b23ebf31 req-9d788501-da2d-4e36-8f16-dcc560348d49 service nova] Creating event network-vif-deleted:e103cc3d-b441-4566-aa59-38c5349af038 for instance a864c636-4238-4a92-91d4-7cd5d4422893 on n-h2-854121-14 Oct 17 13:21:47.297197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-dcb0a6a3-22d2-48ee-82c9-3ce6b23ebf31 req-9d788501-da2d-4e36-8f16-dcc560348d49 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093442 Oct 17 13:21:47.298160 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 751/1450] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:47.303969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:47.304676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:47.314245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.321342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.321342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:47.321342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.321342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.321796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:47.585273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:47.607033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:47.629229 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa06c2f8-7bd0-4ef5-a256-866a5f94ea9c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.329728 Oct 17 13:21:47.641634 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 752/1451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:47 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:47.647212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4bdb41a-00cb-4eac-abef-1c39c05fe181 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:47.648668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4bdb41a-00cb-4eac-abef-1c39c05fe181 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:47.836719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4bdb41a-00cb-4eac-abef-1c39c05fe181 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:47.847711 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4bdb41a-00cb-4eac-abef-1c39c05fe181 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1278 microversion: 2.1 time: 0.204672 Oct 17 13:21:47.856162 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 753/1452] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:47 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:21:47.873635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:47.874263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:47.905297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.905797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.906260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:47.906975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:47.907427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:47.907841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.095990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.112225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.123352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.129521 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f781f3ae-c0dd-48c8-91b4-f6b9facbe50c tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.271369 Oct 17 13:21:48.131155 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 754/1453] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:47 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:48.142277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:48.142997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: a864c636-4238-4a92-91d4-7cd5d4422893] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:48.160151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.171800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.172597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.174235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.180036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.182659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.239092 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance a864c636-4238-4a92-91d4-7cd5d4422893 could not be found. Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 HTTP/1.1 Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:21:48.253445 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance a864c636-4238-4a92-91d4-7cd5d4422893 could not be found. Oct 17 13:21:48.255106 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a864c636-4238-4a92-91d4-7cd5d4422893'} Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a864c636-4238-4a92-91d4-7cd5d4422893 could not be found. Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:21:48.255961 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a864c636-4238-4a92-91d4-7cd5d4422893 could not be found. Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a864c636-4238-4a92-91d4-7cd5d4422893 could not be found. Oct 17 13:21:48.258536 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:21:48.262204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance a864c636-4238-4a92-91d4-7cd5d4422893 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:21:48.266007 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55b7454e-20c3-4067-ad05-95a6d4737b94 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893" status: 404 len: 111 microversion: 2.1 time: 0.132245 Oct 17 13:21:48.271383 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 755/1454] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:48 2022] GET /compute/v2.1/servers/a864c636-4238-4a92-91d4-7cd5d4422893 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:21:48.294781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:48.319530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:48.334653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.338479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.339213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.343011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.347451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.349469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.477835 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14ed0c97-7931-4cdd-960a-5442f5064e79 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 200 len: 324 microversion: 2.1 time: 0.194670 Oct 17 13:21:48.481541 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 756/1455] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:21:48 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:48.494073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:48.495508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:21:48.508920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.509758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.510585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.513402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:48.514154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:48.515081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:48.969568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:48.991091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:49.013632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:21:49.015002 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-123927d0-85b0-40e2-99f2-11439d17a547 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.532215 Oct 17 13:21:49.020919 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 757/1456] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:21:48 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:21:49.040732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d0c8687c-e6b5-44e2-b276-2812640148e8 req-b79a6905-7ec8-4b3a-bd3e-211430048d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9252e01a-a8b6-4774-9ff3-2078a1dbace7", "name": "network-vif-plugged", "status": "completed", "tag": "aa255119-5098-49f5-b78a-938942f7184d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:21:49.086719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d0c8687c-e6b5-44e2-b276-2812640148e8 req-b79a6905-7ec8-4b3a-bd3e-211430048d77 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:21:49.087210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d0c8687c-e6b5-44e2-b276-2812640148e8 req-b79a6905-7ec8-4b3a-bd3e-211430048d77 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:21:49.087661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d0c8687c-e6b5-44e2-b276-2812640148e8 req-b79a6905-7ec8-4b3a-bd3e-211430048d77 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:21:49.134096 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d0c8687c-e6b5-44e2-b276-2812640148e8 req-b79a6905-7ec8-4b3a-bd3e-211430048d77 service nova] Creating event network-vif-plugged:aa255119-5098-49f5-b78a-938942f7184d for instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 on n-h1-854121-14 Oct 17 13:21:49.155047 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d0c8687c-e6b5-44e2-b276-2812640148e8 req-b79a6905-7ec8-4b3a-bd3e-211430048d77 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128760 Oct 17 13:21:49.157809 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 758/1457] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:21:49.174885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6fe1212d-7ad4-4024-9089-336a02523b22 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '.version_select at 0x7f419dd6cc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:21:55.812854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:55.998115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=25 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:56.513958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:57.843516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:59.085815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:21:59.110663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:04.474606 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6fe1212d-7ad4-4024-9089-336a02523b22 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Image not found. Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6fe1212d-7ad4-4024-9089-336a02523b22 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b HTTP/1.1 Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:22:04.476707 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'b503365e-5406-4065-9833-1292f50b3c2b'} Oct 17 13:22:04.478622 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b503365e-5406-4065-9833-1292f50b3c2b to delete Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:04.480622 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b503365e-5406-4065-9833-1292f50b3c2b could not be found. Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:04.482429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6fe1212d-7ad4-4024-9089-336a02523b22 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:04.484765 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6fe1212d-7ad4-4024-9089-336a02523b22 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b" status: 404 len: 62 microversion: 2.1 time: 15.317536 Oct 17 13:22:04.486134 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 759/1458] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:21:49 2022] DELETE /compute/v2.1/images/b503365e-5406-4065-9833-1292f50b3c2b => generated 62 bytes in 15319 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:22:04.487169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:04.499268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:04.515425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.517874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.518130 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9786514a-036a-4ea9-baf7-8f9f70ea4820 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3" status: 200 len: 1420 microversion: 2.1 time: 18.510490 Oct 17 13:22:04.518618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.518830 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 700/1459] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:21:46 2022] GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 => generated 1420 bytes in 18512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:04.519511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.521546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.521939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.533482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:04.534105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:04.540583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.541104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.541658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.543036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.543571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.543999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.835523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:04.851650 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab1b4ec7-d726-4a40-ae7d-07bb317f4ff6 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1404 microversion: 2.1 time: 0.325500 Oct 17 13:22:04.868936 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 701/1460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:04 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1404 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:04.869223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:04.869364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:04.869364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:04.878727 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d047560a-2024-4f0f-b494-d13421380df1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.397279 Oct 17 13:22:04.879867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.880758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.881431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.882559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:04.883213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:04.883818 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 760/1461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:04 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:04.884330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:04.990643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.012008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.017708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.039297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6f3fdb57-4902-4b15-8c97-69784e71cd90 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1555 microversion: 2.91 time: 0.178429 Oct 17 13:22:05.055740 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 702/1462] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:04 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1555 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:05.069062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-cb59b8fe-fa1f-4311-bf44-871ba6ffb4dc req-2074343e-cd58-4005-b4dc-9f7a9df96be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d428abc-b9a2-4d64-8f09-26a50e66508b", "name": "network-vif-unplugged", "status": "completed", "tag": "02dbf2c9-b939-4f06-afc1-f39e8fd74372"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:05.079874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cb59b8fe-fa1f-4311-bf44-871ba6ffb4dc req-2074343e-cd58-4005-b4dc-9f7a9df96be3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.080914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cb59b8fe-fa1f-4311-bf44-871ba6ffb4dc req-2074343e-cd58-4005-b4dc-9f7a9df96be3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.081584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cb59b8fe-fa1f-4311-bf44-871ba6ffb4dc req-2074343e-cd58-4005-b4dc-9f7a9df96be3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.095175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-cb59b8fe-fa1f-4311-bf44-871ba6ffb4dc req-2074343e-cd58-4005-b4dc-9f7a9df96be3 service nova] Creating event network-vif-unplugged:02dbf2c9-b939-4f06-afc1-f39e8fd74372 for instance 5d428abc-b9a2-4d64-8f09-26a50e66508b on n-h1-854121-14 Oct 17 13:22:05.102413 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-cb59b8fe-fa1f-4311-bf44-871ba6ffb4dc req-2074343e-cd58-4005-b4dc-9f7a9df96be3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037309 Oct 17 13:22:05.103666 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 703/1463] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:05.113509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d9954828-a302-49b8-928e-ec1d5f1751c5 req-67d18730-77e2-43a1-b208-0fb8365faad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f52e3dc-1171-465e-8def-abdf79bc5cba", "tag": "106c51ee-a166-4a2b-a4ae-b3fc98394112"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:05.125952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d9954828-a302-49b8-928e-ec1d5f1751c5 req-67d18730-77e2-43a1-b208-0fb8365faad4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.126914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d9954828-a302-49b8-928e-ec1d5f1751c5 req-67d18730-77e2-43a1-b208-0fb8365faad4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.127728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d9954828-a302-49b8-928e-ec1d5f1751c5 req-67d18730-77e2-43a1-b208-0fb8365faad4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.144998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d9954828-a302-49b8-928e-ec1d5f1751c5 req-67d18730-77e2-43a1-b208-0fb8365faad4 service nova] Creating event network-changed:106c51ee-a166-4a2b-a4ae-b3fc98394112 for instance 4f52e3dc-1171-465e-8def-abdf79bc5cba on n-h1-854121-14 Oct 17 13:22:05.152286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d9954828-a302-49b8-928e-ec1d5f1751c5 req-67d18730-77e2-43a1-b208-0fb8365faad4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046838 Oct 17 13:22:05.158289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 704/1464] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:05.349745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.350743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:05.361141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.363334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.363984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.365138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.365791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.366519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.406216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10080598-8b65-4072-85f1-8a9a406da3de tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Action: 'create', calling method: .version_select at 0x7f419db4be50>, body: {"keypair": {"name": "tempest-keypair-1754531388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKzQdlQhIxFJxQjm0r09AAdWbq1zEgcbpzLvMTdKemzsN4ZDA+cP27LdvxUDvqlvWfMAx+eZTZJ+3yFmxrRjsT15Xfg5f9MuvjccSes0dXONtUuMqpwNYmxZ+6jmMqDlw=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:05.446357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-10080598-8b65-4072-85f1-8a9a406da3de tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Getting quotas for project cd0c1190c61647ceb4914330b65b7c24. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:05.473093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-10080598-8b65-4072-85f1-8a9a406da3de tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Getting quotas for user 9976642939654889bb1dc78814a9011c and project cd0c1190c61647ceb4914330b65b7c24. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:05.545372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10080598-8b65-4072-85f1-8a9a406da3de tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.381252 Oct 17 13:22:05.547317 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 705/1465] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:22:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:05.559580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-45895546-1df1-4f85-abee-0cd9209fe868 req-d6efc8f7-561f-4585-940f-b8751fe35d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f52e3dc-1171-465e-8def-abdf79bc5cba", "name": "network-vif-plugged", "status": "completed", "tag": "106c51ee-a166-4a2b-a4ae-b3fc98394112"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:05.587670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45895546-1df1-4f85-abee-0cd9209fe868 req-d6efc8f7-561f-4585-940f-b8751fe35d32 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.588525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45895546-1df1-4f85-abee-0cd9209fe868 req-d6efc8f7-561f-4585-940f-b8751fe35d32 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.589820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45895546-1df1-4f85-abee-0cd9209fe868 req-d6efc8f7-561f-4585-940f-b8751fe35d32 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.615098 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-45895546-1df1-4f85-abee-0cd9209fe868 req-d6efc8f7-561f-4585-940f-b8751fe35d32 service nova] Creating event network-vif-plugged:106c51ee-a166-4a2b-a4ae-b3fc98394112 for instance 4f52e3dc-1171-465e-8def-abdf79bc5cba on n-h1-854121-14 Oct 17 13:22:05.633507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-45895546-1df1-4f85-abee-0cd9209fe868 req-d6efc8f7-561f-4585-940f-b8751fe35d32 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084146 Oct 17 13:22:05.634406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 706/1466] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:05.650263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.651206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:05.686382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.687640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.688195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.689030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.690959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.692415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.704893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.721755 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.722661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.724127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 HTTP/1.1 Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:22:05.725591 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.727415 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '71bab135-352c-4a58-932b-d2624d52cc15'} Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:05.728432 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.730990 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.732721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ba6fbc8-2676-4257-938b-955cae945dc3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.844073 Oct 17 13:22:05.732721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 761/1467] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:04 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:05.734330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:05.735377 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e339ff0e-87dc-4feb-b5c6-cd5234b7d469 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 404 len: 111 microversion: 2.1 time: 0.099646 Oct 17 13:22:05.739301 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 707/1468] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:22:05 2022] DELETE /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:05.742659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6151225-666b-4c9c-8529-89319eba044f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dd80d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.746751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.747607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:05.763014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.763941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.764855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.765801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.766695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.767561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.835156 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6151225-666b-4c9c-8529-89319eba044f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3" status: 200 len: 1420 microversion: 2.1 time: 0.099449 Oct 17 13:22:05.836133 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 762/1469] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:05 2022] GET /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:05.856024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:05.857042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: 71bab135-352c-4a58-932b-d2624d52cc15] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:05.867411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.868269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.868951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.872506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:05.873586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:05.874574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:05.899203 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 HTTP/1.1 Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:22:05.901426 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.903457 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '71bab135-352c-4a58-932b-d2624d52cc15'} Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:05.904637 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. Oct 17 13:22:05.908498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:05.911432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance 71bab135-352c-4a58-932b-d2624d52cc15 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:05.913849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9be69108-4ebc-4ceb-8e83-2ff04909932d tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15" status: 404 len: 111 microversion: 2.1 time: 0.060796 Oct 17 13:22:05.917677 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 763/1470] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:05 2022] GET /compute/v2.1/servers/71bab135-352c-4a58-932b-d2624d52cc15 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:05.930281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9e5e520-5e64-4053-ac50-e52c1f9c2654 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dd6cd30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:06.025216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:06.035193 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-906975f3-e2a7-496b-b4fc-ad04a31ef37e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.294436 Oct 17 13:22:06.035777 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 708/1471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:05 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:06.054904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:06.055258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:06.082141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.083612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.084632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.087323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.088723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.089243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.352269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:06.364062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-253810f0-972d-4bce-87e1-8a745048a302 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1404 microversion: 2.1 time: 0.327016 Oct 17 13:22:06.365390 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 709/1472] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:06 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1404 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:06.370825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-55ba07c1-a902-4b4b-b1c7-d41dfa041c37 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '.version_select at 0x7f419dbb7dc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:06.408910 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-55ba07c1-a902-4b4b-b1c7-d41dfa041c37 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438762774" status: 202 len: 0 microversion: 2.1 time: 0.042075 Oct 17 13:22:06.411238 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 710/1473] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:22:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438762774 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:22:06.436485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:06.438621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:06.460388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.470077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.471036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.474922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.476477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.478048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.834730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:06.851783 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e532de1-ffcd-49c9-8d7e-0645008ec560 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.435903 Oct 17 13:22:06.852423 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 711/1474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:06.863759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:06.864385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:06.882491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.883002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.883451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:06.884171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:06.884630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:06.885059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.154836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9e5e520-5e64-4053-ac50-e52c1f9c2654 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3" status: 204 len: 0 microversion: 2.1 time: 1.232482 Oct 17 13:22:07.155408 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 764/1475] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:05 2022] DELETE /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:22:07.160656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:07.161306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:07.174167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.177023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.180514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.181878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.182535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.184706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.263905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.284087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.287619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.297465 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6965be73-a4fd-4d20-a4b9-99dbbc785726 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1537 microversion: 2.91 time: 0.441811 Oct 17 13:22:07.321637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 712/1476] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:06 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1537 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:07.345919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:07.347036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:07.363693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.365323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.365845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.366596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.367066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.367510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.887004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.908061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.909578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:07.910799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8c65fdf-9e2f-4104-b6bd-d550ab9c9e2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.753970 Oct 17 13:22:07.911361 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 765/1477] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:07 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:07.920117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:07.920711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:07.935524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.936036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.936488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.937241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:07.937707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:07.938135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:07.986231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:08.001542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebd54070-22d8-4ed8-b5f2-e9ebfe493892 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.675951 Oct 17 13:22:08.029347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 713/1478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:07 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:08.057277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-62a0f9e5-7a81-4363-a393-06cadcf5974c req-40bdc9b7-41f4-41e4-b069-09de8eee18f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d428abc-b9a2-4d64-8f09-26a50e66508b", "tag": "02dbf2c9-b939-4f06-afc1-f39e8fd74372"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:08.060779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:22:08.108163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62a0f9e5-7a81-4363-a393-06cadcf5974c req-40bdc9b7-41f4-41e4-b069-09de8eee18f4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.108670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62a0f9e5-7a81-4363-a393-06cadcf5974c req-40bdc9b7-41f4-41e4-b069-09de8eee18f4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.109399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62a0f9e5-7a81-4363-a393-06cadcf5974c req-40bdc9b7-41f4-41e4-b069-09de8eee18f4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.145644 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-62a0f9e5-7a81-4363-a393-06cadcf5974c req-40bdc9b7-41f4-41e4-b069-09de8eee18f4 service nova] Creating event network-changed:02dbf2c9-b939-4f06-afc1-f39e8fd74372 for instance 5d428abc-b9a2-4d64-8f09-26a50e66508b on n-h1-854121-14 Oct 17 13:22:08.160156 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-62a0f9e5-7a81-4363-a393-06cadcf5974c req-40bdc9b7-41f4-41e4-b069-09de8eee18f4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127476 Oct 17 13:22:08.161465 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 714/1479] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:08.178595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:08.180118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:08.191803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.192724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.193393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.195294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.195944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.199268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.267915 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6f9bb5c-7e10-4d98-a02f-0680199b1380 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 204 len: 0 microversion: 2.1 time: 0.355152 Oct 17 13:22:08.269241 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 766/1480] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:22:07 2022] DELETE /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:22:08.275731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ea2ed779-98e6-4a5e-8cf6-ce99fb8cd9cc req-bc226fd2-eeee-44fe-a29e-d3ee23d480cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9252e01a-a8b6-4774-9ff3-2078a1dbace7", "name": "network-vif-unplugged", "status": "completed", "tag": "aa255119-5098-49f5-b78a-938942f7184d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:08.288228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea2ed779-98e6-4a5e-8cf6-ce99fb8cd9cc req-bc226fd2-eeee-44fe-a29e-d3ee23d480cc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.289763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea2ed779-98e6-4a5e-8cf6-ce99fb8cd9cc req-bc226fd2-eeee-44fe-a29e-d3ee23d480cc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.290659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea2ed779-98e6-4a5e-8cf6-ce99fb8cd9cc req-bc226fd2-eeee-44fe-a29e-d3ee23d480cc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.332459 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ea2ed779-98e6-4a5e-8cf6-ce99fb8cd9cc req-bc226fd2-eeee-44fe-a29e-d3ee23d480cc service nova] Creating event network-vif-unplugged:aa255119-5098-49f5-b78a-938942f7184d for instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 on n-h1-854121-14 Oct 17 13:22:08.343108 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ea2ed779-98e6-4a5e-8cf6-ce99fb8cd9cc req-bc226fd2-eeee-44fe-a29e-d3ee23d480cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069963 Oct 17 13:22:08.345775 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 767/1481] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:08.357575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1767472056", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "409d5ac5-1afa-4a2d-b8d2-6def2794c056"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:08.465061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] validate_networks() for [('409d5ac5-1afa-4a2d-b8d2-6def2794c056', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:08.787262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:08.801745 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3afbdd6e-930d-4d12-96a4-dcac7e2f6309 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1404 microversion: 2.1 time: 0.638759 Oct 17 13:22:08.803591 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 715/1482] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:08 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1404 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:08.810719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:08.811613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:08.820295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.824380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.826611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:08.831529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:08.838462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:08.839959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:09.089443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.099109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.100573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:09.107970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ab895b2-7deb-4a66-9473-213aeeee2ac8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1480 microversion: 2.91 time: 0.302115 Oct 17 13:22:09.108899 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 716/1483] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:08 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1480 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:09.122343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-4637411", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "de69c07b-99ae-49cb-9b55-cd78d1700008"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:09.188534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] validate_networks() for [('de69c07b-99ae-49cb-9b55-cd78d1700008', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:10.000161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:10.001640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:10.003369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:10.004099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:10.005086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:10.021017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.021908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.022672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.024285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.024981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.025638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.061365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:10.082801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for user 6ad84e1798394f69a409af3c96b6752c and project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:10.123742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:10.130045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:10.311606 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-06b0c42a-a69a-4818-b233-4c6f733c3663 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.964280 Oct 17 13:22:10.312257 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 768/1484] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:22:10.331982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:10.341195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:10.352968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.357869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.358671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.361798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:10.362525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:10.365733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:10.953938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:10.969680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:10.976725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:10.982260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73f69f00-8635-4760-84e9-70ca4c9c4643 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.662733 Oct 17 13:22:10.985441 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 769/1485] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:10 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:11.004352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:11.008963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:11.025203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.032971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.033861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.036562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.039001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.040118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.053585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:11.054185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:11.054696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:11.055184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:11.055911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:11.076408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.076903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.082012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.083074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.083758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.084422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.119631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:11.127678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for user c2effa2bc1674d20a064b40849b85df1 and project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:11.149738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:11.153315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:11.216669 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6139cee1-374f-4c42-b937-9f4fe74a1c26 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106297 Oct 17 13:22:11.218044 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 717/1486] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:22:11.223054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65598f43-00b4-4046-8232-798fe9bd4fa2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '.version_select at 0x7f419db4bca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:11.291686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-65598f43-00b4-4046-8232-798fe9bd4fa2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Image not found. Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65598f43-00b4-4046-8232-798fe9bd4fa2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/95bf6eb6-c397-4a8d-9dc8-ca667eef3423 HTTP/1.1 Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:22:11.294535 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '95bf6eb6-c397-4a8d-9dc8-ca667eef3423'} Oct 17 13:22:11.296182 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 95bf6eb6-c397-4a8d-9dc8-ca667eef3423 to delete Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:11.297150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95bf6eb6-c397-4a8d-9dc8-ca667eef3423 could not be found. Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:11.298538 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:22:11.300073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:11.302479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65598f43-00b4-4046-8232-798fe9bd4fa2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:11.303600 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65598f43-00b4-4046-8232-798fe9bd4fa2 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/images/95bf6eb6-c397-4a8d-9dc8-ca667eef3423" status: 404 len: 62 microversion: 2.1 time: 0.084309 Oct 17 13:22:11.305260 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 718/1487] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:11 2022] DELETE /compute/v2.1/images/95bf6eb6-c397-4a8d-9dc8-ca667eef3423 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:22:11.312127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:11.313052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:11.319957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.320742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.322140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.323760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.324608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.325348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.358628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-854121-14". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:22:11.587556 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d695093a-9e76-4293-bd32-7b91af27cf5c tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action" status: 202 len: 0 microversion: 2.91 time: 0.600224 Oct 17 13:22:11.592017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 770/1488] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:22:10 2022] POST /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:22:11.603307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:11.606087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:11.620811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.627093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.627925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.628650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:11.629238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:11.630056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:11.792963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:11.802988 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-642e63b1-a9ec-451f-8574-6e61b2395080 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1211 microversion: 2.1 time: 0.208684 Oct 17 13:22:11.838198 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 771/1489] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:11 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1211 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:11.867707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1452377972", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "588eb70f-62df-466f-855d-0eb3e16b4cea"}], "security_groups": [{"name": "tempest-securitygroup--82572580"}], "key_name": "tempest-keypair-1754531388", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:12.123561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:12.137795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d16773b7-c2ca-4795-bfed-b24a768694f4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1590 microversion: 2.1 time: 0.831044 Oct 17 13:22:12.138393 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 719/1490] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:11 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1590 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:12.156143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:12.156768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:12.170014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.170533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.171203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.173640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.174310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.176138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.177126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] validate_networks() for [('588eb70f-62df-466f-855d-0eb3e16b4cea', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:12.437265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:12.449904 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae643d92-1dbe-49f5-a002-81ed3cecfbdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1209 microversion: 2.1 time: 0.310013 Oct 17 13:22:12.461065 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 720/1491] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:12 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1209 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:12.461065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:12.461065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:12.471719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.472827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.473413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.474242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.475010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.475688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.502736 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 HTTP/1.1 Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:22:12.506352 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:12.508190 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41'} Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:12.509334 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:12.511712 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:12.513559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:12.513559 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-487ec50d-e765-4a60-aaee-b52562f6092b tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 404 len: 111 microversion: 2.1 time: 0.058841 Oct 17 13:22:12.518278 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 721/1492] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:22:12 2022] DELETE /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:12.527779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f6c7973a-f531-4a71-9b00-6107a8ad9965 req-d9e0a962-40e4-469d-8754-c529781e4fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9252e01a-a8b6-4774-9ff3-2078a1dbace7", "name": "network-vif-deleted", "tag": "aa255119-5098-49f5-b78a-938942f7184d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:12.539465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f6c7973a-f531-4a71-9b00-6107a8ad9965 req-d9e0a962-40e4-469d-8754-c529781e4fcc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.540088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f6c7973a-f531-4a71-9b00-6107a8ad9965 req-d9e0a962-40e4-469d-8754-c529781e4fcc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.540531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f6c7973a-f531-4a71-9b00-6107a8ad9965 req-d9e0a962-40e4-469d-8754-c529781e4fcc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.556705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f6c7973a-f531-4a71-9b00-6107a8ad9965 req-d9e0a962-40e4-469d-8754-c529781e4fcc service nova] Creating event network-vif-deleted:aa255119-5098-49f5-b78a-938942f7184d for instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 on n-h1-854121-14 Oct 17 13:22:12.563969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f6c7973a-f531-4a71-9b00-6107a8ad9965 req-d9e0a962-40e4-469d-8754-c529781e4fcc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043779 Oct 17 13:22:12.564636 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 722/1493] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:12.575338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:12.576744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:12.584183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.584673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.585106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.586085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.586600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.587020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.756826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:12.766262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:12.767725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:12.773206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a99b4a9-ab36-4e29-922d-e5e5a82407cc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1488 microversion: 2.91 time: 0.206824 Oct 17 13:22:12.774415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 723/1494] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:12 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1488 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:12.779915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:12.780997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:12.797490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.804336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.805101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:12.807313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:12.810590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:12.811057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.178910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:13.179437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:13.180817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:13.181610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:13.183538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:13.197059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.199615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.200609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.201902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.202600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.203507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.233361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Getting quotas for project cd0c1190c61647ceb4914330b65b7c24. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:13.235153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.239904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Getting quotas for user 9976642939654889bb1dc78814a9011c and project cd0c1190c61647ceb4914330b65b7c24. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:13.243801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.246307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.247704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1d907067-c070-4bd6-be0d-09543c34227b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1814 microversion: 2.25 time: 0.472085 Oct 17 13:22:13.255586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:13.257825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:13.261732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 724/1495] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:12 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1814 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:13.271097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:13.271875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:13.281242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.282064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.282850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.283883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.284529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.285147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.343906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd680973-17b6-464f-8a2d-8155233fc095 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.490086 Oct 17 13:22:13.349299 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 772/1496] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:22:13.356332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:13.356964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] [instance: e91c51f1-75cd-46a1-bf5d-a084e2948c41] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:13.364047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.364589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.365037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.365767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.366226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.366650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.419109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] HTTP exception thrown: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Request method failure captured: Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 HTTP/1.1 Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZhxU78KHhMVxCmEbG-tmANJsTa5Vv1Bvp7a2zIpyCjom1bF9_ii_6fl9T9_t97QRwSGKrEr6f1RrL8EjANtXHZZx_KeO7ObDPnY_snESso4nvfR8eFLKRbO0c3pHRk6g7BsJJKdQxTCl45rWiMDyQGYo7QWVl2PPscEal9w7VvnBM Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:22:13.421069 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/97f2a1e99d30456384a574e0641513a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_97f2a1e99d30456384a574e0641513a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 97f2a1e99d30456384a574e0641513a5 Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-162904779 Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: aba657aa5e344ba3b3a61d9096941a52 Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-162904779-project Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:13.423030 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e91c51f1-75cd-46a1-bf5d-a084e2948c41'} Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:13.424068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. Oct 17 13:22:13.427476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:13.432120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] Returning 404 to user: Instance e91c51f1-75cd-46a1-bf5d-a084e2948c41 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:13.440630 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44aae0b8-cbbd-4b79-9d19-9337c76cd825 tempest-ImagesOneServerNegativeTestJSON-162904779 tempest-ImagesOneServerNegativeTestJSON-162904779-project] 10.222.0.65 "GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41" status: 404 len: 111 microversion: 2.1 time: 0.090041 Oct 17 13:22:13.441887 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 773/1497] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:13 2022] GET /compute/v2.1/servers/e91c51f1-75cd-46a1-bf5d-a084e2948c41 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:13.452565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:13.455161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:13.470074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.473073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.477547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.485895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.486391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.486831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.548438 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc831121-147f-4cb4-9157-19ed00daaebe tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285173 Oct 17 13:22:13.554378 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 725/1498] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:22:13 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:13.561445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-13dcc1a0-5132-433c-a274-81cfaf78fe5f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:13.562111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-13dcc1a0-5132-433c-a274-81cfaf78fe5f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:13.695395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:13.727678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba83ffa6-8f6d-470d-b596-3d3fa4eb2a33 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1273 microversion: 2.1 time: 0.282046 Oct 17 13:22:13.733586 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 774/1499] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:13 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:13.767497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:13.768300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:13.777691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.778256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.778615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:13.779330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:13.779773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:13.780534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.132854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13dcc1a0-5132-433c-a274-81cfaf78fe5f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:14.141085 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-13dcc1a0-5132-433c-a274-81cfaf78fe5f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1242 microversion: 2.1 time: 0.586111 Oct 17 13:22:14.141720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 726/1500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:13 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1242 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:14.163560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:14.164905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:14.174948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.175130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:14.175804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.176419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.177358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.178111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.178712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.198847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df950e59-123f-4869-becc-9dbcfef67f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1257 microversion: 2.1 time: 0.443160 Oct 17 13:22:14.204836 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 775/1501] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:13 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1257 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:14.208400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:14.283482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:14.285867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:14.303727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:14.308327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.310574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.311307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.312812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.318225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:14.319054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.320407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:14.321303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.340206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30788b25-9ea4-4d3d-aa75-757e9562b95b tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.172901 Oct 17 13:22:14.340868 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 727/1502] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:14 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:14.774421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:14.775246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:14.806408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.810642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.811331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.813299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:14.815672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:14.816341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:14.991618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.004582 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7349d7d-bca9-4eaa-b847-d9fb3a3adbe7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1273 microversion: 2.1 time: 0.236467 Oct 17 13:22:15.008755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 728/1503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:14 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:15.175459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:15.177780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:15.197619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.201196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.202122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.203386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.204918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.206871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.233303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.246125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.250948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.262712 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17245d34-bc16-420e-8b22-6d80e238897c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1804 microversion: 2.25 time: 0.990339 Oct 17 13:22:15.277590 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 776/1504] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:14 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1804 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:15.288561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:15.289585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:15.296641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.297522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.298214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.299162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.299853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.300509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.434576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.446725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-145897cb-9c4d-4611-bac2-acc2cfe3c9ea tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1294 microversion: 2.1 time: 0.278264 Oct 17 13:22:15.458025 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 729/1505] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:15 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1294 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:15.465438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-432f1d26-8941-49e6-9504-eeefdd6c2da8 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '.version_select at 0x7f419dc9ad30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:15.475398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-432f1d26-8941-49e6-9504-eeefdd6c2da8 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.475905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-432f1d26-8941-49e6-9504-eeefdd6c2da8 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.476358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-432f1d26-8941-49e6-9504-eeefdd6c2da8 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.508838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-432f1d26-8941-49e6-9504-eeefdd6c2da8 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 2560 microversion: 2.25 time: 0.049741 Oct 17 13:22:15.522076 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 730/1506] 10.222.0.65 () {60 vars in 1184 bytes} [Mon Oct 17 13:22:15 2022] GET /compute/v2.1/os-migrations => generated 2560 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:15.530270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:15.531248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:15.546263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.547060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.547735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.548684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.549405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.550261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.824609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.840088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.840927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:15.851309 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e79c617b-e621-4e65-b476-a77226c32fe8 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.327561 Oct 17 13:22:15.875817 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 731/1507] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:15 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:15.880583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:15.881232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:15.887537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:15.891926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.892420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.892865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:15.893839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:15.894632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:15.895297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.139867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:16.148100 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9130171c-69df-4c15-bbc4-6aa3ab1a1f17 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.869102 Oct 17 13:22:16.165508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 777/1508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:15 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:16.171207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:16.172149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:16.178505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.179333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.180030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.180976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.181678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.182418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.354907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:16.362058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:16.370797 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31f0f4be-a4c1-45a8-9692-794fa6b6b316 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1273 microversion: 2.1 time: 0.203383 Oct 17 13:22:16.387070 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 778/1509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:16 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:16.417545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 5d428abc-b9a2-4d64-8f09-26a50e66508b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:16.447871 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b05ca6e1-af55-4cf0-a1d9-8b902643777c tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 2424 microversion: 2.25 time: 0.570508 Oct 17 13:22:16.454382 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 732/1510] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:15 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 2424 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:16.480648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:16.481540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:16.492192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.492582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.493030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.493810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.494253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.494675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.499562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:16.500184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:16.512128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.512616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.516865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.522980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.523686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.524295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.668775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:16.684810 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8fc6fd8-a930-4283-a357-e7f3c09655b6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1300 microversion: 2.1 time: 0.208075 Oct 17 13:22:16.685439 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 779/1511] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:16 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:16.882209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:16.882681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:16.895741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.896158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.896610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:16.905352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:16.905908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:16.906584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.181785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.205819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.210314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.228923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97d3853a-1b46-452c-9e7e-0bbe996f29dc tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.350609 Oct 17 13:22:17.237493 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 780/1512] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:16 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:17.263766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:17.265390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:17.289431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.290714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.292224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.296117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.299103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.300949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.326224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid 5d428abc-b9a2-4d64-8f09-26a50e66508b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:17.394821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c96c9806-a5c1-48bc-ae76-675ee0a7d1a2 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 2424 microversion: 2.25 time: 0.902675 Oct 17 13:22:17.399750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 733/1513] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:16 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 2424 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:17.419403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:17.420301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:17.464205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.468090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.493727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.498029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.505770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.507474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.835604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:17.847400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4aec2e1c-0319-4ceb-b262-5d88d29345ac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.446270 Oct 17 13:22:17.865398 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 734/1514] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:17 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:17.879982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:17.880730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:17.892550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.893407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.893865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:17.896800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:17.897327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:17.897770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.099887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lazy-loading 'services' on Instance uuid 5d428abc-b9a2-4d64-8f09-26a50e66508b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:18.254049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.266201 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ab8344c-3b23-45be-be27-07ec2af95efb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 1.026402 Oct 17 13:22:18.270869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 781/1515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:17 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:18.282945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.287962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.309577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.312874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.313787 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cfe4f1a5-1dcb-4274-b3aa-ea99875c6b1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments/9cf773ee-1735-4ac2-a052-ff2e4c0119ec" status: 202 len: 0 microversion: 2.25 time: 0.437491 Oct 17 13:22:18.314869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.315423 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 735/1516] 10.222.0.65 () {60 vars in 1457 bytes} [Mon Oct 17 13:22:17 2022] DELETE /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments/9cf773ee-1735-4ac2-a052-ff2e4c0119ec => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:22:18.316029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.317052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.317746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.371209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.375959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.394858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.396644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.398630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.402021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.402892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.403550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.562176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.584920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9d31c30-987e-4dd0-9bd8-ca9e416d9593 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1300 microversion: 2.1 time: 0.307051 Oct 17 13:22:18.586078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 782/1517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1300 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:18.594195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.604483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.606811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.621961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:18.634358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.639095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8335a0a-27ad-4140-be8d-46cd881c9621 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.322384 Oct 17 13:22:18.644386 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 736/1518] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:18.657634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.666690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.667289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.671173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.671735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.672170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.731853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.733629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.749239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.750250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.750923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.751922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.752454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.752992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.800663 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6782263a-d0ba-4420-a05e-c1b5fb3a2277 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.205657 Oct 17 13:22:18.805491 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 783/1519] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:18.815154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5c654b59-54cc-4c8b-bd28-8d89f622b1bb req-3133c0a4-5086-4afa-85c9-593bfdb6dad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f52e3dc-1171-465e-8def-abdf79bc5cba", "tag": "106c51ee-a166-4a2b-a4ae-b3fc98394112"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:18.840751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5c654b59-54cc-4c8b-bd28-8d89f622b1bb req-3133c0a4-5086-4afa-85c9-593bfdb6dad5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.849021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5c654b59-54cc-4c8b-bd28-8d89f622b1bb req-3133c0a4-5086-4afa-85c9-593bfdb6dad5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.849941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5c654b59-54cc-4c8b-bd28-8d89f622b1bb req-3133c0a4-5086-4afa-85c9-593bfdb6dad5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.880409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5c654b59-54cc-4c8b-bd28-8d89f622b1bb req-3133c0a4-5086-4afa-85c9-593bfdb6dad5 service nova] Creating event network-changed:106c51ee-a166-4a2b-a4ae-b3fc98394112 for instance 4f52e3dc-1171-465e-8def-abdf79bc5cba on n-h1-854121-14 Oct 17 13:22:18.893622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5c654b59-54cc-4c8b-bd28-8d89f622b1bb req-3133c0a4-5086-4afa-85c9-593bfdb6dad5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084695 Oct 17 13:22:18.898930 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 784/1520] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:18.905718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:18.917351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:18.928441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.930694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.931345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:18.933541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:18.936320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:18.936980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.669627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:19.684496 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c90ab94e-9115-4837-b1ed-c7b906107723 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1590 microversion: 2.1 time: 0.958154 Oct 17 13:22:19.702710 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 737/1521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1590 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:19.714569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:19.721144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:19.736747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.737537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.739661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.742887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.744296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.747721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.856205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:19.877227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-efda3c63-eac9-4290-8428-583dbf231666 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.966428 Oct 17 13:22:19.879815 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 785/1522] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:18 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:19.890835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:19.891982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:19.922715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.923617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.927536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:19.930052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:19.930710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:19.942011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.110028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:21.133955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.146593 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0224970-b4a7-4386-ba76-69064aecfd50 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 1.439058 Oct 17 13:22:21.149826 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 738/1523] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:19 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:21.164161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:21.165395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:21.177636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.181850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.182712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.183816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.184517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.185974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.676351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.686665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.691551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc1478e2-f5fb-4bcb-ae92-13b1fb68711f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 1.810226 Oct 17 13:22:21.695051 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 786/1524] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:19 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:21.717782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:21.719665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.723292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:21.728898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:21.731480 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9be79fd7-bff3-4d77-bc23-89cdd449c756 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.580160 Oct 17 13:22:21.733822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 739/1525] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:21 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:21.739771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:21.741037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:21.749071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.750428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.751113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.752477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.753687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.754560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.755655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.756163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.756607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.761122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.761815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.764509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:21.919883 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a2e1922-eeae-4b29-8f94-491b7da1b3b5 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.219034 Oct 17 13:22:21.924208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 787/1526] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:21 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:21.942785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c7c08e21-aeda-4ec8-b030-0e5e93ba82c0 req-76b0653f-00ef-4dee-aa0e-c7943cf272fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dfb8d82-d37e-40fe-9c0e-44feee8ce0de", "tag": "c4b6212b-b845-4e49-8b8f-09af425bb042"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:21.978122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7c08e21-aeda-4ec8-b030-0e5e93ba82c0 req-76b0653f-00ef-4dee-aa0e-c7943cf272fc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:21.983142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7c08e21-aeda-4ec8-b030-0e5e93ba82c0 req-76b0653f-00ef-4dee-aa0e-c7943cf272fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:21.986271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c7c08e21-aeda-4ec8-b030-0e5e93ba82c0 req-76b0653f-00ef-4dee-aa0e-c7943cf272fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.059488 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c7c08e21-aeda-4ec8-b030-0e5e93ba82c0 req-76b0653f-00ef-4dee-aa0e-c7943cf272fc service nova] Creating event network-changed:c4b6212b-b845-4e49-8b8f-09af425bb042 for instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de on n-h2-854121-14 Oct 17 13:22:22.068068 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c7c08e21-aeda-4ec8-b030-0e5e93ba82c0 req-76b0653f-00ef-4dee-aa0e-c7943cf272fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142225 Oct 17 13:22:22.074021 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 788/1527] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:22.178200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:22.179994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:22.195312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.201428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.202310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.203772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.204788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.205694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.687443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:22.710056 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c63ff94a-3cd3-4a36-9992-69f7e5e43c15 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.970261 Oct 17 13:22:22.720253 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 740/1528] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:21 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:22.742805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:22.743537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:22.793824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.794960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.798651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:22.804465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:22.805262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:22.808750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:23.214953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:23.249040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:24.137837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:24.176974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:24.187097 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6229ff56-a363-4e13-95b8-67632b90489f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 2.014786 Oct 17 13:22:24.206813 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 789/1529] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:22 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:24.211627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:24.212634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:24.241766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:24.243230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.243726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.244169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.257347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.257953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.258407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.333371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:24.350414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec7d9a83-7ba7-44d6-a706-90f4ac68ad9c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 1.621982 Oct 17 13:22:24.352106 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 741/1530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:22 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:24.363687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:24.372628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:24.388779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.390011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.394414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.395846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.401726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.402304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.488507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-586472f3-9d09-4fa5-bc91-b00ae3de009c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.134976 Oct 17 13:22:24.493915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:24.494468 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 742/1531] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:24 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:24.508385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:24.513338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7fcd79ef-208f-4f1d-94c5-69336a18ac3c req-702cc4e9-3148-4762-bd7a-110b1786cc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437f8312-a3e2-4f61-8dee-aa8bd6846f07", "tag": "e2b39662-babe-42e5-9b71-41c090d74dd3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:24.515988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:24.528932 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f06ac917-9594-410a-98ff-354bdfbb1a36 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.321006 Oct 17 13:22:24.530229 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 790/1532] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:24 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:24.535228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:24.536108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:24.541242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7fcd79ef-208f-4f1d-94c5-69336a18ac3c req-702cc4e9-3148-4762-bd7a-110b1786cc98 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.543163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7fcd79ef-208f-4f1d-94c5-69336a18ac3c req-702cc4e9-3148-4762-bd7a-110b1786cc98 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.543633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.544491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.545145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.546076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:24.546719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:24.547329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.548945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7fcd79ef-208f-4f1d-94c5-69336a18ac3c req-702cc4e9-3148-4762-bd7a-110b1786cc98 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:24.555949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:24.601507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7fcd79ef-208f-4f1d-94c5-69336a18ac3c req-702cc4e9-3148-4762-bd7a-110b1786cc98 service nova] Creating event network-changed:e2b39662-babe-42e5-9b71-41c090d74dd3 for instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 on n-h2-854121-14 Oct 17 13:22:24.616308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7fcd79ef-208f-4f1d-94c5-69336a18ac3c req-702cc4e9-3148-4762-bd7a-110b1786cc98 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113677 Oct 17 13:22:24.623654 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 743/1533] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:25.243937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:25.244776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:25.281687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.288849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.293148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.300497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.302404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.304208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.604863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.626715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8bb97ac2-0ef4-4b5b-9e37-6eecb1cc88df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 1.095177 Oct 17 13:22:25.627611 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 791/1534] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:24 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:25.647460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:25.650792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:25.664350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.672014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.676720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.677778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.678563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.679168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.912166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:25.925343 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc76812e-6861-4416-a342-52be11256569 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.695014 Oct 17 13:22:25.938929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 744/1535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:25 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:25.963256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:25.967910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:25.986049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.987103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.987855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:25.988995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:25.990632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:25.992165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.060334 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec853c8c-9d5c-43be-bcbf-0a3ee3bd8e0a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100500 Oct 17 13:22:26.061236 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 745/1536] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:25 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:26.069194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:26.069921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:26.079486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.080132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.080697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.081663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.082577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.083110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.089115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.107343 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e5fefa4-ebbc-4de6-89b9-60816e63affb tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 0.478435 Oct 17 13:22:26.107922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 792/1537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:25 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:26.240696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.250128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.254963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.265924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b62ab8b-28a9-438b-aa1a-c5777e52f7fd tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.203530 Oct 17 13:22:26.266991 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 746/1538] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:26 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:26.655580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:26.656206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:26.667383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.667880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.668324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.669305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.669788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.670217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.712815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-78b66238-745f-4386-9536-1a3d8c932d33 req-1524c049-6f40-401a-a366-c0017e7cd986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe767a4-03e3-48b0-89e1-7c478aa9ac84", "tag": "882c05fd-ff43-4220-8eef-2ca14c03c2c7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:26.724308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-78b66238-745f-4386-9536-1a3d8c932d33 req-1524c049-6f40-401a-a366-c0017e7cd986 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.724795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-78b66238-745f-4386-9536-1a3d8c932d33 req-1524c049-6f40-401a-a366-c0017e7cd986 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.725259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-78b66238-745f-4386-9536-1a3d8c932d33 req-1524c049-6f40-401a-a366-c0017e7cd986 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:26.739895 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-78b66238-745f-4386-9536-1a3d8c932d33 req-1524c049-6f40-401a-a366-c0017e7cd986 service nova] Creating event network-changed:882c05fd-ff43-4220-8eef-2ca14c03c2c7 for instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 on n-h1-854121-14 Oct 17 13:22:26.746520 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-78b66238-745f-4386-9536-1a3d8c932d33 req-1524c049-6f40-401a-a366-c0017e7cd986 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036720 Oct 17 13:22:26.747733 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 747/1539] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:22:26.918181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:26.934018 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f22f2771-af95-452f-865b-f3e752404d97 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.282271 Oct 17 13:22:26.945196 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 793/1540] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:26 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:26.960964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:26.962112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:26.993234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:26.993741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:26.994184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.002038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.002554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.003007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.075770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.078322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.091908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.092419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.092865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.093613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.103383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.104844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.187786 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3121db81-f69d-493b-8fba-9a485c9a9553 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.117390 Oct 17 13:22:27.190762 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 794/1541] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:27.204042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.207323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.230544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.231122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.231574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.232300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.262641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.265780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.443659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.456237 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90d99057-b5e3-4d64-9b8a-fbcd1da47784 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.503560 Oct 17 13:22:27.469188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 748/1542] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:26 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:27.492892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.493847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.500327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.501053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.501787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.510118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.511515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.512125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.632965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.649173 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52ca0afe-7472-4e34-8b38-d78de4acd266 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 0.456614 Oct 17 13:22:27.649769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 795/1543] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:27.670473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.682912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.684784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:27.694219 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fbdcd5b-25fc-48e6-b495-f5e474d07c42 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.218953 Oct 17 13:22:27.696044 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 749/1544] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:27.962944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:27.963834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:27.974830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.975597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.976751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:27.977917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:27.978381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:27.978811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.203708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.206010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:28.207687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:28.213048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:28.220644 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c543b2f-8d5b-41d9-b58d-adbf5b121bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.261541 Oct 17 13:22:28.230809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.232723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.234749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.236001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.238071 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 796/1545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:27 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:28.238252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.238675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.290706 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-487d9d24-601c-4fd4-8d53-6d2aa7b1d907 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.092678 Oct 17 13:22:28.294387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 750/1546] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:28 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:22:28.485372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:28.486363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:28.493835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.494762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.495474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.496414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.497092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.497877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.679164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:28.680537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:28.685447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.689927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.690677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.691381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.692281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.693003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.693761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.695674 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08f2b883-646e-47e0-b44a-6a88c50fa98d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.214420 Oct 17 13:22:28.696277 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 797/1547] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:28 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:28.729838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:28.731633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:28.739662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.740604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.741075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.742201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:28.742662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:28.743093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:28.868292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.885457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.887010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.901322 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bfb0edd7-5cf0-4283-ad09-a8654b365671 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.175208 Oct 17 13:22:28.922830 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 798/1548] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:28 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:28.931830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:28.942752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-abea7b42-55b5-4df5-9b88-6920ac39eef3 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 0.269255 Oct 17 13:22:28.943708 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 751/1549] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:28 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:29.244106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:29.244861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:29.261655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.263948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.265863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.267823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.268369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.268827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.310398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:29.312676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:29.325285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.325805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.326477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.327405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.329801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.330541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.378072 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b661f2c0-335d-46af-8f86-fd3d5c4e7770 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075332 Oct 17 13:22:29.381221 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 752/1550] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:29 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:29.567514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:29.583324 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97612c13-2406-4c02-ba50-c8e9709c2bfa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.340602 Oct 17 13:22:29.585556 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 799/1551] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:29 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:29.734145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:29.738999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:29.752412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.754670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.755665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.758915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.759632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.760826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.933700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:29.935647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:29.951152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.952001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.953596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:29.955363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:29.957340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:29.959564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.028716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.047493 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c525402f-ef3a-403c-b84c-08e2d9dd1581 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.318038 Oct 17 13:22:30.050076 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 753/1552] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:29 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:30.066089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:30.067287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:30.084756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.085916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.087494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.101939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.105667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.108191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.115378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.130426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.133367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.156727 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e318f475-54b4-4faa-8532-4e32cc6a8dbb tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.227293 Oct 17 13:22:30.169867 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 800/1553] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:29 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:30.412645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.424707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-125411b4-3c0a-4419-9414-7a258d8696e8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 0.372306 Oct 17 13:22:30.444309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 754/1554] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:30 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:30.452520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:30.454885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:30.464416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.464907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.465949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.466839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.467456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.468735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.530545 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4629b4bc-1ced-475d-aea3-db80b79ab24a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083508 Oct 17 13:22:30.531454 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 755/1555] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:30 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:30.591579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3c52533-6980-4265-ac99-efd32b120ea1 tempest-ListImageFiltersNegativeTestJSON-87374568 tempest-ListImageFiltersNegativeTestJSON-87374568-project] Calling method '.version_select at 0x7f419ddcddc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:30.614944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:30.618592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:30.629524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.630155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.630655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.631432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:30.632088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:30.632694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:30.634824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a3c52533-6980-4265-ac99-efd32b120ea1 tempest-ListImageFiltersNegativeTestJSON-87374568 tempest-ListImageFiltersNegativeTestJSON-87374568-project] HTTP exception thrown: Image not found. Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3c52533-6980-4265-ac99-efd32b120ea1 tempest-ListImageFiltersNegativeTestJSON-87374568 tempest-ListImageFiltersNegativeTestJSON-87374568-project] Request method failure captured: Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/images/8a9a48d6-2b2f-464c-a9a6-360741906c4e HTTP/1.1 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVcVHuktR_tZohpJXf3WG79qDueIGrB34R4deeOWhnsFbnuzrZ1yASiRxmcf-4twzVg8HdOcBWSv8lANbx7-0pdL_G2jCGV_T48TBEdTAGFd_YBJY6jP0oEkPU7MAOMNwVppndW8wo2c4zo1gj3fqtQuENGvFU4tCgUtwhbaB7klLe0 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 5aac99a0b81f47e48f5b7d0a3bf66a00 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-87374568 Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:22:30.637368 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5aac99a0b81f47e48f5b7d0a3bf66a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5aac99a0b81f47e48f5b7d0a3bf66a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5aac99a0b81f47e48f5b7d0a3bf66a00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5aac99a0b81f47e48f5b7d0a3bf66a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-87374568 Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 5aac99a0b81f47e48f5b7d0a3bf66a00 Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-87374568 Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListImageFiltersNegativeTestJSON-87374568-project Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 528ce14614af463e864c5bf75e386346 Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-87374568-project Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8a9a48d6-2b2f-464c-a9a6-360741906c4e'} Oct 17 13:22:30.639301 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:22:30.641047 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8a9a48d6-2b2f-464c-a9a6-360741906c4e Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:22:30.642974 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a9a48d6-2b2f-464c-a9a6-360741906c4e could not be found. Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:30.649784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:30.654398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3c52533-6980-4265-ac99-efd32b120ea1 tempest-ListImageFiltersNegativeTestJSON-87374568 tempest-ListImageFiltersNegativeTestJSON-87374568-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:30.655933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3c52533-6980-4265-ac99-efd32b120ea1 tempest-ListImageFiltersNegativeTestJSON-87374568 tempest-ListImageFiltersNegativeTestJSON-87374568-project] 10.222.0.65 "GET /compute/v2.1/images/8a9a48d6-2b2f-464c-a9a6-360741906c4e" status: 404 len: 62 microversion: 2.1 time: 0.470249 Oct 17 13:22:30.655933 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 801/1556] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:30 2022] GET /compute/v2.1/images/8a9a48d6-2b2f-464c-a9a6-360741906c4e => generated 62 bytes in 474 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:22:30.850106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:30.859764 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c110861-0bc5-4907-9695-9692b17065b3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.250386 Oct 17 13:22:30.865549 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 756/1557] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:30 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:31.077208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.078559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.088083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.088694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.089279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.090186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.090707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.091197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.191426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.192193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.199136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.199882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.200402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.201225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.201773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.202281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.303683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:31.313304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:31.315106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:31.321325 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e21efc0f-5119-44ca-8936-93aef7776918 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.135094 Oct 17 13:22:31.337176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 757/1558] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:31.348279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:31.360331 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54419b98-190e-48f2-bb9a-1cd17b3007fe tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.288055 Oct 17 13:22:31.374934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 802/1559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:31.449803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.450432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.460101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.460598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.462796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.464589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.465261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.465864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.546048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.548811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.556472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.557405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.558241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.559239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.560000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.561356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.600545 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d28d111b-c3dd-4f5f-9abe-c3f3942a30ee tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060943 Oct 17 13:22:31.613488 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 803/1560] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:31.735509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:31.746696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18004272-15a2-4ab7-865e-2b280aa25335 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 0.300611 Oct 17 13:22:31.747798 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 758/1561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:31.827086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c477f49a-b36d-4f70-af59-33236af1204c req-28584445-9b92-4dd9-9e9c-5c907d3a0355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe767a4-03e3-48b0-89e1-7c478aa9ac84", "name": "network-vif-plugged", "status": "completed", "tag": "882c05fd-ff43-4220-8eef-2ca14c03c2c7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:31.857373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c477f49a-b36d-4f70-af59-33236af1204c req-28584445-9b92-4dd9-9e9c-5c907d3a0355 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.860908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c477f49a-b36d-4f70-af59-33236af1204c req-28584445-9b92-4dd9-9e9c-5c907d3a0355 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.861823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c477f49a-b36d-4f70-af59-33236af1204c req-28584445-9b92-4dd9-9e9c-5c907d3a0355 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.883946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:31.886710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:31.891685 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c477f49a-b36d-4f70-af59-33236af1204c req-28584445-9b92-4dd9-9e9c-5c907d3a0355 service nova] Creating event network-vif-plugged:882c05fd-ff43-4220-8eef-2ca14c03c2c7 for instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 on n-h1-854121-14 Oct 17 13:22:31.903367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c477f49a-b36d-4f70-af59-33236af1204c req-28584445-9b92-4dd9-9e9c-5c907d3a0355 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084923 Oct 17 13:22:31.907803 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 804/1562] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:22:31.911964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.916012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.916871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:31.917997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:31.920819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:31.923035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.105410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.113948 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc536777-f87b-40be-8e02-5288acc9a270 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.234133 Oct 17 13:22:32.114530 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 759/1563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:31 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:32.353106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:32.354735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:32.369475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.370775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.371621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.372900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.373612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.374435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.393830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:32.394440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:32.403393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.403884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.404457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.405153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.405823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.406374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.478618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.494361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.497140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.514143 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-830c5c4f-ec30-48b3-a3c9-38484cfea07f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.166903 Oct 17 13:22:32.518910 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 805/1564] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:32 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:32.618957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:32.621627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:32.622196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:32.628850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.629763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.630485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.631528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.632260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.632884 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0971e127-9b1f-4b9b-b309-0ea6a2edaaa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.250660 Oct 17 13:22:32.633251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.650228 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 760/1565] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:32 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:32.678010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1db409ec-5393-4e33-9a89-a3ab8aa7a05b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.066140 Oct 17 13:22:32.681541 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 806/1566] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:32 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:22:32.780447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:32.782284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:32.795017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.795678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.796120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.796899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:32.797426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:32.797858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:32.803972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:33.009531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.019012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf0caf05-2b2e-47e6-b354-46946d3167c0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1366 microversion: 2.1 time: 0.251604 Oct 17 13:22:33.019901 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 761/1567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:32 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:33.421651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:33.422210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:33.428419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.429133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.429634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.430558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.431017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.431629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.548506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:33.549415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:33.559541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.560647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.561192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.561967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.562547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.563077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.655539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.667026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.670478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.679106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.698949 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c74919cb-7475-4c4f-abb9-81f17355ffb5 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.154804 Oct 17 13:22:33.702996 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 762/1568] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:33 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:33.713681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:33.714525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:33.722035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.722778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.723627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.724515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.725222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.725802 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44b677f5-88d7-43f2-9598-af162d086cae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.560529 Oct 17 13:22:33.726152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.727883 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 807/1569] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:33 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:33.736734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:33.740862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:33.767383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.768289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.768925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.774418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.776162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.778207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.845187 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7067ddec-d5f7-44c8-a069-bafe15264a28 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114304 Oct 17 13:22:33.846143 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 808/1570] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:33 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:22:33.935937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4c50a736-1581-4148-9128-4d6a4fae9ede req-9cd7f17b-55d3-412d-ae53-a412ccc3f7ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f8312-a3e2-4f61-8dee-aa8bd6846f07", "name": "network-vif-plugged", "status": "completed", "tag": "e2b39662-babe-42e5-9b71-41c090d74dd3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:33.954818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4c50a736-1581-4148-9128-4d6a4fae9ede req-9cd7f17b-55d3-412d-ae53-a412ccc3f7ca service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:33.958159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:33.958780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4c50a736-1581-4148-9128-4d6a4fae9ede req-9cd7f17b-55d3-412d-ae53-a412ccc3f7ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:33.959294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4c50a736-1581-4148-9128-4d6a4fae9ede req-9cd7f17b-55d3-412d-ae53-a412ccc3f7ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:33.966994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9dfa546f-a2fd-4dc4-a66a-bec38d4e588d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.262649 Oct 17 13:22:33.968209 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 763/1571] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:33 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:33.984101 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4c50a736-1581-4148-9128-4d6a4fae9ede req-9cd7f17b-55d3-412d-ae53-a412ccc3f7ca service nova] Creating event network-vif-plugged:e2b39662-babe-42e5-9b71-41c090d74dd3 for instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 on n-h2-854121-14 Oct 17 13:22:33.989958 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4c50a736-1581-4148-9128-4d6a4fae9ede req-9cd7f17b-55d3-412d-ae53-a412ccc3f7ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060823 Oct 17 13:22:33.991132 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 809/1572] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:22:34.054322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:34.055050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:34.082879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.084966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.087739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.088752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.092911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.096457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.372681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:34.385813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34f10221-3cb4-4c43-b2a6-3245cdcbdadf tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1555 microversion: 2.1 time: 0.345426 Oct 17 13:22:34.386886 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 764/1573] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:34 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1555 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:34.411291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:34.412028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:34.434948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.435696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.436325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.437219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.437835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.438422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.654604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20bf25eb-7679-4fa2-8c19-895b2edce86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248533 Oct 17 13:22:34.662436 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 810/1574] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:22:34 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:34.736053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:34.736700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:34.750482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.752230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.754185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.755087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.755282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:34.759322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.760500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.768527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:34.797902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.801192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.807204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:34.808241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:34.811783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:34.812451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.400574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:35.416949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:35.422624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:35.437877 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e977a27-0140-42d7-9df2-895a295d61fa tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.708806 Oct 17 13:22:35.445502 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 765/1575] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:34 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:35.451711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:35.454398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:35.468554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.472265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.473013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.474069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:35.474787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:35.475816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:35.547437 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-20b64d7c-4aed-4580-a62f-b52a263b5e00 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.100146 Oct 17 13:22:35.548654 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 766/1576] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:22:35 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:35.575540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1463084940", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f00eb40b-7ce6-4995-9281-4d82713dfdfa"}], "block_device_mapping_v2": [{"uuid": "74d20eb6-ff69-49f9-93fa-b90274d1ab15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:35.809642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] validate_networks() for [('f00eb40b-7ce6-4995-9281-4d82713dfdfa', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:37.081152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.089109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43d7a90e-274a-40ff-aa9e-fd1dca6e63b7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 2.340986 Oct 17 13:22:37.089733 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 811/1577] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:34 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:37.118667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:37.119974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:37.137827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.138244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.138688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.139595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.140220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.140821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.644761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.665824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff46c8a9-451d-45a3-ac25-1292eec77c9c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.556365 Oct 17 13:22:37.670143 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 812/1578] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:37 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:37.686388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:37.687297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:37.695764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.697344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.698057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.699246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.699915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.701441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.750226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:37.750830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:37.751510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:37.752140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:37.752679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:37.778599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.779129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.781322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.786663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:37.788438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:37.789100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:37.819822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:37.842175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Getting quotas for user 3d18129f56c24321aeff6fa609f78c87 and project d24e295f59e54ff384c107e1ff637e4b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:37.967438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.983202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:37.985266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.008351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a05821c3-0e3d-44b5-9db0-2b19018e0c7a tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.334584 Oct 17 13:22:38.011525 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 813/1579] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:37 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:38.025153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:38.025153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74d20eb6-ff69-49f9-93fa-b90274d1ab15',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:38.042181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f9746b3a-ba4d-4ee8-a33b-d1602e9122d1 req-d57f226b-5fda-43f5-b9cf-a4fe18e8e05f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe767a4-03e3-48b0-89e1-7c478aa9ac84", "tag": "882c05fd-ff43-4220-8eef-2ca14c03c2c7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:38.053887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9746b3a-ba4d-4ee8-a33b-d1602e9122d1 req-d57f226b-5fda-43f5-b9cf-a4fe18e8e05f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.054888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9746b3a-ba4d-4ee8-a33b-d1602e9122d1 req-d57f226b-5fda-43f5-b9cf-a4fe18e8e05f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.055752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9746b3a-ba4d-4ee8-a33b-d1602e9122d1 req-d57f226b-5fda-43f5-b9cf-a4fe18e8e05f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.080475 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f9746b3a-ba4d-4ee8-a33b-d1602e9122d1 req-d57f226b-5fda-43f5-b9cf-a4fe18e8e05f service nova] Creating event network-changed:882c05fd-ff43-4220-8eef-2ca14c03c2c7 for instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 on n-h1-854121-14 Oct 17 13:22:38.090888 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f9746b3a-ba4d-4ee8-a33b-d1602e9122d1 req-d57f226b-5fda-43f5-b9cf-a4fe18e8e05f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061522 Oct 17 13:22:38.092892 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 814/1580] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:38.121704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:38.125752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:38.143824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.146840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.148048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.153993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.154800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.155438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.310096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e0b5be7-f6b5-4978-b280-1c6a68f6dd1b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.759692 Oct 17 13:22:38.324762 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 767/1581] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:22:38.334115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d4d5186-d4b4-4af1-ab3b-4f28b4f23015 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:38.335644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d4d5186-d4b4-4af1-ab3b-4f28b4f23015 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:38.368269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:38.523958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d4d5186-d4b4-4af1-ab3b-4f28b4f23015 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.532991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d4d5186-d4b4-4af1-ab3b-4f28b4f23015 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1053 microversion: 2.1 time: 0.205930 Oct 17 13:22:38.538179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 768/1582] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:38 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1053 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:38.575684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:38.587257 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9a778fa-5e35-4091-803b-ba8d9f0c9f71 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.474613 Oct 17 13:22:38.592641 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 815/1583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:38 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:38.696221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:38.697508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:38.716326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.716777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.717337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:38.718176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:38.718625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:38.719048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.045047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:39.045733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:39.058430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.061298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.061629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.063452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.065319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.066009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.301545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.308132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:39.317105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.323158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.355565 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-676bc901-35e2-4010-92af-a84d0c5eaab1 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.313101 Oct 17 13:22:39.357994 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 816/1584] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:39 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:39.380435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a07c4bd1-a241-48b1-8b26-bb2b2f7310e6 req-9b62f912-c7b3-4e07-b3c3-28163ae7e82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfb8d82-d37e-40fe-9c0e-44feee8ce0de", "name": "network-vif-plugged", "status": "completed", "tag": "c4b6212b-b845-4e49-8b8f-09af425bb042"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:39.418065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a07c4bd1-a241-48b1-8b26-bb2b2f7310e6 req-9b62f912-c7b3-4e07-b3c3-28163ae7e82e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.419218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a07c4bd1-a241-48b1-8b26-bb2b2f7310e6 req-9b62f912-c7b3-4e07-b3c3-28163ae7e82e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.419937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a07c4bd1-a241-48b1-8b26-bb2b2f7310e6 req-9b62f912-c7b3-4e07-b3c3-28163ae7e82e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.476477 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a07c4bd1-a241-48b1-8b26-bb2b2f7310e6 req-9b62f912-c7b3-4e07-b3c3-28163ae7e82e service nova] Creating event network-vif-plugged:c4b6212b-b845-4e49-8b8f-09af425bb042 for instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de on n-h2-854121-14 Oct 17 13:22:39.489388 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a07c4bd1-a241-48b1-8b26-bb2b2f7310e6 req-9b62f912-c7b3-4e07-b3c3-28163ae7e82e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126369 Oct 17 13:22:39.490584 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 817/1585] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:39.573718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:39.574926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:39.594690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.595333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.596583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.600696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.604937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.605692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.615502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.631171 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6eeaa801-ac34-4179-b2bd-73d1ba26fdcc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.938365 Oct 17 13:22:39.633442 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 769/1586] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:38 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:39.669379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:39.670447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:39.698475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.699729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.701896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.703473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:39.705813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:39.707381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.707896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:39.718610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dcf24bb5-4dbf-4c72-ac25-e44510ff6549 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1095 microversion: 2.1 time: 0.156492 Oct 17 13:22:39.719504 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 818/1587] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:39 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1095 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:39.972822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:39.985084 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3126e2b-c341-4be7-926b-46c249521d70 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.334626 Oct 17 13:22:39.987897 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 770/1588] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:39 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:40.393314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:40.393900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:40.407380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.408699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.409174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.410666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.411847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.412294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.540095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:40.565078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:40.567567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:40.580764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c4a8f18-0875-4e8b-a958-75a6a6a1bd92 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.187987 Oct 17 13:22:40.582813 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 819/1589] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:40 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:40.661592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:40.662232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:40.677987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.678864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.679468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.680415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.681029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.681634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.746789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:40.747876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:40.755192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.755882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.756496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.757402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:40.758208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:40.758821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:40.920279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:40.933423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cbe3a62-527f-4d83-a038-7937c3ce639a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1169 microversion: 2.1 time: 0.190545 Oct 17 13:22:40.949285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 820/1590] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:40 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1169 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:41.034031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:41.036633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:41.043139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.054293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.054736 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-463bea3c-0a11-4786-a7c1-f33267e5d2f0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.397299 Oct 17 13:22:41.059766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.060222 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 771/1591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:40 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:41.060806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.061781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.062412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.064605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.328226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.337716 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5bb66cdc-87f7-4e77-8d29-f73cfedf7e1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.327380 Oct 17 13:22:41.339729 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 821/1592] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:41 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:41.612743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:41.614154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:41.630197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.637448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.638741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.639892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.640633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.641622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.755782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.773311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.777074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:41.784388 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b64a8b6-4e2a-4d2d-b544-c2a4355980df tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.176843 Oct 17 13:22:41.785671 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 772/1593] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:41 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:41.962840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:41.963497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:41.982666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.984261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.985117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:41.989731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:41.990438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:41.991332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.080643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:42.082689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:42.111988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.112792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.113423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.117097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.120478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.121433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.349682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:42.363147 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d69bc36-029e-4ae6-b82c-974da9608ccf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1211 microversion: 2.1 time: 0.404375 Oct 17 13:22:42.363763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 822/1594] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:41 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1211 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:42.485100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:42.513132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5f93fc83-db6c-4e21-949a-60df92e6dccf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1305 microversion: 2.1 time: 0.421402 Oct 17 13:22:42.518560 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 773/1595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:42 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1305 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:42.540947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:42.542121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:42.554809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d03a90e-ca5d-474b-8e9e-7572b0450d8c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Action: 'create', calling method: .version_select at 0x7f419de9b310>, body: {"keypair": {"name": "tempest-keypair-964444787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTaYSXJfAzvdaTufaKEDlqAUsqRf2/QEyh1RHAQlZfgcWvrOMzq+R4Y5Y/HZxt2/JIwCxgO9rOpoQGccuvSt1gCTPTfgytJSKaemgeBfH/4IX+5j+OKSMrkFglRE9LInA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:42.559354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.560114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.561768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.565343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.566142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.566754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.595879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-0d03a90e-ca5d-474b-8e9e-7572b0450d8c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Getting quotas for project ba93682abaca481f8ce1796b72f6d154. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:42.616521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-0d03a90e-ca5d-474b-8e9e-7572b0450d8c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Getting quotas for user 2847e2ea14534045b45ac2fbb724c3c9 and project ba93682abaca481f8ce1796b72f6d154. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:42.675632 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d03a90e-ca5d-474b-8e9e-7572b0450d8c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.310750 Oct 17 13:22:42.677056 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 823/1596] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:22:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:42.818881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:42.819502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:42.830525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.831019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.831452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:42.849007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:42.852280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:42.854677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:43.032778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:43.051654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:43.058689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:43.073846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:43.078292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91da3aa6-c2b3-4625-b6e2-050804b441ec tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.263124 Oct 17 13:22:43.078467 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 824/1597] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:42 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:43.083338 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4d6455c-8a07-40f0-b2bc-27f8b7dfae66 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.563348 Oct 17 13:22:43.112717 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 774/1598] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:42 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:43.392181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:43.393346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:43.429716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:43.429844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:43.430201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:43.430920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:43.431371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:43.438935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:43.545605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:43.547838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:43.561960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:43.565516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:43.566297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:43.569735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:43.574235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:43.575653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:43.948859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:43.958212 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ffceb123-5fc2-419c-a372-dc6c09c0611d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1211 microversion: 2.1 time: 0.571124 Oct 17 13:22:43.977790 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 825/1599] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:43 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1211 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:44.113230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:44.114726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:44.130794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.134131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.135034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.138430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.142119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.142878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.156827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:44.167337 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76bf8294-035a-47ab-bf8a-0cf63d365fd1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1485 microversion: 2.1 time: 0.630996 Oct 17 13:22:44.174921 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 775/1600] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:43 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1485 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:44.193619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:44.194714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:44.217284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.222942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.223729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.225651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.228815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.229729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.353865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:44.368571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:44.372415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:44.396120 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08de26fb-e95a-413c-b2c5-e665e1aac6a2 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.288082 Oct 17 13:22:44.397870 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 826/1601] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:44 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:44.409662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:44.411336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:44.427351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:44.430273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.430881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.431443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.432582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.435529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.436630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.523158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lazy-loading 'flavor' on Instance uuid 437f8312-a3e2-4f61-8dee-aa8bd6846f07 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:44.641508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:44.658761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29b70ed5-0a55-43b4-8fb1-e9207026f486 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1315 microversion: 2.1 time: 0.479542 Oct 17 13:22:44.660271 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 776/1602] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:44 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:44.667135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-19be1668-a8cb-485d-883c-dc8ee905c4f5 req-26ef4e37-ac64-4b44-be79-d3ed06784f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f291851-bc65-4d61-8ced-20cef46b6afb", "tag": "dd0fae42-e55f-44c6-81c5-c29ecb3f80d8"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:44.680859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-19be1668-a8cb-485d-883c-dc8ee905c4f5 req-26ef4e37-ac64-4b44-be79-d3ed06784f00 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.682537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-19be1668-a8cb-485d-883c-dc8ee905c4f5 req-26ef4e37-ac64-4b44-be79-d3ed06784f00 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.683564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-19be1668-a8cb-485d-883c-dc8ee905c4f5 req-26ef4e37-ac64-4b44-be79-d3ed06784f00 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.701631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-19be1668-a8cb-485d-883c-dc8ee905c4f5 req-26ef4e37-ac64-4b44-be79-d3ed06784f00 service nova] Creating event network-changed:dd0fae42-e55f-44c6-81c5-c29ecb3f80d8 for instance 7f291851-bc65-4d61-8ced-20cef46b6afb on n-h1-854121-14 Oct 17 13:22:44.710983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-19be1668-a8cb-485d-883c-dc8ee905c4f5 req-26ef4e37-ac64-4b44-be79-d3ed06784f00 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049204 Oct 17 13:22:44.712637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 777/1603] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:44.796080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c4eaea8-654a-4906-ac77-d8358526e218 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07/action" status: 202 len: 0 microversion: 2.1 time: 0.394892 Oct 17 13:22:44.802177 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 827/1604] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:22:44 2022] POST /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:22:44.812085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:44.813006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:44.831556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.841964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.842840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.847354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:44.848052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:44.848673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:44.989703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:44.990566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:45.007905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:45.008457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:45.008865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:45.012052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:45.013726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:45.014376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:45.887641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:45.897111 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0bb58d25-6092-4679-9498-98e11467384d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1493 microversion: 2.1 time: 1.089009 Oct 17 13:22:45.900700 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 778/1605] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:44 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1493 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:45.907025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:45.907674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:45.918634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:45.920295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:45.920738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:45.923725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:45.927276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:45.928762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.134747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.157564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.159978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.178543 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7cecd6aa-2be0-4ad4-8128-6da04ca3086f tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1546 microversion: 2.91 time: 0.276498 Oct 17 13:22:46.187857 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 779/1606] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:45 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1546 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:46.192792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.195293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:46.199198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:46.202743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-99093edf-ba89-4dd3-bdc3-14cb974107e9 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1211 microversion: 2.1 time: 1.222361 Oct 17 13:22:46.203326 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 828/1607] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:44 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1211 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:46.211873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.213394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.214343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.218092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.219537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.220225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.226809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:46.238565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:46.256775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.265085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Searching by: {'deleted': False, 'project_id': '2da28ea822bd4a92bed60c259b24067d'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:22:46.288867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.290266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.290740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.292147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.293590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.294043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.369709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:22:46.420693 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3338fe74-4ae2-45de-a6e5-d539afb3cad9 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.216279 Oct 17 13:22:46.422485 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 829/1608] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:22:46 2022] GET /compute/v2.1/servers => generated 340 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:46.438421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:46.447112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.448927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Searching by: {'deleted': False, 'project_id': '2da28ea822bd4a92bed60c259b24067d'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:22:46.460209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.461046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.461980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.465319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.466291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.468190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.706155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:22:46.735541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.745258 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-accdd1fd-cc1e-4ba8-adda-3c201e76d7d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1503 microversion: 2.1 time: 0.555335 Oct 17 13:22:46.768052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 780/1609] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:46 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1503 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:46.778153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a57d0de-69a2-42ff-905d-23bd65e35594 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:46.792592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a57d0de-69a2-42ff-905d-23bd65e35594 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.793892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a57d0de-69a2-42ff-905d-23bd65e35594 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.803228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a57d0de-69a2-42ff-905d-23bd65e35594 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.851304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a57d0de-69a2-42ff-905d-23bd65e35594 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:22:46.875152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:46.888333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.889689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.890815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.941139 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a57d0de-69a2-42ff-905d-23bd65e35594 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de/action" status: 202 len: 0 microversion: 2.1 time: 0.170926 Oct 17 13:22:46.942596 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 781/1610] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:22:46 2022] POST /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:22:46.965396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:46.966594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:46.985595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.986423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.987264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:46.988176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:46.988829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:46.989973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.222906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2823d387-041a-4c24-8893-e23887964fa4 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.788370 Oct 17 13:22:47.224227 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 830/1611] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:22:46 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:47.230247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:47.231109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:47.249780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.250566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.251182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.252098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.252985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.253631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.389239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:47.402755 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2edc2a39-2faa-4bc5-aaaa-1fdde45ab188 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 200 len: 1476 microversion: 2.1 time: 0.444802 Oct 17 13:22:47.404209 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 782/1612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:46 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:47.411762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:47.412883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:47.424017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.430536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.431322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.433042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.433634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.434184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.580901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:47.599920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:47.613937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:47.633299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9860dc9f-048f-4bfb-a31a-743184bbc879 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1533 microversion: 2.91 time: 0.226462 Oct 17 13:22:47.633731 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 783/1613] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:47 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1533 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:47.640597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:47.641142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:47.650580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.651435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.651885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.652600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.653675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.654121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.687369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:47.698567 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-461fa63d-82f0-4939-88c8-a4482c9a4f3b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.473052 Oct 17 13:22:47.702846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 831/1614] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:47 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:47.710145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e9f56c0-4076-42e0-8c76-7abbec9a838d tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:47.734156 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e9f56c0-4076-42e0-8c76-7abbec9a838d tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029619 Oct 17 13:22:47.735160 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 832/1615] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:22:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:47.745833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1139517843"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:47.749344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:47.759370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.760394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.761012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.762250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:47.762924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:47.763565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:47.787807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:47.809739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:48.103260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0568d438-ffed-4582-8c55-ba4cd36c830f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07/action" status: 202 len: 0 microversion: 2.1 time: 0.364664 Oct 17 13:22:48.108636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 833/1616] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:22:47 2022] POST /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:22:48.124394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.126707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:48.143152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.144842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.145596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.148673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.149455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.152936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.225081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:48.238499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d5114f2-a9a7-4c60-aca6-28252f78bbbe tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1211 microversion: 2.1 time: 0.603447 Oct 17 13:22:48.240277 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 784/1617] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:47 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1211 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:48.250459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.251285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:48.276943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.277470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.277949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.278685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.279186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.279624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.297245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] Lazy-loading 'services' on Instance uuid c681d09b-d520-40d3-90a6-4cc5e3d169d8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:48.328110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cdbd3a17-815e-4fcb-bb0d-13bd977927d6 tempest-UnshelveToHostMultiNodesTest-1030819671 tempest-UnshelveToHostMultiNodesTest-1030819671-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1940 microversion: 2.91 time: 0.217532 Oct 17 13:22:48.339558 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 834/1618] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:48 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1940 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:48.345292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd9118f5-3571-47ce-8181-849bb3061d57 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419eaa0310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.372858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:22:48.428031 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd9118f5-3571-47ce-8181-849bb3061d57 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.085475 Oct 17 13:22:48.428652 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 835/1619] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:48 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:48.451487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.452003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:48.459006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.459505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.459947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.460655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.461110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.461627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.548362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:22:48.551113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:48.587626 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53710ea4-832c-46c3-871e-4045a373b4ab tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 204 len: 0 microversion: 2.1 time: 0.334150 Oct 17 13:22:48.593751 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 785/1620] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:22:48 2022] DELETE /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:22:48.600182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.600887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:48.609106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.609947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.610391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.611103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.611555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.611978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.745254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6900c357-b5a8-48bf-8b6a-7022f75fe737 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 204 len: 0 microversion: 2.91 time: 0.300380 Oct 17 13:22:48.746546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 836/1621] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:22:48 2022] DELETE /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:22:48.752923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2070609786", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "fff6ce91-7170-42e0-8df6-966d4a00bf20"}], "security_groups": [{"name": "tempest-securitygroup--582341620"}], "key_name": "tempest-keypair-964444787", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:48.834170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:48.857640 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c87299f7-87c7-478f-83e2-294f09662399 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1715 microversion: 2.1 time: 0.262231 Oct 17 13:22:48.858865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 786/1622] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:48 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1715 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:48.876213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:48.877272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:48.884344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.885134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.885601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.886943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:48.887839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:48.888704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:48.911136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] validate_networks() for [('fff6ce91-7170-42e0-8df6-966d4a00bf20', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:22:49.135195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:49.154605 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2a9b1e1-f1e2-4faa-bca9-5ab082fc2d1f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.294198 Oct 17 13:22:49.155755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 787/1623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:48 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:49.162041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:49.163672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:49.173718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.174550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.175194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.176101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.176744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.177640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.275877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:49.287002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:49.288720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:49.296901 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95648d65-e7ad-4856-9679-2b6ae0252c41 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.139818 Oct 17 13:22:49.297798 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 788/1624] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:49.304186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:49.304993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:49.311946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.312432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.313055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.313982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.314599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.315189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.564082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:49.574815 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef1c21d2-e3b1-41b4-84f3-ce4feaf92968 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1211 microversion: 2.1 time: 0.275443 Oct 17 13:22:49.575815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 789/1625] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1211 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:49.582127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-531b75a9-bd46-4a2d-9aea-c259f49de368 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419db4bb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:49.646891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Getting quotas for project ba93682abaca481f8ce1796b72f6d154. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:49.655789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-531b75a9-bd46-4a2d-9aea-c259f49de368 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.079179 Oct 17 13:22:49.656392 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 790/1626] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:49.657299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Getting quotas for user 2847e2ea14534045b45ac2fbb724c3c9 and project ba93682abaca481f8ce1796b72f6d154. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:49.672274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:22:49.672798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:22:49.673411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:22:49.673898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:22:49.674327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:22:49.685870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.686362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.686802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.687541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.687998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.688482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.706433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Getting quotas for project ba93682abaca481f8ce1796b72f6d154. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:22:49.713737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Getting quotas for user 2847e2ea14534045b45ac2fbb724c3c9 and project ba93682abaca481f8ce1796b72f6d154. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:22:49.729473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:22:49.732190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:22:49.789090 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1187e9cb-4cd5-47a8-800d-08f2063e2ee7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.040890 Oct 17 13:22:49.796166 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 837/1627] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:22:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:22:49.801813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c06176ae-7d34-48c4-b5ac-f1dd4e3f9401 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:49.802521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c06176ae-7d34-48c4-b5ac-f1dd4e3f9401 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:49.865507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c06176ae-7d34-48c4-b5ac-f1dd4e3f9401 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:49.880309 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c06176ae-7d34-48c4-b5ac-f1dd4e3f9401 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1269 microversion: 2.1 time: 0.082639 Oct 17 13:22:49.881623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 791/1628] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:49.883667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:49.884392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:49.908750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.913927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.915253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:49.916869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:49.918427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:49.919055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.114596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.126741 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-017e7ed4-9b80-40fd-b06c-dbded8c999eb tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1715 microversion: 2.1 time: 0.247885 Oct 17 13:22:50.129214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 838/1629] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:49 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1715 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:50.182924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:50.183965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:50.195693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.196506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.196948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.205683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.206274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.206729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.329039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:50.330073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:50.336595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.337089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.342529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.344799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.348329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.349180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.381647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.412695 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b71560f-dafd-4c84-9e1d-8ab08ed412a2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.234529 Oct 17 13:22:50.420187 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 792/1630] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:50 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:50.451677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.462643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.465014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '77530dc1aed441e486925375db5d69e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae8d7b55ffd4806b385a96033410164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.471542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60194fd4-d4e2-421e-bfd2-6b1621858027 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 200 len: 1539 microversion: 2.91 time: 0.146454 Oct 17 13:22:50.472300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 839/1631] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:50 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 1539 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:50.599321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:50.599938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:50.609979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.611002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.611457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.612226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.612684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.613111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.671783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4851968-56f5-42de-8fb2-4b52f8ed35c4 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e5bf5e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:50.738813 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4851968-56f5-42de-8fb2-4b52f8ed35c4 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.070917 Oct 17 13:22:50.739596 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 840/1632] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:50 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:50.799520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:50.810927 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3755609a-599b-4dab-a123-709c0350028c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.216069 Oct 17 13:22:50.811881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 793/1633] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:50 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:50.905753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:50.906558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:50.918350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.918934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.919440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:50.920539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:50.921331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:50.921838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.005684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:51.025705 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72da3c1e-3fa6-4144-b799-0f7772fca2bf tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1321 microversion: 2.1 time: 0.121291 Oct 17 13:22:51.039133 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 841/1634] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:50 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1321 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:51.151610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.152429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:51.160683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.161426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.163698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.164500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.165330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.167117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.250403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:51.262229 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08c40b56-aa58-4674-b356-3c5b2d72bb56 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1647 microversion: 2.1 time: 0.115330 Oct 17 13:22:51.263335 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 794/1635] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1647 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:51.440343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.440973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:51.451645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.452655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.453359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.456942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.458126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.458812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.500964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.502148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] [instance: c681d09b-d520-40d3-90a6-4cc5e3d169d8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:51.522501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.523375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.526906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.527880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.530218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.530960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.600178 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] HTTP exception thrown: Instance c681d09b-d520-40d3-90a6-4cc5e3d169d8 could not be found. Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Request method failure captured: Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 HTTP/1.1 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ2pbBEzfQVDCnahtFTlrJu6mKWKeVp-lz1c1WrRN9VANbjeXVUtUaRRzpbvLJQsLeLYXX5jpsSt8fJuNq-FkKDspvBoWvuWBLYHzLYu-tOZ1bssXDzeuZYuxrNWnTDRGNKZAjay7aIRZD3SFST-qogLFWOc6-c-3ILdwux2nNkLbM Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.91 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3ae8d7b55ffd4806b385a96033410164 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-655826053 Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:22:51.602719 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae8d7b55ffd4806b385a96033410164"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae8d7b55ffd4806b385a96033410164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae8d7b55ffd4806b385a96033410164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae8d7b55ffd4806b385a96033410164"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-655826053 Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3ae8d7b55ffd4806b385a96033410164 Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-655826053 Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-UnshelveToHostMultiNodesTest-655826053-project Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 77530dc1aed441e486925375db5d69e7 Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-655826053-project Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c681d09b-d520-40d3-90a6-4cc5e3d169d8 could not be found. Oct 17 13:22:51.604622 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c681d09b-d520-40d3-90a6-4cc5e3d169d8'} Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c681d09b-d520-40d3-90a6-4cc5e3d169d8 could not be found. Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:51.605574 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c681d09b-d520-40d3-90a6-4cc5e3d169d8 could not be found. Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c681d09b-d520-40d3-90a6-4cc5e3d169d8 could not be found. Oct 17 13:22:51.607080 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:51.609924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] Returning 404 to user: Instance c681d09b-d520-40d3-90a6-4cc5e3d169d8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:51.609924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-141dbe1d-96c0-4fd6-9df1-8ee0cf910490 tempest-UnshelveToHostMultiNodesTest-655826053 tempest-UnshelveToHostMultiNodesTest-655826053-project] 10.222.0.65 "GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8" status: 404 len: 111 microversion: 2.91 time: 0.109173 Oct 17 13:22:51.610962 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 795/1636] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/servers/c681d09b-d520-40d3-90a6-4cc5e3d169d8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:22:51.617756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-01e3fa0c-dc61-41f7-a769-d868d593849b req-b2deb23c-f584-4e30-a884-651dee612ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f52e3dc-1171-465e-8def-abdf79bc5cba", "name": "network-vif-deleted", "tag": "106c51ee-a166-4a2b-a4ae-b3fc98394112"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:51.632518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-01e3fa0c-dc61-41f7-a769-d868d593849b req-b2deb23c-f584-4e30-a884-651dee612ab3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.633234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-01e3fa0c-dc61-41f7-a769-d868d593849b req-b2deb23c-f584-4e30-a884-651dee612ab3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.633987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-01e3fa0c-dc61-41f7-a769-d868d593849b req-b2deb23c-f584-4e30-a884-651dee612ab3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.659826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-01e3fa0c-dc61-41f7-a769-d868d593849b req-b2deb23c-f584-4e30-a884-651dee612ab3 service nova] Creating event network-vif-deleted:106c51ee-a166-4a2b-a4ae-b3fc98394112 for instance 4f52e3dc-1171-465e-8def-abdf79bc5cba on n-h1-854121-14 Oct 17 13:22:51.685839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-01e3fa0c-dc61-41f7-a769-d868d593849b req-b2deb23c-f584-4e30-a884-651dee612ab3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071398 Oct 17 13:22:51.686970 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 796/1637] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:51.757398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a391cfa1-2795-45f6-9a28-d5b615a5e026 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419db3a790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.873676 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a391cfa1-2795-45f6-9a28-d5b615a5e026 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.122020 Oct 17 13:22:51.874983 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 797/1638] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:51.875690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:51.887140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:51.891765 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17aa48e8-2f7e-4682-98cf-8025fd2b94ed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.455692 Oct 17 13:22:51.908967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:51.913473 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 842/1639] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:51.936896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.946652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.950245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:51.952939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:51.954588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:51.960361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.043020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:52.054332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:52.055070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:52.066886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.072892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.073462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.074971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.086941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.089054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.261749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:52.278954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e3e86ad-95ba-46df-9b22-889c9963587e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1327 microversion: 2.1 time: 0.229469 Oct 17 13:22:52.283280 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 843/1640] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:52 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1327 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:52.292334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:52.295665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:52.310723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.311973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.316746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:52.325424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.328626 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ecabd46-6f5e-4431-aedd-42b25527371e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.452476 Oct 17 13:22:52.328920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.329667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.330175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.331437 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 798/1641] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:51 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:52.392301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.392794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.393261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.393698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lazy-loading 'fault' on Instance uuid 4f52e3dc-1171-465e-8def-abdf79bc5cba {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:22:52.445635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676131cb58654000b52e2493aa159cb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da28ea822bd4a92bed60c259b24067d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:52.456266 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b76cc95-322c-4faf-8619-f798f245a866 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 200 len: 1368 microversion: 2.1 time: 0.171632 Oct 17 13:22:52.457422 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 844/1642] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:52 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:52.892260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1cb27554-be37-4d1f-af63-7974059c0ad4 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc9a280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:52.919963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:52.920585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:52.941323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.941825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.942262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:52.942967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:52.951233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:52.955812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.014883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1cb27554-be37-4d1f-af63-7974059c0ad4 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.130056 Oct 17 13:22:53.015483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 799/1643] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:52 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:53.304567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:53.305485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:53.317610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.318425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.319062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.319988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.320638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.321263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.373596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:53.383279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cfd4db7-e2b6-4583-8c38-993bea2b8aea tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.468125 Oct 17 13:22:53.387872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 845/1644] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:52 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:53.397713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:53.398666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:53.410238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.414786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.417644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.421264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.423317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.423759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.608011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:53.617698 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-855a348f-381c-4bd2-8c52-d322dad703ca tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.317438 Oct 17 13:22:53.620542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 800/1645] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:53 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:53.638799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:53.640632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] [instance: 4f52e3dc-1171-465e-8def-abdf79bc5cba] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:53.653116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.653934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.656795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.657832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:53.658496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:53.660233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:53.701983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] HTTP exception thrown: Instance 4f52e3dc-1171-465e-8def-abdf79bc5cba could not be found. Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Request method failure captured: Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba HTTP/1.1 Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVbhtxvNIHsTw5aO1tYBBery8lhhntOHZO81si2n-ei_-st-Q7FeJSky_6BxB3WDEu7FYhjN07xsv5ZkJTtEIq2VlC3SZ1fYIGPwicwqC311MxjVowi8XlT0afuFj9kYJzEqc99WYoBnx9lBy4ko2Pds3VjOnd9EIGcWv_n-xGTplwk Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2da28ea822bd4a92bed60c259b24067d Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestManualDisk-725410310 Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:22:53.703677 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2da28ea822bd4a92bed60c259b24067d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2da28ea822bd4a92bed60c259b24067d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2da28ea822bd4a92bed60c259b24067d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2da28ea822bd4a92bed60c259b24067d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestManualDisk-725410310 Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2da28ea822bd4a92bed60c259b24067d Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestManualDisk-725410310 Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestManualDisk-725410310-project Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 676131cb58654000b52e2493aa159cb5 Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestManualDisk-725410310-project Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4f52e3dc-1171-465e-8def-abdf79bc5cba could not be found. Oct 17 13:22:53.705309 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4f52e3dc-1171-465e-8def-abdf79bc5cba'} Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f52e3dc-1171-465e-8def-abdf79bc5cba could not be found. Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:53.706247 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f52e3dc-1171-465e-8def-abdf79bc5cba could not be found. Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f52e3dc-1171-465e-8def-abdf79bc5cba could not be found. Oct 17 13:22:53.708332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:22:53.711224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Returning 404 to user: Instance 4f52e3dc-1171-465e-8def-abdf79bc5cba could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:53.711224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb497625-8a0e-40b6-97f4-e3ea22949bee tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba" status: 404 len: 111 microversion: 2.1 time: 0.084597 Oct 17 13:22:53.711224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 801/1646] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:53 2022] GET /compute/v2.1/servers/4f52e3dc-1171-465e-8def-abdf79bc5cba => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:22:53.717447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c05778a-cc7c-4896-bd9e-5b7ca942bf58 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] Calling method '.version_select at 0x7f419db4b5e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:53.756297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c05778a-cc7c-4896-bd9e-5b7ca942bf58 tempest-ServersTestManualDisk-725410310 tempest-ServersTestManualDisk-725410310-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007155954" status: 202 len: 0 microversion: 2.1 time: 0.044119 Oct 17 13:22:53.757505 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 802/1647] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007155954 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:22:53.843995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:53.861080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98171a28-db85-4909-a313-19d3ede02bfd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.471517 Oct 17 13:22:53.862068 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 846/1648] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:53 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:54.031207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9d5a59b-2af8-4ed1-9166-6ab83d841ba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc6d8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:54.117828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9d5a59b-2af8-4ed1-9166-6ab83d841ba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.090424 Oct 17 13:22:54.120843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 803/1649] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:54 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:54.409233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:54.410972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:54.421516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.422551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.423277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.424586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.425113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.425820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.492860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ed24742e-0205-416a-9705-25c6b80a442a req-760dbc71-0c66-43d8-9def-0af3c644243f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688bafde-0fa7-4b7c-990d-6afcdbd8f554", "tag": "cb063e1b-4df3-486b-9139-9f675eb246b3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:54.505429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed24742e-0205-416a-9705-25c6b80a442a req-760dbc71-0c66-43d8-9def-0af3c644243f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.506249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed24742e-0205-416a-9705-25c6b80a442a req-760dbc71-0c66-43d8-9def-0af3c644243f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.506920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed24742e-0205-416a-9705-25c6b80a442a req-760dbc71-0c66-43d8-9def-0af3c644243f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.524177 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ed24742e-0205-416a-9705-25c6b80a442a req-760dbc71-0c66-43d8-9def-0af3c644243f service nova] Creating event network-changed:cb063e1b-4df3-486b-9139-9f675eb246b3 for instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 on n-h1-854121-14 Oct 17 13:22:54.530273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ed24742e-0205-416a-9705-25c6b80a442a req-760dbc71-0c66-43d8-9def-0af3c644243f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043082 Oct 17 13:22:54.531618 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 804/1650] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:54.558217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-decee2d0-ba72-4a7d-a835-672151d7334a req-79919dda-16eb-48b4-8102-ea31c0ace5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f8312-a3e2-4f61-8dee-aa8bd6846f07", "name": "network-vif-plugged", "status": "completed", "tag": "e2b39662-babe-42e5-9b71-41c090d74dd3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:54.582063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-decee2d0-ba72-4a7d-a835-672151d7334a req-79919dda-16eb-48b4-8102-ea31c0ace5d2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.584668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-decee2d0-ba72-4a7d-a835-672151d7334a req-79919dda-16eb-48b4-8102-ea31c0ace5d2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.586136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-decee2d0-ba72-4a7d-a835-672151d7334a req-79919dda-16eb-48b4-8102-ea31c0ace5d2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.596907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:54.609522 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96cf8243-a71e-49d9-b30c-79f6840ce495 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.204991 Oct 17 13:22:54.611010 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 847/1651] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:54 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:54.615246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-decee2d0-ba72-4a7d-a835-672151d7334a req-79919dda-16eb-48b4-8102-ea31c0ace5d2 service nova] Creating event network-vif-plugged:e2b39662-babe-42e5-9b71-41c090d74dd3 for instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 on n-h2-854121-14 Oct 17 13:22:54.625596 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-decee2d0-ba72-4a7d-a835-672151d7334a req-79919dda-16eb-48b4-8102-ea31c0ace5d2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077260 Oct 17 13:22:54.627679 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 805/1652] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:22:54.645153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:54.646093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:54.657973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.659103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.660083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.661604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.662325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.662982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.817441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:54.827996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7caae2e-1188-4d44-9b21-d6b8eea1dcd4 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.187039 Oct 17 13:22:54.828867 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 848/1653] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:54 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:54.890045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:54.890670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:54.897521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.898315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.898927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:54.899839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:54.900462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:54.901066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.073657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:55.103889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46ee86b6-4812-41eb-8f70-8cb0cbaafd77 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.215712 Oct 17 13:22:55.117187 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 806/1654] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:54 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:55.138830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32e2302c-a6cc-4d27-a63b-85464c41b50e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e225dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:55.204697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32e2302c-a6cc-4d27-a63b-85464c41b50e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.072538 Oct 17 13:22:55.205873 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 849/1655] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:55 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:55.642225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:55.643059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:55.653225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:55.654268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:55.655994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.656945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:55.657798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:55.658423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.840569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:55.869754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e0d0170-bffc-42a1-b177-4b56beaf625f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.236414 Oct 17 13:22:55.870731 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 807/1656] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:55 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:55.875625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:55.876195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:55.894556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:55.896649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:55.897281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.898152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:55.898933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:55.899458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:55.943240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:56.129427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:56.130100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:56.142440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:56.143401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:56.144009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:56.144919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:56.145881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:56.147795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:56.157124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:56.167728 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2ca3903-69a3-439e-af32-61458c3450f1 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.303948 Oct 17 13:22:56.171296 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 850/1657] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:55 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:56.220736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95f10a4e-be21-4d42-a613-25d2aa732729 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e225700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:56.325365 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95f10a4e-be21-4d42-a613-25d2aa732729 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.108237 Oct 17 13:22:56.337406 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 851/1658] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:56 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:56.385309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:56.396834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-976b834e-89c8-43f1-a2aa-b108a7f9cedb tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.271232 Oct 17 13:22:56.398954 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 808/1659] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:56 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:56.908102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:56.910280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:56.919060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:56.919722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:56.920163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:56.932549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:56.935032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:56.935515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.190336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:57.191718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:57.211058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.211951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.213316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.214301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.215005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.215672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.289850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:57.302224 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be430355-d704-493a-8477-3a584c9f612e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.404851 Oct 17 13:22:57.302811 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 852/1660] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:56 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:57.519167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:57.535207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-049086d7-e5a3-4c36-82c7-a2b1c7f20f5c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.348681 Oct 17 13:22:57.536060 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 809/1661] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:57 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:57.559283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d06fb16f-8d8f-4fe4-8232-3a31c845eb78 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419db485e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:57.594960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Action: 'update', calling method: .version_select at 0x7f419ddb3a60>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:57.599082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.599572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.600091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.644967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.645753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.646519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.682476 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] HTTP exception thrown: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Request method failure captured: Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc HTTP/1.1 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 56 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVcwHEYu7w9jSK9srmPPvSM1xC1Noas71zLwjMKyCN7KZAiKrRUEuVlzVzV4J_3dwjtZ5JqtdoITA4vE0igAa6qlBgpJ2pw6QdEmEjscMCb44_7mSpOXTzxVCSNbCamQz6wXTjBqXHrCFJGdHObf0T58dYaeAjcz3W7femRwr35vjQ0 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3281da87a884401a808eb533a3d014e3 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:22:57.698783 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3281da87a884401a808eb533a3d014e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3281da87a884401a808eb533a3d014e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3281da87a884401a808eb533a3d014e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3281da87a884401a808eb533a3d014e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3281da87a884401a808eb533a3d014e3 Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 0f65e44577e643b9983f459946356524 Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:22:57.700770 n-d-854121-14 devstack@n-api.service[120698]: exception: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'afc7fef6-f025-4c03-b7df-db62fc4665dc', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.701972 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:57.703985 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:57.705744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:57.705744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.705744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.706017 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d06fb16f-8d8f-4fe4-8232-3a31c845eb78 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.146180 Oct 17 13:22:57.706017 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 810/1662] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:57 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:57.707003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Returning 404 to user: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:57.710595 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e72d1fd6-86f8-40ac-abea-a6e03490a5cb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc" status: 404 len: 110 microversion: 2.53 time: 0.404329 Oct 17 13:22:57.711403 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 853/1663] 10.222.0.65 () {62 vars in 1309 bytes} [Mon Oct 17 13:22:57 2022] PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc => generated 110 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:22:57.716201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:57.716201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:57.727995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.729106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.732425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Action: 'update', calling method: .version_select at 0x7f419e19fc10>, body: {"status": "disabled"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:57.732988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.733847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.734501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.738687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.742498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.745084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.745861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.751766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.752392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.752967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.766607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] HTTP exception thrown: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Request method failure captured: Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc HTTP/1.1 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 22 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVcwHEYu7w9jSK9srmPPvSM1xC1Noas71zLwjMKyCN7KZAiKrRUEuVlzVzV4J_3dwjtZ5JqtdoITA4vE0igAa6qlBgpJ2pw6QdEmEjscMCb44_7mSpOXTzxVCSNbCamQz6wXTjBqXHrCFJGdHObf0T58dYaeAjcz3W7femRwr35vjQ0 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3281da87a884401a808eb533a3d014e3 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:22:57.770179 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3281da87a884401a808eb533a3d014e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3281da87a884401a808eb533a3d014e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3281da87a884401a808eb533a3d014e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3281da87a884401a808eb533a3d014e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3281da87a884401a808eb533a3d014e3 Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 0f65e44577e643b9983f459946356524 Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: {"status": "disabled"} Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: exception: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.772461 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'afc7fef6-f025-4c03-b7df-db62fc4665dc', 'body': {'status': 'disabled'}} Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.773882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:57.776458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:57.778136 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.778136 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.778136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Returning 404 to user: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:57.783585 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e778206-fcfe-477c-a98c-9b18adacd564 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc" status: 404 len: 110 microversion: 2.53 time: 0.058615 Oct 17 13:22:57.783585 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 854/1664] 10.222.0.65 () {62 vars in 1309 bytes} [Mon Oct 17 13:22:57 2022] PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:22:57.812090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Action: 'update', calling method: .version_select at 0x7f419e2258b0>, body: {"status": "enabled"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:22:57.821527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.822536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.823383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.836692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.840576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.841573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.855205 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] HTTP exception thrown: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Request method failure captured: Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc HTTP/1.1 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 21 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVcwHEYu7w9jSK9srmPPvSM1xC1Noas71zLwjMKyCN7KZAiKrRUEuVlzVzV4J_3dwjtZ5JqtdoITA4vE0igAa6qlBgpJ2pw6QdEmEjscMCb44_7mSpOXTzxVCSNbCamQz6wXTjBqXHrCFJGdHObf0T58dYaeAjcz3W7femRwr35vjQ0 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3281da87a884401a808eb533a3d014e3 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:22:57.862468 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3281da87a884401a808eb533a3d014e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3281da87a884401a808eb533a3d014e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3281da87a884401a808eb533a3d014e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3281da87a884401a808eb533a3d014e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3281da87a884401a808eb533a3d014e3 Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227 Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 0f65e44577e643b9983f459946356524 Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: {"status": "enabled"} Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: exception: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.864084 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'afc7fef6-f025-4c03-b7df-db62fc4665dc', 'body': {'status': 'enabled'}} Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.865109 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:22:57.866605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:22:57.867995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. Oct 17 13:22:57.867995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:57.873607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Returning 404 to user: Service afc7fef6-f025-4c03-b7df-db62fc4665dc could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:57.875276 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7cc8c86e-ed77-4615-9677-5a5c83caaeec tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc" status: 404 len: 110 microversion: 2.53 time: 0.083995 Oct 17 13:22:57.878972 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 855/1665] 10.222.0.65 () {62 vars in 1309 bytes} [Mon Oct 17 13:22:57 2022] PUT /compute/v2.1/os-services/afc7fef6-f025-4c03-b7df-db62fc4665dc => generated 110 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:22:57.895122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:57.899255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.904311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.905214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.906325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:57.911714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:57.913000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:57.993341 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-863609c7-7054-40e0-89c8-fd25cd93feda tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.109077 Oct 17 13:22:58.012635 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 856/1666] 10.222.0.65 () {60 vars in 1178 bytes} [Mon Oct 17 13:22:57 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:58.018909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.023770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.024490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.055947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.055947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.055947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.057007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.092300 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec854869-5eb4-4b59-a72b-d14357214da1 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.077809 Oct 17 13:22:58.095309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:58.096414 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 857/1667] 10.222.0.65 () {60 vars in 1211 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:58.111409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.112209 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-858fd266-426d-4da2-bb2e-8015124dd850 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.407849 Oct 17 13:22:58.122880 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 811/1668] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:57 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:58.124231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.125011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.125807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.126833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.127527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.128191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.174043 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ebee26b8-e62a-45df-a644-c5d63fbb1f01 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.067796 Oct 17 13:22:58.175387 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 858/1669] 10.222.0.65 () {60 vars in 1178 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:22:58.189824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.194348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.194989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.195255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.200804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.201605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.204515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.258516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:58.278704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39d7fed9-bdc7-4672-8dac-aea7111d64eb tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?host=n-d-854121-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.094383 Oct 17 13:22:58.279644 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 812/1670] 10.222.0.65 () {60 vars in 1237 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/os-services?host=n-d-854121-14&binary=xxx => generated 16 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:58.292516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.296548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.297035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.301882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.302693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.303168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.303598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.331828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.333024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:58.339457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.340331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.341364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.342342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.343398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.344219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.365539 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff4e7622-e709-4c71-85a0-58cf1819d0f4 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.077818 Oct 17 13:22:58.366485 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 859/1671] 10.222.0.65 () {60 vars in 1178 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:22:58.379649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.384248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.385572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.400713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.402222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.404973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.405666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.460348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:58.490346 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e41a2b01-3cd7-431c-8c81-f0352bd96050 tempest-ServicesAdminNegativeV253TestJSON-1947492227 tempest-ServicesAdminNegativeV253TestJSON-1947492227-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.114242 Oct 17 13:22:58.493621 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 860/1672] 10.222.0.65 () {60 vars in 1239 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:58.626932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:58.638458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe69990c-4390-4d8f-9cd3-f0c8830e175b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.312632 Oct 17 13:22:58.643597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 813/1673] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:58.648617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.652840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:58.667396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.668969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.670533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.672799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:58.674285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:58.675604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:58.735509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5198c83c-5307-470e-a44c-203dbe1579c5 tempest-ServicesAdminNegativeV253TestJSON-670904603 tempest-ServicesAdminNegativeV253TestJSON-670904603-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.739101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5198c83c-5307-470e-a44c-203dbe1579c5 tempest-ServicesAdminNegativeV253TestJSON-670904603 tempest-ServicesAdminNegativeV253TestJSON-670904603-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4eae4c7a8ffd41239af1684c8e09e7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c1e5e3c402141e6bc4a2b07cdd11eda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5198c83c-5307-470e-a44c-203dbe1579c5 tempest-ServicesAdminNegativeV253TestJSON-670904603 tempest-ServicesAdminNegativeV253TestJSON-670904603-project] Request method failure captured: Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVcwGEEF71Km3qGf74PbHGSYfFQ5RJCU-YendVuS9RluKXV9F8oJGpJxxn4LmgbVVNxU2bSVm4MGAgeij3g_gOdUUQoCRco09d89CgkWfM3HBtFjCx6JmBHWXFz850G3DDveD27W0mrBcLIh1ep_RXzbEtKpnbOJsY388kiXvdp9EX0 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.53 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 5c1e5e3c402141e6bc4a2b07cdd11eda Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-670904603 Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:22:58.745000 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5c1e5e3c402141e6bc4a2b07cdd11eda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5c1e5e3c402141e6bc4a2b07cdd11eda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5c1e5e3c402141e6bc4a2b07cdd11eda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5c1e5e3c402141e6bc4a2b07cdd11eda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-670904603 Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 5c1e5e3c402141e6bc4a2b07cdd11eda Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-670904603 Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServicesAdminNegativeV253TestJSON-670904603-project Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4eae4c7a8ffd41239af1684c8e09e7ff Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-670904603-project Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:22:58.746674 n-d-854121-14 devstack@n-api.service[120698]: action_args: {} Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:22:58.747576 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:22:58.748926 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:22:58.753150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5198c83c-5307-470e-a44c-203dbe1579c5 tempest-ServicesAdminNegativeV253TestJSON-670904603 tempest-ServicesAdminNegativeV253TestJSON-670904603-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:22:58.753150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5198c83c-5307-470e-a44c-203dbe1579c5 tempest-ServicesAdminNegativeV253TestJSON-670904603 tempest-ServicesAdminNegativeV253TestJSON-670904603-project] 10.222.0.65 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.243944 Oct 17 13:22:58.758052 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 861/1674] 10.222.0.65 () {60 vars in 1178 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/os-services => generated 112 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:22:58.763504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd968276-3e4c-420f-8b69-f504aa067e4d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dfc3dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:58.867922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd968276-3e4c-420f-8b69-f504aa067e4d tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.108587 Oct 17 13:22:58.876692 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 862/1675] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:59.143282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:59.144003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:59.161094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.167146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.167643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.168422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.168899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.177099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.457904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:59.468556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f704ede-97d4-4544-b761-5b21bac50917 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.823565 Oct 17 13:22:59.488900 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 814/1676] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:58 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:22:59.678523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:59.685932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:22:59.709626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.710289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.712981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.714033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:22:59.714739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:22:59.715394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:22:59.721001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:59.735963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:22:59.752007 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0fb82bdc-76b6-423c-9ab7-8a5817fb2e99 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.608548 Oct 17 13:22:59.754902 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 863/1677] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:59 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:22:59.879684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:22:59.884616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fabfa0d5-f521-44cb-b827-e386e8a62b36 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419de86b80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:22:59.953550 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fabfa0d5-f521-44cb-b827-e386e8a62b36 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.073368 Oct 17 13:22:59.961671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 864/1678] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:22:59 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:00.402800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:00.423498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c80c1e5-8e1b-46f8-b024-fed3d26a1013 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.752822 Oct 17 13:23:00.435387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 815/1679] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:22:59 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:00.499230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:00.500459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:00.516017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.521551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.522256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.523192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.536059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.536884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.776364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:00.778086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:00.793890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.794427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.794902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:00.795820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:00.796163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:00.796638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.769738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:01.784151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-827f7717-88ae-43cc-8f21-da7d11d3a8d9 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 1.289535 Oct 17 13:23:01.785620 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 865/1680] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:00 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:01.792136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50637400-1c53-40d9-99d8-e3545d0a77dc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddb30d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:01.901833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50637400-1c53-40d9-99d8-e3545d0a77dc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.114435 Oct 17 13:23:01.910984 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 866/1681] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:01 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:01.931257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:01.932257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:01.942085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:01.942985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:01.943694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:01.944696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:01.945417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:01.946128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:02.589536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:02.598164 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f36dde6e-9825-41bd-bd04-009b6c6d7e27 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 1.826060 Oct 17 13:23:02.598917 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 816/1682] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:00 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:02.771034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:02.784845 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e19736fe-65aa-46dd-b47e-c2a1a6d13f24 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.871622 Oct 17 13:23:02.798496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 867/1683] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:01 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:02.811224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:02.811915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:02.825185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:02.826117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:02.826633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:02.827486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:02.827956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:02.828472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:02.919048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-558f22df-7bae-4bb6-b876-d29c2857f5dc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e1671f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.043606 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-558f22df-7bae-4bb6-b876-d29c2857f5dc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.129127 Oct 17 13:23:03.055063 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 868/1684] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:02 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:03.176656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:03.192619 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af9b7871-cf60-4112-8a14-0d8098fb8485 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.386063 Oct 17 13:23:03.215166 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 817/1685] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:02 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:03.520565 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6fa36360-6fce-4bdc-8c64-a8387c807be4 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] 10.222.0.65 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.278656 Oct 17 13:23:03.526593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 869/1686] 10.222.0.65 () {58 vars in 1128 bytes} [Mon Oct 17 13:23:03 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 17 13:23:03.533688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26566962-567f-47c6-90da-bb1f13bdce59 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Calling method '.version_select at 0x7f419dc6de50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.626257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.626877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:03.639189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:03.647640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:03.648104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:03.648875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:03.649378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:03.649817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:03.658339 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-26566962-567f-47c6-90da-bb1f13bdce59 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] HTTP exception thrown: Image not found. Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26566962-567f-47c6-90da-bb1f13bdce59 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Request method failure captured: Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVc3c6YrQoUnRNNPP_IVY1KTN2goonldbm0J-0MZvubeUAD9to4TEuPahf5ipRILtvwB5zyflfq_BnuVExFdOCIySKSippdY-h64eYVnON7Wm1reBe99ouW39gO1m35pPvLuDEa306X1n9EWFDQD4QbRNcO_f79-G82DcW5zI8jlpAQ Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:23:03.661046 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: b766e509360a44e4b14a9a2ae4752e7f Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '-1'} Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:03.662994 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.664130 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:03.666879 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:23:03.669671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.673489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26566962-567f-47c6-90da-bb1f13bdce59 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:03.674691 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26566962-567f-47c6-90da-bb1f13bdce59 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] 10.222.0.65 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.146924 Oct 17 13:23:03.677354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 818/1687] 10.222.0.65 () {58 vars in 1134 bytes} [Mon Oct 17 13:23:03 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:23:03.694661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2182869-f752-492f-b49a-9025b900a308 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Calling method '.version_select at 0x7f419db4b550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.738743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a2182869-f752-492f-b49a-9025b900a308 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] HTTP exception thrown: Image not found. Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2182869-f752-492f-b49a-9025b900a308 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Request method failure captured: Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/37b17d65-5e8d-4e31-9669-21ecfc587c2j HTTP/1.1 Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVc3c6YrQoUnRNNPP_IVY1KTN2goonldbm0J-0MZvubeUAD9to4TEuPahf5ipRILtvwB5zyflfq_BnuVExFdOCIySKSippdY-h64eYVnON7Wm1reBe99ouW39gO1m35pPvLuDEa306X1n9EWFDQD4QbRNcO_f79-G82DcW5zI8jlpAQ Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:23:03.741044 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: b766e509360a44e4b14a9a2ae4752e7f Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '37b17d65-5e8d-4e31-9669-21ecfc587c2j'} Oct 17 13:23:03.742762 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 37b17d65-5e8d-4e31-9669-21ecfc587c2j to delete Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.744324 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 37b17d65-5e8d-4e31-9669-21ecfc587c2j could not be found. Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:03.745887 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:23:03.747377 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.750104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2182869-f752-492f-b49a-9025b900a308 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:03.752027 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2182869-f752-492f-b49a-9025b900a308 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] 10.222.0.65 "DELETE /compute/v2.1/images/37b17d65-5e8d-4e31-9669-21ecfc587c2j" status: 404 len: 62 microversion: 2.1 time: 0.070997 Oct 17 13:23:03.755619 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 819/1688] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:03 2022] DELETE /compute/v2.1/images/37b17d65-5e8d-4e31-9669-21ecfc587c2j => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:23:03.772286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a529a03-10ef-48b9-a56e-28371b6b61a4 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Calling method '.version_select at 0x7f419dde4ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.794402 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-7a529a03-10ef-48b9-a56e-28371b6b61a4 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] HTTP exception thrown: Image not found. Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a529a03-10ef-48b9-a56e-28371b6b61a4 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Request method failure captured: Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/1d26209c-006c-4b73-ab67-cab227e3f8001 HTTP/1.1 Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVc3c6YrQoUnRNNPP_IVY1KTN2goonldbm0J-0MZvubeUAD9to4TEuPahf5ipRILtvwB5zyflfq_BnuVExFdOCIySKSippdY-h64eYVnON7Wm1reBe99ouW39gO1m35pPvLuDEa306X1n9EWFDQD4QbRNcO_f79-G82DcW5zI8jlpAQ Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:23:03.796440 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: b766e509360a44e4b14a9a2ae4752e7f Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '1d26209c-006c-4b73-ab67-cab227e3f8001'} Oct 17 13:23:03.798362 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1d26209c-006c-4b73-ab67-cab227e3f8001 to delete Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.799484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d26209c-006c-4b73-ab67-cab227e3f8001 could not be found. Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:03.801980 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:23:03.804597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:03.813409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a529a03-10ef-48b9-a56e-28371b6b61a4 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:03.814675 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a529a03-10ef-48b9-a56e-28371b6b61a4 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] 10.222.0.65 "DELETE /compute/v2.1/images/1d26209c-006c-4b73-ab67-cab227e3f8001" status: 404 len: 62 microversion: 2.1 time: 0.052009 Oct 17 13:23:03.815817 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 820/1689] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:03 2022] DELETE /compute/v2.1/images/1d26209c-006c-4b73-ab67-cab227e3f8001 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:23:03.826713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:03.833198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:03.849099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:03.850001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:03.850710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:03.865422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:03.870077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:03.870948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.234028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:04.246223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2333c74-ca95-4c45-9a9d-91ade7f9840a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.623739 Oct 17 13:23:04.247430 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 870/1690] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:03 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:04.254647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-126def95-f2e8-485f-b15f-c98263ffccc8 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Calling method '.version_select at 0x7f419e1675e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.289062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-126def95-f2e8-485f-b15f-c98263ffccc8 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] HTTP exception thrown: Image not found. Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-126def95-f2e8-485f-b15f-c98263ffccc8 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Request method failure captured: Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/images/tempest-invalid-1102686673 HTTP/1.1 Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVc3c6YrQoUnRNNPP_IVY1KTN2goonldbm0J-0MZvubeUAD9to4TEuPahf5ipRILtvwB5zyflfq_BnuVExFdOCIySKSippdY-h64eYVnON7Wm1reBe99ouW39gO1m35pPvLuDEa306X1n9EWFDQD4QbRNcO_f79-G82DcW5zI8jlpAQ Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:23:04.292144 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: b766e509360a44e4b14a9a2ae4752e7f Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'tempest-invalid-1102686673'} Oct 17 13:23:04.294443 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1102686673 to delete Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:04.295399 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1102686673 could not be found. Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:04.296802 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:23:04.298266 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.304826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-126def95-f2e8-485f-b15f-c98263ffccc8 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:04.306625 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-126def95-f2e8-485f-b15f-c98263ffccc8 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] 10.222.0.65 "DELETE /compute/v2.1/images/tempest-invalid-1102686673" status: 404 len: 62 microversion: 2.1 time: 0.057582 Oct 17 13:23:04.308232 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 871/1691] 10.222.0.65 () {58 vars in 1206 bytes} [Mon Oct 17 13:23:04 2022] DELETE /compute/v2.1/images/tempest-invalid-1102686673 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:23:04.320232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbd2def4-c968-447f-a324-ae78b9a6a6a5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddb3670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.367422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:04.380214 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee773707-67dc-4770-8d3d-d31298f7e5f5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.562397 Oct 17 13:23:04.380831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 821/1692] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:03 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:04.390279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-baf8af3f-5c8d-442f-8ffd-b5f33eb490d6 req-88bfc3b6-dcb6-457e-ba08-4751403d9e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f291851-bc65-4d61-8ced-20cef46b6afb", "name": "network-vif-plugged", "status": "completed", "tag": "dd0fae42-e55f-44c6-81c5-c29ecb3f80d8"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:04.427060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-baf8af3f-5c8d-442f-8ffd-b5f33eb490d6 req-88bfc3b6-dcb6-457e-ba08-4751403d9e22 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.431820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-baf8af3f-5c8d-442f-8ffd-b5f33eb490d6 req-88bfc3b6-dcb6-457e-ba08-4751403d9e22 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.431820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-baf8af3f-5c8d-442f-8ffd-b5f33eb490d6 req-88bfc3b6-dcb6-457e-ba08-4751403d9e22 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.444677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbd2def4-c968-447f-a324-ae78b9a6a6a5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.135065 Oct 17 13:23:04.456692 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 872/1693] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:04 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:04.464130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.465263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:04.470734 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-baf8af3f-5c8d-442f-8ffd-b5f33eb490d6 req-88bfc3b6-dcb6-457e-ba08-4751403d9e22 service nova] Creating event network-vif-plugged:dd0fae42-e55f-44c6-81c5-c29ecb3f80d8 for instance 7f291851-bc65-4d61-8ced-20cef46b6afb on n-h1-854121-14 Oct 17 13:23:04.477814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-baf8af3f-5c8d-442f-8ffd-b5f33eb490d6 req-88bfc3b6-dcb6-457e-ba08-4751403d9e22 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090406 Oct 17 13:23:04.479533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 822/1694] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:04.489673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-707209ff-de7a-4124-ae71-7de0df9ad7d6 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Calling method '.version_select at 0x7f419dc95e50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:04.491743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.500511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.500950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.505462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:04.506068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:04.513693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:04.539795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-707209ff-de7a-4124-ae71-7de0df9ad7d6 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] HTTP exception thrown: Image not found. Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-707209ff-de7a-4124-ae71-7de0df9ad7d6 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Request method failure captured: Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/bdc72737-8e6a-4932-b928-a5e03519f9e2 HTTP/1.1 Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVc3c6YrQoUnRNNPP_IVY1KTN2goonldbm0J-0MZvubeUAD9to4TEuPahf5ipRILtvwB5zyflfq_BnuVExFdOCIySKSippdY-h64eYVnON7Wm1reBe99ouW39gO1m35pPvLuDEa306X1n9EWFDQD4QbRNcO_f79-G82DcW5zI8jlpAQ Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:23:04.545838 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e13c39ac786b4e25b4db3e44b8f4252f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: e13c39ac786b4e25b4db3e44b8f4252f Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130 Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: b766e509360a44e4b14a9a2ae4752e7f Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-2097641130-project Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'bdc72737-8e6a-4932-b928-a5e03519f9e2'} Oct 17 13:23:04.548124 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bdc72737-8e6a-4932-b928-a5e03519f9e2 to delete Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:04.549451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bdc72737-8e6a-4932-b928-a5e03519f9e2 could not be found. Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:04.551667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:23:04.554558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:04.559154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-707209ff-de7a-4124-ae71-7de0df9ad7d6 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:04.564103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-707209ff-de7a-4124-ae71-7de0df9ad7d6 tempest-ImagesDeleteNegativeTestJSON-2097641130 tempest-ImagesDeleteNegativeTestJSON-2097641130-project] 10.222.0.65 "DELETE /compute/v2.1/images/bdc72737-8e6a-4932-b928-a5e03519f9e2" status: 404 len: 62 microversion: 2.1 time: 0.080074 Oct 17 13:23:04.565831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 823/1695] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:04 2022] DELETE /compute/v2.1/images/bdc72737-8e6a-4932-b928-a5e03519f9e2 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:23:04.938779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:04.947324 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-978aaedd-f1e2-4c10-afde-cdcacb66ce50 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.488940 Oct 17 13:23:04.971496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 873/1696] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:04 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:05.273780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:05.274806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:05.294405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:05.294903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:05.295345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:05.296061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:05.296518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:05.296949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:05.408480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:05.409103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:05.422934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:05.423482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:05.423884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:05.424604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:05.425061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:05.431846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:05.595359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:05.620535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f83a68a1-2232-4548-ae97-f7b0798bc3c3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1199 microversion: 2.1 time: 0.351759 Oct 17 13:23:05.646118 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 824/1697] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:05 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1199 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:05.659945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70899c7c-a846-4ce6-b80b-b42c3d3ee250 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dde4820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:05.741289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70899c7c-a846-4ce6-b80b-b42c3d3ee250 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.091948 Oct 17 13:23:05.742669 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 825/1698] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:05 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:05.827791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:05.841971 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df5ea10c-e1f0-4f0f-89b5-382568fbd5d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.438243 Oct 17 13:23:05.846057 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 874/1699] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:05 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:05.977317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:05.978758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:06.005874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.006595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.008106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.011469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.027326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.028593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.412824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:06.429057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc0de265-7138-4e8d-8eb6-886a67e3835e tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.455938 Oct 17 13:23:06.436337 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 826/1700] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:05 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:06.502605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3c884ed9-fa99-49d6-8c52-dfda4ad385ca req-4af9cd03-2096-4b7e-881f-a08215c9341b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688bafde-0fa7-4b7c-990d-6afcdbd8f554", "name": "network-vif-plugged", "status": "completed", "tag": "cb063e1b-4df3-486b-9139-9f675eb246b3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:06.522493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c884ed9-fa99-49d6-8c52-dfda4ad385ca req-4af9cd03-2096-4b7e-881f-a08215c9341b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.523295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c884ed9-fa99-49d6-8c52-dfda4ad385ca req-4af9cd03-2096-4b7e-881f-a08215c9341b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.523730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c884ed9-fa99-49d6-8c52-dfda4ad385ca req-4af9cd03-2096-4b7e-881f-a08215c9341b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.560306 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3c884ed9-fa99-49d6-8c52-dfda4ad385ca req-4af9cd03-2096-4b7e-881f-a08215c9341b service nova] Creating event network-vif-plugged:cb063e1b-4df3-486b-9139-9f675eb246b3 for instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 on n-h1-854121-14 Oct 17 13:23:06.570458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3c884ed9-fa99-49d6-8c52-dfda4ad385ca req-4af9cd03-2096-4b7e-881f-a08215c9341b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071254 Oct 17 13:23:06.576869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 875/1701] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:06.656871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:06.657532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:06.688944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.691563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.692020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.692974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.698966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.699715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.742083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:06.764702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fb70386-1071-42d5-8b9f-03e38c47a42a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e19fc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:06.854329 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fb70386-1071-42d5-8b9f-03e38c47a42a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.098685 Oct 17 13:23:06.855847 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 876/1702] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:06 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:06.873710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:06.874959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:06.889389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.890187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.890898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:06.894168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:06.894895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:06.895537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:07.000908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:07.009505 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee204f73-bfaf-4ba5-a900-29789b3582a0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1381 microversion: 2.1 time: 0.358548 Oct 17 13:23:07.033679 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 827/1703] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:06 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1381 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:07.044216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1333463846", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "86f87344-a5a0-44c6-9bd6-49c37a87ed65"}], "block_device_mapping_v2": [{"uuid": "8ed800e5-00cf-49f7-bc9c-0099d56a9a47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:07.172374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] validate_networks() for [('86f87344-a5a0-44c6-9bd6-49c37a87ed65', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:07.254507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:07.263787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87c3c738-2377-477e-b73d-e01113564b99 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.397189 Oct 17 13:23:07.264376 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 877/1704] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:06 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:07.772906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:07.773569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:07.783457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:07.784591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:07.785491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:07.787099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:07.788305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:07.790362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.091164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:08.092323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:08.093559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:08.094307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:08.094894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:08.112861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.113812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.114648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.116475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.117369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.117521 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95a18b7b-a2a5-4060-aa8c-dcff01fa1788 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1534 microversion: 2.1 time: 0.833340 Oct 17 13:23:08.118206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.120917 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 878/1705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:07 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1534 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:08.142171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:08.143893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:08.145961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:08.156924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Getting quotas for user d9b63e4efecd4b9a96fc3b2e51f625fb and project 0e454a0d18b54711bc621a802aaa239c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:08.172384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.173147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.173678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.176868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.183336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.184669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.251576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:08.257764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8ed800e5-00cf-49f7-bc9c-0099d56a9a47',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:08.417138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=22 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:08.444055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:08.473293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-197ab1ce-f549-4aff-8ba0-230d9bcd3685 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1394 microversion: 2.1 time: 0.349088 Oct 17 13:23:08.473879 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 879/1706] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:08 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1394 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:08.490575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d53957d1-3248-4804-a08a-d7fa2a552914 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e19fee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:08.568248 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d53957d1-3248-4804-a08a-d7fa2a552914 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.081699 Oct 17 13:23:08.573121 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 880/1707] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:08 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:08.592587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:08.595202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:08.623124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45916275-0d6e-42c2-9be2-be4efb104932 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.587958 Oct 17 13:23:08.626125 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 828/1708] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:23:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:23:08.626471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.627064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.627515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.628254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.628707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.633959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.654827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:08.656412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:08.673716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.674733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.676057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:08.677120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:08.677990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:08.678670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.199248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:09.216972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87fd3fde-0a89-444c-9f95-de436078daed tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.587882 Oct 17 13:23:09.220212 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 829/1709] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:08 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:09.230432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-178bfda7-9d9b-4f61-9052-8bab98686546 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:09.248374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-178bfda7-9d9b-4f61-9052-8bab98686546 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:09.267077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e271384-f3fd-45f9-a8e2-9f2d06aa7aa5 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1534 microversion: 2.1 time: 0.692447 Oct 17 13:23:09.272673 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 881/1710] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:08 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1534 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:09.294455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:09.299339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.301153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.303005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.303970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.305386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.306092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.373838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18346996-5fd3-4d0a-a013-bba06963176e tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.081360 Oct 17 13:23:09.376792 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 882/1711] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:23:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:09.390516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": false, "disk_over_commit": false}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:09.393894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:09.409387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.411248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.411947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.414977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.416221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.416922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.428966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-178bfda7-9d9b-4f61-9052-8bab98686546 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:09.442503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-178bfda7-9d9b-4f61-9052-8bab98686546 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:09.443986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-178bfda7-9d9b-4f61-9052-8bab98686546 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:09.445140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-178bfda7-9d9b-4f61-9052-8bab98686546 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1104 microversion: 2.25 time: 0.223371 Oct 17 13:23:09.470913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lazy-loading 'flavor' on Instance uuid 7f291851-bc65-4d61-8ced-20cef46b6afb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:09.471729 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 830/1712] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:09 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1104 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:09.498705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:09.499549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:09.511824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Going to try to live migrate instance to n-h2-854121-14 {{(pid=120698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:23:09.512013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.514246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.514727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.517509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:09.518002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:09.518459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:09.580098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:09.976799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:10.019534 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4754fab4-96ed-48e9-9d9c-fcf065b78273 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1574 microversion: 2.1 time: 0.525253 Oct 17 13:23:10.020676 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 831/1713] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:09 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1574 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:10.033310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc56f78a-4d5f-489a-806e-09000f421e18 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dbb7dc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:10.144301 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc56f78a-4d5f-489a-806e-09000f421e18 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.122124 Oct 17 13:23:10.146376 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 832/1714] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:10 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:10.173833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:10.176324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:10.216619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.218881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.222758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.224444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.227021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.228644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.605768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7735be1c-fff3-4b4a-8c09-f8ddeb63c353 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.443364 Oct 17 13:23:10.606640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 833/1715] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:23:10 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554/os-interface => generated 284 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:10.616415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:10.617145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:10.635394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.635897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.636342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.637069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:10.641753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:10.642223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:10.960856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:10.973859 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-efd94ba2-db8f-4cae-8c4a-a4c5ead6dae5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.362433 Oct 17 13:23:11.007556 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 834/1716] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:10 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:11.016995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:11.022922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:11.036155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:11.039480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:11.040946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:11.044503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:11.045393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:11.046023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:11.628505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:11.647267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:11.651923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:11.660204 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eae0f596-9d90-4ada-8989-e8825ab6dded tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1233 microversion: 2.25 time: 0.651152 Oct 17 13:23:11.680077 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 835/1717] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:11 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1233 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:11.680077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a38e050-8f2f-4695-a8b8-6f48d874927c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419db4bdc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:11.786155 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a38e050-8f2f-4695-a8b8-6f48d874927c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.115686 Oct 17 13:23:11.787869 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 836/1718] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:11 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:12.006117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:12.006886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:12.020342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.021048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.021618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.022616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.023308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.025796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.591504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:12.601000 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-13299463-c8b1-4413-b724-828731ff7f32 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.599675 Oct 17 13:23:12.612431 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 837/1719] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:12 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:12.701816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:12.703315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:12.713837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.719727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.720743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.722095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:12.724691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:12.725455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:12.949253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:12.962256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:12.965431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:12.968907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3f5adbe-22be-4968-b26a-932f11f34d53 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1251 microversion: 2.25 time: 0.275433 Oct 17 13:23:12.972387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 838/1720] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:12 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1251 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:23:12.982098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-663d321b-b484-44de-9dfa-eba491fde2a3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dde44c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:13.088928 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-663d321b-b484-44de-9dfa-eba491fde2a3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.113638 Oct 17 13:23:13.093573 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 839/1721] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:12 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:13.631657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:13.632581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:13.659309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:13.662679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:13.664843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:13.665870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:13.666912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:13.668891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:14.226687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:14.242646 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d052a52c-d109-4c1d-8b6e-865fbd2b69f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 0.615944 Oct 17 13:23:14.248051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 840/1722] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:13 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:14.271374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:14.275375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:14.302746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:14.303480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:14.304118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:14.305046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:14.309654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:14.310383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:14.561706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:14.595667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:14.597139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:14.618022 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbf7a09f-4a11-4bdc-895f-43e1095899f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1251 microversion: 2.25 time: 0.368483 Oct 17 13:23:14.619002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 841/1723] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:14 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1251 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:14.653478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90beb1a5-c8a5-4bbc-906d-b6160c4e1840 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc95ca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:14.713786 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90beb1a5-c8a5-4bbc-906d-b6160c4e1840 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.065439 Oct 17 13:23:14.715673 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 842/1724] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:14 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:15.273051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:15.273857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:15.290193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.291757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.293823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:15.296836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.297772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.299922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:15.893063 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f046f3bd-7230-4d5b-b836-5e64826279df tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb/action" status: 202 len: 0 microversion: 2.1 time: 6.505868 Oct 17 13:23:15.894095 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 883/1725] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:09 2022] POST /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb/action => generated 0 bytes in 6511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:15.899231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:15.904059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:15.930556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.932661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.933479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:15.940364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:15.942479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:15.946090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:16.235609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.245692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.256998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.276390 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29d2a489-6d7c-48ff-8ffa-80a72e452116 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1251 microversion: 2.25 time: 0.371310 Oct 17 13:23:16.277728 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 884/1726] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:15 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1251 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:16.289417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c533edfd-bea3-4ab1-bbdb-5d5b0cd57072 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e19f700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:16.419836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c533edfd-bea3-4ab1-bbdb-5d5b0cd57072 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.140518 Oct 17 13:23:16.426267 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 885/1727] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:16 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:16.432478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:16.433095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:16.487849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:16.488367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:16.488816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:16.489572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:16.490035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:16.490470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:16.582512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.594706 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1100ffed-3628-4818-b93c-08f9bf3e65ef tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1513 microversion: 2.1 time: 1.327834 Oct 17 13:23:16.602493 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 843/1728] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:15 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1513 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:16.937243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:16.948885 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6bc5fd4-02e0-4f3e-9a8f-280e27723730 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.521190 Oct 17 13:23:16.949515 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 886/1729] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:16 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:16.979447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "effe21f7-037b-4a16-a8f0-aa7164824ed7"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:16.990815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:17.011566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.021478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.022146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.026225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.026907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.028802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.308719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:17.309405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:17.331134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.332316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.332854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.333886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.339809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.340580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.585905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:17.610619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:17.615835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:17.621981 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9424a36-5cd2-4f13-8bdc-a88cc7aec539 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1251 microversion: 2.25 time: 0.318044 Oct 17 13:23:17.627319 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 887/1730] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:17 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1251 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:23:17.641385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-204de6ae-5a9c-4423-891a-5283373cc00e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dfc34c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:17.757544 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b58c930-2a86-46e5-8340-3e19e58a2c7e tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "POST /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.782168 Oct 17 13:23:17.765544 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 844/1731] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:23:16 2022] POST /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:17.785451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:17.786706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:17.800785 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-204de6ae-5a9c-4423-891a-5283373cc00e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.171974 Oct 17 13:23:17.801389 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 888/1732] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:17 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:17.827532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.828033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.828473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.829217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.829732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.830139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.935889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:17.937543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:17.947998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.953657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.954526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:17.955618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:17.959965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:17.960697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:18.134686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:19.324801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:19.437653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:19.454608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:19.464022 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5fb9235-c786-4e0c-aeb4-2a2465b860b4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1490 microversion: 2.1 time: 1.696854 Oct 17 13:23:19.477714 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 845/1733] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:17 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1490 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:19.493046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:19.502133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:19.541345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:19.543317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:19.544044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:19.545045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:19.545785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:19.549636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.107822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:20.133368 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dca5029a-2ff5-4ac5-867f-739ff8694ec2 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1574 microversion: 2.1 time: 2.199682 Oct 17 13:23:20.136863 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 889/1734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:17 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1574 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:20.155189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f6060750-7f49-4045-9fe5-214dbc45a9d0 req-eb9b609f-43b8-480e-80cc-935ab2446bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688bafde-0fa7-4b7c-990d-6afcdbd8f554", "tag": "cb063e1b-4df3-486b-9139-9f675eb246b3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:20.196663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f6060750-7f49-4045-9fe5-214dbc45a9d0 req-eb9b609f-43b8-480e-80cc-935ab2446bb5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.206740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f6060750-7f49-4045-9fe5-214dbc45a9d0 req-eb9b609f-43b8-480e-80cc-935ab2446bb5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.207758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f6060750-7f49-4045-9fe5-214dbc45a9d0 req-eb9b609f-43b8-480e-80cc-935ab2446bb5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.250146 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f6060750-7f49-4045-9fe5-214dbc45a9d0 req-eb9b609f-43b8-480e-80cc-935ab2446bb5 service nova] Creating event network-changed:cb063e1b-4df3-486b-9139-9f675eb246b3 for instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 on n-h1-854121-14 Oct 17 13:23:20.274060 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f6060750-7f49-4045-9fe5-214dbc45a9d0 req-eb9b609f-43b8-480e-80cc-935ab2446bb5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133611 Oct 17 13:23:20.275126 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 890/1735] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:20.300759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:20.301510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:20.325302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.331024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.331577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.336178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.336739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.338036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.395206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:20.404825 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8c102b3-cc44-47a6-b1fc-51fe621f0144 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.924419 Oct 17 13:23:20.416916 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 846/1736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:19 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:20.451348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4f03b863-d997-41c7-b954-13216c2c8a96 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc62820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:20.579527 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4f03b863-d997-41c7-b954-13216c2c8a96 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.140427 Oct 17 13:23:20.580248 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 847/1737] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:20 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:20.604640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:20.640349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:20.687972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.688565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.689020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.689740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.690199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.690631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.819204 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e107b7b6-4eef-47b2-8646-743235f91e40 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 200 len: 154 microversion: 2.1 time: 0.227664 Oct 17 13:23:20.820113 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 848/1738] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:20 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 154 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:20.845730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:20.846900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:20.859139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.861785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.862426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:20.870589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:20.871328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:20.871933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.211267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:21.234374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:21.236584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:21.239030 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33840f4c-9a2d-4784-b78a-96b582842533 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1293 microversion: 2.25 time: 0.955218 Oct 17 13:23:21.240536 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 891/1739] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:20 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1293 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:21.443101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:21.444424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:21.461231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.465807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.466439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.469497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.470252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.470861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.516438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:21.527170 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0554d3f7-33b6-41c5-828f-f54dec3ec62d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.686655 Oct 17 13:23:21.547234 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 849/1740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:20 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:21.580327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:21.580931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:21.611739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.612257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.612688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.613443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:21.613902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:21.614335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:21.652280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:22.630523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:22.639750 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6491b9b4-6c10-4154-9641-028709b1e32d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 1.201410 Oct 17 13:23:22.640516 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 892/1741] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:21 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:22.656895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:22.688124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f840e4e5-c9d5-4158-80e6-718d08cfeb42 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.104335 Oct 17 13:23:22.691498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 850/1742] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:21 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:22.701438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8bb9b14-ce45-4fc9-b54c-5a57f912c5b3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e225c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:22.728946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:22.735851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:22.756151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.765645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.766116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.766888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.768623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.770338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.827480 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8bb9b14-ce45-4fc9-b54c-5a57f912c5b3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1438 microversion: 2.1 time: 0.158283 Oct 17 13:23:22.833295 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 893/1743] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:22 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1438 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:22.847904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:22.849600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:22.871247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.879184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.879643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:22.880417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:22.881738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:22.882190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:23.388790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:23.398058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:23.411964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:23.413416 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d76b3cf8-c6f7-48e2-a646-ca0e1d928456 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1293 microversion: 2.25 time: 0.720077 Oct 17 13:23:23.414099 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 851/1744] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:22 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1293 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:23.419944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a3757b9b-266d-455d-a959-d195d7478c20 req-88b326d5-64f6-4407-bfb1-dfdb3aea605a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0cc3d3-998a-4a24-b194-29cf74071bde", "tag": "589b4d61-a74e-4e01-8622-977978d83851"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:23.451296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a3757b9b-266d-455d-a959-d195d7478c20 req-88b326d5-64f6-4407-bfb1-dfdb3aea605a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.462039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a3757b9b-266d-455d-a959-d195d7478c20 req-88b326d5-64f6-4407-bfb1-dfdb3aea605a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.462828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a3757b9b-266d-455d-a959-d195d7478c20 req-88b326d5-64f6-4407-bfb1-dfdb3aea605a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:23.493070 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a3757b9b-266d-455d-a959-d195d7478c20 req-88b326d5-64f6-4407-bfb1-dfdb3aea605a service nova] Creating event network-changed:589b4d61-a74e-4e01-8622-977978d83851 for instance ab0cc3d3-998a-4a24-b194-29cf74071bde on n-h1-854121-14 Oct 17 13:23:23.499206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a3757b9b-266d-455d-a959-d195d7478c20 req-88b326d5-64f6-4407-bfb1-dfdb3aea605a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083668 Oct 17 13:23:23.500438 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 852/1745] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:23.535910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:23.545350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d4c0279-3c6c-486a-a4d4-5ab16cad8023 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.704935 Oct 17 13:23:23.554356 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 894/1746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:22 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:23.581897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:23.583633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:23.599210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.600061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.600770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:23.601770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.602478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.603740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:23.662604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:23.663396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:23.680003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.680938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.681654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:23.682608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:23.683324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:23.689536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:24.953397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:24.955726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:24.964791 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b1c25379-e20a-4695-ba16-4f8a392a060b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.387363 Oct 17 13:23:24.967837 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9434301-10dc-40bf-8050-29d43804052f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 1.308995 Oct 17 13:23:24.969584 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 895/1747] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:23 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:24.980677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 853/1748] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:23 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:24.980677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:24.980677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:25.003399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:25.003399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:25.003399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:25.003399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:25.003918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:25.003918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:25.008277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83fca4ef-68a5-4df8-9457-87f12e0cc322 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e12c160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:25.090597 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83fca4ef-68a5-4df8-9457-87f12e0cc322 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1447 microversion: 2.1 time: 0.119356 Oct 17 13:23:25.091993 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 896/1749] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:24 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1447 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:25.139973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79ac6aa2-5361-4d9f-944b-0889c442900b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dfe93a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:25.278647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79ac6aa2-5361-4d9f-944b-0889c442900b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 200 len: 1447 microversion: 2.1 time: 0.173844 Oct 17 13:23:25.280566 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 897/1750] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:25 2022] GET /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 1447 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:25.295165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35222692-595b-4ea3-8069-064159c67edc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dfc3820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:25.590146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:25.606116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:25.607968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:25.609554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f76386d-0ab9-4ef6-b421-b2718585f255 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1293 microversion: 2.25 time: 0.637537 Oct 17 13:23:25.610712 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 854/1751] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:24 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1293 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:25.650545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-797839203", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "409d5ac5-1afa-4a2d-b8d2-6def2794c056"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:25.742248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] validate_networks() for [('409d5ac5-1afa-4a2d-b8d2-6def2794c056', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:26.300682 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35222692-595b-4ea3-8069-064159c67edc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 204 len: 0 microversion: 2.1 time: 1.009712 Oct 17 13:23:26.301383 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 898/1752] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:25 2022] DELETE /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:23:26.384664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-079fc868-d865-40c2-884e-1b351cf6875a tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419df62670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-440895606", "description": "tempest-description-1678209087"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:26.862806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:26.863285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:26.863713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:26.864132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:26.864566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:26.884073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:26.884847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:26.885568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:26.888581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:26.889829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:26.890638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:26.902477 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-079fc868-d865-40c2-884e-1b351cf6875a tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.599725 Oct 17 13:23:26.912757 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 899/1753] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:26 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:26.924177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:26.924955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:26.932640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:26.939595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for user 6ad84e1798394f69a409af3c96b6752c and project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:26.942742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:26.944054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:26.945242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:26.946747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:26.948976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:26.951915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:26.956597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:26.959653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:27.031993 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e52a4cb4-d96c-4ffd-88b3-1c05111f6128 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.420027 Oct 17 13:23:27.037125 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 855/1754] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:27.050765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:27.052016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:27.068147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.068996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.070257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.074134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.074924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.076005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.144303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:27.251230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:27.288881 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d9d33d0-5d08-4682-87e8-67597708eef0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 204 len: 0 microversion: 2.1 time: 0.249911 Oct 17 13:23:27.289515 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 856/1755] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:27 2022] DELETE /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:27.319804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.322355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:27.325958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:27.331549 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30e4d57e-7552-4a6d-9cd1-747152c96fdf tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.416942 Oct 17 13:23:27.332835 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 900/1756] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:26 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:27.341126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.341675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.342124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.342842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:27.343303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:27.349071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:27.356718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c3604ee-0a48-45d3-8e73-d89073d04aec tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419e0c43a0>, body: {"security_group_rule": {"parent_group_id": "5bdf6779-1ae8-44b7-982a-7ff6fa31c176", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:27.619990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.632383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.637072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.638554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fc36767-5aa8-42e2-9fd5-f3ed32bc7d39 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1293 microversion: 2.25 time: 0.347120 Oct 17 13:23:27.639119 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 857/1757] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:27 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1293 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:27.676212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6aa8df3d-7eb5-4bcf-91e9-283907b52314 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:27.677067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6aa8df3d-7eb5-4bcf-91e9-283907b52314 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:27.819095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6aa8df3d-7eb5-4bcf-91e9-283907b52314 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:27.831834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6aa8df3d-7eb5-4bcf-91e9-283907b52314 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1214 microversion: 2.1 time: 0.186216 Oct 17 13:23:27.837800 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 858/1758] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:27 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:27.928716 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c3604ee-0a48-45d3-8e73-d89073d04aec tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.593840 Oct 17 13:23:27.929350 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 901/1759] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:23:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:27.943060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-822272627", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "de69c07b-99ae-49cb-9b55-cd78d1700008"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:28.000282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-757056889", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "f5becbff-bdff-4cc7-80b7-7ac7aa4dec7f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:28.039065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] validate_networks() for [('de69c07b-99ae-49cb-9b55-cd78d1700008', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:28.184831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] validate_networks() for [('f5becbff-bdff-4cc7-80b7-7ac7aa4dec7f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:29.252901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:29.255410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:29.256333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:29.256955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:29.257614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:29.267690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=53 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:29.289782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.290869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.291572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.292702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.295790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.296586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.340970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:29.341526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:29.342211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:29.342721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:29.343394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:29.357587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.358545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.359221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.360470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.361182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.364150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.379952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:29.404129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for user c2effa2bc1674d20a064b40849b85df1 and project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:29.416655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Getting quotas for project e7b8dc27f74048b69c0d904446c6879c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:29.440949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Getting quotas for user ca7261fc06da476b83f1211c22ac64bb and project e7b8dc27f74048b69c0d904446c6879c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:29.481793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:29.488360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:29.490735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:29.496645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:29.578555 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5193f1f4-7596-4cbc-a994-95a409369cc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639158 Oct 17 13:23:29.580139 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 902/1760] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:29.590556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45cc3a37-0422-43c3-adb3-a3aaf39471fa tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419df339d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-220931560", "description": "tempest-description-1773053242"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:29.629614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ed00593-d932-4b16-8301-dd71860098d0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790679 Oct 17 13:23:29.633109 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 859/1761] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:29.649115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:29.652502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:29.669553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.671309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.675323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:29.676270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:29.676965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:29.677627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.142230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.164823 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7e96d3a-e414-4c0d-a83d-a9d88039a043 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.530039 Oct 17 13:23:30.181127 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 860/1762] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:29 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:30.204844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:30.205535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:30.235118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.236892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.238360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.244761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.248445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.253024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.454401 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45cc3a37-0422-43c3-adb3-a3aaf39471fa tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.872124 Oct 17 13:23:30.456074 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 903/1763] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:29 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:30.462534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:30.465137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:30.484317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.489135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.492594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.494281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.495844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.499227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.665475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.687791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d8a0f50-e507-427d-8e56-d9c7f2fc4a86 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1266 microversion: 2.1 time: 0.223468 Oct 17 13:23:30.702280 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 904/1764] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:30 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:30.734514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5fd8c01e-ce11-4000-9851-bcf45a4b3c95 req-021bd73c-c866-4c28-a929-20e11d891a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f8312-a3e2-4f61-8dee-aa8bd6846f07", "name": "network-vif-unplugged", "status": "completed", "tag": "e2b39662-babe-42e5-9b71-41c090d74dd3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:30.784584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5fd8c01e-ce11-4000-9851-bcf45a4b3c95 req-021bd73c-c866-4c28-a929-20e11d891a58 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.785487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5fd8c01e-ce11-4000-9851-bcf45a4b3c95 req-021bd73c-c866-4c28-a929-20e11d891a58 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.786308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5fd8c01e-ce11-4000-9851-bcf45a4b3c95 req-021bd73c-c866-4c28-a929-20e11d891a58 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.788663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.803410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5fd8c01e-ce11-4000-9851-bcf45a4b3c95 req-021bd73c-c866-4c28-a929-20e11d891a58 service nova] Creating event network-vif-unplugged:e2b39662-babe-42e5-9b71-41c090d74dd3 for instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 on n-h2-854121-14 Oct 17 13:23:30.810420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.811691 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5fd8c01e-ce11-4000-9851-bcf45a4b3c95 req-021bd73c-c866-4c28-a929-20e11d891a58 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104825 Oct 17 13:23:30.812874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 905/1765] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:30.829002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:30.830553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:30.833132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:30.839572 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2165d7f-f774-41e8-b3d7-718c6a436ef4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.657183 Oct 17 13:23:30.840660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 861/1766] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:30 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:30.842659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.843489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.844167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.845236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:30.846078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:30.846725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:30.853445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c395df7-e1b7-4e03-af4d-cc5fc8a5b30f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:30.858541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c395df7-e1b7-4e03-af4d-cc5fc8a5b30f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:31.132034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:31.152532 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a726e35a-69f2-44ab-8a80-084d601b01f7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1211 microversion: 2.1 time: 0.337441 Oct 17 13:23:31.154329 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 906/1767] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:30 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1211 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:31.160630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c395df7-e1b7-4e03-af4d-cc5fc8a5b30f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:31.173630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3837733d-36ed-4e6a-9e27-851c363c373a tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419defa4c0>, body: {"security_group_rule": {"parent_group_id": "fb510503-d8d9-4cd2-8699-9bf649f04fbd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:31.174790 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c395df7-e1b7-4e03-af4d-cc5fc8a5b30f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1216 microversion: 2.1 time: 0.332009 Oct 17 13:23:31.176969 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 862/1768] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:30 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1216 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:31.207995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-36835711-0bcc-4d81-a16e-0c50445f45e4 req-1d52d041-13d6-4372-8401-47d9410e3485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437f8312-a3e2-4f61-8dee-aa8bd6846f07", "name": "network-vif-deleted", "tag": "e2b39662-babe-42e5-9b71-41c090d74dd3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:31.261427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36835711-0bcc-4d81-a16e-0c50445f45e4 req-1d52d041-13d6-4372-8401-47d9410e3485 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.263036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36835711-0bcc-4d81-a16e-0c50445f45e4 req-1d52d041-13d6-4372-8401-47d9410e3485 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.265694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36835711-0bcc-4d81-a16e-0c50445f45e4 req-1d52d041-13d6-4372-8401-47d9410e3485 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.316015 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-36835711-0bcc-4d81-a16e-0c50445f45e4 req-1d52d041-13d6-4372-8401-47d9410e3485 service nova] Creating event network-vif-deleted:e2b39662-babe-42e5-9b71-41c090d74dd3 for instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 on n-h2-854121-14 Oct 17 13:23:31.329521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-36835711-0bcc-4d81-a16e-0c50445f45e4 req-1d52d041-13d6-4372-8401-47d9410e3485 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150756 Oct 17 13:23:31.333308 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 863/1769] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:31.348233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:31.350417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:31.376863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.378984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.379622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.386943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.389552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.390125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.800988 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3837733d-36ed-4e6a-9e27-851c363c373a tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.645255 Oct 17 13:23:31.802234 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 907/1770] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:23:31 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:31.808979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:31.810565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:31.827385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.829596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.830218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.830824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:31.831846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:31.834321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:31.834977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:31.848560 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e06d99e-13ab-49d9-a266-c43241323585 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.508958 Oct 17 13:23:31.850035 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 864/1771] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:31 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:31.863199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c83f0df1-14c8-44c2-9483-de17aafeb5f6 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419dc62700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-982836376", "description": "tempest-description-41915412"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:31.993179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.002757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f3ce6ea7-5232-4e2a-81f5-03b1f43756a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1272 microversion: 2.1 time: 0.199149 Oct 17 13:23:32.014432 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 908/1772] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:31 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:32.033414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:32.038248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:32.057776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.058270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.058714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.059419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.060055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.060641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.137757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c83f0df1-14c8-44c2-9483-de17aafeb5f6 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.286169 Oct 17 13:23:32.138985 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 865/1773] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:31 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:32.153508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94d232ca-454a-4380-93ea-884de30df41b tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419de5aca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-952968489", "description": "tempest-description-1730074326"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:32.349233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.364558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.366729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.370432 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7fb83abf-c61d-4662-8e58-c97bfe36f612 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.354887 Oct 17 13:23:32.373961 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 909/1774] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:32.385888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:32.386761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:32.403999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.405823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.407169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.408089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.417665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.418716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.538155 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94d232ca-454a-4380-93ea-884de30df41b tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.389509 Oct 17 13:23:32.539406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 866/1775] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:32.545556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:32.546470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:32.558228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.564320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.565911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.566708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.567843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.568534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.569441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.577421 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20a935fe-4637-4cea-acb4-32fc3cd2d319 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1259 microversion: 2.1 time: 0.200764 Oct 17 13:23:32.578893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 910/1776] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:32.616925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-debc0b49-4e47-4b63-9b35-da031bd5c651 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419e167040>, body: {"security_group_rule": {"parent_group_id": "8e9b2689-e9a7-41d8-922d-8e0ae77292f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "bb05f481-9d80-4f40-a431-09151ad63340"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:32.790575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:32.806881 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba5e4453-ea6a-4192-b5de-9b005ade9cab tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1212 microversion: 2.1 time: 0.265013 Oct 17 13:23:32.832875 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 867/1777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1212 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:32.878186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:32.878827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:32.890258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.891504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.895383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:32.896345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:32.897024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:32.897674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.328520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:33.340652 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31cb1479-cdee-43ce-9d80-e2210c97a8b1 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.466302 Oct 17 13:23:33.345219 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 868/1778] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:32 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:33.357464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:33.362008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:33.374189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.374783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.375235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.376325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.377934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.380956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.807163 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-debc0b49-4e47-4b63-9b35-da031bd5c651 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.215395 Oct 17 13:23:33.808635 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 911/1779] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:23:32 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:33.813552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:33.814375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:33.835110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.836209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.836921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.837899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:33.838529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:33.839115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:33.902452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:33.997267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.010486 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7042e924-1af2-46cb-9a45-5c9c41f41ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.663815 Oct 17 13:23:34.025406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 869/1780] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:33 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:34.032400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:34.033289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:34.045944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:34.048065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:34.052057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:34.053058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:34.053763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:34.054368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:34.560731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.569372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-09725060-2f42-4760-950d-ba263469c15b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1265 microversion: 2.1 time: 0.542437 Oct 17 13:23:34.570063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 870/1781] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:34 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1265 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:34.575806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddc90bdf-69e5-471c-be77-65d971182b3d tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419dd87f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-288263281", "description": "tempest-description-1037483763"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:34.640886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.653594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.657525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.659722 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2633090a-822f-41c2-b27c-8454e8975ad0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.849800 Oct 17 13:23:34.668634 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 912/1782] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:33 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:34.686408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:34.689394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:34.725005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:34.725960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:34.726512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:34.730767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:34.733067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:34.736653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:34.925089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:34.961773 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f354ac9-708e-4024-a97e-8d85544553a3 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1276 microversion: 2.1 time: 0.287463 Oct 17 13:23:34.968393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 913/1783] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:34 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:34.985512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-dfb9e1d4-a87a-459f-9ab9-d264f3aaac19 req-d7930810-1ba2-4703-85d6-6488ba1aa947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbf01b0-b079-4ebf-ba60-e6c131a57494", "tag": "49a40318-afa6-45e7-8334-0e2b5f563c1f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:35.007158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dfb9e1d4-a87a-459f-9ab9-d264f3aaac19 req-d7930810-1ba2-4703-85d6-6488ba1aa947 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.007569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dfb9e1d4-a87a-459f-9ab9-d264f3aaac19 req-d7930810-1ba2-4703-85d6-6488ba1aa947 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.008002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dfb9e1d4-a87a-459f-9ab9-d264f3aaac19 req-d7930810-1ba2-4703-85d6-6488ba1aa947 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.029577 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-dfb9e1d4-a87a-459f-9ab9-d264f3aaac19 req-d7930810-1ba2-4703-85d6-6488ba1aa947 service nova] Creating event network-changed:49a40318-afa6-45e7-8334-0e2b5f563c1f for instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 on n-h2-854121-14 Oct 17 13:23:35.034487 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-dfb9e1d4-a87a-459f-9ab9-d264f3aaac19 req-d7930810-1ba2-4703-85d6-6488ba1aa947 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064742 Oct 17 13:23:35.035377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 914/1784] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:35.041464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:35.042171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:35.048539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.049031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.049530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.050214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.050668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.051092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.132310 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddc90bdf-69e5-471c-be77-65d971182b3d tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.560909 Oct 17 13:23:35.133401 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 871/1785] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:34 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:35.152203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:35.154418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:35.167822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.168612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.169762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.170731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.171359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.171951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.464058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:35.475464 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cf7ccf8-7f54-4a9c-8648-fee64ef50d22 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.438849 Oct 17 13:23:35.476763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 915/1786] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:35 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:35.484342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0acf0180-18f7-48ba-ac4a-f0b6251ee19b tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419e12c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1325698344", "description": "tempest-description-1311014020"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:35.571022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:35.597112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:35.619846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68fd16f7-5bc0-4ba5-bb70-67186e9b8b19 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.471832 Oct 17 13:23:35.638264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 872/1787] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:35 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:35.638264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:35.638264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:35.646555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.647048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.647701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.648444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.649288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.649980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.778217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:35.786587 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-089f2ede-490e-4013-8ff7-85bab3d75b9b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1265 microversion: 2.1 time: 0.164791 Oct 17 13:23:35.801788 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 873/1788] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:35 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:35.808669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:35.809318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:35.815518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.816008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.816446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:35.817144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:35.817621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:35.818064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.023347 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0acf0180-18f7-48ba-ac4a-f0b6251ee19b tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.544190 Oct 17 13:23:36.024052 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 916/1789] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:35 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:36.030630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.031619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:36.038981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.039592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.040744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.041882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.042523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.043048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.205154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:36.217657 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-623dd3a9-ac06-43df-b6c3-1efac74cbc75 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1274 microversion: 2.1 time: 0.190133 Oct 17 13:23:36.237381 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 917/1790] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:36.246657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ba868e5-3ae2-4788-bd9e-8acc8096d899 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419eb8bee0>, body: {"security_group_rule": {"parent_group_id": "a4692e8d-c878-4a00-ae7f-83c4134a328f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ca4156a4-381e-44c6-a398-fa275849e20c"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:36.275390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:36.291040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:36.293494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:36.294918 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89814489-0587-43f9-8da3-1f94587b7fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.492063 Oct 17 13:23:36.296014 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 874/1791] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:35 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:36.507467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.508340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:36.538201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.539602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.541735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.544288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.545002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.545856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.850410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:36.861812 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ead21c0b-9c20-4a41-a70b-cbf232e075c0 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.360024 Oct 17 13:23:36.881290 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 875/1792] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:36.890955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.891991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:36.900430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.901335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.902098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.903287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.904022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.904177 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ba868e5-3ae2-4788-bd9e-8acc8096d899 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.664816 Oct 17 13:23:36.904773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.904990 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 918/1793] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:23:36 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:36.912433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:36.914016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:36.924404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.925064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.926499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:36.927495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:36.928210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:36.928729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.162749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.171596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.172095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f921c17c-fb5e-401a-8d56-aec82fd1b9c4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.289268 Oct 17 13:23:37.172610 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 876/1794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:37.177114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c19f5ee5-f20d-428d-b6d3-2a9e730aa48a tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419dec3160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:37.189574 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60a5cae7-2731-4e9e-b8f0-e4f7efc802f5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.283154 Oct 17 13:23:37.190292 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 919/1795] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:36 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:37.250921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:37.252003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:37.260512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.261578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.262289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.263255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.265459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.266572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.498909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.510946 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b065d91c-0d5b-4217-910a-b138e146726c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.264224 Oct 17 13:23:37.511614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 920/1796] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:37 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:37.517327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:37.518204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:37.526140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.526957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.527651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.528698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.531331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.532092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.557762 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c19f5ee5-f20d-428d-b6d3-2a9e730aa48a tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/ca4156a4-381e-44c6-a398-fa275849e20c" status: 202 len: 0 microversion: 2.1 time: 0.382646 Oct 17 13:23:37.561781 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 877/1797] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:37 2022] DELETE /compute/v2.1/os-security-groups/ca4156a4-381e-44c6-a398-fa275849e20c => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:37.567850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b53ebe02-4b6c-4634-b1b2-444d24d82cad tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419dc624c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:37.683809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b53ebe02-4b6c-4634-b1b2-444d24d82cad tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/a4692e8d-c878-4a00-ae7f-83c4134a328f" status: 200 len: 247 microversion: 2.1 time: 0.120394 Oct 17 13:23:37.684735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 878/1798] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:23:37 2022] GET /compute/v2.1/os-security-groups/a4692e8d-c878-4a00-ae7f-83c4134a328f => generated 247 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:37.700618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb334989-ea1b-496a-99ca-6b8f2c5a3391 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419ddd2790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-868116736", "description": "tempest-description-1237605435"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:37.753078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.765453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.766932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:37.768103 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0062816-f0d7-4b95-8e7c-927076f84033 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.255125 Oct 17 13:23:37.768889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 921/1799] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:37 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:37.897949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:37.899885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:37.904958 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb334989-ea1b-496a-99ca-6b8f2c5a3391 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.209717 Oct 17 13:23:37.913533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 879/1800] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:23:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:23:37.919216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa5c6cb1-bc9f-4c5c-bdff-00c3a7bab019 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419dd87f70>, body: {"security_group_rule": {"parent_group_id": "b1d1a83d-df73-474e-9a2e-7be73f28e708", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:37.920205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.920823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.921287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:37.923857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:37.924663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:37.925414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.207867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:38.218852 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6a2b7a7-b3c4-47e6-a2e4-5a48a628ed50 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.328566 Oct 17 13:23:38.220688 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 922/1801] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:37 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:38.226605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:38.227819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:38.235599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.236565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.237315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.238308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.239008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.239661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.412513 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa5c6cb1-bc9f-4c5c-bdff-00c3a7bab019 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.497383 Oct 17 13:23:38.413224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 880/1802] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:23:37 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:38.419148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:38.420034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:38.433124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.433889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.434778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.435801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:38.437838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:38.446180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:38.632644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:38.646386 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89cf879b-a846-4394-866a-416a5eaf6ea5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.422754 Oct 17 13:23:38.668747 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 923/1803] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:38 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:38.679655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59f8aaa2-a16e-4bae-b203-bd8c092993fd tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Action: 'create', calling method: .version_select at 0x7f419e12caf0>, body: {"security_group_rule": {"parent_group_id": "b1d1a83d-df73-474e-9a2e-7be73f28e708", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:39.085629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.095213 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8a16874-0834-450a-b92b-76fba1688178 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.680761 Oct 17 13:23:39.095942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 881/1804] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:38 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:39.101175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:39.101877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:39.111105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.111741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.112274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.113423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.114156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.114891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.326347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:39.380035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:39.454883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:39.535207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.546589 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-862d2ea9-798e-4710-b422-ca0cc6e342e8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.449250 Oct 17 13:23:39.547451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 882/1805] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:39 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:39.553071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:39.553968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:39.561916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.562737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.563354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.564477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.565104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.565748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.593130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59f8aaa2-a16e-4bae-b203-bd8c092993fd tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.920237 Oct 17 13:23:39.595223 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 924/1806] 10.222.0.65 () {60 vars in 1195 bytes} [Mon Oct 17 13:23:38 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:39.601473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:39.602640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:39.617178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.617843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.618964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.619829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.620862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.621475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.922816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.938593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.940254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.941478 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-102739be-5729-4bef-af07-5e690486b940 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.392706 Oct 17 13:23:39.942622 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 883/1807] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:39 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:39.949514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b8c76239-12ff-419d-b80e-c7c121d273fe tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419ddd20d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:39.960641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:39.972426 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c590f6f2-80af-4885-ad11-c340461ac908 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.374833 Oct 17 13:23:39.973125 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 925/1808] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:39 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:39.978087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:39.978701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:39.986650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.986762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.987356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:39.988046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:39.988530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:39.988955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.422632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b8c76239-12ff-419d-b80e-c7c121d273fe tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/b1d1a83d-df73-474e-9a2e-7be73f28e708" status: 200 len: 664 microversion: 2.1 time: 0.478482 Oct 17 13:23:40.423489 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 884/1809] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:23:39 2022] GET /compute/v2.1/os-security-groups/b1d1a83d-df73-474e-9a2e-7be73f28e708 => generated 664 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:40.535833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3f01799b-d95f-42d7-b75f-294350921374"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:40.538464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:40.546201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.546706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.547162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.547875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.548335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.548788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.584031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:40.596911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5afa1e3f-2792-4c66-aeb8-22f62d7d2986 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.622487 Oct 17 13:23:40.598875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 926/1810] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:39 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:40.605833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8c9bfa82-316b-478f-8918-cda2997e1a23 req-3320b621-c24d-422b-a44b-fb6f88befca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0cc3d3-998a-4a24-b194-29cf74071bde", "name": "network-vif-plugged", "status": "completed", "tag": "589b4d61-a74e-4e01-8622-977978d83851"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:40.618991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8c9bfa82-316b-478f-8918-cda2997e1a23 req-3320b621-c24d-422b-a44b-fb6f88befca7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.619487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8c9bfa82-316b-478f-8918-cda2997e1a23 req-3320b621-c24d-422b-a44b-fb6f88befca7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.619915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8c9bfa82-316b-478f-8918-cda2997e1a23 req-3320b621-c24d-422b-a44b-fb6f88befca7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.645489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8c9bfa82-316b-478f-8918-cda2997e1a23 req-3320b621-c24d-422b-a44b-fb6f88befca7 service nova] Creating event network-vif-plugged:589b4d61-a74e-4e01-8622-977978d83851 for instance ab0cc3d3-998a-4a24-b194-29cf74071bde on n-h1-854121-14 Oct 17 13:23:40.656969 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8c9bfa82-316b-478f-8918-cda2997e1a23 req-3320b621-c24d-422b-a44b-fb6f88befca7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054505 Oct 17 13:23:40.658043 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 927/1811] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:40.670761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:40.671418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:40.687247 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] HTTP exception thrown: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. Oct 17 13:23:40.716687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.723629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.733267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Request method failure captured: Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments/effe21f7-037b-4a16-a8f0-aa7164824ed7 HTTP/1.1 Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 74 Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVb7KBoVEaXWyuP0PdcNgxTCvstKl1Cy2C9B6O3tHFEHTtaMTYI7LPMpf_26bZxBNMFIJ6lNuHaSNCI1ZVqZSqRnmm4Yg0js3KhRzJIIWpfNvzlqKigJWhOTBcZ_8jt4h-_BHZNgi0Lr5QrNMpiWfU2ArVLzgirrfSKeqCH2YQPT-HI Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 05e1669bb628465eb9f4f3d7b8a05a75 Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesAdminNegativeTest-537296173 Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:23:40.734202 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesAdminNegativeTest-537296173 Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 05e1669bb628465eb9f4f3d7b8a05a75 Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-537296173 Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesAdminNegativeTest-537296173-project-admin Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a32c26ed953146199d825dd85b3e771a Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesAdminNegativeTest-537296173-project-admin Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: {"volumeAttachment": {"volumeId": "3f01799b-d95f-42d7-b75f-294350921374"}} Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:23:40.736257 n-d-854121-14 devstack@n-api.service[120697]: exception: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': 'ffe767a4-03e3-48b0-89e1-7c478aa9ac84', 'id': 'effe21f7-037b-4a16-a8f0-aa7164824ed7', 'body': {'volumeAttachment': {'volumeId': '3f01799b-d95f-42d7-b75f-294350921374'}}} Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:23:40.737268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. (HTTP 404) (Request-ID: req-c2eae928-ec1c-4383-8bc5-55d22c8ff7e8) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:23:40.744227 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:40.748496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. Oct 17 13:23:40.754731 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:40.757852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Returning 400 to user: Volume 3f01799b-d95f-42d7-b75f-294350921374 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:40.757994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:40.758132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc68ff95-ab2f-49a7-9bf8-647f6cee28a9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] 10.222.0.65 "PUT /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments/effe21f7-037b-4a16-a8f0-aa7164824ed7" status: 400 len: 107 microversion: 2.1 time: 0.311761 Oct 17 13:23:40.758346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:40.758586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 885/1812] 10.222.0.65 () {60 vars in 1433 bytes} [Mon Oct 17 13:23:40 2022] PUT /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments/effe21f7-037b-4a16-a8f0-aa7164824ed7 => generated 107 bytes in 313 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:23:40.758784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:40.759020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25105bc4-fbda-447a-b440-5ec4016d7dac tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419dc623a0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.168658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:41.193675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.202203 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8446610-c61a-49f6-bec9-cc4b0ed76ff7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.538029 Oct 17 13:23:41.202793 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 928/1813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:40 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:41.207557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.208167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.214270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.214759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.215194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.215892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.216343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.216763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.401277 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25105bc4-fbda-447a-b440-5ec4016d7dac tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-group-rules/f0965eb8-8b6d-44f1-ac08-4710da1910d8" status: 202 len: 0 microversion: 2.1 time: 0.663556 Oct 17 13:23:41.401898 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 886/1814] 10.222.0.65 () {58 vars in 1287 bytes} [Mon Oct 17 13:23:40 2022] DELETE /compute/v2.1/os-security-group-rules/f0965eb8-8b6d-44f1-ac08-4710da1910d8 => generated 0 bytes in 665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:41.407688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1dee2f9a-6dcf-409d-9c55-1d3459320d80 req-bd76c5fc-5d8a-4aad-9ecc-cef0b0a54b2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b219db7-61f8-409b-a46e-d285774c9641", "tag": "83b7a61b-88d8-42a1-b06e-70702f9c2b32"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:41.418248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1dee2f9a-6dcf-409d-9c55-1d3459320d80 req-bd76c5fc-5d8a-4aad-9ecc-cef0b0a54b2f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.418761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1dee2f9a-6dcf-409d-9c55-1d3459320d80 req-bd76c5fc-5d8a-4aad-9ecc-cef0b0a54b2f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.419186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1dee2f9a-6dcf-409d-9c55-1d3459320d80 req-bd76c5fc-5d8a-4aad-9ecc-cef0b0a54b2f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.433717 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1dee2f9a-6dcf-409d-9c55-1d3459320d80 req-bd76c5fc-5d8a-4aad-9ecc-cef0b0a54b2f service nova] Creating event network-changed:83b7a61b-88d8-42a1-b06e-70702f9c2b32 for instance 8b219db7-61f8-409b-a46e-d285774c9641 on n-h2-854121-14 Oct 17 13:23:41.438637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1dee2f9a-6dcf-409d-9c55-1d3459320d80 req-bd76c5fc-5d8a-4aad-9ecc-cef0b0a54b2f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Oct 17 13:23:41.439265 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 887/1815] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:41.445381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.445905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.452674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.453173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.453610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.454306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.454753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.455176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.542250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lazy-loading 'services' on Instance uuid ffe767a4-03e3-48b0-89e1-7c478aa9ac84 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:41.563872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.573925 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a1c691e-a763-4f5a-abe3-8885edefc72a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.369993 Oct 17 13:23:41.585276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 929/1816] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:41 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:41.585276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.585276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.586813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.587522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.588142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.589032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.589684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.590316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.641690 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-967406d3-3f7a-4e1c-8ad6-bc47b35fb442 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments/effe21f7-037b-4a16-a8f0-aa7164824ed7" status: 202 len: 0 microversion: 2.1 time: 0.199530 Oct 17 13:23:41.642436 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 888/1817] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:23:41 2022] DELETE /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments/effe21f7-037b-4a16-a8f0-aa7164824ed7 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:41.648005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.648801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.661011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.661650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.662209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.663015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.663485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.663918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.920676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.925412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.929536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.931366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:41.932493 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33e0fc9d-5163-4334-9dbc-cf6bc63dacf3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1281 microversion: 2.25 time: 0.356475 Oct 17 13:23:41.933059 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 930/1818] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:41 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1281 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:41.933532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65f8ed8a-812d-428a-b87a-d5598eda6eb6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.289733 Oct 17 13:23:41.934161 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 889/1819] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:41 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:41.937770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-384abb28-f7e3-461f-b639-452bb0af4148 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419e1bd4c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.944747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:41.954008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:41.960286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.960869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.961365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:41.962685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:41.963147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:41.963604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.168137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:42.176238 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af635b5f-af62-4245-9ca7-df0e39aba0a3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.240817 Oct 17 13:23:42.176825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 890/1820] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:41 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:42.182043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.184336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:42.191293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.191792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.192510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.193528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.194017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.194691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.212958 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-384abb28-f7e3-461f-b639-452bb0af4148 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/b1d1a83d-df73-474e-9a2e-7be73f28e708" status: 202 len: 0 microversion: 2.1 time: 0.277833 Oct 17 13:23:42.214102 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 931/1821] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:41 2022] DELETE /compute/v2.1/os-security-groups/b1d1a83d-df73-474e-9a2e-7be73f28e708 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:42.224194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419e00caf0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.235256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-760de7fd-3908-4ca0-a376-eb9f615caad2 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057062 Oct 17 13:23:42.236430 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 891/1822] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:23:42 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:42.241035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.241873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:42.248527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.249486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.249971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.250648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.251090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.251585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.264930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:23:42.265867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Neutron security group ca4156a4-381e-44c6-a398-fa275849e20c not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:23:42.266402 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] HTTP exception thrown: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.266402 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Request method failure captured: Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-security-groups/ca4156a4-381e-44c6-a398-fa275849e20c HTTP/1.1 Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVdN1GJeV3Fo6ekEwJsImVstkrcaE8MQN-p2g9hlhrEgCpvML_v-N-kV41t5KS4m9mOUNmp0unrz9X2xbkXe87v4QGHkNeTtwqhaNRQFDkkFzYzt3lerS5gjbvFnaVGR3kkIGd3M1gs45bw36Qz_x95ZsnTGX3pqzPj9MwVmPk28YJQ Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 651013bb52664058a4a2a7130bc7e2ee Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1446089578 Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:23:42.268355 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/651013bb52664058a4a2a7130bc7e2ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/651013bb52664058a4a2a7130bc7e2ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/651013bb52664058a4a2a7130bc7e2ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_651013bb52664058a4a2a7130bc7e2ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1446089578 Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 651013bb52664058a4a2a7130bc7e2ee Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1446089578 Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupRulesTestJSON-1446089578-project Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fc99400540454b8c8b89583409494b2a Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1446089578-project Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] Oct 17 13:23:42.270032 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ca4156a4-381e-44c6-a398-fa275849e20c'} Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:23:42.271014 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:23:42.272439 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.275789 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Returning 404 to user: Security group ca4156a4-381e-44c6-a398-fa275849e20c does not exist Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-d483c780-3e4e-47dc-917b-5996881ff3ab'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e111970-f1f4-4fa0-b7a6-411bf35c36ed tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/ca4156a4-381e-44c6-a398-fa275849e20c" status: 404 len: 194 microversion: 2.1 time: 0.051629 Oct 17 13:23:42.280491 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 932/1823] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:42 2022] DELETE /compute/v2.1/os-security-groups/ca4156a4-381e-44c6-a398-fa275849e20c => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:23:42.282070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c582399b-0e41-4676-b7ef-cea1bf98d561 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419defa280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.460827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:42.471738 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4beb7f3f-56ee-4dbe-af03-97988fab52bc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.233812 Oct 17 13:23:42.472663 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 892/1824] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:42 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:42.549775 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c582399b-0e41-4676-b7ef-cea1bf98d561 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/a4692e8d-c878-4a00-ae7f-83c4134a328f" status: 202 len: 0 microversion: 2.1 time: 0.274109 Oct 17 13:23:42.553564 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 933/1825] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:42 2022] DELETE /compute/v2.1/os-security-groups/a4692e8d-c878-4a00-ae7f-83c4134a328f => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:23:42.559048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34d85082-c914-4665-81b5-56cb16cb1f7f tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419e15c670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.601537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.602210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:42.610970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.611476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.611913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.612882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.613369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.614010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.812234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:42.820218 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aeecc03e-50e9-4b71-aa9f-242608c69698 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.224168 Oct 17 13:23:42.820963 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 934/1826] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:42 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:42.826288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4ebf36b5-3ece-4af2-9261-27baebd9cfb7 req-04489dd4-a8b1-4e9c-9bf7-f0ada1ea0ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbf01b0-b079-4ebf-ba60-e6c131a57494", "name": "network-vif-plugged", "status": "completed", "tag": "49a40318-afa6-45e7-8334-0e2b5f563c1f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:42.838049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ebf36b5-3ece-4af2-9261-27baebd9cfb7 req-04489dd4-a8b1-4e9c-9bf7-f0ada1ea0ec7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.838636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ebf36b5-3ece-4af2-9261-27baebd9cfb7 req-04489dd4-a8b1-4e9c-9bf7-f0ada1ea0ec7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.839230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ebf36b5-3ece-4af2-9261-27baebd9cfb7 req-04489dd4-a8b1-4e9c-9bf7-f0ada1ea0ec7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.854272 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4ebf36b5-3ece-4af2-9261-27baebd9cfb7 req-04489dd4-a8b1-4e9c-9bf7-f0ada1ea0ec7 service nova] Creating event network-vif-plugged:49a40318-afa6-45e7-8334-0e2b5f563c1f for instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 on n-h2-854121-14 Oct 17 13:23:42.859708 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4ebf36b5-3ece-4af2-9261-27baebd9cfb7 req-04489dd4-a8b1-4e9c-9bf7-f0ada1ea0ec7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037180 Oct 17 13:23:42.860830 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 935/1827] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:42.879118 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34d85082-c914-4665-81b5-56cb16cb1f7f tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/bb05f481-9d80-4f40-a431-09151ad63340" status: 202 len: 0 microversion: 2.1 time: 0.324479 Oct 17 13:23:42.880107 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 893/1828] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:42 2022] DELETE /compute/v2.1/os-security-groups/bb05f481-9d80-4f40-a431-09151ad63340 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:42.889350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b20ae00-9f85-462f-87c7-02ae2d88e246 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419e12c280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.957278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:42.957893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:42.965285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.966038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.966671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:42.967575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:42.968041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:42.968627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.153916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.158163 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b20ae00-9f85-462f-87c7-02ae2d88e246 tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/8e9b2689-e9a7-41d8-922d-8e0ae77292f8" status: 202 len: 0 microversion: 2.1 time: 0.273355 Oct 17 13:23:43.162714 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fd3c97e-5e2f-4c1d-97d0-434329eb928b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.209294 Oct 17 13:23:43.163558 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 894/1830] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:42 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:43.168762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.170091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:43.177416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.177913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.178563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.178733 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 936/1830] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:42 2022] DELETE /compute/v2.1/os-security-groups/8e9b2689-e9a7-41d8-922d-8e0ae77292f8 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:43.180203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.181742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.182701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.186338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39c8e3a6-265c-4c0b-bb33-bef1e20bf5ec tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419e1bd430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.375846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.385517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.386987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.388335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10e13563-7bbe-46b9-a78a-101e786ed9f2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1477 microversion: 2.25 time: 0.223631 Oct 17 13:23:43.388912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 895/1831] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:43 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1477 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:43.393571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.394180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:43.400359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.401057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.401536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.402241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.402865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.403459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.558512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39c8e3a6-265c-4c0b-bb33-bef1e20bf5ec tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/fb510503-d8d9-4cd2-8699-9bf649f04fbd" status: 202 len: 0 microversion: 2.1 time: 0.378269 Oct 17 13:23:43.559389 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 937/1832] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:43 2022] DELETE /compute/v2.1/os-security-groups/fb510503-d8d9-4cd2-8699-9bf649f04fbd => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:43.567220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.569929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:43.578030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.578288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.578989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.579799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.580353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.580897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.599127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.607031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:43.623994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1346fc99-bb95-4341-913a-73f1cc6377a0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.233687 Oct 17 13:23:43.624954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:43.641314 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 896/1833] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:43 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:43.648077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24feeffd-01de-4530-84c3-c1fcc9fb0612 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084674 Oct 17 13:23:43.648858 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 938/1834] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:23:43 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:43.656790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-84323328-0ff1-4765-ab00-c45fd0240b59 req-ef9b6ec4-ef64-4e78-8d11-c8030a4600d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568785e3-bd23-4e83-aeac-098b0977dbbe", "tag": "eb46c2fc-6f45-4b94-839d-de9f9c02ff31"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:43.667762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-84323328-0ff1-4765-ab00-c45fd0240b59 req-ef9b6ec4-ef64-4e78-8d11-c8030a4600d6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.668310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-84323328-0ff1-4765-ab00-c45fd0240b59 req-ef9b6ec4-ef64-4e78-8d11-c8030a4600d6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.668749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-84323328-0ff1-4765-ab00-c45fd0240b59 req-ef9b6ec4-ef64-4e78-8d11-c8030a4600d6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.683320 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-84323328-0ff1-4765-ab00-c45fd0240b59 req-ef9b6ec4-ef64-4e78-8d11-c8030a4600d6 service nova] Creating event network-changed:eb46c2fc-6f45-4b94-839d-de9f9c02ff31 for instance 568785e3-bd23-4e83-aeac-098b0977dbbe on n-h2-854121-14 Oct 17 13:23:43.689213 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-84323328-0ff1-4765-ab00-c45fd0240b59 req-ef9b6ec4-ef64-4e78-8d11-c8030a4600d6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039146 Oct 17 13:23:43.689825 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 939/1835] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:43.696116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.696860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:43.703291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.703771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.704410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.705312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.705768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.706192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.759189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.759978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:43.766658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.767240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.767777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.768571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.769211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.769716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.884874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:43.903231 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c621aad8-e011-4560-a359-60bc68da2b90 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.211607 Oct 17 13:23:43.904169 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 940/1836] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:43 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:43.910584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2c07933-c694-4e7c-a001-5a34c222919e tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] Calling method '.version_select at 0x7f419e12c160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.950227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid ab0cc3d3-998a-4a24-b194-29cf74071bde {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:43.966556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66221a59-68b4-4e09-916d-4bcedaf5beff tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1972 microversion: 2.25 time: 0.339533 Oct 17 13:23:43.967234 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 897/1837] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:43 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1972 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:43.972283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:43.973481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:43.980150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.980956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.981686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:43.982591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:43.983490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:43.983958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.189038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:44.197555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ccf59fd-7ed8-44ef-8e21-0fe173fcee4f tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.229040 Oct 17 13:23:44.198190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 898/1838] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:43 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:44.202766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.203383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.210259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.210982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.212575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.213615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.214250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.214900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.219148 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2c07933-c694-4e7c-a001-5a34c222919e tempest-SecurityGroupRulesTestJSON-1446089578 tempest-SecurityGroupRulesTestJSON-1446089578-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/5bdf6779-1ae8-44b7-982a-7ff6fa31c176" status: 202 len: 0 microversion: 2.1 time: 0.313407 Oct 17 13:23:44.223079 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 941/1839] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:23:43 2022] DELETE /compute/v2.1/os-security-groups/5bdf6779-1ae8-44b7-982a-7ff6fa31c176 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:44.226235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.227105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.244849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.245652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.246246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.247260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.248355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.249215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.449774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:44.456703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid ab0cc3d3-998a-4a24-b194-29cf74071bde {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:44.458370 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d18ef031-03fe-4d7e-9f7b-ccaaa31a508d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.237068 Oct 17 13:23:44.458958 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 942/1840] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:44.475032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c378cf7a-5fab-4414-ac84-14199b3874d5 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1972 microversion: 2.25 time: 0.275783 Oct 17 13:23:44.476331 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 899/1841] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1972 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:44.502425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.507434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.509248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.510099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.511141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.511821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.512682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.543654 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-579aabd9-8c2f-493d-9f63-1edd543e95bd tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.046375 Oct 17 13:23:44.545298 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 943/1842] 10.222.0.65 () {60 vars in 1217 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:23:44.558655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854121-14", "block_migration": "auto"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:44.562052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.568998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.570088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.570944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.571926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.572597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.573262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.607705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'flavor' on Instance uuid ab0cc3d3-998a-4a24-b194-29cf74071bde {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:44.626934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Going to try to live migrate instance to n-h2-854121-14 {{(pid=120697) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 13:23:44.647977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.649518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.658820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.659829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.660777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.661918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.662932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.663389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.820130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:44.828342 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66ba7bd4-cc1a-4072-a3e4-569d16bd8d44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.184115 Oct 17 13:23:44.828916 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 944/1843] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:44.839231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.841535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.849781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.850631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.851235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.852660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.853765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.854639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.938051 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b837fb36-58df-4b7c-92aa-874fb8ebedbc tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107763 Oct 17 13:23:44.939063 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 945/1844] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:44.947934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:44.949636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:44.957789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.962699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.964482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:44.966635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:44.969533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:44.970175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.140552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:45.150459 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d4fccb4-501b-4a60-90b3-af131de50897 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.209846 Oct 17 13:23:45.151384 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 946/1845] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:44 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:45.221410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:45.222030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:45.228330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.229464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.230117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.230855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.231263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.232575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.411076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:45.423611 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74b05f43-228b-402a-9645-85eae3e59a73 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.206034 Oct 17 13:23:45.438930 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 947/1846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:45 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:45.486444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:45.488914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:45.505131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.507012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.512244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.514821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.515431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.516212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.807349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:45.818232 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2964c51d-ac9d-40e2-880e-94370c517b09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.337590 Oct 17 13:23:45.828638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 948/1847] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:45 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:45.856083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:45.861152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:45.870408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.871142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.872017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:45.872909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:45.873573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:45.874139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.045096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:46.055473 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24d0412b-1834-4baf-b2ad-aaf510b7d0d6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.206971 Oct 17 13:23:46.070772 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 949/1848] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:45 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:46.070772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.070772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:46.076296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.076869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.077430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.078355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.078883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.079540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.124389 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-496aa260-f58f-464d-bf39-345888ffad9d tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062046 Oct 17 13:23:46.125527 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 950/1849] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:46.130757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.137122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:46.138255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Searching by: {'deleted': False, 'project_id': 'ba93682abaca481f8ce1796b72f6d154'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:23:46.144877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.150591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.153449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.154541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.155039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.155486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.190693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:23:46.224711 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b9818c4-360f-457f-93fa-92a660fb39df tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.097924 Oct 17 13:23:46.225571 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 951/1850] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers => generated 334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:46.232313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.232801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:46.240206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.240704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.241145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.241895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.242492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.242995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.410978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:46.424273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f2df72a-5010-4c65-8026-855393f88187 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.196385 Oct 17 13:23:46.425354 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 952/1851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:46.431611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.436654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:46.437515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Searching by: {'deleted': False, 'project_id': 'ba93682abaca481f8ce1796b72f6d154'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:23:46.443374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.443858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.444411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.445141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.445643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.448182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.480727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:23:46.536717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:46.544169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.544657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.545106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.823696 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c1a274cf-423a-49f6-b3e3-41775e434138 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.393801 Oct 17 13:23:46.823696 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 953/1852] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:46.827371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:46.828145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:46.844217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.844723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.848273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:46.849038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:46.849537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:46.849957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.147084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:47.165583 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2596943-1dc6-4f2e-8e55-1b10f215ada8 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.338963 Oct 17 13:23:47.166261 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 954/1853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:46 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:47.193527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16b07652-1c19-46d7-bf73-df0ff8c2bd5a tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.213311 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16b07652-1c19-46d7-bf73-df0ff8c2bd5a tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029082 Oct 17 13:23:47.219636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 955/1854] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:47.229907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.230663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:47.233414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:47.247082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.247837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.248202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.248995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.255720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.256280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.443373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:47.452124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff0303f3-c656-4b0e-8e00-7322efb96666 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.231289 Oct 17 13:23:47.461791 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 956/1855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:47.468735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.470171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:47.477766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.478451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.479077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.479821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.480281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.480709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.754600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:47.758650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:47.771332 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1e5acee-9134-43f4-88aa-1d2e7c0bc442 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1314 microversion: 2.1 time: 0.307797 Oct 17 13:23:47.785453 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 957/1856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:47.797384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.800263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:47.808485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.809076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.809660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.810613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.811173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.815041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.873118 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7a189ed-59c8-40dd-a2bb-d1c19ddfb272 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085139 Oct 17 13:23:47.873965 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 958/1857] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:47.883256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:47.883899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:47.895572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.896094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.896538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:47.897364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:47.897994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:47.898568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.085039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:48.094700 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-572808c7-a79a-40f8-964c-f530a66adba7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.216505 Oct 17 13:23:48.095587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 959/1858] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:47 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:48.103893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:48.104783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:48.113629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.114393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.115032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.115742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:48.116375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:48.116804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:48.151183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:23:48.354731 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32dbc399-010f-410c-949e-1cafd5f4988c tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "DELETE /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 204 len: 0 microversion: 2.1 time: 0.257542 Oct 17 13:23:48.355882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 960/1859] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:23:48 2022] DELETE /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:23:48.366780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-85406458", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "588eb70f-62df-466f-855d-0eb3e16b4cea"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:48.446458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] validate_networks() for [('588eb70f-62df-466f-855d-0eb3e16b4cea', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:23:49.011735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:23:49.012426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:23:49.012916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:23:49.013362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:23:49.013780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:23:49.023762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.024538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.025081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.025863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.026311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.026913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.045253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Getting quotas for project cd0c1190c61647ceb4914330b65b7c24. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:23:49.050566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Getting quotas for user 9976642939654889bb1dc78814a9011c and project cd0c1190c61647ceb4914330b65b7c24. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:23:49.064297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:23:49.066755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:23:49.121040 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7217e8ab-4a6f-49ff-a04a-d8203fcbeef8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760140 Oct 17 13:23:49.122224 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 961/1860] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:23:49.128113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:49.129361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:49.138300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.139167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.139639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.140624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.141103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.141767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.380506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:49.389551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-311bb947-be2d-411e-8fc8-e196eff58d2a tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.266001 Oct 17 13:23:49.390882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 962/1861] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:49 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:49.396012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:49.396762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:49.404343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.404860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.405546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.406759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.407577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.408200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.639263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:49.650510 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6e8e33f-7103-4d6f-8fe7-32fe8225571b tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1699 microversion: 2.1 time: 0.258279 Oct 17 13:23:49.651398 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 963/1862] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:49 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1699 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:49.656394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:49.657019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:49.663152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.663633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.664122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:49.665679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:49.666147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:49.666716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:50.588896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:50.616845 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d330b34d-daa3-4015-b3b6-fbe99dcb5367 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.963156 Oct 17 13:23:50.619772 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 964/1863] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:49 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:50.643431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:50.644290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:50.650789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:50.651568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:50.652223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:50.653141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:50.653863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:50.654946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.044071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.053949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7d38a59-7251-4014-8fde-211a43822721 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1501 microversion: 2.1 time: 0.415310 Oct 17 13:23:51.054545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 965/1864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:50 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1501 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:51.059638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:51.060244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.066737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.067217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.067648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.068342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.068785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.069357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.265574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.274913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae6e08a3-a954-4c5e-ba37-4595d50f43b6 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.217703 Oct 17 13:23:51.275841 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 966/1865] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:51 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:51.280865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:51.281509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.288308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.288800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.289265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.290207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.290663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.291088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.363643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.372415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ecbee828-5fac-4d7c-bdba-dbe6d071bc45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1274 microversion: 2.1 time: 0.095499 Oct 17 13:23:51.373001 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 967/1866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:51 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:51.377796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-90ead44b-11a5-472f-a4ae-9a913471eaeb req-2690abbd-ec13-4a98-afd8-9f0c3cfcf9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b219db7-61f8-409b-a46e-d285774c9641", "name": "network-vif-plugged", "status": "completed", "tag": "83b7a61b-88d8-42a1-b06e-70702f9c2b32"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:51.389496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90ead44b-11a5-472f-a4ae-9a913471eaeb req-2690abbd-ec13-4a98-afd8-9f0c3cfcf9f3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.390330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90ead44b-11a5-472f-a4ae-9a913471eaeb req-2690abbd-ec13-4a98-afd8-9f0c3cfcf9f3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.391014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90ead44b-11a5-472f-a4ae-9a913471eaeb req-2690abbd-ec13-4a98-afd8-9f0c3cfcf9f3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.404734 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-90ead44b-11a5-472f-a4ae-9a913471eaeb req-2690abbd-ec13-4a98-afd8-9f0c3cfcf9f3 service nova] Creating event network-vif-plugged:83b7a61b-88d8-42a1-b06e-70702f9c2b32 for instance 8b219db7-61f8-409b-a46e-d285774c9641 on n-h2-854121-14 Oct 17 13:23:51.409750 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-90ead44b-11a5-472f-a4ae-9a913471eaeb req-2690abbd-ec13-4a98-afd8-9f0c3cfcf9f3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035392 Oct 17 13:23:51.410396 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 968/1867] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:51.415306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:51.416022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.422129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.422614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.423045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.423738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.424186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.424604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.619255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.629536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e83d329f-d99f-445d-b6b3-d85c0eeee708 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.218080 Oct 17 13:23:51.630872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 969/1868] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:51 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:51.648287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:51.649259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.656094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.656765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.657375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.658192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.658874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.659676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.733016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad8d036b-2d42-4a4e-b71c-ec921738e102 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde/action" status: 202 len: 0 microversion: 2.25 time: 7.178842 Oct 17 13:23:51.734073 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 900/1869] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:23:44 2022] POST /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde/action => generated 0 bytes in 7181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:23:51.745522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1c050563-af89-4ee2-b2d2-f5849ab696bf req-6ef415dc-8ed0-43ea-b72d-18a43f6a0743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f291851-bc65-4d61-8ced-20cef46b6afb", "name": "network-vif-unplugged", "status": "completed", "tag": "dd0fae42-e55f-44c6-81c5-c29ecb3f80d8"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:51.766720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1c050563-af89-4ee2-b2d2-f5849ab696bf req-6ef415dc-8ed0-43ea-b72d-18a43f6a0743 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.767209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1c050563-af89-4ee2-b2d2-f5849ab696bf req-6ef415dc-8ed0-43ea-b72d-18a43f6a0743 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.767642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1c050563-af89-4ee2-b2d2-f5849ab696bf req-6ef415dc-8ed0-43ea-b72d-18a43f6a0743 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.780991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1c050563-af89-4ee2-b2d2-f5849ab696bf req-6ef415dc-8ed0-43ea-b72d-18a43f6a0743 service nova] Creating event network-vif-unplugged:dd0fae42-e55f-44c6-81c5-c29ecb3f80d8 for instance 7f291851-bc65-4d61-8ced-20cef46b6afb on n-h1-854121-14 Oct 17 13:23:51.787922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1c050563-af89-4ee2-b2d2-f5849ab696bf req-6ef415dc-8ed0-43ea-b72d-18a43f6a0743 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049106 Oct 17 13:23:51.788809 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 901/1870] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:51.795383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:51.797769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.806399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.807034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.807688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.808910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.809757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.810482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.831194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:51.839681 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-856e0103-ac9e-4fc9-aebc-fd8e8f28a552 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1699 microversion: 2.1 time: 0.207716 Oct 17 13:23:51.845329 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 970/1871] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:51 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1699 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:51.848900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:51.850246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:51.855881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.856366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.857067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:51.857527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:51.857973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:51.858434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.064031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.065139 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5ccc03a-1b5b-47ce-a171-635614862f53 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.266490 Oct 17 13:23:52.067794 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 902/1872] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:51 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:52.075312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.076379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.079777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-471adea0-2b63-41c3-86e5-b4091845b4f3 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.237423 Oct 17 13:23:52.081581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 971/1873] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:51 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:52.085116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.085783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.086264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.087313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.088311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.088984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.261007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.274479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.276629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.277959 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd69b8b8-ca80-4935-95e9-a3aba3995dcd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.208514 Oct 17 13:23:52.278767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 903/1874] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:52.300420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.301039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.308487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.309328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.309935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.310788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.311244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.311661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.395486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.396347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.406814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:52.409075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.409997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.410980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.412144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.413496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.414456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.519931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.536736 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7ce8a6a-3582-42a4-88cb-4c895b34b060 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1307 microversion: 2.1 time: 0.241899 Oct 17 13:23:52.539121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.560717 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 972/1875] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1307 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:52.565685 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa1d57ea-9d43-4433-ad1f-490f2db3d57f tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1274 microversion: 2.1 time: 0.173976 Oct 17 13:23:52.566847 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 904/1876] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:52.658611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.659140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.666895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.667386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.667821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.668824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.669375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.670038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.838435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.848000 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a98636b-5baa-4d2d-8773-716194f72e65 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.195128 Oct 17 13:23:52.851013 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 973/1877] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:52.863506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:52.865458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:52.881154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.882022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.882670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.885452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:52.886284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:52.887697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:52.962905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:52.972193 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a169df46-d76b-4abb-9be2-b402a566b337 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1632 microversion: 2.1 time: 0.112626 Oct 17 13:23:52.972788 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 905/1878] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:52 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1632 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:53.077320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:53.080084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.089101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.089714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.090456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.091830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.092454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.093045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.097391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:53.103920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.104531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.111410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.112259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.113018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.114131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.114793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.115444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.295489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.305853 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de5527ca-97d6-4565-8c0d-ff46c46d3012 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.205186 Oct 17 13:23:53.341640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 906/1879] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:53.348166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.349233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.360912 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fad951f-99d2-47f9-bd70-edaf737547a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.286797 Oct 17 13:23:53.365308 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 974/1880] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:53 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:53.377821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.378589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.379511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.380594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.381355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.382213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.510856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c69f6d4d-749d-4507-946d-35db5745c926 req-a3432436-aecb-4e26-afaa-60eb8a01edaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568785e3-bd23-4e83-aeac-098b0977dbbe", "name": "network-vif-plugged", "status": "completed", "tag": "eb46c2fc-6f45-4b94-839d-de9f9c02ff31"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:53.529131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c69f6d4d-749d-4507-946d-35db5745c926 req-a3432436-aecb-4e26-afaa-60eb8a01edaa service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.531763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c69f6d4d-749d-4507-946d-35db5745c926 req-a3432436-aecb-4e26-afaa-60eb8a01edaa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.532209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c69f6d4d-749d-4507-946d-35db5745c926 req-a3432436-aecb-4e26-afaa-60eb8a01edaa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.553032 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c69f6d4d-749d-4507-946d-35db5745c926 req-a3432436-aecb-4e26-afaa-60eb8a01edaa service nova] Creating event network-vif-plugged:eb46c2fc-6f45-4b94-839d-de9f9c02ff31 for instance 568785e3-bd23-4e83-aeac-098b0977dbbe on n-h2-854121-14 Oct 17 13:23:53.561683 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c69f6d4d-749d-4507-946d-35db5745c926 req-a3432436-aecb-4e26-afaa-60eb8a01edaa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062390 Oct 17 13:23:53.569494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 975/1881] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:53.578593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.579851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.601057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.601674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.602848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.604417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.605351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.606135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.665950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.680637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.683902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.685554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a0af872-fe80-4ee7-b3d3-d94127be1204 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.341249 Oct 17 13:23:53.686830 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 907/1882] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:53.693424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.693997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.702230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.702857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.703305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.704299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.704648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.705108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.840409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.852846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65d63b51-fce4-4c84-8070-ee86648798b9 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 200 len: 1486 microversion: 2.1 time: 0.281028 Oct 17 13:23:53.853832 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 976/1883] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 1486 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:53.865018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f291851-bc65-4d61-8ced-20cef46b6afb", "tag": "dd0fae42-e55f-44c6-81c5-c29ecb3f80d8"}, {"server_uuid": "688bafde-0fa7-4b7c-990d-6afcdbd8f554", "name": "network-vif-deleted", "tag": "cb063e1b-4df3-486b-9139-9f675eb246b3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:53.878209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.878990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.879827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.899908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] Creating event network-changed:dd0fae42-e55f-44c6-81c5-c29ecb3f80d8 for instance 7f291851-bc65-4d61-8ced-20cef46b6afb on n-h1-854121-14 Oct 17 13:23:53.901607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] Creating event network-vif-deleted:cb063e1b-4df3-486b-9139-9f675eb246b3 for instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 on n-h1-854121-14 Oct 17 13:23:53.912593 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-93ab42a2-3fd2-4d33-9943-b6169ff9821d req-9cd12ccb-f719-49ba-ae12-e560d4436e9a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054645 Oct 17 13:23:53.914184 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 977/1884] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:53.927390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:53.929589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:53.937193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.938636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.939267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.940602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:53.942077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:53.942941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:53.970124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:53.990697 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9cf1016-6bdd-4390-bb6f-5b734d877774 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.301958 Oct 17 13:23:53.992069 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 908/1885] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.002253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1349078265"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:54.005535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:54.012715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.013218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.014204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.015404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.016257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.016990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.194143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.210958 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60c78243-ae37-4d7e-909b-c3f4bec8bc31 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.294204 Oct 17 13:23:54.215840 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 978/1886] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:53 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.235430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:54.239169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:54.267218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.268911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.270771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.273663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.275134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.276574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.382438 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb0d7482-af45-45be-a999-de00856622bf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641/action" status: 202 len: 0 microversion: 2.1 time: 0.388686 Oct 17 13:23:54.383190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 909/1887] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:53 2022] POST /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641/action => generated 0 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:23:54.392212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:54.393283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:54.397561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.400861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.403374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.404267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lazy-loading 'fault' on Instance uuid 688bafde-0fa7-4b7c-990d-6afcdbd8f554 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:23:54.405230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.406305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.407253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.408348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.410004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.411946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.475359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2847e2ea14534045b45ac2fbb724c3c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba93682abaca481f8ce1796b72f6d154', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.477578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:54.487613 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79b0b2d3-ccaf-43d8-9c70-75a58e3db0e0 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 200 len: 1359 microversion: 2.1 time: 0.267542 Oct 17 13:23:54.488449 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 979/1888] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:54 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.503028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:54.506907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:54.516526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.517821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.519162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.520317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.521207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.522147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.657267 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d57ac3b6-3b04-4615-8061-e563781a768c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.166384 Oct 17 13:23:54.659700 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 980/1889] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:54 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:54.669146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba617603-b34f-4083-a6b0-f4ef516c839a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20f95e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:54.752137 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba617603-b34f-4083-a6b0-f4ef516c839a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.090410 Oct 17 13:23:54.753490 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 981/1890] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:54 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.760337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:54.761033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.762014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:54.771301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.772078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.772720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.773203 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-edddbc41-0aab-44e8-8735-2e516fb53649 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.387339 Oct 17 13:23:54.773971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:54.775361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:54.776036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:54.776887 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 910/1891] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:54 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:54.944108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.957312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.958780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:54.960511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8abeeda-efff-4269-bd02-6413178db7cc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.205547 Oct 17 13:23:54.962152 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 982/1892] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:54 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:55.014690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.015317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.022706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.028978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.033371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.034363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.034920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.035450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.243236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.244167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.255322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.256269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.256879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.258105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.258760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.259575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.295294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:55.304575 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b72bacc-db81-4d7c-9c83-875c98b5dc15 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.294111 Oct 17 13:23:55.309889 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 911/1893] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:55.517393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.518034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] [instance: 688bafde-0fa7-4b7c-990d-6afcdbd8f554] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.531649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.532547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.533810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.535034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.536007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.536681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.557619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:55.559637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] HTTP exception thrown: Instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 could not be found. Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Request method failure captured: Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 HTTP/1.1 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVcilxIFKLBqKII3vOdv2iWJAQ2hNrq8W2sS9LCUzj23qUSJ2bcCSO7lDtDn42JBFwyGxKsNE5evJ77i1I3Pq-w_I8p01a3KdQyI9Mg_uAc5nLT6F_84dDzY0rwtoKXAuIAT3q4RR9H9pjjXZeqq0-t-iXd-RuthM-YX-j_K6AQ7zA8 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ba93682abaca481f8ce1796b72f6d154 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-686352456 Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:23:55.561544 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ba93682abaca481f8ce1796b72f6d154"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba93682abaca481f8ce1796b72f6d154"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ba93682abaca481f8ce1796b72f6d154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ba93682abaca481f8ce1796b72f6d154"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-686352456 Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ba93682abaca481f8ce1796b72f6d154 Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-686352456 Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-686352456-project Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 2847e2ea14534045b45ac2fbb724c3c9 Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-686352456-project Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 could not be found. Oct 17 13:23:55.563677 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '688bafde-0fa7-4b7c-990d-6afcdbd8f554'} Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 could not be found. Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:23:55.565281 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 could not be found. Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 could not be found. Oct 17 13:23:55.568539 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:23:55.572922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e732911e-09ff-4d90-a4be-5a58e9a0e9db tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1316 microversion: 2.1 time: 0.331822 Oct 17 13:23:55.572922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 983/1894] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1316 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:55.574496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Returning 404 to user: Instance 688bafde-0fa7-4b7c-990d-6afcdbd8f554 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:23:55.575787 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67543f86-e7db-41f8-a755-a71258b79fa7 tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554" status: 404 len: 111 microversion: 2.1 time: 0.066522 Oct 17 13:23:55.581238 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 912/1895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/688bafde-0fa7-4b7c-990d-6afcdbd8f554 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:23:55.585744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4d406fe-aa62-4c42-ae28-67540f6c2a4f tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] Calling method '.version_select at 0x7f419e0c4790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.624589 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4d406fe-aa62-4c42-ae28-67540f6c2a4f tempest-ServersTestJSON-686352456 tempest-ServersTestJSON-686352456-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964444787" status: 202 len: 0 microversion: 2.1 time: 0.042759 Oct 17 13:23:55.625224 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 984/1896] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:23:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964444787 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:23:55.672347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:55.676546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.693238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.693238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.693238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.693238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.693757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.693757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.769661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f54f52d3-c1f8-4c30-87e1-6303faad4cb0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2083af0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.776325 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96758ca0-184d-405c-8f31-b48969001dfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.108881 Oct 17 13:23:55.780578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 913/1897] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:55 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:55.803936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.805276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:55.814852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.816289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.818037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.819673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:55.820476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:55.822496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:55.845959 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f54f52d3-c1f8-4c30-87e1-6303faad4cb0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.081338 Oct 17 13:23:55.847636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 985/1898] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:55.988936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:55.991849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.008920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.010699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.012644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.013667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.014638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.014638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.209034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.219100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ea48386-827f-46b0-950f-b00ee004926f tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.422484 Oct 17 13:23:56.225529 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 914/1899] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:56.237813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fee83d30-bb3f-4c0c-82ae-27ae5f1434f4 req-80bf7382-62d5-43ff-b6af-3d2002982567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "930993f9-0499-4d7e-933b-f90262cf7f5d", "tag": "0c8e65dc-b6d3-42c4-a354-2bb3d8047c07"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:56.254556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fee83d30-bb3f-4c0c-82ae-27ae5f1434f4 req-80bf7382-62d5-43ff-b6af-3d2002982567 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.256453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fee83d30-bb3f-4c0c-82ae-27ae5f1434f4 req-80bf7382-62d5-43ff-b6af-3d2002982567 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.257687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fee83d30-bb3f-4c0c-82ae-27ae5f1434f4 req-80bf7382-62d5-43ff-b6af-3d2002982567 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.281490 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fee83d30-bb3f-4c0c-82ae-27ae5f1434f4 req-80bf7382-62d5-43ff-b6af-3d2002982567 service nova] Creating event network-changed:0c8e65dc-b6d3-42c4-a354-2bb3d8047c07 for instance 930993f9-0499-4d7e-933b-f90262cf7f5d on n-h1-854121-14 Oct 17 13:23:56.290242 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fee83d30-bb3f-4c0c-82ae-27ae5f1434f4 req-80bf7382-62d5-43ff-b6af-3d2002982567 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061868 Oct 17 13:23:56.291794 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 915/1900] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:23:56.332752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:56.333890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.346946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.347448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.348087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.349105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.349810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.350582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.359026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.373841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.376152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.379860 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-262b6222-633f-4723-a4b8-4443ccd59d0b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.395154 Oct 17 13:23:56.382973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 986/1901] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:55 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:23:56.530875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.539631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f5571ab2-febc-4c8c-90bb-21c5680124d6 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.211235 Oct 17 13:23:56.540532 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 916/1902] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:56 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:56.597208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:56.597833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.605433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.605935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.606375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.607259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.607891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.608748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.779019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.795883 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d60845cf-44ee-44f2-9c51-fb4b49d64395 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1506 microversion: 2.1 time: 0.202367 Oct 17 13:23:56.797106 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 987/1903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:56 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:56.797778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:56.801745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.818937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.820372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.821810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.823004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:56.823295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.823600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.824369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.825130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.836353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.839241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.839716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.840742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.841455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.841883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:56.907056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:56.911110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96b25d6c-22d1-4daf-a0ad-3b6840f251a1 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe/os-instance-actions/req-7ed00593-d932-4b16-8301-dd71860098d0" status: 200 len: 313 microversion: 2.1 time: 0.093547 Oct 17 13:23:56.912647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 988/1904] 10.222.0.65 () {58 vars in 1419 bytes} [Mon Oct 17 13:23:56 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe/os-instance-actions/req-7ed00593-d932-4b16-8301-dd71860098d0 => generated 313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:23:56.919881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72cb89be-13dc-4136-8a53-0477e4a4da54 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20834c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:56.973911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72cb89be-13dc-4136-8a53-0477e4a4da54 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.059293 Oct 17 13:23:56.981995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 989/1905] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:56 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:56.981995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:56.982521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:56.995710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:56.997324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:56.998543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.000250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.000916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.001566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.058075 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f386a437-f67c-4824-8668-bc1664deecce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.270071 Oct 17 13:23:57.059103 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 917/1906] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:56 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:57.127263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce54ab6c-0cb6-4597-8942-75dcfc5a623c tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "POST /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe/action" status: 202 len: 0 microversion: 2.1 time: 0.150945 Oct 17 13:23:57.129247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 990/1907] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:56 2022] POST /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:23:57.139709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:57.140689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:57.155293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.156222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.156894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.157984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.158608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.159201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.244039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:57.244814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:57.261500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.262305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.262918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.263626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.264075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.264497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.424409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.450785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb798abc-a037-4ccc-a4a1-83c12e834640 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1508 microversion: 2.1 time: 0.315774 Oct 17 13:23:57.468268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 918/1908] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:57 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:57.468649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.473392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:57.473942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:57.480717 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3be81d5-6406-4859-a592-b835d3b2a62b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.241773 Oct 17 13:23:57.482020 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 991/1909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:57 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:57.483830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.484594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.485385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.486615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.487443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.488113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.563737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:57.564887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:57.573045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.574128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.574937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.575997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:57.576704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:57.577383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:57.699634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.724670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.726215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.727418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1abe3271-4e7f-4d6c-8ab5-75ca614e4106 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.271272 Oct 17 13:23:57.733253 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 919/1910] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:57 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:57.868276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:57.882076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36dbe266-e84d-4f2d-aa56-d9539eb9600a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.323037 Oct 17 13:23:57.885673 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 992/1911] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:57 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:57.989970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83bd93a3-d21d-453f-988b-f08062196b68 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419df7cb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:58.049970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83bd93a3-d21d-453f-988b-f08062196b68 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.063989 Oct 17 13:23:58.058244 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 920/1912] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:57 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:58.069663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:58.073702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:58.082977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.083848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.084483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.085456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.086991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.088096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.476778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:58.477502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:58.491089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.491591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.495470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.496445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.498216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.498965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.692199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37f38296-a95d-4163-a13f-59e3bb13a88b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.625179 Oct 17 13:23:58.697798 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 993/1913] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:58 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:23:58.713596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:58.717879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:58.751219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.751873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.752555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:58.756595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:58.757200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:58.757647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.035410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.037636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.056487 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d147d75d-4d3e-419d-a1f2-b668a496bad7 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1508 microversion: 2.1 time: 0.584241 Oct 17 13:23:59.058589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.062503 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 921/1914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:58 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1508 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:23:59.074355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:59.083701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:59.092396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.093004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.093579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.097229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.097820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.098363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.241755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.258742 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-889faeb8-0267-4e93-a10f-8ee0dce822ec tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.558657 Oct 17 13:23:59.260233 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 994/1915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:58 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:59.278479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:59.279572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:59.291958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.295217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.298576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.299710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.301098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.302112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.470739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.484818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.487765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.489797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af8b484a-ea62-4ce8-a47f-92546b84b168 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.424851 Oct 17 13:23:59.490978 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 922/1916] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:23:59 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:23:59.519615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d3bcb24-88de-4932-bd2c-656c818ec8ec tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419decfc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:23:59.583453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d3bcb24-88de-4932-bd2c-656c818ec8ec tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.075616 Oct 17 13:23:59.584051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 923/1917] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:23:59 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:59.697581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:23:59.701846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:23:59.709629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:23:59.712463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:23:59.713477 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cccfc61f-2ff1-4451-ba76-7b2f42f7f8df tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.449189 Oct 17 13:23:59.716544 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 995/1918] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:23:59 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:23:59.745804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.746327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.746775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.747509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:23:59.747972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:23:59.748402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:23:59.830311 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-769bfa78-8eea-4f9c-bfd1-a59ab576c20e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.128863 Oct 17 13:23:59.835746 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 924/1919] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:23:59 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:24:00.122034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:00.123044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:00.143881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.144877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.152570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.154430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.155266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.156762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.288111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:00.289068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:00.305123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.308186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.308714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.309674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.310300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.310904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.868805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:00.880667 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63984d59-8ab7-4252-ad5c-f9d903b04816 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1508 microversion: 2.1 time: 0.794207 Oct 17 13:24:00.886173 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 996/1920] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:00 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1508 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:00.903160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:00.903811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:00.905905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:00.913411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.917673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.919932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:00.921012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.921984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:00.922632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:00.923071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:00.932865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0bac2fc3-a678-4956-9f7c-a053c36cb9e6 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.648065 Oct 17 13:24:00.935217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 925/1921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:00 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:00.953509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f07fe8ce-0b0e-4129-94af-4a9276a22fc7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc1d820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:01.026597 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f07fe8ce-0b0e-4129-94af-4a9276a22fc7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.090330 Oct 17 13:24:01.033910 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 926/1922] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:00 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:01.048308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:01.049141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:01.064500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.067055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.069793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.079855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.083963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.084926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.564209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:01.587932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:01.592148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:01.597976 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52ebe3b8-72c9-47b7-a708-ba661a5c95c3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.707703 Oct 17 13:24:01.601226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 997/1923] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:00 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:01.614546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:01.619164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:01.641230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.645284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.645992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.646975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.650981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.651946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.694269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:01.709121 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cee413e5-6413-44d0-bcfb-a154c401e86c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.673813 Oct 17 13:24:01.716312 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 927/1924] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:01 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:01.798428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ebbd2adb-a3e2-4b13-8d95-c97e74756b03 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.193627 Oct 17 13:24:01.799822 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 998/1925] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:01 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:24:01.921832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:01.928746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:01.946080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.951397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.957687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.958706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:01.960160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:01.960368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.960937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.962122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.971485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.972261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.972875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:01.973984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:01.975063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:01.975685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.590849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:02.607343 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6908f4b0-a845-4920-a9fb-ec507a096152 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1391 microversion: 2.1 time: 0.652461 Oct 17 13:24:02.623723 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 999/1926] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:01 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1391 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:02.640622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2c52a12-dffe-4228-b0fa-0cb1591732cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2083670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:02.670785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:02.687007 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5042b359-5e80-4e2e-86ba-0f0032e6d17d tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1506 microversion: 2.1 time: 0.779248 Oct 17 13:24:02.688940 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 928/1927] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:01 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1506 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:02.744174 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2c52a12-dffe-4228-b0fa-0cb1591732cd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.117751 Oct 17 13:24:02.749468 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1000/1928] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:02 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:02.774751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4cf764d5-6c52-4dd7-a22a-aa34b5d55e39 req-9460026d-22b8-42b0-a0f1-81db3cd7e2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b219db7-61f8-409b-a46e-d285774c9641", "name": "network-vif-plugged", "status": "completed", "tag": "83b7a61b-88d8-42a1-b06e-70702f9c2b32"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:02.824368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4cf764d5-6c52-4dd7-a22a-aa34b5d55e39 req-9460026d-22b8-42b0-a0f1-81db3cd7e2de service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.824938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4cf764d5-6c52-4dd7-a22a-aa34b5d55e39 req-9460026d-22b8-42b0-a0f1-81db3cd7e2de service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.825347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4cf764d5-6c52-4dd7-a22a-aa34b5d55e39 req-9460026d-22b8-42b0-a0f1-81db3cd7e2de service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.855838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4cf764d5-6c52-4dd7-a22a-aa34b5d55e39 req-9460026d-22b8-42b0-a0f1-81db3cd7e2de service nova] Creating event network-vif-plugged:83b7a61b-88d8-42a1-b06e-70702f9c2b32 for instance 8b219db7-61f8-409b-a46e-d285774c9641 on n-h2-854121-14 Oct 17 13:24:02.867048 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4cf764d5-6c52-4dd7-a22a-aa34b5d55e39 req-9460026d-22b8-42b0-a0f1-81db3cd7e2de service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114681 Oct 17 13:24:02.873190 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1001/1929] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:02.890359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:02.892357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:02.929215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.929730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.938126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:02.938998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:02.939490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:02.939937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.004785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Calling method '.version_select at 0x7f419df4eaf0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.246451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:24:03.247586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Neutron security group bafef496-fcfd-4692-b120-5d47d5841102 not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:24:03.248295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] HTTP exception thrown: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.248295 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Request method failure captured: Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-groups/bafef496-fcfd-4692-b120-5d47d5841102 HTTP/1.1 Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVdywilWBbNqaKkE76o2JYjH5CrgYgwQd6wXUSVmz08sSOHYHYyrFQhhE1J_D-Dkq9sdo58TmrmDtQOsQ3OFz_cAg0SX2OQXm3TmcJ33TUYLC1J6jfAi11oPB7xFeXA-hChbTGQ0Ztlip4ZxrLBN9Ldmnprgo56k8gR-0hEMLLCxztE Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:24:03.250766 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c86608e695d9426eb01fb7130cd83f4b Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] Oct 17 13:24:03.252676 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'bafef496-fcfd-4692-b120-5d47d5841102'} Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:03.253885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:24:03.255952 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.258474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] Oct 17 13:24:03.260597 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:03.268316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Returning 404 to user: Security group bafef496-fcfd-4692-b120-5d47d5841102 does not exist Oct 17 13:24:03.268316 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-68980d56-bcb0-43d7-abda-40e65b4d3dc0'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:03.270535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f86def89-65ac-42d5-bd36-64b062c30f4f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/bafef496-fcfd-4692-b120-5d47d5841102" status: 404 len: 194 microversion: 2.1 time: 0.579796 Oct 17 13:24:03.271314 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 929/1930] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:24:02 2022] DELETE /compute/v2.1/os-security-groups/bafef496-fcfd-4692-b120-5d47d5841102 => generated 194 bytes in 582 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:03.283591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '.version_select at 0x7f419dfa58b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.291685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.310452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.311256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.311964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.315092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.315813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.316431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.324192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:03.354144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:03.355699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:03.357045 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d389664a-d44f-4461-bd1f-333ce9de5690 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.480164 Oct 17 13:24:03.357702 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1002/1931] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:02 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:03.379581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.380051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.398838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f762c99-692f-4b71-99e6-28b7d3c2d7f0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.117777 Oct 17 13:24:03.401041 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 930/1932] 10.222.0.65 () {58 vars in 1296 bytes} [Mon Oct 17 13:24:03 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe/os-instance-actions => generated 611 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:03.411412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.411915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.418507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.418936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:03.419272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.419750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.420228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.422676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.436446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.448243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.449706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.451738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.453022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.453746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.548477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7765215b-2786-4d57-ab64-8af70b4719d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.144447 Oct 17 13:24:03.550321 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 931/1933] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:03 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:24:03.560602 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9fa6633-b554-47cf-8c63-a60297c2da65 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008521 Oct 17 13:24:03.561535 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 932/1934] 10.222.0.65 () {58 vars in 1164 bytes} [Mon Oct 17 13:24:03 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:24:03.569321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.570181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.578158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.580162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.580909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.582573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.583303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.584431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.627858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:03.700895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:03.716472 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3275e8a5-68b5-4d7e-b6e4-55def624d050 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.351043 Oct 17 13:24:03.717098 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1003/1935] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:03 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:03.722601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:03.741871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-023b3185-271c-46e2-9d7a-4ad70d042449 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Calling method '.version_select at 0x7f419e1bd160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.836524 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-661720c7-f2ff-4d63-83f4-91db127688ef tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "DELETE /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 204 len: 0 microversion: 2.1 time: 0.270998 Oct 17 13:24:03.838655 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 933/1936] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:03 2022] DELETE /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:03.855772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:03.858371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:03.866396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.866992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.867651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:03.868463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:03.868996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:03.869516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.275208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:04.283445 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3fdd467d-b325-46c4-af6a-140692d8efee tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1381 microversion: 2.1 time: 0.441211 Oct 17 13:24:04.284200 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 934/1937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:03 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1381 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:04.288824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f63ad85e-35d6-4b77-8fee-4a170b8ad0fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dae7040>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.310631 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-023b3185-271c-46e2-9d7a-4ad70d042449 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.585358 Oct 17 13:24:04.323882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1004/1938] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:24:03 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:04.331017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.332563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:04.344167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.344688 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f63ad85e-35d6-4b77-8fee-4a170b8ad0fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.059131 Oct 17 13:24:04.345775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.346452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.347227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.347713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.348140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.352357 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 935/1939] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:04 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:04.360005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a705273-d30c-487d-8418-8bf10fdba96c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '.version_select at 0x7f419ddbbd30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.364260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a705273-d30c-487d-8418-8bf10fdba96c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.364983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a705273-d30c-487d-8418-8bf10fdba96c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.365460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a705273-d30c-487d-8418-8bf10fdba96c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.389229 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a705273-d30c-487d-8418-8bf10fdba96c tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 3115 microversion: 2.1 time: 0.033441 Oct 17 13:24:04.391157 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 936/1940] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:24:04 2022] GET /compute/v2.1/os-migrations => generated 3115 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:04.403056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29bdffe1-34e9-4687-8619-58d8e4210dc1 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Calling method '.version_select at 0x7f419df7c160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.642923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:04.652654 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8000d9fb-761b-43ce-9f87-f7525cb3fea0 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1512 microversion: 2.1 time: 0.327284 Oct 17 13:24:04.653415 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1005/1941] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:04 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:04.675519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.676793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:04.683663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.684148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.684583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.685378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.685823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.686468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.701808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-29bdffe1-34e9-4687-8619-58d8e4210dc1 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:24:04.702431 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-29bdffe1-34e9-4687-8619-58d8e4210dc1 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 17 13:24:04.702431 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29bdffe1-34e9-4687-8619-58d8e4210dc1 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Request method failure captured: Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-groups/d9151131-92f6-4ecf-9686-de29dcb4ef67 HTTP/1.1 Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVdywilWBbNqaKkE76o2JYjH5CrgYgwQd6wXUSVmz08sSOHYHYyrFQhhE1J_D-Dkq9sdo58TmrmDtQOsQ3OFz_cAg0SX2OQXm3TmcJ33TUYLC1J6jfAi11oPB7xFeXA-hChbTGQ0Ztlip4ZxrLBN9Ldmnprgo56k8gR-0hEMLLCxztE Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:24:04.704494 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c86608e695d9426eb01fb7130cd83f4b Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: exception: Insufficient rights for removing default security group. Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] Oct 17 13:24:04.706143 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd9151131-92f6-4ecf-9686-de29dcb4ef67'} Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:04.707096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 17 13:24:04.708496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:04.712484 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:04.717688 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:04.717688 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:04.717688 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:04.717688 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 17 13:24:04.717688 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] Oct 17 13:24:04.717688 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:04.721228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29bdffe1-34e9-4687-8619-58d8e4210dc1 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 17 13:24:04.721228 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-5535cb8a-146f-432a-91ad-ae9cc22ace99'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:04.721228 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29bdffe1-34e9-4687-8619-58d8e4210dc1 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/d9151131-92f6-4ecf-9686-de29dcb4ef67" status: 400 len: 182 microversion: 2.1 time: 0.322231 Oct 17 13:24:04.721879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 937/1942] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:24:04 2022] DELETE /compute/v2.1/os-security-groups/d9151131-92f6-4ecf-9686-de29dcb4ef67 => generated 182 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:24:04.726525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:04.728052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:04.735170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.736051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.736557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.737393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:04.738107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:04.738537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:04.989136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:05.001647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:05.002717 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9db22853-a012-44cc-ad35-e32ffa1f6e89 tempest-LiveMigrationTest-570862789 tempest-LiveMigrationTest-570862789-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1534 microversion: 2.1 time: 0.278994 Oct 17 13:24:05.016732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 938/1943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:04 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1534 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:05.016732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:05.016732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.021489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.023400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.024862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.026002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.027322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.036502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:05.043579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31c8ab3e-ee3c-42db-9298-0247281cf9ad tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.375638 Oct 17 13:24:05.061851 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1006/1944] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:04 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:05.061851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Calling method '.version_select at 0x7f41a2083820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.062200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.079478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:24:05.080868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Neutron security group 62266a9c-d73b-440c-94ac-6946a367ffe7 not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:24:05.081436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] HTTP exception thrown: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.081436 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Request method failure captured: Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-security-groups/62266a9c-d73b-440c-94ac-6946a367ffe7 HTTP/1.1 Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVdywilWBbNqaKkE76o2JYjH5CrgYgwQd6wXUSVmz08sSOHYHYyrFQhhE1J_D-Dkq9sdo58TmrmDtQOsQ3OFz_cAg0SX2OQXm3TmcJ33TUYLC1J6jfAi11oPB7xFeXA-hChbTGQ0Ztlip4ZxrLBN9Ldmnprgo56k8gR-0hEMLLCxztE Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:24:05.084563 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c86608e695d9426eb01fb7130cd83f4b Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] Oct 17 13:24:05.087236 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '62266a9c-d73b-440c-94ac-6946a367ffe7'} Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.088377 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:24:05.096276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.099074 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Returning 404 to user: Security group 62266a9c-d73b-440c-94ac-6946a367ffe7 does not exist Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-105acbc5-1ddf-44fa-bc22-a23450242f35'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd925272-5849-4dd1-9d37-160366eba251 tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/62266a9c-d73b-440c-94ac-6946a367ffe7" status: 404 len: 194 microversion: 2.1 time: 0.039960 Oct 17 13:24:05.102995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1007/1945] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/os-security-groups/62266a9c-d73b-440c-94ac-6946a367ffe7 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:05.104131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.104131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.105674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.106467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.107059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.107844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.109115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.109115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.271067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:05.283384 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8e37c23-117b-4221-b686-302bec891912 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 0.194449 Oct 17 13:24:05.284477 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1008/1946] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:05.291242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.292094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.301586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.302380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.303295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.304326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.305493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.306080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.336950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:05.382874 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5bf60e2-21f1-4dce-9463-0e91f5076064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 14 microversion: 2.1 time: 0.377649 Oct 17 13:24:05.384214 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 939/1947] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:05 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 14 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:24:05.390382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Action: 'update', calling method: .version_select at 0x7f419dc0a1f0>, body: {"security_group": {"name": "tempest-sg-1163868474", "description": "tempest-description-964058268"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:05.437707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:24:05.438670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Neutron security group e44f55df-c13e-4005-a67d-0f8ca867d975 not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:24:05.439597 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] HTTP exception thrown: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.439597 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Request method failure captured: Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/os-security-groups/e44f55df-c13e-4005-a67d-0f8ca867d975 HTTP/1.1 Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 101 Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVdywilWBbNqaKkE76o2JYjH5CrgYgwQd6wXUSVmz08sSOHYHYyrFQhhE1J_D-Dkq9sdo58TmrmDtQOsQ3OFz_cAg0SX2OQXm3TmcJ33TUYLC1J6jfAi11oPB7xFeXA-hChbTGQ0Ztlip4ZxrLBN9Ldmnprgo56k8gR-0hEMLLCxztE Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:24:05.443654 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_276e1a55ee754b4fadc6d21659778cb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 276e1a55ee754b4fadc6d21659778cb2 Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466 Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c86608e695d9426eb01fb7130cd83f4b Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1311759466-project Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: {"security_group": {"name": "tempest-sg-1163868474", "description": "tempest-description-964058268"}} Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:24:05.446260 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e44f55df-c13e-4005-a67d-0f8ca867d975', 'body': {'security_group': {'name': 'tempest-sg-1163868474', 'description': 'tempest-description-964058268'}}} Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:24:05.447640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:24:05.449873 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] Oct 17 13:24:05.451687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] Oct 17 13:24:05.453613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:05.456046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] Returning 404 to user: Security group e44f55df-c13e-4005-a67d-0f8ca867d975 does not exist Oct 17 13:24:05.456046 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-7dc22b2c-62a3-4c9b-9027-f26e7ea2af2a'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:05.457361 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3dae8f1-f850-4d94-b6ed-19cc42408f5f tempest-SecurityGroupsNegativeTestJSON-1311759466 tempest-SecurityGroupsNegativeTestJSON-1311759466-project] 10.222.0.65 "PUT /compute/v2.1/os-security-groups/e44f55df-c13e-4005-a67d-0f8ca867d975" status: 404 len: 194 microversion: 2.1 time: 0.071901 Oct 17 13:24:05.458233 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 940/1948] 10.222.0.65 () {60 vars in 1290 bytes} [Mon Oct 17 13:24:05 2022] PUT /compute/v2.1/os-security-groups/e44f55df-c13e-4005-a67d-0f8ca867d975 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:05.475828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15ba85d5-e082-4453-8797-4435d24e5f09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc0ae50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.538935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da0be23d-2d76-4c95-af03-ab91f46bba4a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 204 len: 0 microversion: 2.1 time: 0.252479 Oct 17 13:24:05.544345 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1009/1949] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:05 2022] DELETE /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:05.555504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.556784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.574012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15ba85d5-e082-4453-8797-4435d24e5f09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.112714 Oct 17 13:24:05.575617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.576228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.576683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.577452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.577967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 941/1950] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:05.578682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.579337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.679274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:05.680106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:05.690769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.691185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.691634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:05.692353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:05.698825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:05.699820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.502097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:06.521436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fccb9a5-61a6-40dc-8ecb-338eb2e5bb62 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1387 microversion: 2.1 time: 0.974257 Oct 17 13:24:06.540111 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1010/1951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1387 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:06.546926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:06.547592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:06.566956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.567480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.580114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.583236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.583741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.584609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.696143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:06.715124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c77de0a3-c20e-4309-ba6e-0a5277529ea4 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1512 microversion: 2.1 time: 1.038503 Oct 17 13:24:06.731002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 942/1952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:05 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1512 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:06.748085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-469d56b2-05e5-45b7-836b-45fc68e8bc77 req-00fe1788-4819-4b4f-afd6-c7b8061a5281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930993f9-0499-4d7e-933b-f90262cf7f5d", "name": "network-vif-plugged", "status": "completed", "tag": "0c8e65dc-b6d3-42c4-a354-2bb3d8047c07"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:06.778894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-469d56b2-05e5-45b7-836b-45fc68e8bc77 req-00fe1788-4819-4b4f-afd6-c7b8061a5281 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.780055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-469d56b2-05e5-45b7-836b-45fc68e8bc77 req-00fe1788-4819-4b4f-afd6-c7b8061a5281 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.780843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-469d56b2-05e5-45b7-836b-45fc68e8bc77 req-00fe1788-4819-4b4f-afd6-c7b8061a5281 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.842180 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-469d56b2-05e5-45b7-836b-45fc68e8bc77 req-00fe1788-4819-4b4f-afd6-c7b8061a5281 service nova] Creating event network-vif-plugged:0c8e65dc-b6d3-42c4-a354-2bb3d8047c07 for instance 930993f9-0499-4d7e-933b-f90262cf7f5d on n-h1-854121-14 Oct 17 13:24:06.861901 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-469d56b2-05e5-45b7-836b-45fc68e8bc77 req-00fe1788-4819-4b4f-afd6-c7b8061a5281 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123406 Oct 17 13:24:06.862531 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 943/1953] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:06.888006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:06.888725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:06.904062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.917547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.918208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:06.918765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:06.919222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:06.919652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:07.644768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:07.665301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:07.676844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:07.682877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4706d292-6dbc-493d-bb5f-ff1cf139bd06 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.141349 Oct 17 13:24:07.686503 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1011/1954] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:06 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:07.708368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:07.717045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:07.747301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:07.752237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:07.753714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:07.756026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:07.757805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:07.758563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:07.870346 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f643bb5-ea52-4a49-8661-78c33cefa746 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action" status: 200 len: 8208 microversion: 2.1 time: 0.181594 Oct 17 13:24:07.875914 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1012/1955] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:07 2022] POST /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494/action => generated 8208 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:07.882470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55bdb3e3-4095-4e98-ba5d-312fd295ab28 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2083d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:07.994066 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55bdb3e3-4095-4e98-ba5d-312fd295ab28 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.116621 Oct 17 13:24:07.997741 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1013/1956] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:07 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:08.006976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.014670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.025278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.027439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.028478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.029454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.030179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.030833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.065625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:08.090347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78242b19-bdf4-4a8f-aae8-ae5afdece2f0 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1316 microversion: 2.1 time: 1.225187 Oct 17 13:24:08.094289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 944/1957] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:06 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1316 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:08.101892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.102945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.122168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.126084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.140536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.141487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.148034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.153036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.501927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca7261fc06da476b83f1211c22ac64bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b8dc27f74048b69c0d904446c6879c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:08.526232 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41f7e745-b382-4036-9b10-bb0e38fd9477 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 200 len: 1470 microversion: 2.1 time: 0.427792 Oct 17 13:24:08.530245 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 945/1958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:08 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 1470 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:08.560492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.562269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.572268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.573615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.575146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.576224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.577300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.578259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.846384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:08.860281 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d4e3d95-9418-4253-b57f-427af66d1612 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1387 microversion: 2.1 time: 0.857778 Oct 17 13:24:08.864947 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1014/1959] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:08 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1387 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:08.876061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c768be57-3963-4468-850b-8b340a08035a req-e98fe470-eb23-4442-bb22-057de4a6ed09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568785e3-bd23-4e83-aeac-098b0977dbbe", "name": "network-vif-deleted", "tag": "eb46c2fc-6f45-4b94-839d-de9f9c02ff31"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:08.897391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c768be57-3963-4468-850b-8b340a08035a req-e98fe470-eb23-4442-bb22-057de4a6ed09 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.903478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c768be57-3963-4468-850b-8b340a08035a req-e98fe470-eb23-4442-bb22-057de4a6ed09 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.904540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c768be57-3963-4468-850b-8b340a08035a req-e98fe470-eb23-4442-bb22-057de4a6ed09 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.934857 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c768be57-3963-4468-850b-8b340a08035a req-e98fe470-eb23-4442-bb22-057de4a6ed09 service nova] Creating event network-vif-deleted:eb46c2fc-6f45-4b94-839d-de9f9c02ff31 for instance 568785e3-bd23-4e83-aeac-098b0977dbbe on n-h2-854121-14 Oct 17 13:24:08.947721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c768be57-3963-4468-850b-8b340a08035a req-e98fe470-eb23-4442-bb22-057de4a6ed09 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080958 Oct 17 13:24:08.957544 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1015/1960] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:08.964280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:08.965081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:08.982280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.983020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.983667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:08.984576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:08.985521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:08.986379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:09.285043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:09.299799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e7800e6-0c31-453d-b0a3-2392ead563b8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.767570 Oct 17 13:24:09.326874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 946/1961] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:08 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:09.358553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a19620c-7193-495d-a602-be2d0a0ca09a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dc0ae50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:09.428360 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a19620c-7193-495d-a602-be2d0a0ca09a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.092514 Oct 17 13:24:09.428946 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 947/1962] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:09 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:09.434789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:09.435679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:09.442228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:09.442730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:09.443176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:09.443899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:09.444360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:09.444943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.094832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:10.113393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:10.119254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:10.126107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80b7dac4-52ab-425f-b9f1-367ab30ce4f8 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1506 microversion: 2.1 time: 0.673181 Oct 17 13:24:10.126786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 948/1963] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:09 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1506 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:10.151248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:10.159474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:10.160745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e936763-8c5f-4020-b698-537737aed814 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.201480 Oct 17 13:24:10.162109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.165914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:10.180688 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1016/1964] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:08 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:10.210562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.212406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.212889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.213857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.214584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] [instance: 568785e3-bd23-4e83-aeac-098b0977dbbe] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:10.224552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.225097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.228726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.280846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.281407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.287745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.288643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.296424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.300408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.374219 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] HTTP exception thrown: Instance 568785e3-bd23-4e83-aeac-098b0977dbbe could not be found. Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Request method failure captured: Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe HTTP/1.1 Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVdOHN-LWpktYprueCx21SvECqoB7sgWgNwfBbUSHc1WeM8on9mAp-I_EXL-ziIDBHljkZrRv-qvurzsCjUp1SC-hiFdceUyBT9XuOmeHUlRDtuE6Q72lg069VWpyfrfulX0S90RyoqxGVl5FeENlHIjVaxl21Svjx_3fZdYxTJGUB0 Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: e7b8dc27f74048b69c0d904446c6879c Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceActionsTestJSON-1190217585 Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:24:10.382044 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/e7b8dc27f74048b69c0d904446c6879c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7b8dc27f74048b69c0d904446c6879c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/e7b8dc27f74048b69c0d904446c6879c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_e7b8dc27f74048b69c0d904446c6879c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceActionsTestJSON-1190217585 Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: e7b8dc27f74048b69c0d904446c6879c Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1190217585 Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceActionsTestJSON-1190217585-project Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ca7261fc06da476b83f1211c22ac64bb Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceActionsTestJSON-1190217585-project Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 568785e3-bd23-4e83-aeac-098b0977dbbe could not be found. Oct 17 13:24:10.384656 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '568785e3-bd23-4e83-aeac-098b0977dbbe'} Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568785e3-bd23-4e83-aeac-098b0977dbbe could not be found. Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:10.385897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568785e3-bd23-4e83-aeac-098b0977dbbe could not be found. Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568785e3-bd23-4e83-aeac-098b0977dbbe could not be found. Oct 17 13:24:10.388158 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:10.390168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] Returning 404 to user: Instance 568785e3-bd23-4e83-aeac-098b0977dbbe could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:10.390168 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6402b666-1326-4638-9877-b96d64620471 tempest-InstanceActionsTestJSON-1190217585 tempest-InstanceActionsTestJSON-1190217585-project] 10.222.0.65 "GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe" status: 404 len: 111 microversion: 2.1 time: 0.199185 Oct 17 13:24:10.393094 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1017/1965] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:10 2022] GET /compute/v2.1/servers/568785e3-bd23-4e83-aeac-098b0977dbbe => generated 111 bytes in 212 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:10.408483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:10.413733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:10.442837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.443631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.448667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.449742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.453577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.455821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.833377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:10.848020 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1973860a-e46c-4d78-b99a-32f4a8facb9e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1184 microversion: 2.1 time: 0.452095 Oct 17 13:24:10.865667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1018/1966] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:10 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1184 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:10.885265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d42e9bfb-e936-4ff4-b309-f2c445cfc82d req-3a05acb5-0467-48bd-8807-ac019e5a9f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f291851-bc65-4d61-8ced-20cef46b6afb", "name": "network-vif-deleted", "tag": "dd0fae42-e55f-44c6-81c5-c29ecb3f80d8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:10.927192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d42e9bfb-e936-4ff4-b309-f2c445cfc82d req-3a05acb5-0467-48bd-8807-ac019e5a9f2f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:10.927951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d42e9bfb-e936-4ff4-b309-f2c445cfc82d req-3a05acb5-0467-48bd-8807-ac019e5a9f2f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:10.928599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d42e9bfb-e936-4ff4-b309-f2c445cfc82d req-3a05acb5-0467-48bd-8807-ac019e5a9f2f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:10.978105 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d42e9bfb-e936-4ff4-b309-f2c445cfc82d req-3a05acb5-0467-48bd-8807-ac019e5a9f2f service nova] Creating event network-vif-deleted:dd0fae42-e55f-44c6-81c5-c29ecb3f80d8 for instance 7f291851-bc65-4d61-8ced-20cef46b6afb on n-h2-854121-14 Oct 17 13:24:11.001754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d42e9bfb-e936-4ff4-b309-f2c445cfc82d req-3a05acb5-0467-48bd-8807-ac019e5a9f2f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134350 Oct 17 13:24:11.002959 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1019/1967] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:11.015325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e59eca98-b4a5-4ab5-bc53-0b6f8f39c166 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20ac3a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:11.130177 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e59eca98-b4a5-4ab5-bc53-0b6f8f39c166 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.125541 Oct 17 13:24:11.140470 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1020/1968] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:11 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:11.213019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:11.215302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:11.233573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:11.234278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:11.234908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:11.237296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:11.238344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:11.238843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:12.902856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:12.920564 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b773f92-ae8b-41c2-bf21-9629ee459137 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 2.789395 Oct 17 13:24:12.949809 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 949/1969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:10 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 2819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:12.966021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:12.969091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:12.997851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:12.998360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:12.998815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:12.999899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.000021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.008706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:13.020024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:13.036228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:13.043890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:13.046821 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ee939354-e54a-4124-890a-8c5f3e39f2dc tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.843211 Oct 17 13:24:13.050007 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1021/1970] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:11 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:24:13.060695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7be6006-931e-49a2-91c7-0c18830ff484 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20a5a60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:13.149512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7be6006-931e-49a2-91c7-0c18830ff484 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.097331 Oct 17 13:24:13.151451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1022/1971] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:13 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:13.163430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:13.166075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:13.181743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.190561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.191778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:13.192782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.193551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.194405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:13.507133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:13.519601 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f04bb1c-2113-4ac1-887f-5bb10b3cb481 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1184 microversion: 2.1 time: 0.568063 Oct 17 13:24:13.521149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 950/1972] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:12 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1184 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:13.786975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:13.798091 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9995ef81-f27d-458c-9202-c7ce24c3bf69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.645191 Oct 17 13:24:13.798969 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1023/1973] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:13 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:13.832317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:13.833383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:13.889543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.893575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.896494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:13.899677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:13.900725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:13.901351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:14.088351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:14.094075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:14.136176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:14.137070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:14.138480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:14.141031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:14.142730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:14.143519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:14.872287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:14.893802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0655975-908e-49a4-8c78-724da5e84583 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.067010 Oct 17 13:24:14.900417 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 951/1974] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:13 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:14.920491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ed82cc8-166c-4f84-bd97-7cbdf619636a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dae7ca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:14.957882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:14.972359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:14.974371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:14.977956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-270d1aee-deee-4f7c-a1e4-18408a2397d3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.901937 Oct 17 13:24:14.983256 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1024/1975] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:14 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:14.999985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:15.004656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:15.035243 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ed82cc8-166c-4f84-bd97-7cbdf619636a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.133186 Oct 17 13:24:15.037139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.043935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 952/1976] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:14 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:15.044837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.045860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.046710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.047325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.047999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.063914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:15.067141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:15.093723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.094767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.096792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.104557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.105393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.106056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.292022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Locking {{(pid=120697) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 17 13:24:15.438289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:15.447744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77758e7b-a5c9-4353-a0c6-817dfd622a6b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1184 microversion: 2.1 time: 0.463055 Oct 17 13:24:15.470569 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1025/1977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:14 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1184 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:15.496787 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a2d88cf-972f-433a-a464-69e838a516e6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.450928 Oct 17 13:24:15.500575 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 953/1978] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:15 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:15.508893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:15.509751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:15.521778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.522851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.526347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:15.527465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:15.528173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:15.530648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:16.015541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:16.016891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:16.046181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:16.051433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:16.052632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:16.056937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:16.058943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:16.059884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:16.868373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:16.912848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:16.925391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:16.933015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:16.940955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed2803c4-ea64-4f47-8c80-d788ff4bf406 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.927697 Oct 17 13:24:16.951854 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 954/1979] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:16 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:24:16.954408 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7db7cdff-3a70-4ee2-a383-fddf907d9b0f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.446475 Oct 17 13:24:16.954408 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1026/1980] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:15 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:16.976191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21dd0148-a93b-4e08-9fb2-c768a50c5c4f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e18dee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:16.985310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:16.996860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:17.018918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.019385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.019823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.020587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.021047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.061795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.181991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21dd0148-a93b-4e08-9fb2-c768a50c5c4f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.239053 Oct 17 13:24:17.189576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 955/1981] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:16 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:17.203804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:17.218703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.224990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.225730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.229993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:17.316995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] HTTP exception thrown: Instance c6846508-cc19-42bb-b770-e04bb565f35b is locked Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Request method failure captured: Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action HTTP/1.1 Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 15 Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXrXOq1J8GlTQWot-zAG3WlRWt-QdhKUznWYj0YFe614sXohh7tqN32E9k2SZUeu6BhKCRkVm1AefILJCKP8kJFxL8S-j92iLTPCugVISVd78CkJiNf2tsIFecAhZasPSBaWXgvE_xfzQlsyjsd3WurSHhdYF9YhkGfOjgcKJ6tUzY Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:24:17.319035 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-397715486 Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6ad84e1798394f69a409af3c96b6752c Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: {"os-stop": {}} Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c6846508-cc19-42bb-b770-e04bb565f35b is locked Oct 17 13:24:17.321392 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c6846508-cc19-42bb-b770-e04bb565f35b', 'body': {'os-stop': {}}} Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c6846508-cc19-42bb-b770-e04bb565f35b is locked Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 17 13:24:17.322695 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c6846508-cc19-42bb-b770-e04bb565f35b is locked Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6846508-cc19-42bb-b770-e04bb565f35b is locked Oct 17 13:24:17.324488 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:17.326166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Returning 409 to user: Instance c6846508-cc19-42bb-b770-e04bb565f35b is locked {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:17.327043 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce105283-c5d8-4de2-a9d6-ea58ad417d83 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 409 len: 107 microversion: 2.1 time: 0.136111 Oct 17 13:24:17.328017 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 956/1982] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:17 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 107 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:24:17.359111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:17.359712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:17.375543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.376110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.377506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.378850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.379347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.379784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.469502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Unlocking {{(pid=120697) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 13:24:17.553969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3548d9e-0997-4b6e-a599-465458b1d116 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.221129 Oct 17 13:24:17.555561 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 957/1983] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:17 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:17.572929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa5593e5-a3c5-458f-832c-df1d0e1c5136 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:17.583645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5593e5-a3c5-458f-832c-df1d0e1c5136 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.587290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5593e5-a3c5-458f-832c-df1d0e1c5136 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.588048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5593e5-a3c5-458f-832c-df1d0e1c5136 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.681019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:17.684671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa5593e5-a3c5-458f-832c-df1d0e1c5136 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:24:17.689799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b1a8dcc-81a8-4315-83ed-db98237fd2da tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1184 microversion: 2.1 time: 0.716138 Oct 17 13:24:17.712200 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1027/1984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:16 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1184 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:17.798445 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa5593e5-a3c5-458f-832c-df1d0e1c5136 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.232019 Oct 17 13:24:17.800764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 958/1985] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:17 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:17.815972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:17.816600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:17.828483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.829841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.832049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.833836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:17.836893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:17.837755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:17.973286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:17.974546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:17.999404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:18.001881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:18.004118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:18.005042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:18.007930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:18.010909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:19.028227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:19.051426 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8d8f015-dcba-4eb5-b606-279b9ef85bf0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 1.247117 Oct 17 13:24:19.061503 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1028/1986] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:17 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:19.075765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84cd2e95-4d1d-4cc0-8cb0-aff18e9dd1ff tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e055ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:19.187253 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84cd2e95-4d1d-4cc0-8cb0-aff18e9dd1ff tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.124215 Oct 17 13:24:19.188176 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1029/1987] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:19 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:19.202504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:19.203433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:19.221522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:19.225742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:19.226463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:19.228325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:19.228990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:19.232290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:19.420510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:19.435435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:19.442841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:19.444706 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-787acb0a-1973-4e03-ac2c-1b3b9c7ef6f7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.476574 Oct 17 13:24:19.446176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 959/1988] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:17 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:19.519470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:19.533086 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c69feb1-fa8f-41b6-b1ec-719cd876e330 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1184 microversion: 2.1 time: 0.341461 Oct 17 13:24:19.539541 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1030/1989] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:19 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1184 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:20.087997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:20.088840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:20.101537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.116898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.123434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:20.127261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.132030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.133370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:20.204597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b12d8293-bb3c-4a38-9ddc-396c7e4f8d0f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20fc700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:20.287153 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b12d8293-bb3c-4a38-9ddc-396c7e4f8d0f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.087036 Oct 17 13:24:20.287751 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1031/1990] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:20 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:20.481550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:20.482629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:20.522825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.525787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.530751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:20.532976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:20.534812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:20.540841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:21.092092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:21.112483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08be1aea-c452-4b66-abb2-06624cbd8396 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 1.029148 Oct 17 13:24:21.121956 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 960/1991] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:20 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:21.146017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:21.154124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:21.188047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:21.190796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:21.194699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:21.200331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:21.201201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:21.203959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:21.516588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:21.545370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:21.547454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:21.555059 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33e62ef1-58ec-4279-98c2-28277715c695 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.084045 Oct 17 13:24:21.564910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:21.574119 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6affa8cf-a40b-40a1-8071-65d0a8435fa8 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 200 len: 1184 microversion: 2.1 time: 0.450995 Oct 17 13:24:21.574483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1032/1992] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:20 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:21.599737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 961/1993] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:21 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 1184 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:21.622923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e96bc920-705e-4662-8952-57ac22c3543c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e8a6790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:21.747678 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e96bc920-705e-4662-8952-57ac22c3543c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.145793 Oct 17 13:24:21.748394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 962/1994] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:21 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:22.004096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-375306214", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "7484d2b6-e2e9-4013-8bf9-00cf3fb833dd"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:22.149387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:22.150014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:22.151433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] validate_networks() for [('7484d2b6-e2e9-4013-8bf9-00cf3fb833dd', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:22.168921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:22.169718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:22.170840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:22.171831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:22.172532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:22.173269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:22.897650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:22.912978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d1187fc-fd93-475f-8c59-3d5be09575b0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.768918 Oct 17 13:24:22.920832 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 963/1995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:22 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:22.940579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e87e25f4-4990-454a-bffd-395aa46b2c47"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:22.951227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:22.959997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:23.002928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:23.003498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:23.017726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:23.019861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:23.022396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:23.023065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:23.200002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] HTTP exception thrown: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Request method failure captured: Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d/os-volume_attachments/6b4ca852-27d2-466b-ba9b-d6c2ba666381 HTTP/1.1 Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 74 Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVb7KBoVEaXWyuP0PdcNgxTCvstKl1Cy2C9B6O3tHFEHTtaMTYI7LPMpf_26bZxBNMFIJ6lNuHaSNCI1ZVqZSqRnmm4Yg0js3KhRzJIIWpfNvzlqKigJWhOTBcZ_8jt4h-_BHZNgi0Lr5QrNMpiWfU2ArVLzgirrfSKeqCH2YQPT-HI Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 05e1669bb628465eb9f4f3d7b8a05a75 Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesAdminNegativeTest-537296173 Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:24:23.203272 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_05e1669bb628465eb9f4f3d7b8a05a75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesAdminNegativeTest-537296173 Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 05e1669bb628465eb9f4f3d7b8a05a75 Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-537296173 Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesAdminNegativeTest-537296173-project-admin Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a32c26ed953146199d825dd85b3e771a Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesAdminNegativeTest-537296173-project-admin Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: {"volumeAttachment": {"volumeId": "e87e25f4-4990-454a-bffd-395aa46b2c47"}} Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:24:23.206217 n-d-854121-14 devstack@n-api.service[120697]: exception: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': '930993f9-0499-4d7e-933b-f90262cf7f5d', 'id': '6b4ca852-27d2-466b-ba9b-d6c2ba666381', 'body': {'volumeAttachment': {'volumeId': 'e87e25f4-4990-454a-bffd-395aa46b2c47'}}} Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:24:23.208110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. (HTTP 404) (Request-ID: req-7e10b66d-e72b-4d1e-91d0-1d1e53dd88be) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:24:23.210049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:23.212429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. Oct 17 13:24:23.216181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:23.219053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] Returning 404 to user: Volume 6b4ca852-27d2-466b-ba9b-d6c2ba666381 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:23.219053 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03bf697e-4e4d-4804-9f36-0ed80ee6ffc9 tempest-VolumesAdminNegativeTest-537296173 tempest-VolumesAdminNegativeTest-537296173-project-admin] 10.222.0.65 "PUT /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d/os-volume_attachments/6b4ca852-27d2-466b-ba9b-d6c2ba666381" status: 404 len: 109 microversion: 2.1 time: 0.286672 Oct 17 13:24:23.219053 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 964/1996] 10.222.0.65 () {60 vars in 1433 bytes} [Mon Oct 17 13:24:22 2022] PUT /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d/os-volume_attachments/6b4ca852-27d2-466b-ba9b-d6c2ba666381 => generated 109 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:23.229828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:23.231049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:23.255810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:23.256449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:23.258387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:23.261322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:23.262024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:23.262645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:23.924798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:23.955270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:23.972796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:23.988923 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe7091c5-6cfb-4f5f-b2c9-cca1ad0cc12c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.757312 Oct 17 13:24:23.996308 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 965/1997] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:23 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:24.032588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:24.033248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 7f291851-bc65-4d61-8ced-20cef46b6afb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:24.059229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:24.059983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:24.060490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:24.068816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:24.069465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:24.069934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:24.128830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] HTTP exception thrown: Instance 7f291851-bc65-4d61-8ced-20cef46b6afb could not be found. Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Request method failure captured: Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb HTTP/1.1 Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW2xxO_iWa6F4OYoUcoBq3y2w7k7_s6uSU1woOffhOYg4afY7dTGHuten9hbgIYejxDUnqbJyzAvrBs7CNXpWUVezb_RHggdktSjdKDQsE7yH0YGMgLFtXMP1jGv_uTRnDeCHgAhzmqKpot_4WiKqo8HxTZqcYvkQMKjBYnJsW_h-8 Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:24:24.130751 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveMigrationTest-272515712 Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveMigrationTest-272515712-project Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 3d18129f56c24321aeff6fa609f78c87 Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveMigrationTest-272515712-project Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7f291851-bc65-4d61-8ced-20cef46b6afb could not be found. Oct 17 13:24:24.132416 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7f291851-bc65-4d61-8ced-20cef46b6afb'} Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f291851-bc65-4d61-8ced-20cef46b6afb could not be found. Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:24.133999 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f291851-bc65-4d61-8ced-20cef46b6afb could not be found. Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f291851-bc65-4d61-8ced-20cef46b6afb could not be found. Oct 17 13:24:24.135527 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:24:24.139257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Returning 404 to user: Instance 7f291851-bc65-4d61-8ced-20cef46b6afb could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:24.144314 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64030786-e2e0-404c-92f9-c1320772e482 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb" status: 404 len: 111 microversion: 2.1 time: 0.133927 Oct 17 13:24:24.152745 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 966/1998] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:23 2022] GET /compute/v2.1/servers/7f291851-bc65-4d61-8ced-20cef46b6afb => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:24.158158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c83b80b3-d797-46e8-8433-65c1d7a4ed5c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419db520d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:24.269731 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c83b80b3-d797-46e8-8433-65c1d7a4ed5c tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.115538 Oct 17 13:24:24.274180 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 967/1999] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:24 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:24.279914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:24.291722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:24.307767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:24.311248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:24.312487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:24.314775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:24.316660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:24.320024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:24.887534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:24.887999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:24.888492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:24.888891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:24.889334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:24.919028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:24.922483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:24.923022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:24.923842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:24.924312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:24.924738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:25.041141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Getting quotas for project fb68ea94527c4077866640f874dc764b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:25.084642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Getting quotas for user e3b5b6c60444486da0aed98d9b8dd3ec and project fb68ea94527c4077866640f874dc764b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:25.172107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:25.189019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:25.392900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:25.405017 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54de785b-c96a-4867-be1b-cd645b325e17 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 1.129357 Oct 17 13:24:25.409114 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 968/2000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:24 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:25.433367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:25.434303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:25.444921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:25.449056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:25.449827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:25.450772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:25.452260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:25.455627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:25.569927 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4bc2a66e-82ca-4135-9cd0-fd0dc11eaee5 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.987758 Oct 17 13:24:25.579146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1033/2001] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:25.606692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6f8ba9a-735d-4b9a-b6b4-cb5b43ddf41a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20fc9d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:25.785956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6f8ba9a-735d-4b9a-b6b4-cb5b43ddf41a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.202855 Oct 17 13:24:25.786607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1034/2002] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:25 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:25.813495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60adfffe-ac5b-47e9-9673-8f4305ba254b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:25.824876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60adfffe-ac5b-47e9-9673-8f4305ba254b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:26.052945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:26.091495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:26.093073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:26.117793 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad33ee75-fd9d-4e9a-b581-3780cfa57c6d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.688059 Oct 17 13:24:26.118459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 969/2003] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:25 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:26.260254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60adfffe-ac5b-47e9-9673-8f4305ba254b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:26.273794 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60adfffe-ac5b-47e9-9673-8f4305ba254b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1224 microversion: 2.1 time: 0.485170 Oct 17 13:24:26.276397 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1035/2004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:25 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1224 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:26.444090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:26.444901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:26.472558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:26.473214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:26.473642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:26.474399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:26.474862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:26.475321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:26.802944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2bb8ba85-ba3a-406f-b05a-ef365d367cce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2044d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:27.000538 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2bb8ba85-ba3a-406f-b05a-ef365d367cce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.201483 Oct 17 13:24:27.020417 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1036/2005] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:26 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:24:27.158684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:27.162115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:27.200700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:27.206986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:27.218266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:27.221534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:27.223972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:27.229961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:27.501647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:27.513077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df17a32c-e6cf-4d49-a1f9-505c20ca3b6a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 1.074384 Oct 17 13:24:27.514223 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 970/2006] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:26 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:27.520838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34ecaddb-1c4c-4bbf-af96-df57048000d0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:27.524921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34ecaddb-1c4c-4bbf-af96-df57048000d0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:27.741693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-34ecaddb-1c4c-4bbf-af96-df57048000d0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:27.751301 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34ecaddb-1c4c-4bbf-af96-df57048000d0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1224 microversion: 2.1 time: 0.234874 Oct 17 13:24:27.754760 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 971/2007] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:27 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1224 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:27.819506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:27.845516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:27.849603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:27.856780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f46eb834-a2e0-4f83-a814-85d37aac31b2 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.704045 Oct 17 13:24:27.859426 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1037/2008] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:27 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:24:28.038371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fc2b0be-56fd-40f4-80ed-6a12af809ece tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419df4e1f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:28.157063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fc2b0be-56fd-40f4-80ed-6a12af809ece tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.122455 Oct 17 13:24:28.161387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 972/2009] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:28 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:28.542910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:28.543835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:28.554198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.557496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.558084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:28.559525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.560382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.561301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:28.778925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:28.779708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:28.797569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.799060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.799605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:28.802415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.803453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.804053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:28.810508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:28.823310 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e633ebf4-fd5f-49b9-a171-579638976bdd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1658 microversion: 2.1 time: 0.285338 Oct 17 13:24:28.825487 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1038/2010] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:28 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1658 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:28.861954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9a15102-b7cd-433d-97d0-fc9dafc5237f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:28.884617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a15102-b7cd-433d-97d0-fc9dafc5237f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:28.886166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a15102-b7cd-433d-97d0-fc9dafc5237f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:28.888375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9a15102-b7cd-433d-97d0-fc9dafc5237f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:29.013516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:29.040600 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37ca451d-9461-480a-9139-1db03b7cdb7f tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1276 microversion: 2.1 time: 0.267075 Oct 17 13:24:29.047693 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 973/2011] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:28 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:29.074646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:29.076368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:29.107746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:29.107746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:29.110038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:29.111023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:29.114468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:29.115084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:29.162965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9a15102-b7cd-433d-97d0-fc9dafc5237f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:24:29.187132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:29.407982 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9a15102-b7cd-433d-97d0-fc9dafc5237f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.557200 Oct 17 13:24:29.419410 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1039/2012] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:28 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:29.450959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-71514245-62ad-4fe0-8a27-b11a92c3b4f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dfe9dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:29.550273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-71514245-62ad-4fe0-8a27-b11a92c3b4f3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.128502 Oct 17 13:24:29.551402 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1040/2013] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:29 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:29.569920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:29.578259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:29.603215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:29.615580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:29.615973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:29.616088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:29.616521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:29.620243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:29.624034 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d35948e3-da27-40db-ab89-c9c3c487e942 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.575155 Oct 17 13:24:29.625786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 974/2014] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:29 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:29.643522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:29.644048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:29.644495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.064221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:30.064903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:30.086521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.087037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.094486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.095263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.096246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.096686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.721325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:30.723860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:30.745847 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3a34fcd-35cc-4a27-bba7-5d6835b8de4b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1282 microversion: 2.1 time: 0.685861 Oct 17 13:24:30.746386 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4427be1e-3426-4b89-beed-92b9049a8f36 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1667 microversion: 2.1 time: 1.193472 Oct 17 13:24:30.747404 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1041/2015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:29 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1667 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:30.752467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:30.757541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:30.769619 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 975/2016] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:30 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1282 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:30.769796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.771507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.781930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.782816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3eac7685-7a39-4985-beba-c3bc17b39a23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddbb0d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:30.783163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.783775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.784323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.832848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:30.860557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:30.879654 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3eac7685-7a39-4985-beba-c3bc17b39a23 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.108775 Oct 17 13:24:30.880318 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 976/2017] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:30 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:30.916216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:30.953674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:30.986694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.987216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:30.989930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:30.996347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:30.997722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:31.001320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:31.045743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:31.118688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd01622e-bb8a-42a0-beb4-db9a257da7d7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "DELETE /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 204 len: 0 microversion: 2.1 time: 0.365951 Oct 17 13:24:31.124931 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1042/2018] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:30 2022] DELETE /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:31.140536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:31.153354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:31.160343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:31.161232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:31.161927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:31.162992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:31.170047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:31.170874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:33.495296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:33.503350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab689de1-6880-491f-9203-e413ef6c309a tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1512 microversion: 2.1 time: 2.375512 Oct 17 13:24:33.524355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1043/2019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:31 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1512 bytes in 2398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:33.533457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:33.538172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:33.551466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:33.552223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:33.552818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:33.553721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:33.557958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:33.558586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:34.134125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:34.156168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:34.161540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:34.164079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c668f824-185e-448d-bbd9-d4afc955754b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 3.279866 Oct 17 13:24:34.164879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 977/2020] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:30 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 3284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:34.174089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:34.176215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:34.205499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:34.206007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:34.206446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:34.207170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:34.207623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:34.208048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:34.976602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:35.357306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:35.367415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2bc589a5-6183-4c32-adb4-c84fdd543c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1667 microversion: 2.1 time: 1.841240 Oct 17 13:24:35.379049 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1044/2021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:33 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1667 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:35.400386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-698d6dd3-647f-4b1e-90c0-0ff77636af8b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e055ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:35.550811 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-698d6dd3-647f-4b1e-90c0-0ff77636af8b tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.162696 Oct 17 13:24:35.551653 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1045/2022] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:35 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:35.574565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:35.575417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:35.623371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:35.625098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:35.625750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:35.626740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:35.627337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:35.627889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:36.274068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:37.708803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:37.721594 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38a72a56-61a8-43cf-b65a-f75f0840eb45 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1512 microversion: 2.1 time: 2.158405 Oct 17 13:24:37.722175 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1046/2023] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:35 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1512 bytes in 2164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:37.748049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:37.748672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:37.749500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:37.771646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:37.772164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:37.774179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:37.776708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:37.793730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:37.794561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:37.891240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:37.916504 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-552a33bb-c0fe-42e1-9f7c-59fc5263ce63 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 3.749895 Oct 17 13:24:37.923025 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 978/2024] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:34 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 3757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:37.928199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:37.955780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:38.003653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:38.014814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:38.017697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:38.018716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:38.022013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:38.025937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:38.830132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:38.847906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:38.859668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:38.864328 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61772bbd-e57b-4f3c-9ef3-0ea9e55cc56d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.137869 Oct 17 13:24:38.882004 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1047/2025] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:37 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:38.906988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-051ee999-7d8b-489b-be6a-d0bebfe6ca0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2044310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:39.013469 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-051ee999-7d8b-489b-be6a-d0bebfe6ca0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.129019 Oct 17 13:24:39.014377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1048/2026] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:38 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:39.036658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3c3826b0-92cf-4d97-aafe-671afad9dcbf req-b2962db2-6dfc-42a3-a789-199e63513816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930993f9-0499-4d7e-933b-f90262cf7f5d", "name": "network-vif-unplugged", "status": "completed", "tag": "0c8e65dc-b6d3-42c4-a354-2bb3d8047c07"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:39.062332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c3826b0-92cf-4d97-aafe-671afad9dcbf req-b2962db2-6dfc-42a3-a789-199e63513816 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.066312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c3826b0-92cf-4d97-aafe-671afad9dcbf req-b2962db2-6dfc-42a3-a789-199e63513816 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.070123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c3826b0-92cf-4d97-aafe-671afad9dcbf req-b2962db2-6dfc-42a3-a789-199e63513816 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.114303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3c3826b0-92cf-4d97-aafe-671afad9dcbf req-b2962db2-6dfc-42a3-a789-199e63513816 service nova] Creating event network-vif-unplugged:0c8e65dc-b6d3-42c4-a354-2bb3d8047c07 for instance 930993f9-0499-4d7e-933b-f90262cf7f5d on n-h1-854121-14 Oct 17 13:24:39.131884 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3c3826b0-92cf-4d97-aafe-671afad9dcbf req-b2962db2-6dfc-42a3-a789-199e63513816 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113283 Oct 17 13:24:39.138614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1049/2027] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:39.151691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:39.157437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:39.181065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.188511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.189572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.190511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.191158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.196785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.580046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:39.608843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:39.609547 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a5c1cb3-ab73-4bd2-af04-901a595e777c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 200 len: 1470 microversion: 2.1 time: 0.465768 Oct 17 13:24:39.612652 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1050/2028] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:39 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 1470 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:39.628336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:39.636811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd0783b3-510e-4896-b077-07aed5cd44f6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.711342 Oct 17 13:24:39.637464 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 979/2029] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:37 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:39.640940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:39.670408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.674536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.675235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.679711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.684083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.686898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.712168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:39.712796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:39.739672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.740532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.745255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:39.746365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:39.747123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:39.749645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.284730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:41.288009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:41.297214 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b352090-d61b-49b4-a4cc-ad1f1e0d3330 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 1.679132 Oct 17 13:24:41.299252 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1051/2030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:39 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:41.302268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f0f9b53-9bde-4cff-9eb8-dbb8f170ab9a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.637465 Oct 17 13:24:41.307988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b673ef0e-1876-468e-8060-00cd66ebf70e req-bd21482d-b48c-4dab-8828-84692a2a89f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "930993f9-0499-4d7e-933b-f90262cf7f5d", "name": "network-vif-deleted", "tag": "0c8e65dc-b6d3-42c4-a354-2bb3d8047c07"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:41.325638 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 980/2031] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:39 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:41.331049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b673ef0e-1876-468e-8060-00cd66ebf70e req-bd21482d-b48c-4dab-8828-84692a2a89f2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.331528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b673ef0e-1876-468e-8060-00cd66ebf70e req-bd21482d-b48c-4dab-8828-84692a2a89f2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.332083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b673ef0e-1876-468e-8060-00cd66ebf70e req-bd21482d-b48c-4dab-8828-84692a2a89f2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.333856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:41.334774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:41.349477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.350465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.351626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.352555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.353187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.354350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.360765 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b673ef0e-1876-468e-8060-00cd66ebf70e req-bd21482d-b48c-4dab-8828-84692a2a89f2 service nova] Creating event network-vif-deleted:0c8e65dc-b6d3-42c4-a354-2bb3d8047c07 for instance 930993f9-0499-4d7e-933b-f90262cf7f5d on n-h1-854121-14 Oct 17 13:24:41.379166 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b673ef0e-1876-468e-8060-00cd66ebf70e req-bd21482d-b48c-4dab-8828-84692a2a89f2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078336 Oct 17 13:24:41.379709 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1052/2032] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:41.400191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f47b6b0-aec3-4fd4-9390-3361468910ae tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20acc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:41.499526 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f47b6b0-aec3-4fd4-9390-3361468910ae tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.118424 Oct 17 13:24:41.501513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1053/2033] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:41 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:41.508652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:41.509692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: 930993f9-0499-4d7e-933b-f90262cf7f5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:41.517833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.519093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.520055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.521292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.522020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.522840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.557999 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] HTTP exception thrown: Instance 930993f9-0499-4d7e-933b-f90262cf7f5d could not be found. Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Request method failure captured: Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d HTTP/1.1 Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVbv1mf7pciz9-SM0DaRKEUopGH3YO8KRUAX35KGE2QGBSNUHruQfaJl-h5R7RScIagJdiPgfsltOnF-R6FyHxwFDtp993byrCHYJXTzgDpBsew213TX_jGEo4v4aZQnarpQqhD6thrX8wFfw4WiCVrRrOqcurYcujnxpcmkJSXasVs Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: cd0c1190c61647ceb4914330b65b7c24 Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesAdminNegativeTest-586391586 Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:24:41.560143 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesAdminNegativeTest-586391586 Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: cd0c1190c61647ceb4914330b65b7c24 Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-586391586 Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesAdminNegativeTest-586391586-project Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9976642939654889bb1dc78814a9011c Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesAdminNegativeTest-586391586-project Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 930993f9-0499-4d7e-933b-f90262cf7f5d could not be found. Oct 17 13:24:41.561485 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '930993f9-0499-4d7e-933b-f90262cf7f5d'} Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 930993f9-0499-4d7e-933b-f90262cf7f5d could not be found. Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:41.562170 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 930993f9-0499-4d7e-933b-f90262cf7f5d could not be found. Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 930993f9-0499-4d7e-933b-f90262cf7f5d could not be found. Oct 17 13:24:41.563308 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:41.564977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Returning 404 to user: Instance 930993f9-0499-4d7e-933b-f90262cf7f5d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:41.566094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2dd98984-7842-4a01-b862-96c3c907ea76 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d" status: 404 len: 111 microversion: 2.1 time: 0.062877 Oct 17 13:24:41.566821 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1054/2034] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:41 2022] GET /compute/v2.1/servers/930993f9-0499-4d7e-933b-f90262cf7f5d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:41.591530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:41.595615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:41.610175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.615553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.616233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.617743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.619762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.624763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.798137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Unlocking {{(pid=120698) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 17 13:24:41.909274 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8ad20e7-c31f-4fb7-aad4-3b29ccd42930 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.340864 Oct 17 13:24:41.910285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1055/2035] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:41 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:41.935221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:41.935742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:41.980323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.983750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.984324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:41.985034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:41.985525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:41.985955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:42.063862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:42.290327 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80bc1ab7-b780-46e7-9069-50d3ae45d63c tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "DELETE /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 204 len: 0 microversion: 2.1 time: 0.369098 Oct 17 13:24:42.291331 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1056/2036] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:41 2022] DELETE /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:42.300174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:42.326223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:42.350309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:42.352500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:42.353242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:42.354458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:42.355192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:42.355942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:42.994190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.004394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.013692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.015104 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46e8cd9b-1564-4190-baab-bdc96fc0366e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.687415 Oct 17 13:24:43.035748 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 981/2037] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:41 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:43.048810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:43.049449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:43.084783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:43.086355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:43.090926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:43.092190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:43.092876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:43.093544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:43.234251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.254182 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3faa8fc-64b8-4a2b-87b6-3a38df012f7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.961465 Oct 17 13:24:43.254995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1057/2038] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:42 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:43.260668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:43.268516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:43.279129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:43.282201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:43.282876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:43.283791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:43.284413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:43.285711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:43.331692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:43.687503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.700153 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4fc3f1e-5fa7-4ea7-a64b-be2fb63a920e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1668 microversion: 2.1 time: 0.663183 Oct 17 13:24:43.717073 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 982/2039] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:43 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1668 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:43.730902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d974437-76b2-4000-9c56-c3d67dd00089 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2179670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:43.816176 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d974437-76b2-4000-9c56-c3d67dd00089 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1412 microversion: 2.1 time: 0.090355 Oct 17 13:24:43.816905 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 983/2040] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:43 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:43.875733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:43.888226 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46e8fea5-b47e-4054-8a5e-a684d3fe0df1 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 0.629373 Oct 17 13:24:43.890199 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1058/2041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:43 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:43.902360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:43.903267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:43.919457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:43.920201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:43.920791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:43.921719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:43.922387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:43.922967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:44.189849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-624769744", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "7698af7b-3b74-48b5-bedf-fe36ba7824ac"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:44.299445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] validate_networks() for [('7698af7b-3b74-48b5-bedf-fe36ba7824ac', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:44.432432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:44.441223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fe4dfb2-4c88-4f2b-b5f1-4cba3969af56 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.542802 Oct 17 13:24:44.450012 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1059/2042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:43 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:44.450012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-60f424be-37bd-4bde-a1b3-b7814a217c0c req-1f5fa96d-360f-4d85-bc16-d8e2d7aa796d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8", "tag": "67dbafd1-929a-4c8e-8683-10897b5a339d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:44.458696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-60f424be-37bd-4bde-a1b3-b7814a217c0c req-1f5fa96d-360f-4d85-bc16-d8e2d7aa796d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.459348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-60f424be-37bd-4bde-a1b3-b7814a217c0c req-1f5fa96d-360f-4d85-bc16-d8e2d7aa796d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.459919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-60f424be-37bd-4bde-a1b3-b7814a217c0c req-1f5fa96d-360f-4d85-bc16-d8e2d7aa796d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:44.474779 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-60f424be-37bd-4bde-a1b3-b7814a217c0c req-1f5fa96d-360f-4d85-bc16-d8e2d7aa796d service nova] Creating event network-changed:67dbafd1-929a-4c8e-8683-10897b5a339d for instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 on n-h2-854121-14 Oct 17 13:24:44.480545 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-60f424be-37bd-4bde-a1b3-b7814a217c0c req-1f5fa96d-360f-4d85-bc16-d8e2d7aa796d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036994 Oct 17 13:24:44.482129 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1060/2043] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:44.488092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:44.489122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:44.496674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.497492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.498082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:44.498956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.499557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.500155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:44.958088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:44.972370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:44.974617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:44.976698 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2712e549-4c30-494c-9ca2-4413429cf5c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.492670 Oct 17 13:24:44.977492 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1061/2044] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:44 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:44.984697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:44.985752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:44.993292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.994202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.994784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:44.995845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:44.996444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:44.997011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:45.726417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:45.739709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c313e9cb-7177-4b12-b9f7-f033c2cab2c0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.761010 Oct 17 13:24:45.746164 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1062/2045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:44 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:45.758425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:45.759210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:45.766231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:45.767038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:45.767546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:45.768342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:45.768851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:45.769582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:45.826738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:45.827660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:45.828376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:45.829044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:45.829783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:45.854029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:45.854639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:45.855092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:45.855895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:45.856559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:45.857147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:45.889301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Getting quotas for project fa0267911da14adc981d0332a8101ed8. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:45.896084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Getting quotas for user a01a874bcbf0436aacd1e4864be54906 and project fa0267911da14adc981d0332a8101ed8. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:45.921414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:45.924223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:46.009547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3ee567e-dc38-4901-a092-1be5e307aabc tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.191063 Oct 17 13:24:46.010317 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 984/2046] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:46.023769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-489c5682-3465-41e5-842e-1bfee77b977e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2160430>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:46.135489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-489c5682-3465-41e5-842e-1bfee77b977e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1421 microversion: 2.1 time: 0.121041 Oct 17 13:24:46.145264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 985/2047] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:46 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1421 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:46.145264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:46.145264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:46.161901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.165189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.165722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:46.166691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.167269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.171228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:46.543944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:46.558908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a6e6173-b017-4033-aef2-89902400bb94 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1668 microversion: 2.1 time: 0.810013 Oct 17 13:24:46.561218 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1063/2048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:45 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1668 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:46.578221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:46.581916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:46.601990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.603731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.605636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:46.608699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.610693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.611453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:46.809885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:46.821137 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05c8ba9c-b09e-495e-badd-fe0b09f2b4c7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.253734 Oct 17 13:24:46.822813 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1064/2049] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:46 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:46.832504 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bc8ba16-ec20-42d6-9d5d-b38b786fc311 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 0.694800 Oct 17 13:24:46.838105 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 986/2050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:46 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:46.854732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:46.856655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:46.862161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d57f935f-41f2-4c8e-89ee-e1d7caf27d19 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:46.870343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d57f935f-41f2-4c8e-89ee-e1d7caf27d19 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:46.875410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.876979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.878085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:46.879063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:46.879738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:46.880383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.115210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d57f935f-41f2-4c8e-89ee-e1d7caf27d19 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:47.123320 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d57f935f-41f2-4c8e-89ee-e1d7caf27d19 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1224 microversion: 2.1 time: 0.283653 Oct 17 13:24:47.128915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 987/2051] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:46 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1224 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:47.134312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-953514f4-57b0-46a3-94c2-69bcb58c51eb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419ddd2af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:47.209614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-953514f4-57b0-46a3-94c2-69bcb58c51eb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 200 len: 1421 microversion: 2.1 time: 0.079049 Oct 17 13:24:47.240442 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 988/2052] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:24:47 2022] GET /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 1421 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:47.247316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:47.253207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:47.270798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:47.275120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:47.275759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.276659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:47.277372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:47.277971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.334927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:47.624308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-850c4771-ac3a-4a6f-b092-f9da1d2f3a6c tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 204 len: 0 microversion: 2.1 time: 0.379627 Oct 17 13:24:47.626268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 989/2053] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:47 2022] DELETE /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:47.653233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:47.664422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:47.687556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:47.688064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:47.694013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.695401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:47.696047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:47.697723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.789846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:47.805587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:47.807522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:47.811437 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-102a51d5-3493-49f9-8999-32bc3a0729c4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.987340 Oct 17 13:24:47.815763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1065/2054] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:46 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:47.832900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:47.834637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:47.848741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:47.849269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:47.856661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.857578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:47.858233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:47.862237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:47.999167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:48.018165 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c6c2b44-a338-4d34-a586-f014a5139c09 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 200 len: 1600 microversion: 2.1 time: 0.198756 Oct 17 13:24:48.019347 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1066/2055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:47 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 1600 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:48.032398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1759473605", "imageRef": "9d8cc6c6-69c0-42b0-9280-9ba9efbab907", "flavorRef": "452", "networks": [{"uuid": "de69c07b-99ae-49cb-9b55-cd78d1700008"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:48.102388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:48.112603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4331635b-1402-4d0f-abb4-7fe597c96276 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1676 microversion: 2.1 time: 0.479678 Oct 17 13:24:48.129912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 990/2056] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:47 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1676 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:48.146033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:48.146835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:48.159324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] validate_networks() for [('de69c07b-99ae-49cb-9b55-cd78d1700008', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:48.162642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.163754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.164407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:48.165344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.165950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.167912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:48.481717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:48.494998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcbd7085-33b8-4d83-bf4b-f4251cdc66c7 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1679 microversion: 2.1 time: 0.358691 Oct 17 13:24:48.509685 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 991/2057] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:48 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:48.564539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-24fe8104-2926-49cc-877b-410cf5429139 req-7758a1e7-a998-42db-9e84-7809114016b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45ff27cf-dee5-48e5-938c-f98c803813be", "name": "network-vif-deleted", "tag": "96bcfefd-87dc-40b2-a430-c8b8458e604e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:48.629462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24fe8104-2926-49cc-877b-410cf5429139 req-7758a1e7-a998-42db-9e84-7809114016b4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.634064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24fe8104-2926-49cc-877b-410cf5429139 req-7758a1e7-a998-42db-9e84-7809114016b4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.641045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24fe8104-2926-49cc-877b-410cf5429139 req-7758a1e7-a998-42db-9e84-7809114016b4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:48.701939 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-24fe8104-2926-49cc-877b-410cf5429139 req-7758a1e7-a998-42db-9e84-7809114016b4 service nova] Creating event network-vif-deleted:96bcfefd-87dc-40b2-a430-c8b8458e604e for instance 45ff27cf-dee5-48e5-938c-f98c803813be on n-h2-854121-14 Oct 17 13:24:48.738700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-24fe8104-2926-49cc-877b-410cf5429139 req-7758a1e7-a998-42db-9e84-7809114016b4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196403 Oct 17 13:24:48.741460 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 992/2058] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:48.774140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:48.787728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:48.818289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.818801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.819253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:48.820613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:48.821076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:48.825922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:49.790077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:49.809002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b34ff68-c7dc-4ea6-81b1-ebf23c8b442a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 1.063228 Oct 17 13:24:49.809649 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 993/2059] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:48 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:49.831572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:49.832415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:49.860580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:49.868109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:49.868616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:49.869408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:49.869877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:49.885068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.072295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:50.088794 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a30dc7b9-17a9-4917-b44e-ab43f1a5d193 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1276 microversion: 2.1 time: 0.270711 Oct 17 13:24:50.097517 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 994/2060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:49 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1276 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:50.103104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:50.110274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:50.122748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:50.123252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:50.123651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:50.124069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:50.124486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:50.133309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.139289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.139939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.144419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.149054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.151151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.151702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.152199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.153078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.156945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.157626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.158080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.223852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:50.246897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for user c2effa2bc1674d20a064b40849b85df1 and project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:50.286525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:50.294662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9d8cc6c6-69c0-42b0-9280-9ba9efbab907',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:50.453945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25b055fa-b09f-4972-857f-c1c4d5320a09 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.428580 Oct 17 13:24:50.459832 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1067/2061] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:50.485722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:50.486375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: 45ff27cf-dee5-48e5-938c-f98c803813be] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:50.503246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.503984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.506891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.511085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.512585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.513222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.548707 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] HTTP exception thrown: Instance 45ff27cf-dee5-48e5-938c-f98c803813be could not be found. Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Request method failure captured: Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be HTTP/1.1 Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVW2xxO_iWa6F4OYoUcoBq3y2w7k7_s6uSU1woOffhOYg4afY7dTGHuten9hbgIYejxDUnqbJyzAvrBs7CNXpWUVezb_RHggdktSjdKDQsE7yH0YGMgLFtXMP1jGv_uTRnDeCHgAhzmqKpot_4WiKqo8HxTZqcYvkQMKjBYnJsW_h-8 Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:24:50.553432 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-LiveMigrationTest-272515712 Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-LiveMigrationTest-272515712-project Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 3d18129f56c24321aeff6fa609f78c87 Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-LiveMigrationTest-272515712-project Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 45ff27cf-dee5-48e5-938c-f98c803813be could not be found. Oct 17 13:24:50.555377 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '45ff27cf-dee5-48e5-938c-f98c803813be'} Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45ff27cf-dee5-48e5-938c-f98c803813be could not be found. Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:24:50.556069 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45ff27cf-dee5-48e5-938c-f98c803813be could not be found. Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45ff27cf-dee5-48e5-938c-f98c803813be could not be found. Oct 17 13:24:50.557043 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:24:50.561852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Returning 404 to user: Instance 45ff27cf-dee5-48e5-938c-f98c803813be could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:24:50.563137 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98be865d-d1fc-4872-9801-fa5a47adbc8b tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be" status: 404 len: 111 microversion: 2.1 time: 0.100213 Oct 17 13:24:50.564018 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1068/2062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:50 2022] GET /compute/v2.1/servers/45ff27cf-dee5-48e5-938c-f98c803813be => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:24:50.578252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:50.580109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:50.595043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.595913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.596559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.598576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.599790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.601985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.882706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:50.887164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:50.900588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:50.904383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:50.907605 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0024b8ee-0dd9-4ad4-9423-691652df9331 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 0.808723 Oct 17 13:24:50.921188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 995/2063] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:50 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:50.926914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:50.933607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:50.952088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.952626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.953082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:50.953846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:50.956219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:50.956678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:51.770087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:51.786915 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7159ec9c-c06a-41e9-b079-e30c0c54ee47 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1656 microversion: 2.1 time: 1.219380 Oct 17 13:24:51.790060 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1069/2064] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:50 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1656 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:51.940735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1643806707", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "61e1e648-9939-4d0c-93cd-d82020ffaced"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:52.024897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] validate_networks() for [('61e1e648-9939-4d0c-93cd-d82020ffaced', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:24:52.203679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:52.221860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e97c0848-5ede-4488-a97c-b9f4349fcb33 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1679 microversion: 2.1 time: 1.307599 Oct 17 13:24:52.224845 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 996/2065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:50 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1679 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:52.240280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:52.249044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:52.273498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.277803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.279976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.280892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.282721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.284147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.444311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:52.494353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-363659a6-923d-4a43-bfcd-3213c2c68bda tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1260 microversion: 2.1 time: 0.262102 Oct 17 13:24:52.497542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 997/2066] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:52 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1260 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:52.517756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8d6b06a-547f-4976-8832-3fd8dc98ecbd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '.version_select at 0x7f41a216be50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:52.557871 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8d6b06a-547f-4976-8832-3fd8dc98ecbd tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495570568" status: 202 len: 0 microversion: 2.1 time: 0.057507 Oct 17 13:24:52.566108 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 998/2067] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:24:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495570568 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:52.571993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:52.572776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:52.583238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.588175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.595300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:52.596334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:52.601892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:52.602856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.085525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:53.100727 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b9c5f49-44c0-48b8-b248-edfbd781ed46 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 0.534738 Oct 17 13:24:53.120390 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 999/2068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:52 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:53.131324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:53.138759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:53.154054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:53.160821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.161726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.164101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.166442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.168485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.169466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.373655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:24:53.376311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:24:53.377023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:24:53.378005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:24:53.378599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:24:53.399244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.402585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.403299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.406251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.408050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.408643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.490874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Getting quotas for project d36ee521e7394316bb2925e96614916f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:24:53.499586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Getting quotas for user cd070a584a94493cb350e95b5911658c and project d36ee521e7394316bb2925e96614916f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:24:53.533755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Going to run 2 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:24:53.548428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: fb070b38-9787-40e2-a423-5bfaf571a978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:53.609448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=fb070b38-9787-40e2-a423-5bfaf571a978,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:24:53.763089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e09ee70-0dfd-4665-8966-efea98a52fe2 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.969922 Oct 17 13:24:53.764474 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1070/2069] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:24:53.771049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-13bdc9c5-eb39-4537-9919-1ebe323e6e61 req-ddb1a9a4-21cc-4b4c-a8fe-a7e50a04eae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b219db7-61f8-409b-a46e-d285774c9641", "name": "network-vif-unplugged", "status": "completed", "tag": "83b7a61b-88d8-42a1-b06e-70702f9c2b32"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:53.785548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13bdc9c5-eb39-4537-9919-1ebe323e6e61 req-ddb1a9a4-21cc-4b4c-a8fe-a7e50a04eae8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.786382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13bdc9c5-eb39-4537-9919-1ebe323e6e61 req-ddb1a9a4-21cc-4b4c-a8fe-a7e50a04eae8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.787327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13bdc9c5-eb39-4537-9919-1ebe323e6e61 req-ddb1a9a4-21cc-4b4c-a8fe-a7e50a04eae8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.836753 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-13bdc9c5-eb39-4537-9919-1ebe323e6e61 req-ddb1a9a4-21cc-4b4c-a8fe-a7e50a04eae8 service nova] Creating event network-vif-unplugged:83b7a61b-88d8-42a1-b06e-70702f9c2b32 for instance 8b219db7-61f8-409b-a46e-d285774c9641 on n-h2-854121-14 Oct 17 13:24:53.849387 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-13bdc9c5-eb39-4537-9919-1ebe323e6e61 req-ddb1a9a4-21cc-4b4c-a8fe-a7e50a04eae8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083202 Oct 17 13:24:53.853694 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1071/2070] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:53.864859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:53.870074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:53.884949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.886492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.887835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:53.889624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:53.890987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:53.892067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.143058 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2e6dc18-14c5-49f6-8f11-ba35a8ff3045 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.287604 Oct 17 13:24:54.152281 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1072/2071] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:24:53 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:24:54.173320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8846dd9b-0fde-40c2-b294-a8492bd35842 req-c1c02905-cf50-4299-b266-b743cc5fd5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0cc3d3-998a-4a24-b194-29cf74071bde", "name": "network-vif-unplugged", "status": "completed", "tag": "589b4d61-a74e-4e01-8622-977978d83851"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:54.210746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8846dd9b-0fde-40c2-b294-a8492bd35842 req-c1c02905-cf50-4299-b266-b743cc5fd5bd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.211883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8846dd9b-0fde-40c2-b294-a8492bd35842 req-c1c02905-cf50-4299-b266-b743cc5fd5bd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.213295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8846dd9b-0fde-40c2-b294-a8492bd35842 req-c1c02905-cf50-4299-b266-b743cc5fd5bd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.248937 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8846dd9b-0fde-40c2-b294-a8492bd35842 req-c1c02905-cf50-4299-b266-b743cc5fd5bd service nova] Creating event network-vif-unplugged:589b4d61-a74e-4e01-8622-977978d83851 for instance ab0cc3d3-998a-4a24-b194-29cf74071bde on n-h1-854121-14 Oct 17 13:24:54.270263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8846dd9b-0fde-40c2-b294-a8492bd35842 req-c1c02905-cf50-4299-b266-b743cc5fd5bd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113101 Oct 17 13:24:54.271583 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1073/2072] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:54.294663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:54.296130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:54.311611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:54.318007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.318780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.320776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.323609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.324108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.324551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.393957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:54.407529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-318016da-1c76-4701-8c26-7f3414d1384f tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1324 microversion: 2.1 time: 1.278813 Oct 17 13:24:54.411846 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1000/2073] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:53 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1324 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:54.429776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:54.430859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:54.442616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.445433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.447647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.450087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.451323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.452561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.779388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:54.796497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e801f3cf-c9c7-49d7-bd1d-bf6f1511a8f1 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1613 microversion: 2.1 time: 0.382946 Oct 17 13:24:54.806060 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1001/2074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:54 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1613 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:54.811970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:54.818097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:54.841497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.845367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.846114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:54.849305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:54.855222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:54.857495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.357061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:55.371877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:55.384500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:55.391488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:55.396613 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33f8218c-3f31-43a5-9638-4297ece11d1c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.121015 Oct 17 13:24:55.423081 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3de3f979-5d1a-47cd-aba9-40a6cc48ecce tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.610572 Oct 17 13:24:55.423081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1002/2075] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:54 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:55.423707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1074/2076] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:54 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:55.434204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:55.441926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:55.442586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:55.460838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:55.461910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Searching by: {'deleted': False, 'project_id': 'd36ee521e7394316bb2925e96614916f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:24:55.466154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.469096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.469601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.473452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.473953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.474393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.522703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.522703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.522703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.523323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.523323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.523781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.689561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:24:55.761286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1cc1d56b-ae4b-4f7b-bcda-4738ca364398 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.340644 Oct 17 13:24:55.762452 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1003/2077] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1/servers => generated 677 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:55.779228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:55.780797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:55.797449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.798260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.798851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:55.810622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:55.815657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:55.816343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.184254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:56.202026 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b678bc44-050f-4990-9faf-256d51cbbbec tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 0.779156 Oct 17 13:24:56.221027 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1075/2078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:56.230608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f025cb71-6801-41e5-8265-99497f30d958 req-cee76618-9be0-46db-a01e-370fbfc5d4dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e57858-d31a-4a7c-ae37-4f1fdec71aa9", "tag": "dfa4680a-1a7d-484e-9d8d-06bba0c971d9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:56.253448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f025cb71-6801-41e5-8265-99497f30d958 req-cee76618-9be0-46db-a01e-370fbfc5d4dd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.254228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f025cb71-6801-41e5-8265-99497f30d958 req-cee76618-9be0-46db-a01e-370fbfc5d4dd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.254832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f025cb71-6801-41e5-8265-99497f30d958 req-cee76618-9be0-46db-a01e-370fbfc5d4dd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.275215 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f025cb71-6801-41e5-8265-99497f30d958 req-cee76618-9be0-46db-a01e-370fbfc5d4dd service nova] Creating event network-changed:dfa4680a-1a7d-484e-9d8d-06bba0c971d9 for instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 on n-h1-854121-14 Oct 17 13:24:56.283036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f025cb71-6801-41e5-8265-99497f30d958 req-cee76618-9be0-46db-a01e-370fbfc5d4dd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060195 Oct 17 13:24:56.285297 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1076/2079] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:56.296826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.298062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:56.308459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.309724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.312484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.313864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.316737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.317795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.474532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:56.499322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ac55dc6-8e10-4e04-8463-b8f2a378f71b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.733890 Oct 17 13:24:56.525502 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1004/2080] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:55 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:56.540101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.543544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:56.551164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.552060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.552679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.572130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.573027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.576181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.795614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:56.834114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7555928-64cd-4031-b4da-b7a701a54b14 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1272 microversion: 2.1 time: 0.303312 Oct 17 13:24:56.846242 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1005/2081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:56.869453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:56.871971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:56.892132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.892505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.893093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:56.906710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:56.907299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:56.939901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.017139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:57.019608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:57.033081 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6428f42-80a2-40d9-9277-46e4a4bf4fcd tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1324 microversion: 2.1 time: 0.745939 Oct 17 13:24:57.050040 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1077/2082] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1324 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:57.058138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-56f13050-73c0-46d6-8122-505dbb264a13 req-9e660f60-dcd6-4a2d-bd9a-0ca048f88f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8", "name": "network-vif-plugged", "status": "completed", "tag": "67dbafd1-929a-4c8e-8683-10897b5a339d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:57.068699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56f13050-73c0-46d6-8122-505dbb264a13 req-9e660f60-dcd6-4a2d-bd9a-0ca048f88f85 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.069205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56f13050-73c0-46d6-8122-505dbb264a13 req-9e660f60-dcd6-4a2d-bd9a-0ca048f88f85 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.069743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56f13050-73c0-46d6-8122-505dbb264a13 req-9e660f60-dcd6-4a2d-bd9a-0ca048f88f85 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.090070 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-56f13050-73c0-46d6-8122-505dbb264a13 req-9e660f60-dcd6-4a2d-bd9a-0ca048f88f85 service nova] Creating event network-vif-plugged:67dbafd1-929a-4c8e-8683-10897b5a339d for instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 on n-h2-854121-14 Oct 17 13:24:57.097129 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-56f13050-73c0-46d6-8122-505dbb264a13 req-9e660f60-dcd6-4a2d-bd9a-0ca048f88f85 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045490 Oct 17 13:24:57.098264 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1078/2083] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:57.105457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:57.106612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:57.115085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.115883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.116595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.117555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.118254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.118902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.143765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:24:57.159683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:24:57.193324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.200720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.201748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.203233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lazy-loading 'fault' on Instance uuid ffe767a4-03e3-48b0-89e1-7c478aa9ac84 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:24:57.334781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-780e06a7-ad74-4015-8c99-777c39da51cc tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 204 len: 0 microversion: 2.1 time: 0.233217 Oct 17 13:24:57.344078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1079/2084] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:24:57 2022] DELETE /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:24:57.351655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab0cc3d3-998a-4a24-b194-29cf74071bde", "tag": "589b4d61-a74e-4e01-8622-977978d83851"}, {"server_uuid": "ffe767a4-03e3-48b0-89e1-7c478aa9ac84", "name": "network-vif-deleted", "tag": "882c05fd-ff43-4220-8eef-2ca14c03c2c7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:24:57.365331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.367090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.369441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.396195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9976642939654889bb1dc78814a9011c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd0c1190c61647ceb4914330b65b7c24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:57.417311 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] Creating event network-changed:589b4d61-a74e-4e01-8622-977978d83851 for instance ab0cc3d3-998a-4a24-b194-29cf74071bde on n-h1-854121-14 Oct 17 13:24:57.418069 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] Creating event network-vif-deleted:882c05fd-ff43-4220-8eef-2ca14c03c2c7 for instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 on n-h1-854121-14 Oct 17 13:24:57.419095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37e464ae-68be-43c9-a782-823dfbab1c08 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 200 len: 1332 microversion: 2.1 time: 0.574931 Oct 17 13:24:57.423413 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1006/2085] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:56 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 1332 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:57.443267 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-21f0f538-473f-4d44-9ac0-00c407db2d56 req-c0834bbc-2511-4358-883f-6d3b429dda43 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.097067 Oct 17 13:24:57.445243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1080/2086] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:24:57.467079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:57.471311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:57.491730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.495371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.496706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.499708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.503012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.503464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.627178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:57.628633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:57.662944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.664346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.665560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:57.670728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:57.672947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:57.674847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.168428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:59.181883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:59.183251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:59.184442 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1db89be0-3f0b-4b54-a249-5d28a8289f0c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.759868 Oct 17 13:24:59.185019 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1007/2087] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:24:57 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:24:59.209622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:59.210851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:59.219575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.220776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.221714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.223235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.224264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.224887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.265501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:59.279054 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd63de51-3b36-4d45-9c7d-25def91c9e10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 1.828968 Oct 17 13:24:59.283923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1081/2088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:57 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:59.301418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:59.303349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:24:59.323537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.324427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.325313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.327811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:24:59.328624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:24:59.329695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:24:59.971750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:24:59.983235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3bc49956-fce6-4e89-a56b-53bd75194441 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.787969 Oct 17 13:24:59.986482 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1008/2089] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:24:59.994371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:24:59.998088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.018916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.022337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.023675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.024692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.026744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.027663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.188704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.211596 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1e0b2fd-2cbe-401b-84a3-777eff70888a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 200 len: 1280 microversion: 2.1 time: 0.222283 Oct 17 13:25:00.212538 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1009/2090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:00.234727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.235606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.243255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.253968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.254667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.255584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.256210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.257594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.329750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.355692 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d3434fe-ded2-4cc4-8495-c0404300e41a tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1324 microversion: 2.1 time: 1.068934 Oct 17 13:25:00.359282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1082/2091] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:24:59 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1324 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:00.374451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.375597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.385185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.386174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.386974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.387884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.388533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.389144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.637901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.650315 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f90cb05-8544-4faa-a174-8fdb1ba7ce95 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1278 microversion: 2.1 time: 0.427632 Oct 17 13:25:00.652578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1010/2092] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1278 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:00.664780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-34673468-271a-4ce3-8036-c4410a0209d6 req-218fad24-8797-4cb4-a8f3-4a1885271067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e8b461-e28c-47c2-afca-4120b847d953", "tag": "09230873-4a9e-4e31-a06a-859918003885"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:00.702236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-34673468-271a-4ce3-8036-c4410a0209d6 req-218fad24-8797-4cb4-a8f3-4a1885271067 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.716193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-34673468-271a-4ce3-8036-c4410a0209d6 req-218fad24-8797-4cb4-a8f3-4a1885271067 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.716852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-34673468-271a-4ce3-8036-c4410a0209d6 req-218fad24-8797-4cb4-a8f3-4a1885271067 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.748507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-34673468-271a-4ce3-8036-c4410a0209d6 req-218fad24-8797-4cb4-a8f3-4a1885271067 service nova] Creating event network-changed:09230873-4a9e-4e31-a06a-859918003885 for instance 27e8b461-e28c-47c2-afca-4120b847d953 on n-h1-854121-14 Oct 17 13:25:00.757531 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-34673468-271a-4ce3-8036-c4410a0209d6 req-218fad24-8797-4cb4-a8f3-4a1885271067 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097862 Oct 17 13:25:00.758748 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1011/2093] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:00.777344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.784518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] [instance: ffe767a4-03e3-48b0-89e1-7c478aa9ac84] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.805745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.814791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.815605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.816572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.817307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.817917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.842249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:00.868522 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] HTTP exception thrown: Instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 could not be found. Oct 17 13:25:00.873282 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29e25d4a-5219-47e3-938e-0dc19f186af6 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1324 microversion: 2.1 time: 0.512630 Oct 17 13:25:00.873872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1083/2094] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1324 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Request method failure captured: Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 HTTP/1.1 Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVbv1mf7pciz9-SM0DaRKEUopGH3YO8KRUAX35KGE2QGBSNUHruQfaJl-h5R7RScIagJdiPgfsltOnF-R6FyHxwFDtp993byrCHYJXTzgDpBsew213TX_jGEo4v4aZQnarpQqhD6thrX8wFfw4WiCVrRrOqcurYcujnxpcmkJSXasVs Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: cd0c1190c61647ceb4914330b65b7c24 Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesAdminNegativeTest-586391586 Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:00.885049 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd0c1190c61647ceb4914330b65b7c24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesAdminNegativeTest-586391586 Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: cd0c1190c61647ceb4914330b65b7c24 Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-586391586 Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesAdminNegativeTest-586391586-project Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 9976642939654889bb1dc78814a9011c Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesAdminNegativeTest-586391586-project Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 could not be found. Oct 17 13:25:00.886529 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ffe767a4-03e3-48b0-89e1-7c478aa9ac84'} Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 could not be found. Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:00.887149 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 could not be found. Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 could not be found. Oct 17 13:25:00.888161 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:00.892503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Returning 404 to user: Instance ffe767a4-03e3-48b0-89e1-7c478aa9ac84 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:00.897033 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c911345-47d9-420a-9854-97eb3f397af4 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84" status: 404 len: 111 microversion: 2.1 time: 0.136886 Oct 17 13:25:00.906652 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1012/2095] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/servers/ffe767a4-03e3-48b0-89e1-7c478aa9ac84 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:00.926461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.931004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.955529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:00.956584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.957042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:00.957573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.958297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.959642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.961877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.962593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:00.986075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:00.986579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:00.987517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:01.026052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:01.026551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:01.026998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.151396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.171690 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbce45d3-b0b1-460f-9441-fe72635f5bad tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.296671 Oct 17 13:25:02.172535 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1084/2096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:02.190421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:02.198466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:02.211678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.214236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.214236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.215696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.226593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.227485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.237342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.267521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.275945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.283981 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-569c44cb-07ad-48e2-9842-c118e285ca94 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.375294 Oct 17 13:25:02.289079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1013/2097] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:00 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:02.308079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6b1261f-3bcb-42eb-8967-be542c951459 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] Calling method '.version_select at 0x7f41a2048940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:02.383577 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6b1261f-3bcb-42eb-8967-be542c951459 tempest-VolumesAdminNegativeTest-586391586 tempest-VolumesAdminNegativeTest-586391586-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754531388" status: 202 len: 0 microversion: 2.1 time: 0.092180 Oct 17 13:25:02.384148 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1014/2098] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:25:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754531388 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:02.394101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:02.413586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:02.433308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.434263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.434865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.435784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.436387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.436977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.441824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:02.474167 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] HTTP exception thrown: Instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd could not be found. Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Request method failure captured: Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd HTTP/1.1 Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW2xxO_iWa6F4OYoUcoBq3y2w7k7_s6uSU1woOffhOYg4afY7dTGHuten9hbgIYejxDUnqbJyzAvrBs7CNXpWUVezb_RHggdktSjdKDQsE7yH0YGMgLFtXMP1jGv_uTRnDeCHgAhzmqKpot_4WiKqo8HxTZqcYvkQMKjBYnJsW_h-8 Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:02.481457 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveMigrationTest-272515712 Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveMigrationTest-272515712-project Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 3d18129f56c24321aeff6fa609f78c87 Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveMigrationTest-272515712-project Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd could not be found. Oct 17 13:25:02.482875 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd30aa33c-4020-467e-bd4c-e6e5e2a8a4dd'} Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd could not be found. Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:02.483562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd could not be found. Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd could not be found. Oct 17 13:25:02.484636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:02.488819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Returning 404 to user: Instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:02.493474 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a210f0f9-56fc-4a6e-8c2f-e9bfadc2ac7e tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd" status: 404 len: 111 microversion: 2.1 time: 0.108027 Oct 17 13:25:02.496137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1015/2099] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:02 2022] GET /compute/v2.1/servers/d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:02.504190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:02.511521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:02.533873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.534875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.539294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.543067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.543579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.544608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.899793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:02.920885 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24870094-9474-4b45-a664-0efa7263142e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.742412 Oct 17 13:25:02.922239 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1085/2100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:02 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:02.937439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:02.938426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:02.951240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.952075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.952747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:02.953794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:02.954489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:02.955173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.308419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:03.345536 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca92f083-2527-4f56-b06c-f1a1d898e8e0 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1520 microversion: 2.1 time: 0.846701 Oct 17 13:25:03.351989 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1016/2101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:02 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1520 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:03.394222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.398832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:03.424509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.427584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.428817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.430045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.437706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.438435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.452414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:03.512228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:03.743375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:03.752732 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d51a4432-2794-4bb0-99de-db2c2934e84e tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.829223 Oct 17 13:25:03.758182 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1086/2102] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:02 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:03.782951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:03.790493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:03.800053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.802273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.806564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:03.807646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:03.808372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:03.809073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.171270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:04.188818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9cfb44f3-73dc-4465-8ca2-0e95b8d58f72 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1324 microversion: 2.1 time: 0.835000 Oct 17 13:25:04.221960 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1017/2103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:03 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1324 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:04.234231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:04.237766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:04.245040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.246154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.246751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.247875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.248493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.249144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.320155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:04.526787 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b722fa3-b2fd-4da2-a44b-da1c1ad1c00d tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 204 len: 0 microversion: 2.1 time: 0.302727 Oct 17 13:25:04.530144 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1018/2104] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:04 2022] DELETE /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:04.539858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-37fdf4a3-0da3-4926-8e82-d9690f532866 req-f117ebd9-e2da-4558-8a07-9b70beb932ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd", "name": "network-vif-deleted", "tag": "76bd1a7e-0678-4c82-8b2b-3c87effe2275"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:04.552590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-37fdf4a3-0da3-4926-8e82-d9690f532866 req-f117ebd9-e2da-4558-8a07-9b70beb932ce service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.553454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-37fdf4a3-0da3-4926-8e82-d9690f532866 req-f117ebd9-e2da-4558-8a07-9b70beb932ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.554172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-37fdf4a3-0da3-4926-8e82-d9690f532866 req-f117ebd9-e2da-4558-8a07-9b70beb932ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.579080 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-37fdf4a3-0da3-4926-8e82-d9690f532866 req-f117ebd9-e2da-4558-8a07-9b70beb932ce service nova] Creating event network-vif-deleted:76bd1a7e-0678-4c82-8b2b-3c87effe2275 for instance d30aa33c-4020-467e-bd4c-e6e5e2a8a4dd on n-h2-854121-14 Oct 17 13:25:04.587956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-37fdf4a3-0da3-4926-8e82-d9690f532866 req-f117ebd9-e2da-4558-8a07-9b70beb932ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055770 Oct 17 13:25:04.597646 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1019/2105] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:04.606657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:04.623113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:04.642264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.661787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.662273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:04.663597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:04.664092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:04.671995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.195765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:05.204190 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aadc6108-6ec5-445d-985f-dce317f946c6 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.432905 Oct 17 13:25:05.211173 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1087/2106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:03 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:05.220673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.230530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:05.246963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.250135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.251435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.253206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.257632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.258559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.300584 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] HTTP exception thrown: Instance is not a member of specified network Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Request method failure captured: Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8/ips/invalid HTTP/1.1 Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVeEJ04QzqOPbeKniH4zT06ZklEeKbs2Ic8ZGNKS3n3RwdzdMuC03D8Qlqh-ULRK7vVxGB19yq3H85fSji5hfPnMD3TwZq83ggj3-YRD-so3MfnI-86CCvEKXaF6yKkr-mieKLmxzz2AoBUC1a7aG7hVv04e9YmXW6cvRr5HPGPyfGA Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: fb68ea94527c4077866640f874dc764b Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:05.308927 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb68ea94527c4077866640f874dc764b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb68ea94527c4077866640f874dc764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb68ea94527c4077866640f874dc764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb68ea94527c4077866640f874dc764b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: fb68ea94527c4077866640f874dc764b Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerAddressesNegativeTestJSON-692510355-project Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: e3b5b6c60444486da0aed98d9b8dd3ec Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-692510355-project Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance is not a member of specified network Oct 17 13:25:05.310492 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': '5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8', 'id': 'invalid'} Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 17 13:25:05.311176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:05.315064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:05.316292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf7ae7a7-d70d-4f5d-a10c-18d481c6626d tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.100621 Oct 17 13:25:05.318282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1088/2107] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8/ips/invalid => generated 91 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:25:05.325095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.325955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:05.334154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.335387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.336445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.337397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.338126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.356368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.629622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:05.693246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:05.712981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:05.718093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:05.719827 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7da5234f-9a69-4fe2-b995-4fd828c20c2b tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1487 microversion: 2.25 time: 1.120666 Oct 17 13:25:05.738883 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1020/2108] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:04 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1487 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:05.745754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:05.746621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:05.754149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.758674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.760444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:05.766844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:05.767543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:05.768157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.102044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:06.111275 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae3dd747-15b9-4a84-8456-c84b191fa357 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.791711 Oct 17 13:25:06.112705 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1089/2109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:06.121351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d5f4924b-00a0-4691-a3f0-f958e6fde751 req-029c461a-6b66-492e-bb69-67071a0e0247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e57858-d31a-4a7c-ae37-4f1fdec71aa9", "name": "network-vif-plugged", "status": "completed", "tag": "dfa4680a-1a7d-484e-9d8d-06bba0c971d9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:06.140531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5f4924b-00a0-4691-a3f0-f958e6fde751 req-029c461a-6b66-492e-bb69-67071a0e0247 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.146327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5f4924b-00a0-4691-a3f0-f958e6fde751 req-029c461a-6b66-492e-bb69-67071a0e0247 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.147317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5f4924b-00a0-4691-a3f0-f958e6fde751 req-029c461a-6b66-492e-bb69-67071a0e0247 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.183214 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d5f4924b-00a0-4691-a3f0-f958e6fde751 req-029c461a-6b66-492e-bb69-67071a0e0247 service nova] Creating event network-vif-plugged:dfa4680a-1a7d-484e-9d8d-06bba0c971d9 for instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 on n-h1-854121-14 Oct 17 13:25:06.190604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d5f4924b-00a0-4691-a3f0-f958e6fde751 req-029c461a-6b66-492e-bb69-67071a0e0247 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076432 Oct 17 13:25:06.191867 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1090/2110] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:06.199244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.199940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:06.209745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.210859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.213586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.214739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.215419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.216079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.409821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:06.418456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9d061f4-5d1b-4270-99a8-792e64b6384a tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1499 microversion: 2.1 time: 0.678147 Oct 17 13:25:06.419054 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1021/2111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:05 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1499 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:06.423602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.424223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:06.451325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.451815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.452248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.452956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.453438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.453870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.577898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:06.586465 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a6a3b2bd-8f08-446d-84b7-9cfd68fb1e87 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.392235 Oct 17 13:25:06.590672 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1091/2112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:06.594538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.595983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:06.603158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.603640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.604072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.604773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.605303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.605666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.724287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:06.737867 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77485405-b078-4b35-bd18-7a55279b49a5 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1324 microversion: 2.1 time: 0.317708 Oct 17 13:25:06.739113 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1022/2113] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:06.750870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65ce14f7-6158-4e64-9643-852864c27a9c tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.751354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65ce14f7-6158-4e64-9643-852864c27a9c tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Failed to fetch instance by id 999 {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:25:06.751857 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-65ce14f7-6158-4e64-9643-852864c27a9c tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] HTTP exception thrown: Instance 999 could not be found. Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65ce14f7-6158-4e64-9643-852864c27a9c tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Request method failure captured: Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVeEJ04QzqOPbeKniH4zT06ZklEeKbs2Ic8ZGNKS3n3RwdzdMuC03D8Qlqh-ULRK7vVxGB19yq3H85fSji5hfPnMD3TwZq83ggj3-YRD-so3MfnI-86CCvEKXaF6yKkr-mieKLmxzz2AoBUC1a7aG7hVv04e9YmXW6cvRr5HPGPyfGA Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: fb68ea94527c4077866640f874dc764b Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:06.753579 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb68ea94527c4077866640f874dc764b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb68ea94527c4077866640f874dc764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb68ea94527c4077866640f874dc764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb68ea94527c4077866640f874dc764b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: fb68ea94527c4077866640f874dc764b Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerAddressesNegativeTestJSON-692510355-project Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e3b5b6c60444486da0aed98d9b8dd3ec Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-692510355-project Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 999 could not be found. Oct 17 13:25:06.754780 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': '999'} Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 17 13:25:06.755416 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65ce14f7-6158-4e64-9643-852864c27a9c tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:06.756511 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65ce14f7-6158-4e64-9643-852864c27a9c tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.015860 Oct 17 13:25:06.761818 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1023/2114] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:25:06.767107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:06.767728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:06.775183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.775674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.776114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.776820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:06.777300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:06.777732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:06.990973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.002996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35b9a23c-08ca-4252-b66b-8bf603973177 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.413756 Oct 17 13:25:07.013455 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1092/2115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:07.013455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.013455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.018391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.018892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.020253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.020994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.022532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.024156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.060523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:07.079751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.095075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.097237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.099558 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b36284b4-bfff-4198-8fc4-7a2f7481effd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1477 microversion: 2.25 time: 0.336679 Oct 17 13:25:07.114023 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1024/2116] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:06 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:07.129246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a5f5119f-6504-4e1e-b635-44df5a380ae7 req-b7f06b68-1990-49cd-8577-186241d01862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3c4258-846c-423b-9ea9-79739744e0b5", "tag": "79f5598d-2c0d-4af9-afd2-e89db585c8f5"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:07.139567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:07.139789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a5f5119f-6504-4e1e-b635-44df5a380ae7 req-b7f06b68-1990-49cd-8577-186241d01862 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.140280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a5f5119f-6504-4e1e-b635-44df5a380ae7 req-b7f06b68-1990-49cd-8577-186241d01862 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.140718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a5f5119f-6504-4e1e-b635-44df5a380ae7 req-b7f06b68-1990-49cd-8577-186241d01862 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.158251 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a5f5119f-6504-4e1e-b635-44df5a380ae7 req-b7f06b68-1990-49cd-8577-186241d01862 service nova] Creating event network-changed:79f5598d-2c0d-4af9-afd2-e89db585c8f5 for instance 3b3c4258-846c-423b-9ea9-79739744e0b5 on n-h2-854121-14 Oct 17 13:25:07.164909 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a5f5119f-6504-4e1e-b635-44df5a380ae7 req-b7f06b68-1990-49cd-8577-186241d01862 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048954 Oct 17 13:25:07.166255 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1025/2117] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:07.172227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.172990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.181022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.182077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.182311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.182910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.183433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.184364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.217082 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93b2c63e-ddea-4bc8-bd88-35a85ae3f764 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 204 len: 0 microversion: 2.1 time: 0.210321 Oct 17 13:25:07.218881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1093/2118] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:07 2022] DELETE /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:07.227975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3464aa9b-9682-4873-9cb0-c26206ea3c14 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '.version_select at 0x7f41a1fedaf0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.236174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3464aa9b-9682-4873-9cb0-c26206ea3c14 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.236666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3464aa9b-9682-4873-9cb0-c26206ea3c14 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.237397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3464aa9b-9682-4873-9cb0-c26206ea3c14 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.248591 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3464aa9b-9682-4873-9cb0-c26206ea3c14 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 2380 microversion: 2.25 time: 0.027524 Oct 17 13:25:07.249893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1094/2119] 10.222.0.65 () {60 vars in 1184 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/os-migrations => generated 2380 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:07.254702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.255626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.263470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.264269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.264910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.265851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.266487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.267091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.434091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.444471 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35545264-50fb-4391-a07b-57c3ebe651f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.276761 Oct 17 13:25:07.446160 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1026/2120] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:07.451582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.452286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.460735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.461722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.462565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.464399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.465002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.465980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.490128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.499430 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-597c174f-3727-421f-a679-c69ecff63b49 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.248161 Oct 17 13:25:07.500022 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1095/2121] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:07.519398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.520007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.528848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.529418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.529921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.530718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.531313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.531843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.676246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:07.686645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-084334ae-2b99-4caa-9097-87330b6f3518 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1526 microversion: 2.1 time: 0.239056 Oct 17 13:25:07.692001 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1027/2122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:07.696475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.697097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.703999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.704496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.704930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.705669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.706117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.706543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.719979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] Lazy-loading 'services' on Instance uuid ab0cc3d3-998a-4a24-b194-29cf74071bde {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:07.735332 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54180389-7aec-44ab-894e-d4dada890922 tempest-LiveAutoBlockMigrationV225Test-2047366696 tempest-LiveAutoBlockMigrationV225Test-2047366696-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1972 microversion: 2.25 time: 0.218854 Oct 17 13:25:07.749726 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1096/2123] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1972 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:07.759819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:07.760442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:07.767121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.767618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.768059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.768772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:07.769285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:07.769870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:07.999083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.007818 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35642f87-0a72-42ba-a587-bd0b94a954f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.256902 Oct 17 13:25:08.013750 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1097/2124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:08.013750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.013750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:08.028720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.029392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.030099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.031078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.031529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.032281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.066130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.076687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5ccd1a9-0820-4585-bf13-59c49a718571 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1499 microversion: 2.1 time: 0.388386 Oct 17 13:25:08.085935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1028/2125] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:07 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1499 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:08.093347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.094135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:08.100344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.101146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.101891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.102836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.103442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.103895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.138463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:08.174564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.184570 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6129fc1-0ad7-4a5a-ad67-9eeb44069e91 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1324 microversion: 2.1 time: 0.175127 Oct 17 13:25:08.185513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1098/2126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:08 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1324 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:08.233323 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9b28132-5900-4aa5-ab03-cc71820740c7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 204 len: 0 microversion: 2.25 time: 0.145592 Oct 17 13:25:08.233935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1029/2127] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:25:08 2022] DELETE /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:25:08.242370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.243040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:08.249043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.249806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.250272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.250969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.251418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.251834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.400478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.409236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.410787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.412050 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7475dfc2-901c-4649-8647-ff6f2edf33f4 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1483 microversion: 2.25 time: 0.173638 Oct 17 13:25:08.412695 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1099/2128] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:08 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1483 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:08.485488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1e4bbc4e-b10a-4bf3-9a3f-0dd3ac147da3 req-45b5554c-e143-4c8c-8072-24c0e7d65399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb237cbb-7c63-45de-a406-b73d6b221ac5", "name": "network-vif-deleted", "tag": "d4bdd4ae-856b-4eb5-9670-e2ce1a62a781"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:08.498441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1e4bbc4e-b10a-4bf3-9a3f-0dd3ac147da3 req-45b5554c-e143-4c8c-8072-24c0e7d65399 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.499020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1e4bbc4e-b10a-4bf3-9a3f-0dd3ac147da3 req-45b5554c-e143-4c8c-8072-24c0e7d65399 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.499535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1e4bbc4e-b10a-4bf3-9a3f-0dd3ac147da3 req-45b5554c-e143-4c8c-8072-24c0e7d65399 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.511731 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1e4bbc4e-b10a-4bf3-9a3f-0dd3ac147da3 req-45b5554c-e143-4c8c-8072-24c0e7d65399 service nova] Creating event network-vif-deleted:d4bdd4ae-856b-4eb5-9670-e2ce1a62a781 for instance eb237cbb-7c63-45de-a406-b73d6b221ac5 on n-h1-854121-14 Oct 17 13:25:08.524684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.525695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:08.532890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.535125 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1e4bbc4e-b10a-4bf3-9a3f-0dd3ac147da3 req-45b5554c-e143-4c8c-8072-24c0e7d65399 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056566 Oct 17 13:25:08.535935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1030/2129] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:08.536675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.537330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.538322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.538791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.539205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.714242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:08.714984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:08.718158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:08.721918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.722409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.722848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.723556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:08.724005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:08.724431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:08.728356 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19448c1f-a00e-4f08-8528-c46e615af6cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.210006 Oct 17 13:25:08.729197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1100/2130] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:08 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:09.032107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.033115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.046526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.047481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.048151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.049363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.050630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.052375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.071793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.084372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db4541a3-4162-4348-9503-980c7d3dfb32 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1526 microversion: 2.1 time: 0.376760 Oct 17 13:25:09.085873 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1031/2131] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:08 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1526 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:09.106361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.106978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.118215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.119072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.119766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.120687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.133954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.134765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.155493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:09.216166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.217443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.218041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.218633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lazy-loading 'fault' on Instance uuid eb237cbb-7c63-45de-a406-b73d6b221ac5 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:09.233670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.244943 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-237edfe1-72ff-4a5b-bcd2-3f899670991a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.217083 Oct 17 13:25:09.246744 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1101/2132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:09.253786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.254681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.264057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.264714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.265287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.266159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.266822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.267668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.305284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d18129f56c24321aeff6fa609f78c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24e295f59e54ff384c107e1ff637e4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.318066 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4cdf91b8-d2f5-4a3e-8ed1-12569e64b111 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 200 len: 1301 microversion: 2.1 time: 0.221220 Oct 17 13:25:09.318770 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1032/2133] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 1301 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:09.434376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.437142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.437991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.445317 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f790505b-d1f9-4112-a55c-491dd280235e tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1522 microversion: 2.1 time: 0.197206 Oct 17 13:25:09.457197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1102/2134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:09.457606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.457606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.457606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.457606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.457942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.457942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.477341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.478333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.490590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.491177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.492448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.493544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.494092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.494592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.532870 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] HTTP exception thrown: Action 999 not found Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Request method failure captured: Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9/os-instance-actions/999 HTTP/1.1 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVeaXuEJ4cWR0hJqM3twYgh6IhafbbVxBxk8ThRxClpH_WIvd7wyaZErCaCU3dMIplC1tTmaTdQ2KOp2hyL_2uL1X9DeAnFuE5rgqFWSDy3fTyfI4pDzNZKJ6-xuPPHedJmKwknJy2Cxd0HoLc30IaiuLgiOTGg25DpV5h6XO6os8h4 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: fa0267911da14adc981d0332a8101ed8 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:09.542364 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fa0267911da14adc981d0332a8101ed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: fa0267911da14adc981d0332a8101ed8 Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceActionsNegativeTestJSON-1690057788-project Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: a01a874bcbf0436aacd1e4864be54906 Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1690057788-project Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: exception: Action 999 not found Oct 17 13:25:09.543944 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': 'f6e57858-d31a-4a7c-ae37-4f1fdec71aa9', 'id': '999'} Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 17 13:25:09.549116 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.550247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Returning 404 to user: Action 999 not found {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:09.550247 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e516f8d-2e91-4bd5-9dca-fdeae8aeb037 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.075526 Oct 17 13:25:09.550247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1103/2135] 10.222.0.65 () {58 vars in 1308 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9/os-instance-actions/999 => generated 66 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:25:09.559668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29a998e3-42a7-473b-beaa-8bcd21c14a2c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '.version_select at 0x7f41a1f8eb80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.560521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29a998e3-42a7-473b-beaa-8bcd21c14a2c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: 854f7b87-8012-415d-99b5-1e96915568f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.571372 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-29a998e3-42a7-473b-beaa-8bcd21c14a2c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] HTTP exception thrown: Instance 854f7b87-8012-415d-99b5-1e96915568f3 could not be found. Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29a998e3-42a7-473b-beaa-8bcd21c14a2c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Request method failure captured: Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/854f7b87-8012-415d-99b5-1e96915568f3/os-instance-actions HTTP/1.1 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVeaXuEJ4cWR0hJqM3twYgh6IhafbbVxBxk8ThRxClpH_WIvd7wyaZErCaCU3dMIplC1tTmaTdQ2KOp2hyL_2uL1X9DeAnFuE5rgqFWSDy3fTyfI4pDzNZKJ6-xuPPHedJmKwknJy2Cxd0HoLc30IaiuLgiOTGg25DpV5h6XO6os8h4 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: fa0267911da14adc981d0332a8101ed8 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:09.573660 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fa0267911da14adc981d0332a8101ed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: fa0267911da14adc981d0332a8101ed8 Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceActionsNegativeTestJSON-1690057788-project Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: a01a874bcbf0436aacd1e4864be54906 Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1690057788-project Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 854f7b87-8012-415d-99b5-1e96915568f3 could not be found. Oct 17 13:25:09.574765 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': '854f7b87-8012-415d-99b5-1e96915568f3'} Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 854f7b87-8012-415d-99b5-1e96915568f3 could not be found. Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:09.575402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 854f7b87-8012-415d-99b5-1e96915568f3 could not be found. Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 854f7b87-8012-415d-99b5-1e96915568f3 could not be found. Oct 17 13:25:09.576394 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:09.578955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29a998e3-42a7-473b-beaa-8bcd21c14a2c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Returning 404 to user: Instance 854f7b87-8012-415d-99b5-1e96915568f3 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:09.580267 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29a998e3-42a7-473b-beaa-8bcd21c14a2c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/854f7b87-8012-415d-99b5-1e96915568f3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.029403 Oct 17 13:25:09.585944 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1104/2136] 10.222.0.65 () {58 vars in 1296 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/854f7b87-8012-415d-99b5-1e96915568f3/os-instance-actions => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:09.591648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.592399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.603954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.604788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.605507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.607435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.608501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.609822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.634457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.646444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:09.646833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.648899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:09.650228 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01f59373-cc92-4389-ad07-7b5a53de4041 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1483 microversion: 2.25 time: 0.217048 Oct 17 13:25:09.651237 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1033/2137] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1483 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:09.753797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.754419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.762363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.762845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.763271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.763964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.771687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.772858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.790918 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08b258ea-39b3-48b9-9e78-556d56320455 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 204 len: 0 microversion: 2.1 time: 0.203413 Oct 17 13:25:09.793511 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1105/2138] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:09 2022] DELETE /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:09.806910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:09.809588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:09.823610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.824435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.825892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:09.826674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:09.827320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:09.827793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.016597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:10.031281 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4de86517-1220-416b-8bb5-1936e6cd5bd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.282528 Oct 17 13:25:10.033244 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1034/2139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:10.093821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:10.104721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9547d4e-745c-44ed-8dc6-8d2cbd663012 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1528 microversion: 2.1 time: 0.306188 Oct 17 13:25:10.104998 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1106/2140] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:09 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:10.123212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:10.125917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:10.132212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.132895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.133588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.134415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.134939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.135428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.269657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:10.270270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:10.281637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.282127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.282583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.283246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.283694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.284113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.363749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:10.374826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e477519-9ee0-452f-a7a7-a9586595b70b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1526 microversion: 2.1 time: 0.255714 Oct 17 13:25:10.390626 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1035/2141] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:10 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1526 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:10.392257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:10.394529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] [instance: eb237cbb-7c63-45de-a406-b73d6b221ac5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:10.412458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.412731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.414689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.414997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.415454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.415881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.440624 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] HTTP exception thrown: Instance eb237cbb-7c63-45de-a406-b73d6b221ac5 could not be found. Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Request method failure captured: Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 HTTP/1.1 Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW2xxO_iWa6F4OYoUcoBq3y2w7k7_s6uSU1woOffhOYg4afY7dTGHuten9hbgIYejxDUnqbJyzAvrBs7CNXpWUVezb_RHggdktSjdKDQsE7yH0YGMgLFtXMP1jGv_uTRnDeCHgAhzmqKpot_4WiKqo8HxTZqcYvkQMKjBYnJsW_h-8 Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:10.445112 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d24e295f59e54ff384c107e1ff637e4b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveMigrationTest-272515712 Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d24e295f59e54ff384c107e1ff637e4b Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveMigrationTest-272515712 Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveMigrationTest-272515712-project Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 3d18129f56c24321aeff6fa609f78c87 Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveMigrationTest-272515712-project Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance eb237cbb-7c63-45de-a406-b73d6b221ac5 could not be found. Oct 17 13:25:10.446389 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'eb237cbb-7c63-45de-a406-b73d6b221ac5'} Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb237cbb-7c63-45de-a406-b73d6b221ac5 could not be found. Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:10.447014 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb237cbb-7c63-45de-a406-b73d6b221ac5 could not be found. Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb237cbb-7c63-45de-a406-b73d6b221ac5 could not be found. Oct 17 13:25:10.448029 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:10.448901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] Returning 404 to user: Instance eb237cbb-7c63-45de-a406-b73d6b221ac5 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:10.448901 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b68381c-7d12-4f1c-b8fc-28fc72e8cb24 tempest-LiveMigrationTest-272515712 tempest-LiveMigrationTest-272515712-project] 10.222.0.65 "GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5" status: 404 len: 111 microversion: 2.1 time: 0.066239 Oct 17 13:25:10.451586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1036/2142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:10 2022] GET /compute/v2.1/servers/eb237cbb-7c63-45de-a406-b73d6b221ac5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:10.572359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3fdea5c5-5a68-4af7-a4ce-f202fc850893 req-0ee52525-2b85-47f5-a008-a7fc1551ea35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb070b38-9787-40e2-a423-5bfaf571a978", "tag": "c7bff42a-e4cf-4196-b029-addfe1727ccd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:10.593192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3fdea5c5-5a68-4af7-a4ce-f202fc850893 req-0ee52525-2b85-47f5-a008-a7fc1551ea35 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.599572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3fdea5c5-5a68-4af7-a4ce-f202fc850893 req-0ee52525-2b85-47f5-a008-a7fc1551ea35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.601003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3fdea5c5-5a68-4af7-a4ce-f202fc850893 req-0ee52525-2b85-47f5-a008-a7fc1551ea35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.642331 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3fdea5c5-5a68-4af7-a4ce-f202fc850893 req-0ee52525-2b85-47f5-a008-a7fc1551ea35 service nova] Creating event network-changed:c7bff42a-e4cf-4196-b029-addfe1727ccd for instance fb070b38-9787-40e2-a423-5bfaf571a978 on n-h1-854121-14 Oct 17 13:25:10.647158 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3fdea5c5-5a68-4af7-a4ce-f202fc850893 req-0ee52525-2b85-47f5-a008-a7fc1551ea35 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079467 Oct 17 13:25:10.648274 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1037/2143] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:10.672478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:10.676923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:10.677891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:10.686217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-51c2c53a-d0cf-4e0a-872a-ed00830439f4 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.420795 Oct 17 13:25:10.686993 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1107/2144] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:10 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:10.687728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.688412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.689135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:10.690212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:10.691122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:10.691796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.022948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.036932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.039236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.040666 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ffeace41-29a4-4933-8497-4a81d05471dd tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1483 microversion: 2.25 time: 0.368542 Oct 17 13:25:11.045205 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1038/2145] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:10 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1483 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:11.059604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:11.060230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:11.066518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.067037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.067479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.068177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.068626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.069045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.140369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:11.140996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:11.146957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.148280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.148280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.148605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.149052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.149598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.375210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.384517 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29dfba79-d75e-4521-b7f2-5ebb2888a523 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.333329 Oct 17 13:25:11.385106 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1108/2146] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:11 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:11.400233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:11.401396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:11.416085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.417231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.417888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.418884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.419627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.420336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.466183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.483445 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08da39d5-23fa-4b6b-920f-fbd8e22477c0 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1528 microversion: 2.1 time: 0.349316 Oct 17 13:25:11.487609 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1039/2147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:11 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1528 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:11.710276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:11.711121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:11.727230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:11.729657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:11.730165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.730677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.731127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.733592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:11.736474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:11.737246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:11.745462 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d3c2dd2-4d8c-4761-9930-bcab9f815661 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1526 microversion: 2.1 time: 0.349855 Oct 17 13:25:11.746041 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1109/2148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:11 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1526 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:12.066787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:12.068767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:12.070088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:12.078674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce3cad53-2f9b-4003-bda7-2b3b58cea66c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.372529 Oct 17 13:25:12.079197 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1040/2149] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:11 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:12.091482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.092875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.093557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.095241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.095939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.098052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.355207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:12.370404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:12.372138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:12.374002 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea84fe73-a538-42f0-8716-2a7992146329 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1483 microversion: 2.25 time: 0.311054 Oct 17 13:25:12.375375 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1110/2150] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:12 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1483 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:12.408925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:12.410236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:12.417881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.418382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.418841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.419558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.420016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.420446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.513772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:12.514829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:12.523825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.524671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.525348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:12.526307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:12.526919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:12.527556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.127480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:13.140385 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57a3591b-0af1-4bd7-a8ed-4f51980c50e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.735144 Oct 17 13:25:13.142587 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1041/2151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:12 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:13.156976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6add4ca4-eb85-493d-b12a-c0b2a9d8c064 req-13084de8-40ba-4837-8c8a-596d21785e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e8b461-e28c-47c2-afca-4120b847d953", "name": "network-vif-plugged", "status": "completed", "tag": "09230873-4a9e-4e31-a06a-859918003885"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:13.176519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:13.194733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6add4ca4-eb85-493d-b12a-c0b2a9d8c064 req-13084de8-40ba-4837-8c8a-596d21785e91 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.198498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6add4ca4-eb85-493d-b12a-c0b2a9d8c064 req-13084de8-40ba-4837-8c8a-596d21785e91 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.198498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6add4ca4-eb85-493d-b12a-c0b2a9d8c064 req-13084de8-40ba-4837-8c8a-596d21785e91 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.222418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:13.235836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a82f13e4-4088-4339-ac63-c8f990dcd70a tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1528 microversion: 2.1 time: 0.726889 Oct 17 13:25:13.251489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6add4ca4-eb85-493d-b12a-c0b2a9d8c064 req-13084de8-40ba-4837-8c8a-596d21785e91 service nova] Creating event network-vif-plugged:09230873-4a9e-4e31-a06a-859918003885 for instance 27e8b461-e28c-47c2-afca-4120b847d953 on n-h1-854121-14 Oct 17 13:25:13.260619 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1111/2152] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:12 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1528 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:13.268434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:13.272046 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6add4ca4-eb85-493d-b12a-c0b2a9d8c064 req-13084de8-40ba-4837-8c8a-596d21785e91 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126458 Oct 17 13:25:13.273898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:13.275032 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1042/2153] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:13.280367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:13.284577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:13.288625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.290968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.292394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.295375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.296036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.296795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.308496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.309222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.311644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.312758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.315869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.316461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.892859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:13.909725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9884fd6-b16e-4dd3-87c7-2f12c1dec6ed tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.633098 Oct 17 13:25:13.912172 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1043/2154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:13 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:13.922784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:13.931398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:13.957563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.958347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.960067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.963103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:13.964532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:13.966628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:13.996272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:14.007981 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6f64002-f6f1-4931-9265-95d422486dca tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1526 microversion: 2.1 time: 0.745772 Oct 17 13:25:14.008804 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1112/2155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:13 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1526 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:14.020249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1d16c024-6888-4df8-8932-193bb954915c req-c6f9df0c-4f45-4070-bb1b-45f2f5540a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e57858-d31a-4a7c-ae37-4f1fdec71aa9", "name": "network-vif-deleted", "tag": "dfa4680a-1a7d-484e-9d8d-06bba0c971d9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:14.045939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1d16c024-6888-4df8-8932-193bb954915c req-c6f9df0c-4f45-4070-bb1b-45f2f5540a60 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.046420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1d16c024-6888-4df8-8932-193bb954915c req-c6f9df0c-4f45-4070-bb1b-45f2f5540a60 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.046851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1d16c024-6888-4df8-8932-193bb954915c req-c6f9df0c-4f45-4070-bb1b-45f2f5540a60 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.068318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1d16c024-6888-4df8-8932-193bb954915c req-c6f9df0c-4f45-4070-bb1b-45f2f5540a60 service nova] Creating event network-vif-deleted:dfa4680a-1a7d-484e-9d8d-06bba0c971d9 for instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 on n-h1-854121-14 Oct 17 13:25:14.076648 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1d16c024-6888-4df8-8932-193bb954915c req-c6f9df0c-4f45-4070-bb1b-45f2f5540a60 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066423 Oct 17 13:25:14.077593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1113/2156] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:14.169090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:14.169826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:14.183880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.183980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.184414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.185120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.186193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.186630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.693029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:14.704769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:14.711182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:14.712724 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a51f93b-606c-4ee9-a06f-f526f2452864 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1483 microversion: 2.25 time: 0.794123 Oct 17 13:25:14.726141 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1044/2157] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:13 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1483 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:14.740686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:14.742168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:14.761672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.769991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.770457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.771761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.773116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.776111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.853825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:14.854329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:14.854772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:14.855236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lazy-loading 'fault' on Instance uuid f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:15.010609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01a874bcbf0436aacd1e4864be54906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa0267911da14adc981d0332a8101ed8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:15.019778 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb4f76d5-b413-44aa-8f31-ec265fdd6f58 tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 200 len: 1314 microversion: 2.1 time: 0.292450 Oct 17 13:25:15.033750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1045/2158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:14 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:15.046454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:15.047342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:15.054304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.055037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.055472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.056368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.056973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.057573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.122238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:15.139289 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed25e4e9-e49e-41f9-b17c-b22b3048387e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1308 microversion: 2.1 time: 0.974231 Oct 17 13:25:15.141028 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1114/2159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:14 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1308 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:15.148437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:15.149427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:15.168652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.170213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.171695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.172621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.173301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.174483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.222184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:15.224546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.225271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.226343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.227128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lazy-loading 'fault' on Instance uuid 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:15.420552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3b5b6c60444486da0aed98d9b8dd3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb68ea94527c4077866640f874dc764b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:15.435720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6b1d7a9-d9d8-4eb8-9b88-733180a6298b tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 200 len: 1314 microversion: 2.1 time: 0.290053 Oct 17 13:25:15.437615 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1115/2160] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:15 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:15.447605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fd890410-3386-4c59-88d1-b1d0a1ac2afe req-fb8bd897-2a66-4790-a003-dd033d439c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8", "name": "network-vif-unplugged", "status": "completed", "tag": "67dbafd1-929a-4c8e-8683-10897b5a339d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:15.478359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fd890410-3386-4c59-88d1-b1d0a1ac2afe req-fb8bd897-2a66-4790-a003-dd033d439c07 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.479022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fd890410-3386-4c59-88d1-b1d0a1ac2afe req-fb8bd897-2a66-4790-a003-dd033d439c07 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.479630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fd890410-3386-4c59-88d1-b1d0a1ac2afe req-fb8bd897-2a66-4790-a003-dd033d439c07 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.520681 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fd890410-3386-4c59-88d1-b1d0a1ac2afe req-fb8bd897-2a66-4790-a003-dd033d439c07 service nova] Creating event network-vif-unplugged:67dbafd1-929a-4c8e-8683-10897b5a339d for instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 on n-h2-854121-14 Oct 17 13:25:15.527008 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fd890410-3386-4c59-88d1-b1d0a1ac2afe req-fb8bd897-2a66-4790-a003-dd033d439c07 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086940 Oct 17 13:25:15.529660 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1116/2161] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:15.690233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c4312f1b-078c-4f70-a556-6e024ff7129f req-d58645cf-6fc7-424f-9561-0f57eab3b2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab0cc3d3-998a-4a24-b194-29cf74071bde", "name": "network-vif-deleted", "tag": "589b4d61-a74e-4e01-8622-977978d83851"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:15.705799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c4312f1b-078c-4f70-a556-6e024ff7129f req-d58645cf-6fc7-424f-9561-0f57eab3b2be service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.706416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:15.706881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c4312f1b-078c-4f70-a556-6e024ff7129f req-d58645cf-6fc7-424f-9561-0f57eab3b2be service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.708487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c4312f1b-078c-4f70-a556-6e024ff7129f req-d58645cf-6fc7-424f-9561-0f57eab3b2be service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.718366 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fde6f746-248f-492b-beb8-ed7a9d0f0c4a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.683212 Oct 17 13:25:15.727732 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c4312f1b-078c-4f70-a556-6e024ff7129f req-d58645cf-6fc7-424f-9561-0f57eab3b2be service nova] Creating event network-vif-deleted:589b4d61-a74e-4e01-8622-977978d83851 for instance ab0cc3d3-998a-4a24-b194-29cf74071bde on n-h2-854121-14 Oct 17 13:25:15.734912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1046/2162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:15 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:15.737320 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c4312f1b-078c-4f70-a556-6e024ff7129f req-d58645cf-6fc7-424f-9561-0f57eab3b2be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049324 Oct 17 13:25:15.737733 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1117/2163] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:15.752563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:15.753563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:15.765578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.766445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.766933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.769106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:15.770329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:15.777711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:15.998112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:16.040881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:16.052709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:16.053916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] [instance: f6e57858-d31a-4a7c-ae37-4f1fdec71aa9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:16.062723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:16.066775 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c2cac7a-4408-4f60-b1c5-104927e27fc6 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1266 microversion: 2.25 time: 0.328000 Oct 17 13:25:16.067371 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1047/2164] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:15 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:16.070785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.073129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.075002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.083233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.083913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.084519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.117949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] HTTP exception thrown: Instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 could not be found. Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Request method failure captured: Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 HTTP/1.1 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVeaXuEJ4cWR0hJqM3twYgh6IhafbbVxBxk8ThRxClpH_WIvd7wyaZErCaCU3dMIplC1tTmaTdQ2KOp2hyL_2uL1X9DeAnFuE5rgqFWSDy3fTyfI4pDzNZKJ6-xuPPHedJmKwknJy2Cxd0HoLc30IaiuLgiOTGg25DpV5h6XO6os8h4 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: fa0267911da14adc981d0332a8101ed8 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:16.120056 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fa0267911da14adc981d0332a8101ed8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fa0267911da14adc981d0332a8101ed8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: fa0267911da14adc981d0332a8101ed8 Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1690057788 Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceActionsNegativeTestJSON-1690057788-project Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: a01a874bcbf0436aacd1e4864be54906 Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1690057788-project Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 could not be found. Oct 17 13:25:16.121618 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f6e57858-d31a-4a7c-ae37-4f1fdec71aa9'} Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 could not be found. Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:16.122837 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 could not be found. Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 could not be found. Oct 17 13:25:16.123908 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.124827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] Returning 404 to user: Instance f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:16.124827 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5ec011f-4091-4193-a5b5-c308ee42892c tempest-InstanceActionsNegativeTestJSON-1690057788 tempest-InstanceActionsNegativeTestJSON-1690057788-project] 10.222.0.65 "GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9" status: 404 len: 111 microversion: 2.1 time: 0.074903 Oct 17 13:25:16.124827 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1118/2165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:16 2022] GET /compute/v2.1/servers/f6e57858-d31a-4a7c-ae37-4f1fdec71aa9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:25:16.168642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:16.169471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:16.180105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.180608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.181050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.185890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.186387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.186833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.461151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:16.461849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] [instance: 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:16.470900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.471401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.471837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.472550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.473004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.473454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.508192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] HTTP exception thrown: Instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 could not be found. Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Request method failure captured: Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 HTTP/1.1 Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVeEJ04QzqOPbeKniH4zT06ZklEeKbs2Ic8ZGNKS3n3RwdzdMuC03D8Qlqh-ULRK7vVxGB19yq3H85fSji5hfPnMD3TwZq83ggj3-YRD-so3MfnI-86CCvEKXaF6yKkr-mieKLmxzz2AoBUC1a7aG7hVv04e9YmXW6cvRr5HPGPyfGA Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: fb68ea94527c4077866640f874dc764b Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:16.509693 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fb68ea94527c4077866640f874dc764b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb68ea94527c4077866640f874dc764b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fb68ea94527c4077866640f874dc764b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fb68ea94527c4077866640f874dc764b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: fb68ea94527c4077866640f874dc764b Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-692510355 Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerAddressesNegativeTestJSON-692510355-project Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: e3b5b6c60444486da0aed98d9b8dd3ec Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-692510355-project Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 could not be found. Oct 17 13:25:16.510934 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8'} Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 could not be found. Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:16.511709 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 could not be found. Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 could not be found. Oct 17 13:25:16.512960 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:16.517756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] Returning 404 to user: Instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:16.518707 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a139e17-3602-4ab4-ad0c-b1622d07d3e3 tempest-ServerAddressesNegativeTestJSON-692510355 tempest-ServerAddressesNegativeTestJSON-692510355-project] 10.222.0.65 "GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8" status: 404 len: 111 microversion: 2.1 time: 0.062631 Oct 17 13:25:16.519305 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1119/2166] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:16 2022] GET /compute/v2.1/servers/5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:25:16.556283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6d5610da-b225-42d8-9c8b-706c6e8b4d01 req-ebda9ec3-8c5e-49e7-a6a0-be75164d0d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8", "name": "network-vif-deleted", "tag": "67dbafd1-929a-4c8e-8683-10897b5a339d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:16.574597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6d5610da-b225-42d8-9c8b-706c6e8b4d01 req-ebda9ec3-8c5e-49e7-a6a0-be75164d0d15 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.575083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6d5610da-b225-42d8-9c8b-706c6e8b4d01 req-ebda9ec3-8c5e-49e7-a6a0-be75164d0d15 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.575520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6d5610da-b225-42d8-9c8b-706c6e8b4d01 req-ebda9ec3-8c5e-49e7-a6a0-be75164d0d15 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.601037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6d5610da-b225-42d8-9c8b-706c6e8b4d01 req-ebda9ec3-8c5e-49e7-a6a0-be75164d0d15 service nova] Creating event network-vif-deleted:67dbafd1-929a-4c8e-8683-10897b5a339d for instance 5ebe9fdf-a3c5-440e-b9f1-6b188967b6f8 on n-h2-854121-14 Oct 17 13:25:16.619293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6d5610da-b225-42d8-9c8b-706c6e8b4d01 req-ebda9ec3-8c5e-49e7-a6a0-be75164d0d15 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067337 Oct 17 13:25:16.620268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1120/2167] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:16.763761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:16.764688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:16.779549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.782880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.783521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:16.784447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:16.785052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:16.786834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.070923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.085053 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21975511-cf3e-444f-a96d-6f064aca680a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1488 microversion: 2.1 time: 0.922024 Oct 17 13:25:17.085815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1048/2168] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:16 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1488 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:17.096399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:17.100914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:17.121102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.134348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.135103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.135787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.136406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.136921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.481729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.494903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.502974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.504672 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6df9f97-da31-4949-8c67-26c41c460347 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1266 microversion: 2.25 time: 0.414413 Oct 17 13:25:17.517516 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1049/2169] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:17 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:17.527600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:17.528391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:17.536111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.536847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.537533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.539113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.539810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.540438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.545314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:17.580695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:17.728206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:17.743485 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94630fd0-2041-4b01-af45-561cafc4d8fc tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 204 len: 0 microversion: 2.1 time: 0.224270 Oct 17 13:25:17.744499 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1050/2170] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:17 2022] DELETE /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:17.748490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5f5c88d-988c-4f6d-9af6-a0752b81fdd9 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.985645 Oct 17 13:25:17.754630 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1121/2171] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:16 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:17.761360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b80be329-57f6-426e-9976-acb0e9b25501 req-f758fe52-5520-4639-b1d3-d84f42cc9d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb070b38-9787-40e2-a423-5bfaf571a978", "name": "network-vif-plugged", "status": "completed", "tag": "c7bff42a-e4cf-4196-b029-addfe1727ccd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:17.773776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:17.774835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:17.779575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b80be329-57f6-426e-9976-acb0e9b25501 req-f758fe52-5520-4639-b1d3-d84f42cc9d29 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.780197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b80be329-57f6-426e-9976-acb0e9b25501 req-f758fe52-5520-4639-b1d3-d84f42cc9d29 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.781485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b80be329-57f6-426e-9976-acb0e9b25501 req-f758fe52-5520-4639-b1d3-d84f42cc9d29 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.782846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.783591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.784228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.785153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:17.786274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:17.789790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:17.801800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b80be329-57f6-426e-9976-acb0e9b25501 req-f758fe52-5520-4639-b1d3-d84f42cc9d29 service nova] Creating event network-vif-plugged:c7bff42a-e4cf-4196-b029-addfe1727ccd for instance fb070b38-9787-40e2-a423-5bfaf571a978 on n-h1-854121-14 Oct 17 13:25:17.807915 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b80be329-57f6-426e-9976-acb0e9b25501 req-f758fe52-5520-4639-b1d3-d84f42cc9d29 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061811 Oct 17 13:25:17.818367 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1051/2172] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:18.250867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:18.266874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c58a1491-e58c-45fd-8c76-23f662939630 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1494 microversion: 2.1 time: 0.507489 Oct 17 13:25:18.286593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1122/2173] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:17 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1494 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:18.533487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:18.535889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:18.559624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.560581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.563787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.564881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.566871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.585455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.777534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:18.778726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:18.782701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:18.797839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.799880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.801317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.805475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:18.806783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:18.807281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:18.807846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:18.808769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:18.822283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed4a47d5-9cf8-4ae0-bdf7-624875cbc0b0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1266 microversion: 2.25 time: 0.294203 Oct 17 13:25:18.841601 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1052/2174] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:18 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:19.176858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:19.194840 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05663e53-3bdd-4e74-881b-cc4571461659 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 0.418324 Oct 17 13:25:19.196712 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1123/2175] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:18 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:19.292005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:19.292633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:19.302915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:19.305607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:19.306419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:19.307325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:19.310245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:19.311424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:19.833430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-50fb495a-1155-46fb-a7d1-41489c3675eb req-70b59da6-8b97-497c-b871-e504bed7dcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3c4258-846c-423b-9ea9-79739744e0b5", "name": "network-vif-plugged", "status": "completed", "tag": "79f5598d-2c0d-4af9-afd2-e89db585c8f5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:19.866726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50fb495a-1155-46fb-a7d1-41489c3675eb req-70b59da6-8b97-497c-b871-e504bed7dcd8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:19.868250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50fb495a-1155-46fb-a7d1-41489c3675eb req-70b59da6-8b97-497c-b871-e504bed7dcd8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:19.868700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50fb495a-1155-46fb-a7d1-41489c3675eb req-70b59da6-8b97-497c-b871-e504bed7dcd8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:19.916551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-50fb495a-1155-46fb-a7d1-41489c3675eb req-70b59da6-8b97-497c-b871-e504bed7dcd8 service nova] Creating event network-vif-plugged:79f5598d-2c0d-4af9-afd2-e89db585c8f5 for instance 3b3c4258-846c-423b-9ea9-79739744e0b5 on n-h2-854121-14 Oct 17 13:25:19.942482 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-50fb495a-1155-46fb-a7d1-41489c3675eb req-70b59da6-8b97-497c-b871-e504bed7dcd8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113029 Oct 17 13:25:19.943708 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1124/2176] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:19.952834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:19.954033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:19.962388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:19.963159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:19.964550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:19.965487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:19.978062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:19.979242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.389406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:20.403081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:20.404551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:20.405694 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9dceb125-9e77-4b81-b29f-e77cf55ab556 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1266 microversion: 2.25 time: 0.460150 Oct 17 13:25:20.406257 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1125/2177] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:19 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1266 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:20.428428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:20.437663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:20.451776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:20.452402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:20.452918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.453772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:20.454310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:20.465929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:20.793981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:20.804118 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80065982-8ccc-4560-9e9d-ed27f3bb28e5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1494 microversion: 2.1 time: 1.515821 Oct 17 13:25:20.805069 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1053/2178] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:19 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1494 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:21.434003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:21.434629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:21.446975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.447474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.447913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.448640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.449098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.449553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.647882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:21.659818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:21.661293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:21.663164 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fca39bb2-f9ef-4d59-9a5e-152223f82f57 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1266 microversion: 2.25 time: 0.232759 Oct 17 13:25:21.664310 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1054/2179] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:21 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:21.795616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a1321823-40b4-407f-b52f-ee3caaa5829a req-ea3c1524-4e99-455a-a618-b4a8343b623e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e8b461-e28c-47c2-afca-4120b847d953", "name": "network-vif-deleted", "tag": "09230873-4a9e-4e31-a06a-859918003885"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:21.836808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a1321823-40b4-407f-b52f-ee3caaa5829a req-ea3c1524-4e99-455a-a618-b4a8343b623e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.839604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a1321823-40b4-407f-b52f-ee3caaa5829a req-ea3c1524-4e99-455a-a618-b4a8343b623e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.840122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a1321823-40b4-407f-b52f-ee3caaa5829a req-ea3c1524-4e99-455a-a618-b4a8343b623e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.882516 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a1321823-40b4-407f-b52f-ee3caaa5829a req-ea3c1524-4e99-455a-a618-b4a8343b623e service nova] Creating event network-vif-deleted:09230873-4a9e-4e31-a06a-859918003885 for instance 27e8b461-e28c-47c2-afca-4120b847d953 on n-h1-854121-14 Oct 17 13:25:21.892147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a1321823-40b4-407f-b52f-ee3caaa5829a req-ea3c1524-4e99-455a-a618-b4a8343b623e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225941 Oct 17 13:25:21.898874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1055/2180] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:21.904580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:21.905320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:21.923985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.924428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.924837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:21.928341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:21.929361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:21.929860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:22.015710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:22.016245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:22.016683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:22.017176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lazy-loading 'fault' on Instance uuid 27e8b461-e28c-47c2-afca-4120b847d953 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:22.070940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.109830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1473b0a-15c7-4197-bc3c-cab97d47af4b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 1.696599 Oct 17 13:25:22.125353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1126/2181] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:20 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:22.147147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.163879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6b3ac92-e56a-4760-8011-6f465d5a76ad tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 200 len: 1298 microversion: 2.1 time: 0.265377 Oct 17 13:25:22.164690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1056/2182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:21 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 1298 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:22.693220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:22.693922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:22.712727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:22.713552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:22.714154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:22.715036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:22.715645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:22.716230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:22.893955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.904646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.915284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:22.916758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f247da6-d43c-4000-9846-834799919ba3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1266 microversion: 2.25 time: 0.228745 Oct 17 13:25:22.917845 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1127/2183] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:22 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:23.140982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:23.141750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:23.161938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.162431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.166298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.166922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.167408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.167845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.188565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:23.189771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:23.198971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.205919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.206745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.207872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:23.208609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:23.209318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:23.242414 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 HTTP/1.1 Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:23.244668 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:25:23.245994 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '27e8b461-e28c-47c2-afca-4120b847d953'} Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:23.246648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:25:23.247779 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:23.250262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:23.257965 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1760d06-5709-4c97-a81f-30f7147d5132 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 404 len: 111 microversion: 2.1 time: 0.073854 Oct 17 13:25:23.258823 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1128/2184] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:23 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:25:23.278904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-03f5f009-7759-48ea-b4b6-db685c7b1013 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2041c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:24.416831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:24.431384 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fde44ed1-e30e-4db5-a088-053b5b787318 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1320 microversion: 2.1 time: 1.295927 Oct 17 13:25:24.441697 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1057/2185] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:23 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1320 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:24.453637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:24.454268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:24.477014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.477759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.478317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.484754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.485651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.487705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.571337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.572412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.573076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.573844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lazy-loading 'fault' on Instance uuid ab0cc3d3-998a-4a24-b194-29cf74071bde {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:24.632616 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-03f5f009-7759-48ea-b4b6-db685c7b1013 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 204 len: 0 microversion: 2.1 time: 1.369015 Oct 17 13:25:24.635102 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1129/2186] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:23 2022] DELETE /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 0 bytes in 1372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:24.646542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:24.647409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:24.675528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.676031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.676467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.680901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:24.681409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:24.686706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:24.800192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:25.001837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:25.035187 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de20aa88-fa37-4329-9e65-8f09421410c5 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 204 len: 0 microversion: 2.1 time: 0.395240 Oct 17 13:25:25.036161 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1130/2187] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:24 2022] DELETE /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:25.099781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:25.110829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:25.118029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:25.119237 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82c025d5-3b58-4a15-bf10-7b1988c1ffe3 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 200 len: 1194 microversion: 2.25 time: 0.676464 Oct 17 13:25:25.122043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-166354240", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "de69c07b-99ae-49cb-9b55-cd78d1700008"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:25.143687 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1058/2188] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:24 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 1194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:25.235793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] validate_networks() for [('de69c07b-99ae-49cb-9b55-cd78d1700008', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:25.459065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:25.461455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:25.477650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:25.478166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:25.478617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:25.479347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:25.479807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:25.480239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.287745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:26.299765 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2c657dd-db97-4360-aded-f7e9adcbb17c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 200 len: 1508 microversion: 2.1 time: 0.847339 Oct 17 13:25:26.320588 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1059/2189] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:25 2022] GET /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 1508 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:26.327831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:26.331959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: ab0cc3d3-998a-4a24-b194-29cf74071bde] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:26.347488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:26.348262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:26.349021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.351558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:26.352277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:26.352894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.372030 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] HTTP exception thrown: Instance ab0cc3d3-998a-4a24-b194-29cf74071bde could not be found. Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Request method failure captured: Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde HTTP/1.1 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW7U36pkPQAedG9abQld3e43Gp9h_YLxHE34DDydNQo5-B4C16NneCMi1wMUSjSVavKyuiy2ONjCBQPMZyRRWWyQSajJm8iql4c7Qvp3gA7M0Hke0HuktkY016b1aj2H286FI8UTkEmL-43LDYCfJXdVc4UPTqh9qkG5vsMO3WMxH8 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:26.374793 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d9b63e4efecd4b9a96fc3b2e51f625fb Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance ab0cc3d3-998a-4a24-b194-29cf74071bde could not be found. Oct 17 13:25:26.376308 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ab0cc3d3-998a-4a24-b194-29cf74071bde'} Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab0cc3d3-998a-4a24-b194-29cf74071bde could not be found. Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:26.377250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab0cc3d3-998a-4a24-b194-29cf74071bde could not be found. Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab0cc3d3-998a-4a24-b194-29cf74071bde could not be found. Oct 17 13:25:26.378326 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:26.379428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Returning 404 to user: Instance ab0cc3d3-998a-4a24-b194-29cf74071bde could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:26.379428 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f92e8734-c846-4578-b705-81084f1a6c26 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde" status: 404 len: 111 microversion: 2.25 time: 0.054480 Oct 17 13:25:26.379428 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1060/2190] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:26 2022] GET /compute/v2.1/servers/ab0cc3d3-998a-4a24-b194-29cf74071bde => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:25:26.384421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:26.385294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: fb070b38-9787-40e2-a423-5bfaf571a978] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:26.393484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:26.394178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:26.394797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:26.395654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:26.396256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:26.396820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.079282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:27.103966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5193650d-3ba5-491c-9fa4-5d2193273118 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/fb070b38-9787-40e2-a423-5bfaf571a978" status: 200 len: 1508 microversion: 2.1 time: 0.725367 Oct 17 13:25:27.107373 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1061/2191] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:26 2022] GET /compute/v2.1/servers/fb070b38-9787-40e2-a423-5bfaf571a978 => generated 1508 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:27.139401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:27.141025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: fb070b38-9787-40e2-a423-5bfaf571a978] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:27.156331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.159505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.160310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.161936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.164883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.166497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.206812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: fb070b38-9787-40e2-a423-5bfaf571a978] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:27.378227 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00d30c01-1963-44b0-a1c1-a3e9d6cd4852 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fb070b38-9787-40e2-a423-5bfaf571a978" status: 204 len: 0 microversion: 2.1 time: 0.246294 Oct 17 13:25:27.382280 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1062/2192] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:27 2022] DELETE /compute/v2.1/servers/fb070b38-9787-40e2-a423-5bfaf571a978 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:27.393411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:27.400905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:27.419800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.420644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.421266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.422148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:27.422849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:27.423452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:27.498772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 3b3c4258-846c-423b-9ea9-79739744e0b5] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:27.573447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:27.711958 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d46165d-dae6-4c9f-bf74-00fb65c76a43 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5" status: 204 len: 0 microversion: 2.1 time: 0.323808 Oct 17 13:25:27.712876 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1063/2193] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:27 2022] DELETE /compute/v2.1/servers/3b3c4258-846c-423b-9ea9-79739744e0b5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:25:27.954982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-465345016", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "61e1e648-9939-4d0c-93cd-d82020ffaced"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:28.071169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:28.071711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:28.072966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:28.073431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:28.073852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:28.094762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:28.095671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:28.096531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:28.097694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:28.098334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:28.099256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:28.107535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] validate_networks() for [('61e1e648-9939-4d0c-93cd-d82020ffaced', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:28.125703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:28.137523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Getting quotas for user c2effa2bc1674d20a064b40849b85df1 and project d2b94b21085446509a1a52835eb4a180. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:28.176922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:28.182668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:28.335813 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d5fe4cd-0278-405c-ad7d-90df43d9139f tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.215744 Oct 17 13:25:28.341081 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1131/2194] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:28.363427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0463148-1811-454a-a7b5-bb2a45c0d181 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:28.367799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0463148-1811-454a-a7b5-bb2a45c0d181 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:28.728588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0463148-1811-454a-a7b5-bb2a45c0d181 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:28.737547 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0463148-1811-454a-a7b5-bb2a45c0d181 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1207 microversion: 2.1 time: 0.389811 Oct 17 13:25:28.740981 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1132/2195] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:28 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1207 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:29.766644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:29.768241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:29.785396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:29.786389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:29.789109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:29.792921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:29.793797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:29.794493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:30.128983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:30.142978 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31293b50-c5ff-40df-b1d7-54a68e5ef865 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1211 microversion: 2.1 time: 0.379323 Oct 17 13:25:30.145270 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1133/2196] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:29 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1211 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:30.838357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c977ab0a-fb8f-443e-ab51-67c51e213844 req-1864f164-158c-44d6-a339-6e269e645aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb070b38-9787-40e2-a423-5bfaf571a978", "name": "network-vif-deleted", "tag": "c7bff42a-e4cf-4196-b029-addfe1727ccd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:30.878792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c977ab0a-fb8f-443e-ab51-67c51e213844 req-1864f164-158c-44d6-a339-6e269e645aea service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:30.880264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c977ab0a-fb8f-443e-ab51-67c51e213844 req-1864f164-158c-44d6-a339-6e269e645aea service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:30.882955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c977ab0a-fb8f-443e-ab51-67c51e213844 req-1864f164-158c-44d6-a339-6e269e645aea service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:30.919058 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c977ab0a-fb8f-443e-ab51-67c51e213844 req-1864f164-158c-44d6-a339-6e269e645aea service nova] Creating event network-vif-deleted:c7bff42a-e4cf-4196-b029-addfe1727ccd for instance fb070b38-9787-40e2-a423-5bfaf571a978 on n-h1-854121-14 Oct 17 13:25:30.928713 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c977ab0a-fb8f-443e-ab51-67c51e213844 req-1864f164-158c-44d6-a339-6e269e645aea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094936 Oct 17 13:25:30.933928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1134/2197] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:31.172951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:31.174018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:31.195063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:31.201014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:31.203738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:31.204703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:31.206236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:31.206879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:31.729476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:31.747392 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37d708ac-c796-448d-bd15-bbdbe248f455 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1265 microversion: 2.1 time: 0.575241 Oct 17 13:25:31.748172 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1135/2198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:31 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1265 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:32.403955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-621774da-887c-4389-b5c0-34172a35f6c5 req-97cb579f-4909-4da5-ad7f-b07ca530ba47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b219db7-61f8-409b-a46e-d285774c9641", "name": "network-vif-deleted", "tag": "83b7a61b-88d8-42a1-b06e-70702f9c2b32"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:32.429550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-621774da-887c-4389-b5c0-34172a35f6c5 req-97cb579f-4909-4da5-ad7f-b07ca530ba47 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.430415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-621774da-887c-4389-b5c0-34172a35f6c5 req-97cb579f-4909-4da5-ad7f-b07ca530ba47 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.431014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-621774da-887c-4389-b5c0-34172a35f6c5 req-97cb579f-4909-4da5-ad7f-b07ca530ba47 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.454307 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-621774da-887c-4389-b5c0-34172a35f6c5 req-97cb579f-4909-4da5-ad7f-b07ca530ba47 service nova] Creating event network-vif-deleted:83b7a61b-88d8-42a1-b06e-70702f9c2b32 for instance 8b219db7-61f8-409b-a46e-d285774c9641 on n-h2-854121-14 Oct 17 13:25:32.478257 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-621774da-887c-4389-b5c0-34172a35f6c5 req-97cb579f-4909-4da5-ad7f-b07ca530ba47 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076755 Oct 17 13:25:32.482403 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1136/2199] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:32.630201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:32.630707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:32.636939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:32.637520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:32.637960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:32.660949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.661479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.661997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.663221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.663665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.664123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.706235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Getting quotas for project d36ee521e7394316bb2925e96614916f. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:32.719067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Getting quotas for user cd070a584a94493cb350e95b5911658c and project d36ee521e7394316bb2925e96614916f. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:32.750879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Going to run 2 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:32.761987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:32.775982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:32.776877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:32.800660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.805661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.807623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.809145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:32.810506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:32.810894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:32.854382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=7fe2cdfb-5a77-40fd-ba6e-192f40240f24,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:33.037273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-017e93e2-37db-44f3-8d8b-424606b23ed8 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 5.086314 Oct 17 13:25:33.056129 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1064/2200] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:27 2022] POST /compute/v2.1/servers => generated 32 bytes in 5106 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 17 13:25:33.073457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:33.152911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:33.154147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Searching by: {'deleted': False, 'project_id': 'd36ee521e7394316bb2925e96614916f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:25:33.203823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:33.206952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:33.207418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:33.208395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:33.209046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:33.210719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:33.278349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:33.287369 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a9d7daa-9fe2-4b69-ae81-a5b525b407e0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 0.517152 Oct 17 13:25:33.291283 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1137/2201] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:32 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:33.356802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:25:33.454837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa31cd6d-ab84-4841-99e8-80ffed7497af tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.394637 Oct 17 13:25:33.474446 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1065/2202] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:25:33 2022] GET /compute/v2.1/servers => generated 1003 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:33.497599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:33.498578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:33.526969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:33.528266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:33.531392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:33.532227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:33.532716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:33.540383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:33.602943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b5856d7-d85c-4d85-933c-55ac4a2b2997 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:33.641184 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b5856d7-d85c-4d85-933c-55ac4a2b2997 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.348327 Oct 17 13:25:33.657604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1138/2203] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:25:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:33.676681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:33.681132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad7b71d8-5cff-4982-a5f7-294b5642e67c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:33.683896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad7b71d8-5cff-4982-a5f7-294b5642e67c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:33.995703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad7b71d8-5cff-4982-a5f7-294b5642e67c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:34.006247 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad7b71d8-5cff-4982-a5f7-294b5642e67c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1217 microversion: 2.1 time: 0.346360 Oct 17 13:25:34.012775 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8edcf862-d1e5-46ec-85f7-37ee607fc97e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 204 len: 0 microversion: 2.25 time: 0.535458 Oct 17 13:25:34.014288 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1139/2204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:33 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:34.016179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1066/2205] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:25:33 2022] DELETE /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:25:34.033302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:34.033923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:34.070025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.070477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.071015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:34.073491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.074012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.074424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:34.315769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:34.316496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:34.331955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.332376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.332831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:34.338938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.339459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.339905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:34.859370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:34.876989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:34.882643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:34.887213 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7fe6aca2-34d0-47b5-aec2-0bbb0dd4551c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1732 microversion: 2.25 time: 0.865225 Oct 17 13:25:34.904563 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1140/2206] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:34 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1732 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:34.925820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-db41855b-7b3c-4309-85fc-b70daa9268f3 req-d290da01-0d58-430e-93ea-68fb8c8b2148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3c4258-846c-423b-9ea9-79739744e0b5", "name": "network-vif-deleted", "tag": "79f5598d-2c0d-4af9-afd2-e89db585c8f5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:34.955184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-db41855b-7b3c-4309-85fc-b70daa9268f3 req-d290da01-0d58-430e-93ea-68fb8c8b2148 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:34.956532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-db41855b-7b3c-4309-85fc-b70daa9268f3 req-d290da01-0d58-430e-93ea-68fb8c8b2148 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:34.966314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-db41855b-7b3c-4309-85fc-b70daa9268f3 req-d290da01-0d58-430e-93ea-68fb8c8b2148 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:35.005646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-db41855b-7b3c-4309-85fc-b70daa9268f3 req-d290da01-0d58-430e-93ea-68fb8c8b2148 service nova] Creating event network-vif-deleted:79f5598d-2c0d-4af9-afd2-e89db585c8f5 for instance 3b3c4258-846c-423b-9ea9-79739744e0b5 on n-h2-854121-14 Oct 17 13:25:35.020674 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-db41855b-7b3c-4309-85fc-b70daa9268f3 req-d290da01-0d58-430e-93ea-68fb8c8b2148 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113537 Oct 17 13:25:35.024226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1141/2207] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:35.039238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e157076b-7d67-41bc-a300-ed6b5e5b5ab6 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-167243386", "imageRef": "d720fa7c-3295-46a7-b8bf-07f7711323d2", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:35.091145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:35.102467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2873bf89-2e6d-461b-b862-acf0edbf6a0e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 0.791314 Oct 17 13:25:35.107797 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1067/2208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:34 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:35.131219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:35.133214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:35.137052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:35.142852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-e157076b-7d67-41bc-a300-ed6b5e5b5ab6 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:35.167632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:35.168206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:35.168664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:35.172480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:35.173245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:35.173844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:35.510738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:35.520956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-438feb36-a298-4331-9301-f0a88abdf688 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1221 microversion: 2.1 time: 0.410839 Oct 17 13:25:35.524352 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1068/2209] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:35 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1221 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:35.924835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:35.925774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:35.938111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:35.938798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:35.945446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:35.946808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:35.950001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:35.950653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:36.468913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e157076b-7d67-41bc-a300-ed6b5e5b5ab6 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e157076b-7d67-41bc-a300-ed6b5e5b5ab6 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] Request method failure captured: Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 142 Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfN0pz1Odw_Qt9r2AXAlASyECEXX5LavXT0uUJeZExaAQm7Sop438Zm8XPiw9cuhby5pS5kJtVvCSAvLuoAcOo2Auutx282id9xz7mDH8dyaVFxMB5Vc-eg1sVjW9V6t7cpQaDnBED-sxl3i5SSw0gLLTlmS04DjlhBZ4ZALOCRoHQ Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2b864a0a99cf48febc4633bd64da1dd8 Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FlavorsV2NegativeTest-1713026803 Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:36.470788 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2b864a0a99cf48febc4633bd64da1dd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b864a0a99cf48febc4633bd64da1dd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b864a0a99cf48febc4633bd64da1dd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2b864a0a99cf48febc4633bd64da1dd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FlavorsV2NegativeTest-1713026803 Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2b864a0a99cf48febc4633bd64da1dd8 Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1713026803 Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FlavorsV2NegativeTest-1713026803-project Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: e612209ac2d14f3cadb549febec8a9bc Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FlavorsV2NegativeTest-1713026803-project Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-167243386", "imageRef": "d720fa7c-3295-46a7-b8bf-07f7711323d2", "flavorRef": "452"}} Oct 17 13:25:36.472368 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor's memory is too small for requested image. Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-167243386', 'imageRef': 'd720fa7c-3295-46a7-b8bf-07f7711323d2', 'flavorRef': '452'}}} Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:36.473029 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:36.474117 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e157076b-7d67-41bc-a300-ed6b5e5b5ab6 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e157076b-7d67-41bc-a300-ed6b5e5b5ab6 tempest-FlavorsV2NegativeTest-1713026803 tempest-FlavorsV2NegativeTest-1713026803-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.444737 Oct 17 13:25:36.475956 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1142/2210] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:35 2022] POST /compute/v2.1/servers => generated 93 bytes in 1446 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:25:36.495783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:36.498654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:36.519056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:36.522349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:36.533686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:36.534657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:36.535277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:36.536338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:36.910547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:36.926450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:36.927950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:36.929773 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5090a6b5-1a1d-474e-8191-984197e2fa67 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1732 microversion: 2.25 time: 1.009018 Oct 17 13:25:36.963421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1069/2211] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:35 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1732 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:36.984286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:36.985222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:36.999839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:37.004503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:37.005408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:37.007843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:37.009744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:37.011222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:37.232396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:37.245884 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cbc9acd-4221-4f41-ad3b-de8584146791 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 0.771655 Oct 17 13:25:37.249716 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1143/2212] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:36 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:37.260841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7eaca0e7-338f-4801-a056-ce87150ec315 req-10b00ab4-bce9-4995-ac4f-f5f1c7e3d736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "328a3772-e65b-4434-8c0c-6938dcc69206", "tag": "05989507-da4b-428f-9e3e-9ab795ce90b4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:37.286352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:37.308855 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34028a0b-089d-4d27-86f7-4f0c054adf47 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1275 microversion: 2.1 time: 0.342416 Oct 17 13:25:37.312452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7eaca0e7-338f-4801-a056-ce87150ec315 req-10b00ab4-bce9-4995-ac4f-f5f1c7e3d736 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:37.313480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7eaca0e7-338f-4801-a056-ce87150ec315 req-10b00ab4-bce9-4995-ac4f-f5f1c7e3d736 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:37.314197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7eaca0e7-338f-4801-a056-ce87150ec315 req-10b00ab4-bce9-4995-ac4f-f5f1c7e3d736 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:37.325193 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1070/2213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:36 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1275 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:37.377237 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7eaca0e7-338f-4801-a056-ce87150ec315 req-10b00ab4-bce9-4995-ac4f-f5f1c7e3d736 service nova] Creating event network-changed:05989507-da4b-428f-9e3e-9ab795ce90b4 for instance 328a3772-e65b-4434-8c0c-6938dcc69206 on n-h1-854121-14 Oct 17 13:25:37.392996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7eaca0e7-338f-4801-a056-ce87150ec315 req-10b00ab4-bce9-4995-ac4f-f5f1c7e3d736 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135880 Oct 17 13:25:37.394112 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1144/2214] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:37.511995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1788074633", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "d4b54292-1717-4190-84af-7df366cdc190"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:37.650871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] validate_networks() for [('d4b54292-1717-4190-84af-7df366cdc190', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:37.988883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:37.991263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:38.007716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:38.009555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:38.010425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:38.011364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:38.012086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:38.013386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:38.443428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:39.104898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:39.123525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:39.125000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:39.126255 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c02c3a8-8606-49d2-a660-c6280bf99438 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1732 microversion: 2.25 time: 1.148993 Oct 17 13:25:39.137236 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1145/2215] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:37 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1732 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:39.157409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:39.158270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:39.174618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.175120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.175568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.176298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.176756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.177200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.797655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:39.811742 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f31c8a9-5105-4991-a98e-3c1d0f1f2fc8 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 0.672886 Oct 17 13:25:39.812392 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1146/2216] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:39 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:39.821646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:39.822633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:39.836752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.837561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.838224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.839111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.843727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.844485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.912231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:39.913510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:39.917614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:39.918383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:39.919289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:39.934946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.936314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.937012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.938065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:39.938918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:39.939578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:39.983906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Getting quotas for project 7f30f289ed3b49d7bf958763126154e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:39.996383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Getting quotas for user 6af3ccbc0a6e48288a3bc04014e81922 and project 7f30f289ed3b49d7bf958763126154e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:40.035855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:40.041248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:40.112693 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebe8f6d1-1868-46ab-a85a-acbbb3a26126 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.780821 Oct 17 13:25:40.113893 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1071/2217] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:40.155002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:40.155980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:40.172221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:40.174940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:40.181723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:40.198866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:40.202761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:40.203850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:40.691145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:40.715500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:40.716843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:40.728057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52cf99fd-3ac4-4d9e-9e26-0608bba19989 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 200 len: 1665 microversion: 2.25 time: 0.577226 Oct 17 13:25:40.760337 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1072/2218] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:40 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 1665 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:40.769036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-78006258", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "d4b54292-1717-4190-84af-7df366cdc190"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:40.869040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] validate_networks() for [('d4b54292-1717-4190-84af-7df366cdc190', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:40.888242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:40.897821 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc62f985-d74c-44af-af73-a76290d06e05 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 1.083023 Oct 17 13:25:40.902874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1147/2219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:39 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:40.917646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1ad6627d-99bc-4dc6-9481-d62c59304dde req-806f4e03-b63d-41f5-a9f4-dfb1549f920a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d428abc-b9a2-4d64-8f09-26a50e66508b", "name": "network-vif-deleted", "tag": "02dbf2c9-b939-4f06-afc1-f39e8fd74372"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:40.937194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ad6627d-99bc-4dc6-9481-d62c59304dde req-806f4e03-b63d-41f5-a9f4-dfb1549f920a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:40.954056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ad6627d-99bc-4dc6-9481-d62c59304dde req-806f4e03-b63d-41f5-a9f4-dfb1549f920a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:40.954714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ad6627d-99bc-4dc6-9481-d62c59304dde req-806f4e03-b63d-41f5-a9f4-dfb1549f920a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:40.995141 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1ad6627d-99bc-4dc6-9481-d62c59304dde req-806f4e03-b63d-41f5-a9f4-dfb1549f920a service nova] Creating event network-vif-deleted:02dbf2c9-b939-4f06-afc1-f39e8fd74372 for instance 5d428abc-b9a2-4d64-8f09-26a50e66508b on n-h2-854121-14 Oct 17 13:25:41.009947 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1ad6627d-99bc-4dc6-9481-d62c59304dde req-806f4e03-b63d-41f5-a9f4-dfb1549f920a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104244 Oct 17 13:25:41.010840 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1148/2220] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:41.029005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:41.040424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:41.058577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:41.059269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:41.059901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:41.061438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:41.065189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:41.065812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:41.474309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:41.487322 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-941406f6-3f19-48e0-aa46-aff3a3a52d21 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 0.471786 Oct 17 13:25:41.489000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1149/2221] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:41 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:41.840431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b19fe6d2-a55b-4a59-b0a5-dbedeeafdcc4 tempest-ListImagesTestJSON-383958519 tempest-ListImagesTestJSON-383958519-project] Calling method '.version_select at 0x7f41a1fed670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:41.931979 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b19fe6d2-a55b-4a59-b0a5-dbedeeafdcc4 tempest-ListImagesTestJSON-383958519 tempest-ListImagesTestJSON-383958519-project] 10.222.0.65 "GET /compute/v2.1/images/db51f7c1-415a-4ea9-94a7-afd34c3636cd" status: 200 len: 784 microversion: 2.1 time: 0.441652 Oct 17 13:25:41.932639 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1150/2222] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:25:41 2022] GET /compute/v2.1/images/db51f7c1-415a-4ea9-94a7-afd34c3636cd => generated 784 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:41.961543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:41.962798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 5d428abc-b9a2-4d64-8f09-26a50e66508b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:41.971585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:41.972333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:41.973035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:41.974215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:41.976243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:41.976886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:41.999026 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] HTTP exception thrown: Instance 5d428abc-b9a2-4d64-8f09-26a50e66508b could not be found. Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Request method failure captured: Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b HTTP/1.1 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVW7U36pkPQAedG9abQld3e43Gp9h_YLxHE34DDydNQo5-B4C16NneCMi1wMUSjSVavKyuiy2ONjCBQPMZyRRWWyQSajJm8iql4c7Qvp3gA7M0Hke0HuktkY016b1aj2H286FI8UTkEmL-43LDYCfJXdVc4UPTqh9qkG5vsMO3WMxH8 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:42.001999 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d9b63e4efecd4b9a96fc3b2e51f625fb Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5d428abc-b9a2-4d64-8f09-26a50e66508b could not be found. Oct 17 13:25:42.003437 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5d428abc-b9a2-4d64-8f09-26a50e66508b'} Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d428abc-b9a2-4d64-8f09-26a50e66508b could not be found. Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:42.004193 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d428abc-b9a2-4d64-8f09-26a50e66508b could not be found. Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d428abc-b9a2-4d64-8f09-26a50e66508b could not be found. Oct 17 13:25:42.005492 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:42.011723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Returning 404 to user: Instance 5d428abc-b9a2-4d64-8f09-26a50e66508b could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:42.013729 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f3157d8-46db-40f4-92fc-e467764fa845 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b" status: 404 len: 111 microversion: 2.25 time: 0.065635 Oct 17 13:25:42.014963 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1151/2223] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:41 2022] GET /compute/v2.1/servers/5d428abc-b9a2-4d64-8f09-26a50e66508b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:25:42.021451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:42.022934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:42.032073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:42.032965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:42.033624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:42.034560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:42.035162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:42.035981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:42.618673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:42.628954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9bce498-2a2b-4052-ade0-aed78ab7def7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.612585 Oct 17 13:25:42.634887 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1152/2224] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:42 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:42.644750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5221e8f-5ea1-4e36-9d8c-b43047272c63 tempest-ListImagesTestJSON-383958519 tempest-ListImagesTestJSON-383958519-project] Calling method '.version_select at 0x7f41a1fedd30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:42.776522 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5221e8f-5ea1-4e36-9d8c-b43047272c63 tempest-ListImagesTestJSON-383958519 tempest-ListImagesTestJSON-383958519-project] 10.222.0.65 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.140034 Oct 17 13:25:42.777111 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1153/2225] 10.222.0.65 () {58 vars in 1122 bytes} [Mon Oct 17 13:25:42 2022] GET /compute/v2.1/images => generated 445 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:42.806042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7efd93e-646d-4d63-8fec-98fbe7220cd1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '.version_select at 0x7f41a2083160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:42.848451 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7efd93e-646d-4d63-8fec-98fbe7220cd1 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638427564" status: 204 len: 0 microversion: 2.25 time: 0.051764 Oct 17 13:25:42.855865 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1154/2226] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638427564 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:25:42.860985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:42.877007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:42.879047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:42.890035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:42.890526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:42.890962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:42.891737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:42.892185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:42.892606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:42.997344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:42.997828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:42.998223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:42.998909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:42.999528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:43.016793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.017546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.019715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.024525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.025254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.026763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.078869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Getting quotas for project 7f30f289ed3b49d7bf958763126154e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:43.098630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Getting quotas for user 6af3ccbc0a6e48288a3bc04014e81922 and project 7f30f289ed3b49d7bf958763126154e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:43.124241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:43.126484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:43.222518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a61213eb-5b88-44a0-b360-aab14e07220b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.460684 Oct 17 13:25:43.240010 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1073/2227] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:43.251351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccc25f59-9e2f-4318-8131-e76799015ac7 tempest-ListImagesTestJSON-383958519 tempest-ListImagesTestJSON-383958519-project] Calling method '.version_select at 0x7f41a1ff5b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:43.284071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:43.324309 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ef1fcf5-f7fa-4952-8e40-6128713dbb41 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 0.467147 Oct 17 13:25:43.335316 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1155/2228] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:42 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:43.385593 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ccc25f59-9e2f-4318-8131-e76799015ac7 tempest-ListImagesTestJSON-383958519 tempest-ListImagesTestJSON-383958519-project] 10.222.0.65 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.144279 Oct 17 13:25:43.390445 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1074/2229] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:25:43 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:43.656306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:43.656931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:43.669855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.675458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.677449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1586748634", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "451", "networks": [{"uuid": "d4b54292-1717-4190-84af-7df366cdc190"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:43.679536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.680631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:43.681119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:43.681574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:43.827955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] validate_networks() for [('d4b54292-1717-4190-84af-7df366cdc190', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:44.001511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:44.375752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:44.409725 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2093d6ee-86d4-440f-b9f3-269476419d9b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.757558 Oct 17 13:25:44.414310 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1156/2230] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:43 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:44.427492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:44.429602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:44.453660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:44.457271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:44.457821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:44.459567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:44.461083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:44.462774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.570122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:45.571115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:45.571738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:45.572648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:45.573224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:45.585800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.586627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.587284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.588616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.589467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.590563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.613214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Getting quotas for project 7f30f289ed3b49d7bf958763126154e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:45.621692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Getting quotas for user 6af3ccbc0a6e48288a3bc04014e81922 and project 7f30f289ed3b49d7bf958763126154e9. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:45.641976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:45.645690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:45.650547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:45.671048 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c770447f-5458-4597-8138-3fb0ce0fac11 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 1.253276 Oct 17 13:25:45.689512 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1157/2231] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:44 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:45.701224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:45.701887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:45.710789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.712574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.713090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.714097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:45.714788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:45.715537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:45.733677 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3d9ec47-8c8a-4547-9ccf-70cad54c2ad7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.064568 Oct 17 13:25:45.734814 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1075/2232] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:25:45.748732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b76658c1-6a88-4097-9dc2-823317aeef91 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:45.749744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b76658c1-6a88-4097-9dc2-823317aeef91 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:46.208571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b76658c1-6a88-4097-9dc2-823317aeef91 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:46.218068 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b76658c1-6a88-4097-9dc2-823317aeef91 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1221 microversion: 2.1 time: 0.474669 Oct 17 13:25:46.221491 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1076/2233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:45 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1221 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:46.639911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:46.640488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:46.651671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:46.654255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:46.655868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:46.657835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:46.660150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:46.661646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:46.680060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:46.702814 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d2633f9-4830-47c7-9cdb-effe9ce1e0c1 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 1.015834 Oct 17 13:25:46.713217 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1158/2234] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:45 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:46.726687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:46.727176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:46.734782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:46.735355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:46.735701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:46.736586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:46.737101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:46.738031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:46.743690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:46.754257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:46.987041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-689d080f-1ae1-4f5e-97a7-404a10dcd8e0 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 204 len: 0 microversion: 2.25 time: 0.349087 Oct 17 13:25:46.993379 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1077/2235] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:25:46 2022] DELETE /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:25:47.562875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-62bf7e06-1247-46cb-a49b-0758d3acb034 req-d6ad8cef-de3b-4893-949c-c9943a8bf871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328a3772-e65b-4434-8c0c-6938dcc69206", "name": "network-vif-plugged", "status": "completed", "tag": "05989507-da4b-428f-9e3e-9ab795ce90b4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:47.578461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62bf7e06-1247-46cb-a49b-0758d3acb034 req-d6ad8cef-de3b-4893-949c-c9943a8bf871 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:47.579235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62bf7e06-1247-46cb-a49b-0758d3acb034 req-d6ad8cef-de3b-4893-949c-c9943a8bf871 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:47.579866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62bf7e06-1247-46cb-a49b-0758d3acb034 req-d6ad8cef-de3b-4893-949c-c9943a8bf871 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:47.602766 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-62bf7e06-1247-46cb-a49b-0758d3acb034 req-d6ad8cef-de3b-4893-949c-c9943a8bf871 service nova] Creating event network-vif-plugged:05989507-da4b-428f-9e3e-9ab795ce90b4 for instance 328a3772-e65b-4434-8c0c-6938dcc69206 on n-h1-854121-14 Oct 17 13:25:47.638567 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-62bf7e06-1247-46cb-a49b-0758d3acb034 req-d6ad8cef-de3b-4893-949c-c9943a8bf871 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.643090 Oct 17 13:25:47.639625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1078/2236] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:47.648218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:47.649651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:47.668084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:47.668530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:47.669600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:47.670661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:47.671924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:47.672953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.460671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:48.475458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7c83928-7620-45cb-971f-d9194b7ba793 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1307 microversion: 2.1 time: 1.770001 Oct 17 13:25:48.479146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1159/2237] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:46 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1307 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:48.495407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:48.503198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:48.565326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.566448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.569444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.575582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.576484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.579217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.754586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:48.777690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:48.779658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:48.781341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e1aaeaf-b98a-43be-8bdb-36438c56135d tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1548 microversion: 2.25 time: 1.140170 Oct 17 13:25:48.783065 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1079/2238] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:47 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1548 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:48.798430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:48.799049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:48.822940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.824077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.824620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:48.825464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:48.826077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:48.827236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:49.150876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:49.166342 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-794a5959-d1d0-4f02-a9a6-2c8660ea2e4e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1279 microversion: 2.1 time: 0.680361 Oct 17 13:25:49.181944 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1160/2239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:48 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1279 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:49.181944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-efd11feb-d4bc-4aa4-a6f8-fd9f41c274b0 req-a6bd0a99-ac0d-4644-be06-3afe2e680a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0927f93d-d1ed-4be0-a68d-59777ff26fe0", "tag": "e316b4c0-9796-4aae-8427-85dd2d16810c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:49.197612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-efd11feb-d4bc-4aa4-a6f8-fd9f41c274b0 req-a6bd0a99-ac0d-4644-be06-3afe2e680a45 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:49.198113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-efd11feb-d4bc-4aa4-a6f8-fd9f41c274b0 req-a6bd0a99-ac0d-4644-be06-3afe2e680a45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:49.198562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-efd11feb-d4bc-4aa4-a6f8-fd9f41c274b0 req-a6bd0a99-ac0d-4644-be06-3afe2e680a45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:49.226610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-efd11feb-d4bc-4aa4-a6f8-fd9f41c274b0 req-a6bd0a99-ac0d-4644-be06-3afe2e680a45 service nova] Creating event network-changed:e316b4c0-9796-4aae-8427-85dd2d16810c for instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 on n-h2-854121-14 Oct 17 13:25:49.239256 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-efd11feb-d4bc-4aa4-a6f8-fd9f41c274b0 req-a6bd0a99-ac0d-4644-be06-3afe2e680a45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068316 Oct 17 13:25:49.239857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1161/2240] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:49.770858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-550690011", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "d4ff0526-b003-47f9-93d8-605ee1e9d79c"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:49.859482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] validate_networks() for [('d4ff0526-b003-47f9-93d8-605ee1e9d79c', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:50.264289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:50.279412 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a1f308b-dc06-42b0-aad7-4b6360f39ce7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 1.495149 Oct 17 13:25:50.281832 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1080/2241] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:48 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:50.300100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-10fc3025-c91d-416a-b663-4b748a895808 req-68fcfe16-029b-40f7-a242-31ab3006c3fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fe2cdfb-5a77-40fd-ba6e-192f40240f24", "tag": "5e3b6742-b019-4f17-ba1d-1f89ece416a3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:50.330883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10fc3025-c91d-416a-b663-4b748a895808 req-68fcfe16-029b-40f7-a242-31ab3006c3fd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:50.331468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10fc3025-c91d-416a-b663-4b748a895808 req-68fcfe16-029b-40f7-a242-31ab3006c3fd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:50.331974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10fc3025-c91d-416a-b663-4b748a895808 req-68fcfe16-029b-40f7-a242-31ab3006c3fd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:50.352297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-10fc3025-c91d-416a-b663-4b748a895808 req-68fcfe16-029b-40f7-a242-31ab3006c3fd service nova] Creating event network-changed:5e3b6742-b019-4f17-ba1d-1f89ece416a3 for instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 on n-h1-854121-14 Oct 17 13:25:50.360421 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-10fc3025-c91d-416a-b663-4b748a895808 req-68fcfe16-029b-40f7-a242-31ab3006c3fd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077147 Oct 17 13:25:50.361966 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1081/2242] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:50.371543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:50.372458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:50.388933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:50.390195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:50.391343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:50.393959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:50.394631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:50.395331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:50.429876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:51.155635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:51.183854 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4877cf91-2fa7-496a-9dad-89275844431a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1487 microversion: 2.1 time: 0.819474 Oct 17 13:25:51.185242 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1082/2243] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:50 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1487 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:51.219297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:51.220618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:51.231838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.232683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.233361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.236682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.237482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.238484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.489070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:51.502241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:51.508879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:51.510218 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35e28704-5fbf-4c27-bcbf-15f3058ce72e tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 200 len: 1506 microversion: 2.25 time: 0.315654 Oct 17 13:25:51.525190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1083/2244] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:51 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:51.526388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:51.527064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:51.544351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:51.545472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:51.546283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:51.546699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.547117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:51.547302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.547894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:51.549402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.550334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.550806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.551232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.565960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.566709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.567376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.569086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:51.569926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:51.570584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:51.600108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Getting quotas for project 8f9ef8693b8b4c28b5186422a6c104c3. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:51.634257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Getting quotas for user c288455d66584d91868c588e2879432c and project 8f9ef8693b8b4c28b5186422a6c104c3. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:51.669507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:51.672247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:51.817646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e1ff884-418b-46e9-9d29-ad3135985c59 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.573138 Oct 17 13:25:51.820707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1162/2245] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:51.900612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:51.919849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67ee1d31-51fa-4136-bff0-7504ebaa758e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.404426 Oct 17 13:25:51.920464 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1084/2246] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:51 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:52.096020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1507896414", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:52.158451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b6f231d-5214-4c3b-aa77-b3ee3083370f tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Action: 'create', calling method: .version_select at 0x7f41a1f9ad30>, body: {"keypair": {"name": "tempest-keypair-1042667201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKttHl4vSJBByZu/rh/jqv5LN9223VL+4k2zccHYJAd1r8pJaitN6M7Vvw/MiTLf6WEaCZ82jMAoz1vJo9QZOta4G60TcriVsBUBlWexlp0MOcfT46DdlLa/SIz6RPhltA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:52.181832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:25:52.225584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8b6f231d-5214-4c3b-aa77-b3ee3083370f tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:52.237196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8b6f231d-5214-4c3b-aa77-b3ee3083370f tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for user 88a1158dbe724f55bc97bc1c3dacf2df and project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:52.305677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b6f231d-5214-4c3b-aa77-b3ee3083370f tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.483236 Oct 17 13:25:52.307220 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1163/2247] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:52.317102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-873876910"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:52.329474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:52.348232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.349561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.354060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:52.355153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.356131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.357078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:52.866844 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d3ebc5a-e87c-44f8-9d7e-615c58429fbf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "POST /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206/action" status: 202 len: 0 microversion: 2.1 time: 0.544843 Oct 17 13:25:52.867715 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1164/2248] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:25:52 2022] POST /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206/action => generated 0 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:25:52.900307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:52.901251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:52.931926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.932672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.933345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:52.934257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:52.934930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:52.935547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.195135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:25:53.195639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:25:53.197198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:25:53.197635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:25:53.198409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:25:53.217850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.218320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.218790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.219691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.220363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.223412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.260097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:53.270953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:53.276903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for user fec0e15aae5c4bf996ee4b8a98a496e2 and project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:53.277906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d13bcfae-407e-4979-a21c-68e4d9dd227b tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.401457 Oct 17 13:25:53.278824 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1165/2249] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:52 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.284254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e5c3962c-b812-45f7-af25-e9629685cc26 req-b1c9e2e3-39b3-402a-9909-721f5591f92a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d3ea40f-54a7-4185-9cee-459f289abf28", "name": "network-vif-deleted", "tag": "186d7cf2-0816-4f4a-bc90-ca4d191d66ba"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:53.307314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:25:53.310333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:25:53.312988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e5c3962c-b812-45f7-af25-e9629685cc26 req-b1c9e2e3-39b3-402a-9909-721f5591f92a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.316636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e5c3962c-b812-45f7-af25-e9629685cc26 req-b1c9e2e3-39b3-402a-9909-721f5591f92a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.317750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e5c3962c-b812-45f7-af25-e9629685cc26 req-b1c9e2e3-39b3-402a-9909-721f5591f92a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.349309 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e5c3962c-b812-45f7-af25-e9629685cc26 req-b1c9e2e3-39b3-402a-9909-721f5591f92a service nova] Creating event network-vif-deleted:186d7cf2-0816-4f4a-bc90-ca4d191d66ba for instance 2d3ea40f-54a7-4185-9cee-459f289abf28 on n-h1-854121-14 Oct 17 13:25:53.377264 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e5c3962c-b812-45f7-af25-e9629685cc26 req-b1c9e2e3-39b3-402a-9909-721f5591f92a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096736 Oct 17 13:25:53.377915 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1166/2250] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:53.386026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.389466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:53.402860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.404871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.405569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.406523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.407136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.407587 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab8bb131-af88-49a0-8ad7-f7730fc7fc00 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.485959 Oct 17 13:25:53.407894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.408760 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1085/2251] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:25:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:25:53.414549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c1233b2-1063-4970-9c01-c5ac117eb379 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a1fde310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.426799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c1233b2-1063-4970-9c01-c5ac117eb379 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs/tempest-keypair-1042667201" status: 200 len: 498 microversion: 2.1 time: 0.016600 Oct 17 13:25:53.435261 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1086/2252] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1042667201 => generated 498 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:53.441369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-909a8fa0-5df5-497f-bc4b-869636917b3e req-34793881-4f43-443b-834a-4695ad3fdf7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a230025f-977a-4bf7-a561-c6e69dfb11bb", "tag": "34cd6a64-f4c4-45b7-bd0a-d4209e5076d3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:53.447426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:53.479358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-909a8fa0-5df5-497f-bc4b-869636917b3e req-34793881-4f43-443b-834a-4695ad3fdf7d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.480139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-909a8fa0-5df5-497f-bc4b-869636917b3e req-34793881-4f43-443b-834a-4695ad3fdf7d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.480720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-909a8fa0-5df5-497f-bc4b-869636917b3e req-34793881-4f43-443b-834a-4695ad3fdf7d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.496989 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-909a8fa0-5df5-497f-bc4b-869636917b3e req-34793881-4f43-443b-834a-4695ad3fdf7d service nova] Creating event network-changed:34cd6a64-f4c4-45b7-bd0a-d4209e5076d3 for instance a230025f-977a-4bf7-a561-c6e69dfb11bb on n-h1-854121-14 Oct 17 13:25:53.504708 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-909a8fa0-5df5-497f-bc4b-869636917b3e req-34793881-4f43-443b-834a-4695ad3fdf7d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067729 Oct 17 13:25:53.509015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1087/2253] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:53.516297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.517547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: 2d3ea40f-54a7-4185-9cee-459f289abf28] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:53.529609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:53.531402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.532633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.533306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.535310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.537706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.538621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.540094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e43b0be-61d2-429e-aab1-2a31a8c168fb tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1219 microversion: 2.1 time: 0.159145 Oct 17 13:25:53.540877 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1167/2254] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.546462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e975f9bf-69cb-4382-9ee7-60c2b60692be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a1f9a430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.598834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] HTTP exception thrown: Instance 2d3ea40f-54a7-4185-9cee-459f289abf28 could not be found. Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Request method failure captured: Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 HTTP/1.1 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW7U36pkPQAedG9abQld3e43Gp9h_YLxHE34DDydNQo5-B4C16NneCMi1wMUSjSVavKyuiy2ONjCBQPMZyRRWWyQSajJm8iql4c7Qvp3gA7M0Hke0HuktkY016b1aj2H286FI8UTkEmL-43LDYCfJXdVc4UPTqh9qkG5vsMO3WMxH8 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:53.600955 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d9b63e4efecd4b9a96fc3b2e51f625fb Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 2d3ea40f-54a7-4185-9cee-459f289abf28 could not be found. Oct 17 13:25:53.602246 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2d3ea40f-54a7-4185-9cee-459f289abf28'} Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d3ea40f-54a7-4185-9cee-459f289abf28 could not be found. Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:53.602939 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d3ea40f-54a7-4185-9cee-459f289abf28 could not be found. Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d3ea40f-54a7-4185-9cee-459f289abf28 could not be found. Oct 17 13:25:53.604030 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:53.605094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Returning 404 to user: Instance 2d3ea40f-54a7-4185-9cee-459f289abf28 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:53.605723 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3349ad3-b35c-43df-af6f-f1176e687130 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28" status: 404 len: 111 microversion: 2.25 time: 0.094755 Oct 17 13:25:53.609982 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1088/2255] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/servers/2d3ea40f-54a7-4185-9cee-459f289abf28 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:25:53.616873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.617966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:53.626385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.627080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.627710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.629429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.629904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.630328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.632318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e975f9bf-69cb-4382-9ee7-60c2b60692be tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444" status: 200 len: 1411 microversion: 2.1 time: 0.089951 Oct 17 13:25:53.633654 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1168/2256] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.651712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d8c6478-af05-4aee-99ae-25d656648ed5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.652340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d8c6478-af05-4aee-99ae-25d656648ed5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:53.730709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d8c6478-af05-4aee-99ae-25d656648ed5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:53.746606 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d8c6478-af05-4aee-99ae-25d656648ed5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1213 microversion: 2.1 time: 0.111615 Oct 17 13:25:53.761583 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1169/2257] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.766665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52732d12-54f5-4ef1-94d8-3ff92443915b tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a2041700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.799818 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52732d12-54f5-4ef1-94d8-3ff92443915b tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042667201" status: 202 len: 0 microversion: 2.1 time: 0.036870 Oct 17 13:25:53.809482 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1170/2258] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:25:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1042667201 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:53.815415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.816116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:53.824033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.824784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.825428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.826289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:53.826908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:53.827567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:53.854785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:53.866459 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-104e881b-9b34-4a66-ad9b-724cc441f557 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.253844 Oct 17 13:25:53.867434 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1089/2259] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.889076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-714cd1bf-b7fe-4c02-b496-cca0f0fdd12e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419dfa5310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:53.892752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:53.976557 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-714cd1bf-b7fe-4c02-b496-cca0f0fdd12e tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444" status: 200 len: 1411 microversion: 2.1 time: 0.107513 Oct 17 13:25:53.977506 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1090/2260] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:25:53 2022] GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:53.983519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b09eb80b-1cf0-487a-805a-c00db03b4a14 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Action: 'create', calling method: .version_select at 0x7f41a1fad790>, body: {"keypair": {"name": "tempest-keypair-1920701803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLCRy1aP6JjUpT51HbfBco8u4ZexVWc690rH1Em1KB2tx/z6M9XMF34RQoVbZF96sGDZ2cOE/0R6ox8K02rAl59mT6ClTf43qFqCVoY5/H7DLplKUF0+HEdtk4lPmncOuQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:54.005535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b09eb80b-1cf0-487a-805a-c00db03b4a14 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:54.013054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b09eb80b-1cf0-487a-805a-c00db03b4a14 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for user 88a1158dbe724f55bc97bc1c3dacf2df and project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:54.050465 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b09eb80b-1cf0-487a-805a-c00db03b4a14 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071316 Oct 17 13:25:54.051623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1091/2261] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:54.060718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0137c053-fd8f-4078-bcd8-9439c5315c75 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a1fadd30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.062020 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b4e7608-505d-477a-be0c-e100268a82e7 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 204 len: 0 microversion: 2.25 time: 0.249038 Oct 17 13:25:54.063624 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1171/2262] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:25:53 2022] DELETE /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:25:54.075913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54cadca6-bc23-4fb1-8b76-4b772b762aec tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a2031790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.114227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54cadca6-bc23-4fb1-8b76-4b772b762aec tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920701803" status: 202 len: 0 microversion: 2.1 time: 0.049155 Oct 17 13:25:54.119648 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1172/2263] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920701803 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:54.126235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.140340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.153676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.154612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.155375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.157789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.159443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.161344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.266035 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0137c053-fd8f-4078-bcd8-9439c5315c75 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444" status: 204 len: 0 microversion: 2.1 time: 0.212875 Oct 17 13:25:54.269731 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1092/2264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] DELETE /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:54.272286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2e07611-a64e-4a94-acb4-caeefb1fd5b6 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Action: 'create', calling method: .version_select at 0x7f419dfa5ca0>, body: {"keypair": {"name": "tempest-keypair-274974723", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:54.289368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c2e07611-a64e-4a94-acb4-caeefb1fd5b6 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:54.294613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c2e07611-a64e-4a94-acb4-caeefb1fd5b6 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for user 88a1158dbe724f55bc97bc1c3dacf2df and project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:54.314721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.321569 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2e07611-a64e-4a94-acb4-caeefb1fd5b6 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.053606 Oct 17 13:25:54.322265 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1093/2265] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:54 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:54.323883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.325361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.326516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eec34bfd-80e1-46e0-acb9-55db889b0a9c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1564 microversion: 2.25 time: 0.205208 Oct 17 13:25:54.332116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27790d2a-ccbd-4198-9ef3-94270cf4ef06 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2025160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.332268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1173/2266] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:54.332268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.332268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.339028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.339519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.339961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.340665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.341361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.341577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.375559 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-27790d2a-ccbd-4198-9ef3-94270cf4ef06 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Image not found. Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27790d2a-ccbd-4198-9ef3-94270cf4ef06 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 HTTP/1.1 Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:54.377634 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '302cf9bd-f81a-4303-bb7a-a1d8738d2444'} Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:54.378869 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 302cf9bd-f81a-4303-bb7a-a1d8738d2444 Oct 17 13:25:54.379692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:25:54.380774 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 302cf9bd-f81a-4303-bb7a-a1d8738d2444 could not be found. Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:54.382780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27790d2a-ccbd-4198-9ef3-94270cf4ef06 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:54.385682 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27790d2a-ccbd-4198-9ef3-94270cf4ef06 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444" status: 404 len: 62 microversion: 2.1 time: 0.055792 Oct 17 13:25:54.387450 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1094/2267] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:25:54.391577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c7c6a975-bad0-4074-8e72-65c302611180 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f419e15c1f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.421508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c7c6a975-bad0-4074-8e72-65c302611180 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274974723" status: 202 len: 0 microversion: 2.1 time: 0.040423 Oct 17 13:25:54.422413 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1095/2268] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:25:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274974723 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:54.427521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.430119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.441066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.441884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.442497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.444255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.445462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.446106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.714244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.721908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.722113 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d76130a-e6fd-4435-824f-365b512e81c7 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.393771 Oct 17 13:25:54.722693 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1174/2269] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:54.727888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f25442d6-1c98-46ec-aa3c-0b2222bb870e tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Action: 'create', calling method: .version_select at 0x7f41a1f9aa60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-544000703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDsScUmRe72kyUoG6p8FioHPo5Cay1TGahEEaZDUw1sPt4qiePSy+AkxMVdVTWJZ3MjRElvqDtSTYD6rB1zO1EJBlMT4EE2q3ByeGwePOOCsl46qcrmLs4cI8lMA6AxZg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:54.730970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f48bf0cf-c309-417c-9ac3-0efc9a95d211 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1505 microversion: 2.1 time: 0.307424 Oct 17 13:25:54.731620 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1096/2270] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1505 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:54.736380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.737251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.744003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.744503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.744941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.745772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.746147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f25442d6-1c98-46ec-aa3c-0b2222bb870e tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:54.746257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.746642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.751436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f25442d6-1c98-46ec-aa3c-0b2222bb870e tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for user 88a1158dbe724f55bc97bc1c3dacf2df and project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:54.782357 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f25442d6-1c98-46ec-aa3c-0b2222bb870e tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.058302 Oct 17 13:25:54.783431 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1175/2271] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:54.790969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4e1cf22a-0234-4a4b-8015-5ea697b2e693 req-a54f49d3-836e-4b91-98d1-8d37ab432500 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe2cdfb-5a77-40fd-ba6e-192f40240f24", "name": "network-vif-plugged", "status": "completed", "tag": "5e3b6742-b019-4f17-ba1d-1f89ece416a3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:54.802061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4e1cf22a-0234-4a4b-8015-5ea697b2e693 req-a54f49d3-836e-4b91-98d1-8d37ab432500 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.802554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4e1cf22a-0234-4a4b-8015-5ea697b2e693 req-a54f49d3-836e-4b91-98d1-8d37ab432500 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.803370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4e1cf22a-0234-4a4b-8015-5ea697b2e693 req-a54f49d3-836e-4b91-98d1-8d37ab432500 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.814646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4e1cf22a-0234-4a4b-8015-5ea697b2e693 req-a54f49d3-836e-4b91-98d1-8d37ab432500 service nova] Creating event network-vif-plugged:5e3b6742-b019-4f17-ba1d-1f89ece416a3 for instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 on n-h1-854121-14 Oct 17 13:25:54.820212 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4e1cf22a-0234-4a4b-8015-5ea697b2e693 req-a54f49d3-836e-4b91-98d1-8d37ab432500 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033735 Oct 17 13:25:54.820996 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1176/2272] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:54.826236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.826976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.833566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.834655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.835098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.836165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.836689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.837308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.845264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.855041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c18322c-24db-41d0-8a65-38b1d47a582d tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1267 microversion: 2.1 time: 0.122038 Oct 17 13:25:54.856120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1097/2273] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1267 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:54.860932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1cd473b0-6f23-427e-896c-59677b2b5ef4 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Action: 'create', calling method: .version_select at 0x7f41a1ff5280>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-762691812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMBQrdpUD0nF5UfL2RABjzR3kOdK7cDrbI3q2rk5L/2po2ZQP3yXRAoYvG+439Hd+puLJ95V7e4JFFztkR0wh2+0R+3MR+K/8VgF6iAKHBHaBoaOZI7/2CJkGCYEwkFtMQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:54.912459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1cd473b0-6f23-427e-896c-59677b2b5ef4 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:54.930957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1cd473b0-6f23-427e-896c-59677b2b5ef4 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for user 88a1158dbe724f55bc97bc1c3dacf2df and project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:54.942923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:54.954651 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c74b6166-8f05-42db-96bc-0ee381bfc6cf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1209 microversion: 2.1 time: 0.132488 Oct 17 13:25:54.957096 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1177/2274] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1209 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:54.973035 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1cd473b0-6f23-427e-896c-59677b2b5ef4 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.115673 Oct 17 13:25:54.976069 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1098/2275] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:54.977615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:54.978537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:54.990677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39ed3de1-125f-486d-b031-c06281096d51 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Action: 'create', calling method: .version_select at 0x7f41a1f921f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-287234294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJqHjvXO1JYmNUJS08EG8oBkVL0r2V/biixydyOwmvWMv+OZaASdgDyiYMel08Ojv+BqyGZNYR54iOG+8Auu9H2BqrU9V90JG/ywEMGM0XPdERj987m5ZdLlVh1UWm5WA=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:54.997414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:54.997974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:54.998423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:54.999181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.016246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.016724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.070627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-39ed3de1-125f-486d-b031-c06281096d51 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:55.085264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-39ed3de1-125f-486d-b031-c06281096d51 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Getting quotas for user 88a1158dbe724f55bc97bc1c3dacf2df and project 66b12427e498420dbaf6f0874651db3b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:55.141636 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39ed3de1-125f-486d-b031-c06281096d51 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.155388 Oct 17 13:25:55.143161 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1099/2276] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:54 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:25:55.154529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5290257-2340-4ec5-85fb-fc6c063842dd tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a1f92550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.160601 n-d-854121-14 devstack@n-api.service[120697]: WARNING oslo_db.sqlalchemy.utils [None req-d5290257-2340-4ec5-85fb-fc6c063842dd tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:25:55.168259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5290257-2340-4ec5-85fb-fc6c063842dd tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.018031 Oct 17 13:25:55.169644 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1100/2277] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:25:55 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:55.184090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba801fd9-3257-4254-afb5-0be777c2cd9c tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a1fad8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.226029 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba801fd9-3257-4254-afb5-0be777c2cd9c tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-287234294" status: 202 len: 0 microversion: 2.1 time: 0.048984 Oct 17 13:25:55.227518 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1101/2278] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-287234294 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:55.236477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-570663bf-39ac-42f4-87ed-4a55752400a0 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a1fdeca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.264163 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-570663bf-39ac-42f4-87ed-4a55752400a0 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-762691812" status: 202 len: 0 microversion: 2.1 time: 0.032329 Oct 17 13:25:55.267971 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1102/2279] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-762691812 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:55.275214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9aecdae9-e4ea-4495-ba8a-4bb4d58c1664 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] Calling method '.version_select at 0x7f41a1fe7700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.305188 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9aecdae9-e4ea-4495-ba8a-4bb4d58c1664 tempest-KeyPairsV2TestJSON-1407470977 tempest-KeyPairsV2TestJSON-1407470977-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-544000703" status: 202 len: 0 microversion: 2.1 time: 0.035362 Oct 17 13:25:55.309826 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1103/2280] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:25:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-544000703 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:25:55.357631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.358224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:55.366180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.366693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.367173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.368341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.369205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.370012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.459989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:55.471374 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbc36f38-ef6a-4667-9fa8-df8e5e8c928b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.504168 Oct 17 13:25:55.471919 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1178/2281] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:54 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:55.481860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d3c827e1-a0da-4521-84c5-2c7357c50d31 req-159482b1-16b5-420a-a35c-ba96612089b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb856c7-aefc-4336-8fce-9ca16f6501ef", "tag": "8c4b10bb-641a-4c5d-b189-7f04fd8da087"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:55.499225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3c827e1-a0da-4521-84c5-2c7357c50d31 req-159482b1-16b5-420a-a35c-ba96612089b6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.499820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3c827e1-a0da-4521-84c5-2c7357c50d31 req-159482b1-16b5-420a-a35c-ba96612089b6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.500325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3c827e1-a0da-4521-84c5-2c7357c50d31 req-159482b1-16b5-420a-a35c-ba96612089b6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.525641 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d3c827e1-a0da-4521-84c5-2c7357c50d31 req-159482b1-16b5-420a-a35c-ba96612089b6 service nova] Creating event network-changed:8c4b10bb-641a-4c5d-b189-7f04fd8da087 for instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef on n-h2-854121-14 Oct 17 13:25:55.531145 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d3c827e1-a0da-4521-84c5-2c7357c50d31 req-159482b1-16b5-420a-a35c-ba96612089b6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056675 Oct 17 13:25:55.532000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1179/2282] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:55.607461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:55.644567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:55.646281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:55.653590 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48d80239-4f69-4b4c-a0e5-8fc20017a812 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1564 microversion: 2.25 time: 0.301670 Oct 17 13:25:55.654550 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1104/2283] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:55 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1564 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:55.750981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.752592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:55.754712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:55.755329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:55.766270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.766746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.772875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.775813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.777239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.782850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.786325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.794876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.795831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:55.802067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:55.804213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:55.805720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.148922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.162210 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1bc63e18-b491-4b08-ba2d-0a1b6a82560c tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.417652 Oct 17 13:25:56.163445 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1180/2284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:55 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.170885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:56.172094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.176172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.190740 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c85cf7d-64d2-4f45-8612-da9b59d83bdd tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1505 microversion: 2.1 time: 0.438958 Oct 17 13:25:56.195088 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1105/2285] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:55 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.215708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.216209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.216655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.217398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.219902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.220205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:56.220498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.220840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.227456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.227947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.228387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.229095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.229578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.230004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.302531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.313408 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edefa7ca-8b36-40e1-9d49-f008afe74a0b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1275 microversion: 2.1 time: 0.147814 Oct 17 13:25:56.314335 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1181/2286] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.320725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-83539742-7d61-401f-8fa8-4baa033dd35f req-940cfd06-e2da-4183-b35e-547c2f4d0388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2e370f9-ef51-4a16-af3a-97a277a88a0a", "tag": "77f7e214-6e82-4a54-9b0c-cca3792bfe07"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:56.331418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-83539742-7d61-401f-8fa8-4baa033dd35f req-940cfd06-e2da-4183-b35e-547c2f4d0388 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.332103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-83539742-7d61-401f-8fa8-4baa033dd35f req-940cfd06-e2da-4183-b35e-547c2f4d0388 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.332535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-83539742-7d61-401f-8fa8-4baa033dd35f req-940cfd06-e2da-4183-b35e-547c2f4d0388 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.335832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.337108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:56.345738 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-83539742-7d61-401f-8fa8-4baa033dd35f req-940cfd06-e2da-4183-b35e-547c2f4d0388 service nova] Creating event network-changed:77f7e214-6e82-4a54-9b0c-cca3792bfe07 for instance d2e370f9-ef51-4a16-af3a-97a277a88a0a on n-h1-854121-14 Oct 17 13:25:56.348157 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6260949b-a86d-441e-8622-28714606f254 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1265 microversion: 2.1 time: 0.138079 Oct 17 13:25:56.353358 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1106/2287] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.353533 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-83539742-7d61-401f-8fa8-4baa033dd35f req-940cfd06-e2da-4183-b35e-547c2f4d0388 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035521 Oct 17 13:25:56.353533 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1182/2288] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:56.495588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:56.496204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.510831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.511862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.512316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.513069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.518143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.518802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.685847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:56.686825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:56.688989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:56.695530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.696295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.696923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.698796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:56.699456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:56.700067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:56.719801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.737109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94ab8768-4c57-41d8-a334-c47441b35582 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.246305 Oct 17 13:25:56.749273 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1107/2289] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:56.876050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.918484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.921817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:56.924036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8dfaae90-9705-4677-9aa8-07c98d709856 tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1522 microversion: 2.25 time: 0.244580 Oct 17 13:25:56.925153 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1183/2290] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:56 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:25:57.186761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.187785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.194408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.194992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.195463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.196245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.196803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.198110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.221211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.221648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.228891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.229416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.230295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.231305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.231954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.232569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.444016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:57.460278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:57.471206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b41b25f9-8175-4a73-8a02-881036780dfd tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.288672 Oct 17 13:25:57.477833 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1108/2291] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:57.480173 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3f97e22-6f25-4916-9b13-46c6fa820c47 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1487 microversion: 2.1 time: 0.263121 Oct 17 13:25:57.485119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.486657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.498876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.500042 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1184/2292] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1487 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:57.506553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.507298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.508553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.509201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.509935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.513487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.514223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.523153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.523700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.524152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.524899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.525406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.526023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.606159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:57.626268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:57.630088 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-93bdd299-68f1-4b3b-9658-1d87e406e738 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1275 microversion: 2.1 time: 0.150035 Oct 17 13:25:57.635782 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12fe18c9-8bbe-4068-83db-5ea4e81ed4f4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1265 microversion: 2.1 time: 0.134561 Oct 17 13:25:57.636363 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1185/2293] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:57.642294 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1109/2294] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1275 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:57.658430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.658940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.665598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.666088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.666695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.667410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.667866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.668307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.698136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:57.789377 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed14fb3b-ab11-4487-87fd-ccd7947ec19a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 204 len: 0 microversion: 2.1 time: 0.150261 Oct 17 13:25:57.790322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1186/2295] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:57 2022] DELETE /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:57.796151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.797262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:57.805821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.806320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.807051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.807824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.808209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.808631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.825148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdbaeb49-7cd6-42be-af8b-145fddbfd79f tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a20484c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZ4iCm4BQB4qMPUIjYTaqf8Wi2fqUtwGnws2vTmBabSNoYAokUukWtW+SWiKYZ2UyaKIjC4q7YYgopsUy2bFkasfGKJ/V9Cq5LZtORz7MlfmzzWa4bzhav47lTRX9epA=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdbaeb49-7cd6-42be-af8b-145fddbfd79f tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 257 Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:57.829309 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:57.830549 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZ4iCm4BQB4qMPUIjYTaqf8Wi2fqUtwGnws2vTmBabSNoYAokUukWtW+SWiKYZ2UyaKIjC4q7YYgopsUy2bFkasfGKJ/V9Cq5LZtORz7MlfmzzWa4bzhav47lTRX9epA=="}} Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMZ4iCm4BQB4qMPUIjYTaqf8Wi2fqUtwGnws2vTmBabSNoYAokUukWtW+SWiKYZ2UyaKIjC4q7YYgopsUy2bFkasfGKJ/V9Cq5LZtORz7MlfmzzWa4bzhav47lTRX9epA=='}}} Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.831157 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:57.832178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:25:57.833444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:25:57.835667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 17 13:25:57.835667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.836565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdbaeb49-7cd6-42be-af8b-145fddbfd79f tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:57.840057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cdbaeb49-7cd6-42be-af8b-145fddbfd79f tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.154859 Oct 17 13:25:57.840642 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1110/2296] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:57 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:25:57.855278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4cbdaa77-ba23-4bb5-9538-d5d0109c5d34 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a2025ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:57.894701 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-4cbdaa77-ba23-4bb5-9538-d5d0109c5d34 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Image not found. Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4cbdaa77-ba23-4bb5-9538-d5d0109c5d34 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 HTTP/1.1 Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:57.897789 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '302cf9bd-f81a-4303-bb7a-a1d8738d2444'} Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:57.899096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 302cf9bd-f81a-4303-bb7a-a1d8738d2444 to delete Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.899856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 302cf9bd-f81a-4303-bb7a-a1d8738d2444 could not be found. Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:57.900898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4cbdaa77-ba23-4bb5-9538-d5d0109c5d34 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4cbdaa77-ba23-4bb5-9538-d5d0109c5d34 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444" status: 404 len: 62 microversion: 2.1 time: 0.057009 Oct 17 13:25:57.902120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1111/2297] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] DELETE /compute/v2.1/images/302cf9bd-f81a-4303-bb7a-a1d8738d2444 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:25:57.909010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8a897575-2638-4fcd-9be8-49927c021fc0 req-f659fda8-c9d9-4d30-b970-89ce15d3c2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0927f93d-d1ed-4be0-a68d-59777ff26fe0", "name": "network-vif-plugged", "status": "completed", "tag": "e316b4c0-9796-4aae-8427-85dd2d16810c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:57.947442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8a897575-2638-4fcd-9be8-49927c021fc0 req-f659fda8-c9d9-4d30-b970-89ce15d3c2e0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:57.948094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8a897575-2638-4fcd-9be8-49927c021fc0 req-f659fda8-c9d9-4d30-b970-89ce15d3c2e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:57.948538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8a897575-2638-4fcd-9be8-49927c021fc0 req-f659fda8-c9d9-4d30-b970-89ce15d3c2e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:57.964216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8a897575-2638-4fcd-9be8-49927c021fc0 req-f659fda8-c9d9-4d30-b970-89ce15d3c2e0 service nova] Creating event network-vif-plugged:e316b4c0-9796-4aae-8427-85dd2d16810c for instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 on n-h2-854121-14 Oct 17 13:25:57.969624 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8a897575-2638-4fcd-9be8-49927c021fc0 req-f659fda8-c9d9-4d30-b970-89ce15d3c2e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066835 Oct 17 13:25:57.970229 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1112/2298] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:57.979122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a1ff53a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-175551044", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:57.994060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=49 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:57.996882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:58.004110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for user a92321ee06df498dad0c9128edd926fb and project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:58.025732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.043231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 2166 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-175551044", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:58.044632 n-d-854121-14 devstack@n-api.service[120697]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-175551044', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.046830 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5884b414-74c7-48f3-95a4-fe184a59aa48 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.071882 Oct 17 13:25:58.050055 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1113/2299] 10.222.0.65 () {60 vars in 1160 bytes} [Mon Oct 17 13:25:57 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:25:58.053335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.054124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.055825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ead65f62-3f43-4145-a5e1-00e91a3a9a7a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.263731 Oct 17 13:25:58.056692 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1187/2300] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:57 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:58.056789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:58.062846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.063334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.063772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.064481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.064933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.065391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.069691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.070612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.077379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.077875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.078312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.079012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.079462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.079886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.095237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:25:58.143183 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Instance is already in deleting state, ignoring this request Oct 17 13:25:58.144014 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53a2b15a-384e-4d81-b08a-e9015c3a1117 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 204 len: 0 microversion: 2.1 time: 0.096260 Oct 17 13:25:58.144585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1114/2301] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:25:58 2022] DELETE /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:25:58.149208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.150228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9476ddb7-d636-45c5-a48b-5f5535e63bc4 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a1fe7040>, body: {"keypair": {"name": "tempest-keypair-1856457898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQiEPngQ+RtyNVlWfSViTVp9pXp2z7S0N9jh9T6RXwuWJXOaftO0ijCsTXKBo9odUoHTI6YVVIp4y9y5iLXFBt34Jsd2Isnz8f5lAZJdECUywW6cxJwSsY2I4AcpKKhg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.157652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.159102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.160272 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f814868-808c-4a23-94a2-ba7b8e471fab tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1522 microversion: 2.25 time: 0.102547 Oct 17 13:25:58.160999 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1188/2302] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1522 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:58.165864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9476ddb7-d636-45c5-a48b-5f5535e63bc4 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:58.170908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9476ddb7-d636-45c5-a48b-5f5535e63bc4 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for user a92321ee06df498dad0c9128edd926fb and project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:58.175075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.175692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.181989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.182490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.182924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.183626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.184085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.184515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.195504 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9476ddb7-d636-45c5-a48b-5f5535e63bc4 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049884 Oct 17 13:25:58.196124 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1115/2303] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:58.210286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a216baf0>, body: {"keypair": {"name": "tempest-keypair-1856457898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcgZcuY+s2F8NtOBCawAMO2+0aHEtkvgRst7ipxUaQF0a6ub7Q/Oc4EQN6PWrWd6Z9n92MisDExy7IyJSCOjj4ZZE8XcvpN/cLW5DqH2jDIJCKLYiApqAAfR4WYOKukZw=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.226699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:58.232312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for user a92321ee06df498dad0c9128edd926fb and project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:58.254748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] HTTP exception thrown: Key pair 'tempest-keypair-1856457898' already exists. Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 273 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "tempest-keypair-1856457898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcgZcuY+s2F8NtOBCawAMO2+0aHEtkvgRst7ipxUaQF0a6ub7Q/Oc4EQN6PWrWd6Z9n92MisDExy7IyJSCOjj4ZZE8XcvpN/cLW5DqH2jDIJCKLYiApqAAfR4WYOKukZw=="}} Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: exception: Key pair 'tempest-keypair-1856457898' already exists. Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1856457898', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcgZcuY+s2F8NtOBCawAMO2+0aHEtkvgRst7ipxUaQF0a6ub7Q/Oc4EQN6PWrWd6Z9n92MisDExy7IyJSCOjj4ZZE8XcvpN/cLW5DqH2jDIJCKLYiApqAAfR4WYOKukZw=='}}} Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'a92321ee06df498dad0c9128edd926fb-tempest-keypair-1856457898' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 13:25:58.261103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi session.flush() Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result.read() Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 17 13:25:58.264682 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'a92321ee06df498dad0c9128edd926fb-tempest-keypair-1856457898' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 17, 13, 25, 58, 248507), 'updated_at': None, 'name': 'tempest-keypair-1856457898', 'user_id': 'a92321ee06df498dad0c9128edd926fb', 'fingerprint': '52:16:3f:31:0c:74:41:2d:da:f5:be:dc:81:c5:e6:a4', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcgZcuY+s2F8NtOBCawAMO2+0aHEtkvgRst7ipxUaQF0a6ub7Q/Oc4EQN6PWrWd6Z9n92MisDExy7IyJSCOjj4ZZE8XcvpN/cLW5DqH2jDIJCKLYiApqAAfR4WYOKukZw==', 'type': 'ssh'}] Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi keypair.create() Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._create() Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1856457898' already exists. Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 17 13:25:58.267658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1856457898' already exists. Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1856457898' already exists. Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 409 to user: Key pair 'tempest-keypair-1856457898' already exists. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12e547a0-4023-46e4-8e75-93747eab68a7 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.056906 Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1116/2304] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:25:58.278566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27474967-1ae4-4c1b-989b-d7700e59aeeb tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Calling method '.version_select at 0x7f41a1fc7160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.291682 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27474967-1ae4-4c1b-989b-d7700e59aeeb tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856457898" status: 202 len: 0 microversion: 2.1 time: 0.024307 Oct 17 13:25:58.292314 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1117/2305] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:25:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856457898 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:25:58.304725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2db96e91-2625-426a-b6e7-262b17fb5a79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a2048550>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH65/MZ/w0rrZPt4VD8FCE7gJ8TEnCHIizBM1tPfj+nf3hoY1ep/r0SxtBjOb/Qf3Zczg95oedem2FLFFa/COPp7qgSKxP28AtgQM0h8xuxVu/j8Mg16N2YmTS3T/LjIqg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2db96e91-2625-426a-b6e7-262b17fb5a79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 247 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH65/MZ/w0rrZPt4VD8FCE7gJ8TEnCHIizBM1tPfj+nf3hoY1ep/r0SxtBjOb/Qf3Zczg95oedem2FLFFa/COPp7qgSKxP28AtgQM0h8xuxVu/j8Mg16N2YmTS3T/LjIqg=="}} Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH65/MZ/w0rrZPt4VD8FCE7gJ8TEnCHIizBM1tPfj+nf3hoY1ep/r0SxtBjOb/Qf3Zczg95oedem2FLFFa/COPp7qgSKxP28AtgQM0h8xuxVu/j8Mg16N2YmTS3T/LjIqg=='}}} Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '' Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:25:58.308496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2db96e91-2625-426a-b6e7-262b17fb5a79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2db96e91-2625-426a-b6e7-262b17fb5a79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009747 Oct 17 13:25:58.312651 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1118/2306] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:25:58.319796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a1f94820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-870460762", "public_key": " "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.326842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.335425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54b0a52f-dcd9-4294-bd13-61517f30018a tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1493 microversion: 2.1 time: 0.164420 Oct 17 13:25:58.336008 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1189/2307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1493 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:58.349350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:58.349350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for user a92321ee06df498dad0c9128edd926fb and project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:58.358253 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 94 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-870460762", "public_key": " "}} Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-870460762', 'public_key': ' '}}} Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.360088 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c819da85-1842-49d2-b9a2-d3443a04c110 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.045968 Oct 17 13:25:58.364989 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1119/2308] 10.222.0.65 () {60 vars in 1158 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:25:58.375177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5fe5d7bc-8150-4c09-a486-fed6e2e3981e req-036205c2-8d2c-41e5-a1bc-ea47d3976560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7695663-7195-438d-be05-5c0e52665c89", "name": "network-vif-deleted", "tag": "40da2ef7-39de-495c-ad80-f595dfbf584a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.376645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9c64bd1-3596-4842-b5fa-f8cdcfa1d77c tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a1f941f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/fvTXk6xOgeTP/msohbYMzHBmFu9rnQdpy+tX7AubSO8K5UrW0v0SGQgfcgpJmWJWO1KN43mSZrzFVZYybosymfSfuZbW1EAOm3CtEq7X6Q+xYlyl7eSKSoLH7OHnENg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9c64bd1-3596-4842-b5fa-f8cdcfa1d77c tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 507 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/fvTXk6xOgeTP/msohbYMzHBmFu9rnQdpy+tX7AubSO8K5UrW0v0SGQgfcgpJmWJWO1KN43mSZrzFVZYybosymfSfuZbW1EAOm3CtEq7X6Q+xYlyl7eSKSoLH7OHnENg=="}} Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/fvTXk6xOgeTP/msohbYMzHBmFu9rnQdpy+tX7AubSO8K5UrW0v0SGQgfcgpJmWJWO1KN43mSZrzFVZYybosymfSfuZbW1EAOm3CtEq7X6Q+xYlyl7eSKSoLH7OHnENg=='}}} Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 17 13:25:58.380491 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9c64bd1-3596-4842-b5fa-f8cdcfa1d77c tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9c64bd1-3596-4842-b5fa-f8cdcfa1d77c tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.010504 Oct 17 13:25:58.384188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1120/2309] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:25:58.388009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5fe5d7bc-8150-4c09-a486-fed6e2e3981e req-036205c2-8d2c-41e5-a1bc-ea47d3976560 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.388009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5fe5d7bc-8150-4c09-a486-fed6e2e3981e req-036205c2-8d2c-41e5-a1bc-ea47d3976560 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.388009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5fe5d7bc-8150-4c09-a486-fed6e2e3981e req-036205c2-8d2c-41e5-a1bc-ea47d3976560 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.392106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Action: 'create', calling method: .version_select at 0x7f41a2025ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1747450557", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:58.398370 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5fe5d7bc-8150-4c09-a486-fed6e2e3981e req-036205c2-8d2c-41e5-a1bc-ea47d3976560 service nova] Creating event network-vif-deleted:40da2ef7-39de-495c-ad80-f595dfbf584a for instance f7695663-7195-438d-be05-5c0e52665c89 on n-h2-854121-14 Oct 17 13:25:58.403331 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5fe5d7bc-8150-4c09-a486-fed6e2e3981e req-036205c2-8d2c-41e5-a1bc-ea47d3976560 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Oct 17 13:25:58.404113 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1190/2310] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:25:58.408599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:25:58.414040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Getting quotas for user a92321ee06df498dad0c9128edd926fb and project 37c52faacdc645ddade4c3fd9e84ed4f. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:25:58.430306 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 118 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1747450557", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: exception: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1747450557', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 17 13:25:58.432181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-082a081c-904c-4d3e-8797-12bdfd443892 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.045167 Oct 17 13:25:58.436056 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1121/2311] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:25:58 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 17 13:25:58.445123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c5fb61a-7d44-4465-9891-d81e39377d79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Calling method '.version_select at 0x7f41a2064ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.457292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2c5fb61a-7d44-4465-9891-d81e39377d79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-765120234 not found for user a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c5fb61a-7d44-4465-9891-d81e39377d79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Request method failure captured: Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-765120234 HTTP/1.1 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfleiEczB6qD7ks2ffMU8604Dp_2ho0wGnIwrRIfyJwDycxhOa3m5XpXamavmvD_YZTc7KORvZ4Yz7D5AIK9fZVb9Nc5mPbLusGrG1eUi3Lo-9SxYK9k5ER4CZdOl__95veLvpfuxxA3KfjWwHigkrcyu1ljyTC4G9Vkx9v5wfys6E Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37c52faacdc645ddade4c3fd9e84ed4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 37c52faacdc645ddade4c3fd9e84ed4f Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-490283127 Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-KeyPairsNegativeTestJSON-490283127-project Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: exception: Keypair tempest-keypair-non-existent-765120234 not found for user a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'tempest-keypair-non-existent-765120234'} Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-765120234 not found for user a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.459867 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-765120234 not found for user a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-765120234 not found for user a92321ee06df498dad0c9128edd926fb Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c5fb61a-7d44-4465-9891-d81e39377d79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] Returning 404 to user: Keypair tempest-keypair-non-existent-765120234 not found for user a92321ee06df498dad0c9128edd926fb {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:25:58.464138 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c5fb61a-7d44-4465-9891-d81e39377d79 tempest-KeyPairsNegativeTestJSON-490283127 tempest-KeyPairsNegativeTestJSON-490283127-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-765120234" status: 404 len: 144 microversion: 2.1 time: 0.021751 Oct 17 13:25:58.468000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1191/2312] 10.222.0.65 () {58 vars in 1257 bytes} [Mon Oct 17 13:25:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-765120234 => generated 144 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:25:58.507441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.508344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.514931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.515505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.516013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.516791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.517341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.517839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.666125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.672321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.690634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.691459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.699150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.701848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.704128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.704842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.715356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:58.727475 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37820c15-24b6-4b7d-bb9e-d7bb68ef082a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.224916 Oct 17 13:25:58.728410 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1122/2313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:58.744586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:58.747787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:58.765631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.767124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.769461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.770298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:58.774286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:58.789428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:58.804001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:25:59.063295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.071747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e6c0c54-3bd5-4f3b-beba-e548fd0d1d75 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1265 microversion: 2.1 time: 0.414598 Oct 17 13:25:59.072928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1192/2314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:25:59.079393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:25:59.082211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:59.089626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.090465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.091124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.092024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.092636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.093258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.143094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.156729 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6641e992-f793-4228-9235-7d1911878b86 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1275 microversion: 2.1 time: 0.423289 Oct 17 13:25:59.158051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1123/2315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:58 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1275 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:59.172865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:59.173812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:59.187407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.187906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.188340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.189046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.189547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.189968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.233926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90c96a29-3e8d-47fc-8901-94252e0e87ae tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.159403 Oct 17 13:25:59.238131 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1193/2316] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:25:59 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:25:59.253408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:59.254346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:59.271700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.273425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.273890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.277838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.278561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.279041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.353694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.353694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.353694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.354504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lazy-loading 'fault' on Instance uuid f7695663-7195-438d-be05-5c0e52665c89 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:25:59.453243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.465897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.468943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.470827 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96ee9f6f-0ce7-4335-961d-b802ccce136c tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1351 microversion: 2.25 time: 0.231285 Oct 17 13:25:59.471848 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1194/2317] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:25:59 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1351 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:25:59.477986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:59.478917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:59.485833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.486640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.487370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.488557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.489272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.489917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.603390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.614285 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b44e315-2841-4057-a06d-4d71f3a941a2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.454879 Oct 17 13:25:59.632260 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1124/2318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:59 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:59.642389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:59.643035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:59.650758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.651734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.652179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.652938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.653593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.654177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.863368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:25:59.875928 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fa7786e-c885-4aa0-b0fe-773d13f6ee39 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1673 microversion: 2.1 time: 0.402559 Oct 17 13:25:59.876943 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1195/2319] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:59 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1673 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:25:59.883212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:25:59.884083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:25:59.891884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.892608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.893057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:25:59.893939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:25:59.894316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:25:59.894717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.040170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.053037 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1833fc16-85e4-4ba8-a138-d748067af4ba tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1493 microversion: 2.1 time: 0.418066 Oct 17 13:26:00.053681 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1125/2320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:59 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1493 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.059269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c2db1f2f-696d-4897-b571-6a00c1bc989d req-3e27eaa9-4366-44ec-9b61-cb47b135942f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a230025f-977a-4bf7-a561-c6e69dfb11bb", "name": "network-vif-plugged", "status": "completed", "tag": "34cd6a64-f4c4-45b7-bd0a-d4209e5076d3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:00.073374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c2db1f2f-696d-4897-b571-6a00c1bc989d req-3e27eaa9-4366-44ec-9b61-cb47b135942f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.074149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c2db1f2f-696d-4897-b571-6a00c1bc989d req-3e27eaa9-4366-44ec-9b61-cb47b135942f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.074752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c2db1f2f-696d-4897-b571-6a00c1bc989d req-3e27eaa9-4366-44ec-9b61-cb47b135942f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.090977 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c2db1f2f-696d-4897-b571-6a00c1bc989d req-3e27eaa9-4366-44ec-9b61-cb47b135942f service nova] Creating event network-vif-plugged:34cd6a64-f4c4-45b7-bd0a-d4209e5076d3 for instance a230025f-977a-4bf7-a561-c6e69dfb11bb on n-h1-854121-14 Oct 17 13:26:00.097081 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c2db1f2f-696d-4897-b571-6a00c1bc989d req-3e27eaa9-4366-44ec-9b61-cb47b135942f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041195 Oct 17 13:26:00.103922 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1126/2321] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:00.109728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.110494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.118297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.119050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.119576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.120697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.132480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.133603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.251451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.259907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2b9094a-4f2d-4c2b-b087-07bb1d29bd71 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1317 microversion: 2.1 time: 0.381725 Oct 17 13:26:00.260494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1196/2322] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:25:59 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.281555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.281555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.289067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.289596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.290479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.291732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.292389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.292871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.324417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.337724 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99791c2d-9d59-4321-8c06-d1989b17c7a7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1265 microversion: 2.1 time: 0.231027 Oct 17 13:26:00.342694 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1127/2323] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.498144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.498860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.523558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.525557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.525557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.528339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.529447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.532933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.565125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.579490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d2d7e49-f27f-432e-a900-ee3f7ff8a552 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.308955 Oct 17 13:26:00.592340 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1197/2324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:00.597101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.597626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.598071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.598517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lazy-loading 'fault' on Instance uuid f7695663-7195-438d-be05-5c0e52665c89 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:00.645914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.646651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.654188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.655146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.656758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.657924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.665947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.666702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.666918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.679197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:00.681336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.683347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9b63e4efecd4b9a96fc3b2e51f625fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e454a0d18b54711bc621a802aaa239c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.684561 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4be4fd49-40ca-47c3-b170-c1905aed9a8a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 200 len: 1351 microversion: 2.25 time: 0.190873 Oct 17 13:26:00.685766 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1128/2325] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 1351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:00.900762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:00.901848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:00.932081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.937094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.937094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.938546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:00.938546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:00.938546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:00.966389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:00.976001 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29e023e5-c0b5-4c32-8b4b-46ae1c7ba159 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.333909 Oct 17 13:26:00.981595 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1198/2326] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:01.077992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:01.079187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:01.086357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.087196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.087792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.088714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.089447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.090028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.452417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2effa2bc1674d20a064b40849b85df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b94b21085446509a1a52835eb4a180', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:01.503824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ca0a69a-1962-4f39-8537-2ce268857742 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 200 len: 1451 microversion: 2.1 time: 0.429933 Oct 17 13:26:01.507085 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1199/2327] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:01 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 1451 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:01.515064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:01.520065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:01.540995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.549299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.550233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.551221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.551944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.553119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.604975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:01.797354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:01.809196 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ee3ddfc-7c15-408f-98b3-2d6a653f75ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1673 microversion: 2.1 time: 0.913124 Oct 17 13:26:01.810412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1129/2328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:00 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1673 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:01.815498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:01.816332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:01.823256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.823978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.824588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:01.825734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:01.826340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:01.826917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.339196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:02.352286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d56d7949-2518-4e8c-a02a-0d825c467c96 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1271 microversion: 2.1 time: 0.540546 Oct 17 13:26:02.353977 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1130/2329] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:01 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1271 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:02.361265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e8ebba28-7153-45e3-8457-fea796a7590e req-d5089026-ed65-465b-a4f2-192f18d0afdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "328a3772-e65b-4434-8c0c-6938dcc69206", "name": "network-vif-deleted", "tag": "05989507-da4b-428f-9e3e-9ab795ce90b4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:02.370440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:02.384309 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f387af8-15f4-479f-a99b-bf761cefdcf5 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1504 microversion: 2.1 time: 0.875863 Oct 17 13:26:02.399132 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1200/2330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:01 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1504 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:02.404328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e8ebba28-7153-45e3-8457-fea796a7590e req-d5089026-ed65-465b-a4f2-192f18d0afdd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.410991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:02.410991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:02.416448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e8ebba28-7153-45e3-8457-fea796a7590e req-d5089026-ed65-465b-a4f2-192f18d0afdd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.417116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e8ebba28-7153-45e3-8457-fea796a7590e req-d5089026-ed65-465b-a4f2-192f18d0afdd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.439417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.445013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e8ebba28-7153-45e3-8457-fea796a7590e req-d5089026-ed65-465b-a4f2-192f18d0afdd service nova] Creating event network-vif-deleted:05989507-da4b-428f-9e3e-9ab795ce90b4 for instance 328a3772-e65b-4434-8c0c-6938dcc69206 on n-h1-854121-14 Oct 17 13:26:02.446981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.448077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.451053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.453056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.453553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.464732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e8ebba28-7153-45e3-8457-fea796a7590e req-d5089026-ed65-465b-a4f2-192f18d0afdd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106205 Oct 17 13:26:02.466254 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1131/2331] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:02.478940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:02.485153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] [instance: f7695663-7195-438d-be05-5c0e52665c89] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:02.497920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.498613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.502334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.503304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.504479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.506712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.548357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] HTTP exception thrown: Instance f7695663-7195-438d-be05-5c0e52665c89 could not be found. Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Request method failure captured: Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 HTTP/1.1 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVW7U36pkPQAedG9abQld3e43Gp9h_YLxHE34DDydNQo5-B4C16NneCMi1wMUSjSVavKyuiy2ONjCBQPMZyRRWWyQSajJm8iql4c7Qvp3gA7M0Hke0HuktkY016b1aj2H286FI8UTkEmL-43LDYCfJXdVc4UPTqh9qkG5vsMO3WMxH8 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.25 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0e454a0d18b54711bc621a802aaa239c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0e454a0d18b54711bc621a802aaa239c Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-384726890 Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d9b63e4efecd4b9a96fc3b2e51f625fb Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-384726890-project Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f7695663-7195-438d-be05-5c0e52665c89 could not be found. Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'f7695663-7195-438d-be05-5c0e52665c89'} Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7695663-7195-438d-be05-5c0e52665c89 could not be found. Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7695663-7195-438d-be05-5c0e52665c89 could not be found. Oct 17 13:26:02.556451 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7695663-7195-438d-be05-5c0e52665c89 could not be found. Oct 17 13:26:02.560444 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:02.562971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] Returning 404 to user: Instance f7695663-7195-438d-be05-5c0e52665c89 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:02.569263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c71f6e96-0214-4d1e-9ab0-329c1a3aca4a tempest-LiveAutoBlockMigrationV225Test-384726890 tempest-LiveAutoBlockMigrationV225Test-384726890-project] 10.222.0.65 "GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89" status: 404 len: 111 microversion: 2.25 time: 0.100101 Oct 17 13:26:02.570268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1132/2332] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:02 2022] GET /compute/v2.1/servers/f7695663-7195-438d-be05-5c0e52665c89 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:26:02.579459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:02.580348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:02.589836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.590677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.591390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.592384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:02.593452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:02.594782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:02.997581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.014700 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de928e0f-ff3f-423b-8243-bfa3aaa575f0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.612347 Oct 17 13:26:03.017485 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1201/2333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:02 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:03.034775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.036800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.046924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.048067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.050350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.051432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.053926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.054871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.081038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.090675 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03f29ce8-1f18-4290-b2c6-60bc843e861f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.519126 Oct 17 13:26:03.105952 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1133/2334] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:02 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:03.111017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.111813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 328a3772-e65b-4434-8c0c-6938dcc69206] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.127652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.128409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.129034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.129922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.131041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.131705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.149779 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 328a3772-e65b-4434-8c0c-6938dcc69206 could not be found. Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 HTTP/1.1 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 328a3772-e65b-4434-8c0c-6938dcc69206 could not be found. Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '328a3772-e65b-4434-8c0c-6938dcc69206'} Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 328a3772-e65b-4434-8c0c-6938dcc69206 could not be found. Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 328a3772-e65b-4434-8c0c-6938dcc69206 could not be found. Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.151932 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.155888 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:03.155888 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:03.155888 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:03.155888 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:03.155888 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 328a3772-e65b-4434-8c0c-6938dcc69206 could not be found. Oct 17 13:26:03.155888 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.157675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 328a3772-e65b-4434-8c0c-6938dcc69206 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:03.159256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c107f5b6-b247-47c0-ae82-23c7b7684f10 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206" status: 404 len: 111 microversion: 2.1 time: 0.052003 Oct 17 13:26:03.160081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1134/2335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/328a3772-e65b-4434-8c0c-6938dcc69206 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:03.166059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.166981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.173867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.174644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.175319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.176248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.176966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.177670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.237019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:03.558545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.570008 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7222e18-6515-4198-964a-7b9f9362aa02 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24" status: 200 len: 1505 microversion: 2.1 time: 0.551065 Oct 17 13:26:03.571168 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1202/2336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:03.575823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ed73c9ba-3d36-44f1-9710-9082c96065d9 req-d2e5cdf2-8b0a-4618-a3b2-0fa374f79635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e370f9-ef51-4a16-af3a-97a277a88a0a", "name": "network-vif-plugged", "status": "completed", "tag": "77f7e214-6e82-4a54-9b0c-cca3792bfe07"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:03.587727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed73c9ba-3d36-44f1-9710-9082c96065d9 req-d2e5cdf2-8b0a-4618-a3b2-0fa374f79635 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.588647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed73c9ba-3d36-44f1-9710-9082c96065d9 req-d2e5cdf2-8b0a-4618-a3b2-0fa374f79635 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.590594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed73c9ba-3d36-44f1-9710-9082c96065d9 req-d2e5cdf2-8b0a-4618-a3b2-0fa374f79635 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.617026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.642553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12ad86b2-9a7d-40fc-945e-1afb02726e3a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1678 microversion: 2.1 time: 0.481052 Oct 17 13:26:03.644043 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ed73c9ba-3d36-44f1-9710-9082c96065d9 req-d2e5cdf2-8b0a-4618-a3b2-0fa374f79635 service nova] Creating event network-vif-plugged:77f7e214-6e82-4a54-9b0c-cca3792bfe07 for instance d2e370f9-ef51-4a16-af3a-97a277a88a0a on n-h1-854121-14 Oct 17 13:26:03.645967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1135/2337] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1678 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:03.656699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.657973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.660296 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ed73c9ba-3d36-44f1-9710-9082c96065d9 req-d2e5cdf2-8b0a-4618-a3b2-0fa374f79635 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087590 Oct 17 13:26:03.664102 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1203/2338] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:03.702568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.714834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.715581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.716177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.718950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.720896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.731722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.732498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.743610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.745006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.749598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.753967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.755623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.758955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.782668 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 HTTP/1.1 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '27e8b461-e28c-47c2-afca-4120b847d953'} Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:03.784438 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-111e125c-3560-4715-9be7-b0423ef21825 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 404 len: 111 microversion: 2.1 time: 0.138083 Oct 17 13:26:03.789461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1136/2339] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:03 2022] DELETE /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:03.801288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.801799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.808553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.809149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.809747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.810892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.811418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.811851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.854594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:03.907719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:03.922877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8002994-a356-45f9-b846-173cc9adb316 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1271 microversion: 2.1 time: 0.250974 Oct 17 13:26:03.923610 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1204/2340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:03.948540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:03.949209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 27e8b461-e28c-47c2-afca-4120b847d953] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:03.968406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.969195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.969795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.970672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:03.971405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:03.971994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:03.995890 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 HTTP/1.1 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '27e8b461-e28c-47c2-afca-4120b847d953'} Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:03.997889 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.002843 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.002843 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.002843 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:04.002843 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:04.002843 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. Oct 17 13:26:04.002843 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.004085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 27e8b461-e28c-47c2-afca-4120b847d953 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:04.005117 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d61a3b9-a868-4e91-a1db-0b5feaacf3c0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953" status: 404 len: 111 microversion: 2.1 time: 0.060581 Oct 17 13:26:04.006528 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1205/2341] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:03 2022] GET /compute/v2.1/servers/27e8b461-e28c-47c2-afca-4120b847d953 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:04.015285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-253b0ed9-6b2e-4486-8e6a-0ef1c65376cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f419e235550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.043984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1573e19b-fd85-4728-b7d9-b09839c7aead tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24" status: 204 len: 0 microversion: 2.1 time: 0.255095 Oct 17 13:26:04.048423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-253b0ed9-6b2e-4486-8e6a-0ef1c65376cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Image not found. Oct 17 13:26:04.049054 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1137/2342] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:03 2022] DELETE /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-253b0ed9-6b2e-4486-8e6a-0ef1c65376cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 HTTP/1.1 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '9d8cc6c6-69c0-42b0-9280-9ba9efbab907'} Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9d8cc6c6-69c0-42b0-9280-9ba9efbab907 to delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9d8cc6c6-69c0-42b0-9280-9ba9efbab907 could not be found. Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.051120 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:26:04.055688 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.058296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-253b0ed9-6b2e-4486-8e6a-0ef1c65376cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:04.059388 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-253b0ed9-6b2e-4486-8e6a-0ef1c65376cb tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907" status: 404 len: 62 microversion: 2.1 time: 0.048898 Oct 17 13:26:04.061174 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1206/2343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] DELETE /compute/v2.1/images/9d8cc6c6-69c0-42b0-9280-9ba9efbab907 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:26:04.066151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.066652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.067401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.068550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.078411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.079165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.079797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.080838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.081632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.082220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.082479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.082988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.083505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.084334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.084803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.085263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.115302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:04.234833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d418805-7025-4268-a3fe-37f942d99609 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 204 len: 0 microversion: 2.1 time: 0.171922 Oct 17 13:26:04.235580 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1207/2344] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:04 2022] DELETE /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:04.243781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.245115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.254668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.255013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.256385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.257416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.257883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.259037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.276615 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 HTTP/1.1 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8b219db7-61f8-409b-a46e-d285774c9641'} Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:04.278458 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3e09b4e-83d1-43c7-a281-4fa294464fc1 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 404 len: 111 microversion: 2.1 time: 0.042859 Oct 17 13:26:04.283065 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1208/2345] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:04 2022] DELETE /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:04.375041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:04.394378 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0cc9c409-c2b4-4951-aed5-5f2b11ffc2e0 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.343946 Oct 17 13:26:04.396220 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1138/2346] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:04.410236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.412487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.431735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.433857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.434366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.438202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.440202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.441500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.551989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-13ccbd88-d622-4424-97d0-7a28c0d9e7ee req-46fc0f16-6fe1-475e-a059-f468c97cb1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58496304-7f75-46c9-90aa-0bf036ecf80f", "tag": "d552c1e9-48b3-49ef-9b47-f96fe41f5eca"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:04.565013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13ccbd88-d622-4424-97d0-7a28c0d9e7ee req-46fc0f16-6fe1-475e-a059-f468c97cb1a9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.565537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13ccbd88-d622-4424-97d0-7a28c0d9e7ee req-46fc0f16-6fe1-475e-a059-f468c97cb1a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.565969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13ccbd88-d622-4424-97d0-7a28c0d9e7ee req-46fc0f16-6fe1-475e-a059-f468c97cb1a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.580899 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-13ccbd88-d622-4424-97d0-7a28c0d9e7ee req-46fc0f16-6fe1-475e-a059-f468c97cb1a9 service nova] Creating event network-changed:d552c1e9-48b3-49ef-9b47-f96fe41f5eca for instance 58496304-7f75-46c9-90aa-0bf036ecf80f on n-h2-854121-14 Oct 17 13:26:04.586911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-13ccbd88-d622-4424-97d0-7a28c0d9e7ee req-46fc0f16-6fe1-475e-a059-f468c97cb1a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304466 Oct 17 13:26:04.587875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1209/2347] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:04.593553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.594409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.601990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.602644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.603085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.603942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.604405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.604826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.759505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:04.914912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:04.925487 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96ebbecd-2937-45e1-ac69-56d26478804a tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24" status: 200 len: 1511 microversion: 2.1 time: 0.336228 Oct 17 13:26:04.933064 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1210/2348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:04.939033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.939931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 8b219db7-61f8-409b-a46e-d285774c9641] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.940703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:04.953481 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c288671-e029-4d52-8733-b08cd4f79fe5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1321 microversion: 2.1 time: 0.553751 Oct 17 13:26:04.955061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.955562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.955907 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1139/2349] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1321 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:04.956046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.956708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.957178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.957622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.973413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.974526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.976790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 HTTP/1.1 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8b219db7-61f8-409b-a46e-d285774c9641'} Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.978912 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 8b219db7-61f8-409b-a46e-d285774c9641 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83145baa-198d-4aaf-95cf-9f74f04a8fa3 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641" status: 404 len: 111 microversion: 2.1 time: 0.049968 Oct 17 13:26:04.983275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1211/2350] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/8b219db7-61f8-409b-a46e-d285774c9641 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:04.990772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:04.991610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:04.992524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.993290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.993899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.994890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.995521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.996115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:04.998994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:04.999527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:04.999913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.000901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.001392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.001883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.243712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:05.260998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d05e2aa1-2f33-4f31-94be-4e04823cbed7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1678 microversion: 2.1 time: 0.303423 Oct 17 13:26:05.263889 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1140/2351] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1678 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:05.279910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-440eedf2-03d4-4c4b-96de-703bd6fa5fdf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a1fffb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.287388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:05.307181 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c9735fb-882c-482e-8e9f-8261c19a5561 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.324831 Oct 17 13:26:05.307833 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1212/2352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:04 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:05.334287 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-440eedf2-03d4-4c4b-96de-703bd6fa5fdf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Image not found. Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-440eedf2-03d4-4c4b-96de-703bd6fa5fdf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 HTTP/1.1 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2e5290ae-bace-4b79-acc0-9d5965d6b0c0'} Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2e5290ae-bace-4b79-acc0-9d5965d6b0c0 to delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e5290ae-bace-4b79-acc0-9d5965d6b0c0 could not be found. Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.336403 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-440eedf2-03d4-4c4b-96de-703bd6fa5fdf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-440eedf2-03d4-4c4b-96de-703bd6fa5fdf tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0" status: 404 len: 62 microversion: 2.1 time: 0.072653 Oct 17 13:26:05.340482 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1141/2353] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] DELETE /compute/v2.1/images/2e5290ae-bace-4b79-acc0-9d5965d6b0c0 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:26:05.348322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.348643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.358311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.358816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.359264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.359979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.360438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.361542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.385259 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 HTTP/1.1 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '437f8312-a3e2-4f61-8dee-aa8bd6846f07'} Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:05.386873 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1a59f6f-45bb-4500-9461-32d01993cbd7 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 404 len: 111 microversion: 2.1 time: 0.045715 Oct 17 13:26:05.393656 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1213/2354] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:05 2022] DELETE /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:05.399796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.400446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 437f8312-a3e2-4f61-8dee-aa8bd6846f07] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.413828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.414486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.414930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.415832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.416439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.417106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.422927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.423723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.433066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:05.434497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.434999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.435700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.436147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.436590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.437259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.447418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 HTTP/1.1 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '437f8312-a3e2-4f61-8dee-aa8bd6846f07'} Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.449665 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.454198 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.454198 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.454198 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.454198 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.454198 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. Oct 17 13:26:05.454198 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.455386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 437f8312-a3e2-4f61-8dee-aa8bd6846f07 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.457966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36dbc86c-37e9-43b8-be1e-f33ed3d06e38 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07" status: 404 len: 111 microversion: 2.1 time: 0.063264 Oct 17 13:26:05.458902 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1142/2355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/437f8312-a3e2-4f61-8dee-aa8bd6846f07 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:05.475817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf5f5f24-39a0-4276-b5da-7946354c8591 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a20484c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.504407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cf5f5f24-39a0-4276-b5da-7946354c8591 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Image not found. Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf5f5f24-39a0-4276-b5da-7946354c8591 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 HTTP/1.1 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3'} Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 to delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 could not be found. Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.506835 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.511480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf5f5f24-39a0-4276-b5da-7946354c8591 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.512851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf5f5f24-39a0-4276-b5da-7946354c8591 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3" status: 404 len: 62 microversion: 2.1 time: 0.048972 Oct 17 13:26:05.512851 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1143/2356] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] DELETE /compute/v2.1/images/205cd989-4a9c-42dd-aa9b-2a9f24d7e1b3 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:26:05.528320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.528895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.543419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.544067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.544511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.545255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.545715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.546153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.568199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 HTTP/1.1 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '9252e01a-a8b6-4774-9ff3-2078a1dbace7'} Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:05.569942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.574185 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff774a2a-c9aa-4ad1-84e5-e25eb98ec3c2 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 404 len: 111 microversion: 2.1 time: 0.049399 Oct 17 13:26:05.575081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1144/2357] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:05 2022] DELETE /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:05.583464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.585509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 9252e01a-a8b6-4774-9ff3-2078a1dbace7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.587561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:05.594349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.594928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.595434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.596227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.596743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.597256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.618213 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 HTTP/1.1 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '9252e01a-a8b6-4774-9ff3-2078a1dbace7'} Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.619877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 9252e01a-a8b6-4774-9ff3-2078a1dbace7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.626233 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-edd884a6-c00d-4b72-820f-f20166007558 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7" status: 404 len: 111 microversion: 2.1 time: 0.042606 Oct 17 13:26:05.628941 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1145/2358] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/9252e01a-a8b6-4774-9ff3-2078a1dbace7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:05.635038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54ad6022-ccd6-42d0-8bf3-2fc95aa72eee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '.version_select at 0x7f41a1f7d160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.666751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:05.670364 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-54ad6022-ccd6-42d0-8bf3-2fc95aa72eee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Image not found. Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54ad6022-ccd6-42d0-8bf3-2fc95aa72eee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 HTTP/1.1 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a57ce322-6a14-4cc3-b3c9-98386d307316'} Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a57ce322-6a14-4cc3-b3c9-98386d307316 to delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a57ce322-6a14-4cc3-b3c9-98386d307316 could not be found. Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.672123 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54ad6022-ccd6-42d0-8bf3-2fc95aa72eee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.675900 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54ad6022-ccd6-42d0-8bf3-2fc95aa72eee tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316" status: 404 len: 62 microversion: 2.1 time: 0.042969 Oct 17 13:26:05.678807 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89cb4115-a6ba-4e47-9614-63c381ae19fe tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.259244 Oct 17 13:26:05.679896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1146/2359] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] DELETE /compute/v2.1/images/a57ce322-6a14-4cc3-b3c9-98386d307316 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:26:05.692621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.693183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.694655 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1214/2360] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:05.701731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.702278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.702722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.704026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.704498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.704908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.722136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ae43117c-362e-4e81-8cd0-f662aac9dca3 req-c6f6cc92-3c9c-40bb-abf0-5a169c3dfa9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb856c7-aefc-4336-8fce-9ca16f6501ef", "name": "network-vif-plugged", "status": "completed", "tag": "8c4b10bb-641a-4c5d-b189-7f04fd8da087"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:05.723327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 HTTP/1.1 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '400a5ed2-2c32-40d4-a873-280ea80a26b9'} Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:05.725740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.730262 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d46ac51a-5737-4612-862f-b3d6be91dd56 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "DELETE /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 404 len: 111 microversion: 2.1 time: 0.046252 Oct 17 13:26:05.731199 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1147/2361] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:05 2022] DELETE /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:05.735703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.736308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] [instance: 400a5ed2-2c32-40d4-a873-280ea80a26b9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.743538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.744286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.744874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.745252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae43117c-362e-4e81-8cd0-f662aac9dca3 req-c6f6cc92-3c9c-40bb-abf0-5a169c3dfa9f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.745738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae43117c-362e-4e81-8cd0-f662aac9dca3 req-c6f6cc92-3c9c-40bb-abf0-5a169c3dfa9f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.746097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.746238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae43117c-362e-4e81-8cd0-f662aac9dca3 req-c6f6cc92-3c9c-40bb-abf0-5a169c3dfa9f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.746818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.747563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.761514 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ae43117c-362e-4e81-8cd0-f662aac9dca3 req-c6f6cc92-3c9c-40bb-abf0-5a169c3dfa9f service nova] Creating event network-vif-plugged:8c4b10bb-641a-4c5d-b189-7f04fd8da087 for instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef on n-h2-854121-14 Oct 17 13:26:05.767966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] HTTP exception thrown: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.768455 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ae43117c-362e-4e81-8cd0-f662aac9dca3 req-c6f6cc92-3c9c-40bb-abf0-5a169c3dfa9f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050604 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Request method failure captured: Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 HTTP/1.1 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVZ8j4YcNSU9jBkhtoC0kNibVz_Rx5WiH9ggtWsRnRJGuob1hq9Gl1J9MYyqBXd4lV24dVTCXzBIc73Y4KZiQ8HD369MZHOXsu7RhmImKLZnLP0R42bcLMt3WuFVKQMVPwOJcEKSoSCPaPXMnt5wmJXSik1Hvd0UlAnzuFTNFEXtxTg Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d2b94b21085446509a1a52835eb4a180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d2b94b21085446509a1a52835eb4a180"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d2b94b21085446509a1a52835eb4a180 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesTestJSON-104936094 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c2effa2bc1674d20a064b40849b85df1 Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesTestJSON-104936094-project Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '400a5ed2-2c32-40d4-a873-280ea80a26b9'} Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.769804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:05.776492 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:05.776492 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:05.776492 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:05.776492 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:05.776492 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. Oct 17 13:26:05.776492 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:05.777390 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1215/2362] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:05.777472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] Returning 404 to user: Instance 400a5ed2-2c32-40d4-a873-280ea80a26b9 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:05.777472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e1f0608-54e6-4b0b-8298-51362c7fa7b0 tempest-ImagesTestJSON-104936094 tempest-ImagesTestJSON-104936094-project] 10.222.0.65 "GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9" status: 404 len: 111 microversion: 2.1 time: 0.044337 Oct 17 13:26:05.778462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1148/2363] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/400a5ed2-2c32-40d4-a873-280ea80a26b9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:05.963942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.965868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:05.976119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.977040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.977812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.979282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:05.980159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:05.980799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:05.990824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:05.993577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:06.007292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.009039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.009771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.014576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.015864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.018725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.350837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:06.364764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c16f93fd-d1d7-45e3-9bfb-aa4332ced390 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24" status: 200 len: 1511 microversion: 2.1 time: 0.410728 Oct 17 13:26:06.377262 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1216/2364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:06.398739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:06.407397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:06.413005 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0999fe1-0e95-4024-b1de-fd952a5b4805 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1512 microversion: 2.1 time: 0.425497 Oct 17 13:26:06.425186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:06.432567 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1149/2365] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:05 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1512 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:06.434587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:06.435205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:06.440655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.442293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.443310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.444693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.445488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.446078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.460876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.461404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.461845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.462557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.463016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.463442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.743989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:06.756862 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43479d5d-4192-444b-8cc9-3688ed6d95a5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1678 microversion: 2.1 time: 0.386835 Oct 17 13:26:06.770864 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1217/2366] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:06.782047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:06.783026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:06.791827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.792765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.793486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:06.794491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:06.795169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:06.796367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.065587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.091181 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea72118b-cdbb-4b75-996e-8dfa5cc96457 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.660339 Oct 17 13:26:07.091795 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1150/2367] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.106211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.106211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:07.113623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.114098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.114621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.115384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.115841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.116268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.215222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.218210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:07.239753 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ffcc58ec-b7f8-48cb-a39b-5ee2a4d64384 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1321 microversion: 2.1 time: 0.467239 Oct 17 13:26:07.241035 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1218/2368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:06 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1321 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.394139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.401380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:07.414293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.416820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.417526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.418546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.420083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.422353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.651458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.666089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6eb2e86f-d85a-45f1-aadc-99026b383bde tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24" status: 200 len: 1469 microversion: 2.1 time: 0.275708 Oct 17 13:26:07.666690 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1219/2369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 => generated 1469 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.707656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:07.722054 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25a64539-1237-408b-b27c-1684b7e87ded tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.629174 Oct 17 13:26:07.722943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1151/2370] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:07.788832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9651bb66-2246-42b4-a3fb-5b11c0da2b55 req-bc6a72cc-2f12-4f5d-a1d9-31571164e430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fe2cdfb-5a77-40fd-ba6e-192f40240f24", "name": "network-vif-deleted", "tag": "5e3b6742-b019-4f17-ba1d-1f89ece416a3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:07.791557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:07.792378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:07.811815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9651bb66-2246-42b4-a3fb-5b11c0da2b55 req-bc6a72cc-2f12-4f5d-a1d9-31571164e430 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.812458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9651bb66-2246-42b4-a3fb-5b11c0da2b55 req-bc6a72cc-2f12-4f5d-a1d9-31571164e430 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.813070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9651bb66-2246-42b4-a3fb-5b11c0da2b55 req-bc6a72cc-2f12-4f5d-a1d9-31571164e430 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.820644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.821813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.823124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.824664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:07.825379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:07.826913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:07.843878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9651bb66-2246-42b4-a3fb-5b11c0da2b55 req-bc6a72cc-2f12-4f5d-a1d9-31571164e430 service nova] Creating event network-vif-deleted:5e3b6742-b019-4f17-ba1d-1f89ece416a3 for instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 on n-h1-854121-14 Oct 17 13:26:07.871540 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9651bb66-2246-42b4-a3fb-5b11c0da2b55 req-bc6a72cc-2f12-4f5d-a1d9-31571164e430 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088293 Oct 17 13:26:07.872762 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1152/2371] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:08.124543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.126379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.173404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.174197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.177927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.180441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.182875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:08.192807 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2791320d-0983-4581-bcfd-6bed3f3429e4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1678 microversion: 2.1 time: 0.410419 Oct 17 13:26:08.195203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.196695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.215846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1220/2372] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:07 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1678 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:08.267019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.268013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.279872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.280525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.283527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.284520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.292049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.292989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.421178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=19 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:08.746575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:08.761844 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-14b3c12e-a497-46ed-b96d-8843bca509e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.645137 Oct 17 13:26:08.762815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1153/2373] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:08.767478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.768110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 7fe2cdfb-5a77-40fd-ba6e-192f40240f24] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.770000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:08.775543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.776039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.776617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.777358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.777813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.778229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.781757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e799dafc-7a90-48b4-a17a-267277c50bd9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1321 microversion: 2.1 time: 0.518738 Oct 17 13:26:08.782662 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1221/2374] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:08.796997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.797660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.814394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.814910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.815549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.816080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.816190 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] HTTP exception thrown: Instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 could not be found. Oct 17 13:26:08.816546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.816986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Request method failure captured: Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 HTTP/1.1 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVeiNOxYyA28hGk4JPWwaYD6Kk2ysVKvJCRlpp7w2Lsl-oX7A6qTNHaxUdmCL3hbkfnOt5_QRTBsBXLFofzY6LwJzqTRi0-wEDbbqSBPqZB4SRemAm8XH66I7M2_7Dsblfp25-foEW3tNoR5M1ivtI-ugHC18Wm0Dzpr8sUNIf8BRcs Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d36ee521e7394316bb2925e96614916f Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-MultipleCreateTestJSON-280833072 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d36ee521e7394316bb2925e96614916f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d36ee521e7394316bb2925e96614916f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d36ee521e7394316bb2925e96614916f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d36ee521e7394316bb2925e96614916f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-MultipleCreateTestJSON-280833072 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d36ee521e7394316bb2925e96614916f Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-MultipleCreateTestJSON-280833072 Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-MultipleCreateTestJSON-280833072-project Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cd070a584a94493cb350e95b5911658c Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-MultipleCreateTestJSON-280833072-project Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 could not be found. Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7fe2cdfb-5a77-40fd-ba6e-192f40240f24'} Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 could not be found. Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 could not be found. Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:08.823859 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 could not be found. Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Returning 404 to user: Instance 7fe2cdfb-5a77-40fd-ba6e-192f40240f24 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:08.827815 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e5e6e19-216d-4275-89c0-b57adb936247 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24" status: 404 len: 111 microversion: 2.1 time: 0.062065 Oct 17 13:26:08.828439 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1154/2375] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/7fe2cdfb-5a77-40fd-ba6e-192f40240f24 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:08.844678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:08.845351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:08.859496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.860004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.860445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:08.869478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:08.870043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:08.870498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:09.602922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:09.611538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:09.629788 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df9861c4-2fd9-4610-bb8b-59cbba63cf90 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.846023 Oct 17 13:26:09.631022 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1222/2376] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:09.645291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:09.646984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:09.654539 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f104be1-8eac-48ba-9b7b-0470434e6a5f tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1510 microversion: 2.1 time: 0.821071 Oct 17 13:26:09.658732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:09.659422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:09.660024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:09.660915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:09.665985 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1155/2377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:08 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1510 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:09.670231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:09.670744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:09.791588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:09.792237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:09.802385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:09.803033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:09.809800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:09.810661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:09.811156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:09.811594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.232309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:10.241467 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e957343e-081c-4b5d-8087-472b1c64ca7f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.609104 Oct 17 13:26:10.242687 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1223/2378] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:09 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:10.247795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:10.249315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:10.256535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.257329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.257930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.258790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.259388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.259956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.527131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:10.536230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-20089805-8ac2-472e-bcdc-cecb9df96f09 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.749261 Oct 17 13:26:10.537658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1156/2379] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:09 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:10.656861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:10.657912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:10.666560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.667318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.668088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.669285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.670975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.671637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.734743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:10.759270 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb4649ff-498a-4366-948c-7e60c1c4797d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1321 microversion: 2.1 time: 0.514918 Oct 17 13:26:10.760565 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1224/2380] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:10 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1321 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:10.767200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:10.768199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:10.776922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.777824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.778507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:10.779564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:10.780228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:10.781072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.586133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:11.626179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f15ba037-8d24-4488-adb0-4ef9500e0566 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1510 microversion: 2.1 time: 0.863610 Oct 17 13:26:11.646349 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1225/2381] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:10 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1510 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:11.653830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:11.660333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:11.664072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:11.665930 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac81675f-59ac-4bfe-9e49-1e1ffc287dd9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 1.013464 Oct 17 13:26:11.666751 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1157/2382] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:10 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:11.694657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.695169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.698917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.699764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.700246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.700858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.783162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:11.783993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:11.792602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.800394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.801269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:11.802219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:11.803105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:11.803699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.624448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:12.639872 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6df856ad-f463-47e3-8381-6431d8948ae1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1513 microversion: 2.1 time: 0.861125 Oct 17 13:26:12.640463 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1158/2383] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:11 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1513 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:12.654301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:12.655850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:12.664535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.665027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.666320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.667043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.667525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.668340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.678133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:12.687095 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-700d73a4-5655-422a-8f42-1691d53b54fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 1.039115 Oct 17 13:26:12.703148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1226/2384] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:11 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:12.708316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:12.709942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:12.712116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:12.717262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.717927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.718555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:12.719425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:12.719879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:12.720296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.260576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.275426 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65e9800b-69de-47fe-980a-345781856a87 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 200 len: 1510 microversion: 2.1 time: 0.570876 Oct 17 13:26:13.276020 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1227/2385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:12 2022] GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 1510 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:13.290390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:13.291081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:13.304276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.304764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.305228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.305930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.306388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.306811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.359350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd070a584a94493cb350e95b5911658c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd36ee521e7394316bb2925e96614916f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.377407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-610bd18e-51f0-45d6-af4d-e2f3576324d3 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 200 len: 1510 microversion: 2.1 time: 0.723044 Oct 17 13:26:13.378068 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1159/2386] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:12 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 1510 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:13.410248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a43f7a1a-3db4-4176-b165-7ec46c688c5b req-8acd783b-a4ac-480e-9bb6-b39c23899426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc", "tag": "c55759fd-0f88-4381-af27-9df75fc55a23"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:13.423088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a43f7a1a-3db4-4176-b165-7ec46c688c5b req-8acd783b-a4ac-480e-9bb6-b39c23899426 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.423831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a43f7a1a-3db4-4176-b165-7ec46c688c5b req-8acd783b-a4ac-480e-9bb6-b39c23899426 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.424547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a43f7a1a-3db4-4176-b165-7ec46c688c5b req-8acd783b-a4ac-480e-9bb6-b39c23899426 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.439793 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a43f7a1a-3db4-4176-b165-7ec46c688c5b req-8acd783b-a4ac-480e-9bb6-b39c23899426 service nova] Creating event network-changed:c55759fd-0f88-4381-af27-9df75fc55a23 for instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc on n-h2-854121-14 Oct 17 13:26:13.454728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a43f7a1a-3db4-4176-b165-7ec46c688c5b req-8acd783b-a4ac-480e-9bb6-b39c23899426 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062386 Oct 17 13:26:13.455932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1160/2387] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:13.463582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:13.469052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.472141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:13.505109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.505952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.506607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.507514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.512366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.513332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:13.668646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:13.772111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:13.779297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:13.779939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:13.780487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.211960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:14.244109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6be6c804-98a3-45cb-9be0-ff41b2872ccc tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.963871 Oct 17 13:26:14.248282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1228/2388] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:13 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:14.254936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-00ae8d1a-abc7-48c0-a87e-1f312a8d55fe req-da2ff5b1-521a-4cbb-86f0-b63e3a786303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0927f93d-d1ed-4be0-a68d-59777ff26fe0", "name": "network-vif-deleted", "tag": "e316b4c0-9796-4aae-8427-85dd2d16810c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:14.270188 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12af5ee7-eede-4064-86c5-b177f8be5558 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.812321 Oct 17 13:26:14.271508 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1161/2389] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Oct 17 13:26:13 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:14.276537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:14.277310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:14.295465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.296281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.297020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.297938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.298550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.299137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.314163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-00ae8d1a-abc7-48c0-a87e-1f312a8d55fe req-da2ff5b1-521a-4cbb-86f0-b63e3a786303 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.314948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-00ae8d1a-abc7-48c0-a87e-1f312a8d55fe req-da2ff5b1-521a-4cbb-86f0-b63e3a786303 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.315541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-00ae8d1a-abc7-48c0-a87e-1f312a8d55fe req-da2ff5b1-521a-4cbb-86f0-b63e3a786303 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.331535 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-00ae8d1a-abc7-48c0-a87e-1f312a8d55fe req-da2ff5b1-521a-4cbb-86f0-b63e3a786303 service nova] Creating event network-vif-deleted:e316b4c0-9796-4aae-8427-85dd2d16810c for instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 on n-h2-854121-14 Oct 17 13:26:14.339048 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-00ae8d1a-abc7-48c0-a87e-1f312a8d55fe req-da2ff5b1-521a-4cbb-86f0-b63e3a786303 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089443 Oct 17 13:26:14.339927 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1229/2390] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:14.346727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:14.354278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:14.356180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1788074633', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:14.363556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.364276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.365493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.366572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.367308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.368001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.571007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:14.697608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:14.707175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.707897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.708540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.890245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:14.897400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ca8c30f-f8a4-4af0-ba56-7dfbba20356a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.624251 Oct 17 13:26:14.897797 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1162/2391] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:14 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:14.912977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:14.918875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] [instance: 0927f93d-d1ed-4be0-a68d-59777ff26fe0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:14.935757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.936245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.936692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.937444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:14.937906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:14.938341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:14.962517 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] HTTP exception thrown: Instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 could not be found. Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Request method failure captured: Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 HTTP/1.1 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVeiNOxYyA28hGk4JPWwaYD6Kk2ysVKvJCRlpp7w2Lsl-oX7A6qTNHaxUdmCL3hbkfnOt5_QRTBsBXLFofzY6LwJzqTRi0-wEDbbqSBPqZB4SRemAm8XH66I7M2_7Dsblfp25-foEW3tNoR5M1ivtI-ugHC18Wm0Dzpr8sUNIf8BRcs Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d36ee521e7394316bb2925e96614916f Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-MultipleCreateTestJSON-280833072 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d36ee521e7394316bb2925e96614916f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d36ee521e7394316bb2925e96614916f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d36ee521e7394316bb2925e96614916f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d36ee521e7394316bb2925e96614916f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-MultipleCreateTestJSON-280833072 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d36ee521e7394316bb2925e96614916f Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-MultipleCreateTestJSON-280833072 Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-MultipleCreateTestJSON-280833072-project Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cd070a584a94493cb350e95b5911658c Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-MultipleCreateTestJSON-280833072-project Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 could not be found. Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0927f93d-d1ed-4be0-a68d-59777ff26fe0'} Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 could not be found. Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 could not be found. Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:14.965486 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 could not be found. Oct 17 13:26:14.969785 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:26:14.971649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] Returning 404 to user: Instance 0927f93d-d1ed-4be0-a68d-59777ff26fe0 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:14.972818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59341fc7-c67a-47a9-b660-1f16f9438d28 tempest-MultipleCreateTestJSON-280833072 tempest-MultipleCreateTestJSON-280833072-project] 10.222.0.65 "GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0" status: 404 len: 111 microversion: 2.1 time: 0.069443 Oct 17 13:26:14.973869 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1163/2392] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:14 2022] GET /compute/v2.1/servers/0927f93d-d1ed-4be0-a68d-59777ff26fe0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:15.173011 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ee8642e-b0fc-45cb-ab61-c717907a2810 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1788074633" status: 200 len: 1516 microversion: 2.1 time: 0.830488 Oct 17 13:26:15.174469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1230/2393] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:26:14 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1788074633 => generated 1516 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:15.198711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:15.204263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:15.205412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:15.211635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.212381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.213028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.213985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.214609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.215189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.267850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:15.269125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:15.280315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.281043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.281691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.286176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.287481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.288290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.391680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:15.535068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:15.544117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.544606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.545041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.572857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:15.582386 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57e5b3fb-00c6-4c2b-a798-f63129e69b15 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.318282 Oct 17 13:26:15.586288 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1231/2394] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:15 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:15.923980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:15.926945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:15.937758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.938170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.944199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.945381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:15.947661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:15.948282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:15.970354 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c21cf764-23df-45ca-9a0b-ce46265e06ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.775556 Oct 17 13:26:15.970963 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1164/2395] 10.222.0.65 () {58 vars in 1173 bytes} [Mon Oct 17 13:26:15 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:16.003111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:16.013344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:16.013750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.servers [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Removing options 'limit' from query {{(pid=120697) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:26:16.018839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:16.032689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.034383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.034839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.038490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.038987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.041595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.603250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:16.607782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:16.621876 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc63ae2c-2c6d-4b3e-9927-f64a9fcb2948 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.701488 Oct 17 13:26:16.637195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.637195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.637195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.637195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:16.644686 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1232/2396] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:15 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:16.650855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:16.651780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:16.658364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.659130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.659790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:16.660690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:16.661381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:16.662750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.581412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:17.599886 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8c6d7ff-5fab-4179-8433-900a38f2f405 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.952578 Oct 17 13:26:17.627354 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1233/2397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:16 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:17.653478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:17.654110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:17.665678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.666185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.666637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.667387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.673272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.673859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.909379 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fcdb0935-e6e2-4d2e-8664-c9df8045447a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 1.910044 Oct 17 13:26:17.922087 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1165/2398] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 13:26:15 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:17.937069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:17.942879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:17.944091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:17.950739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.951593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.952313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:17.954412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:17.955105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:17.956100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.079852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:18.185082 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8eaaccb5-e676-43d8-807b-f9c105e50521 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.251138 Oct 17 13:26:18.186439 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1166/2399] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:26:17 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:18.200199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.206083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.206786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.servers [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Removing options 'limit' from query {{(pid=120697) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:26:18.207664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:18.214851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.215723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.216382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.217420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.218103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.219006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.319050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:18.341810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.357049 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f317c8bf-0631-4da1-ae93-d8e14a7f05d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.707014 Oct 17 13:26:18.362944 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e64e363a-f82b-43be-9744-625c8c3cdcad tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.166580 Oct 17 13:26:18.364520 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1167/2400] 10.222.0.65 () {58 vars in 1150 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:18.367907 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1234/2401] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:17 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:18.382770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.409225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.410334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:18.421565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.426650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.430008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.431054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.431964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.432082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.489754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:18.521894 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4ffa3d6-18dc-4293-b8c8-5bbc9b6568e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.146601 Oct 17 13:26:18.522991 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1168/2402] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers => generated 1010 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:18.543921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.556446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.562294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:18.578019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.578906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.579527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.580422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.581047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.581655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.638142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.642528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:18.662345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.665592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.666128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.666956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.669145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.669686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.800732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:18.808534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:18.928485 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2c27568-e571-41db-9a47-578927b523d5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.394666 Oct 17 13:26:18.930352 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1235/2403] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:18.945683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:18.958214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:18.968924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.servers [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Removing options 'limit' from query {{(pid=120698) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:26:18.975670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:18.983954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.984546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.985215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:18.986789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:18.987456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:18.988940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.026505 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61e013c7-a4a7-437a-a5ae-a223c274d96a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.086483 Oct 17 13:26:19.028037 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1236/2404] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:19.043504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.058508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:19.059350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1788074633', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:19.077004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.079245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.080619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.084804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.085602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.086346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.199943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:19.217605 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ec2fc7b-38a9-4263-9913-7bf2eb1e4022 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.584734 Oct 17 13:26:19.218613 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1169/2405] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:18 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:19.262003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:19.361773 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d27cb2c-2da4-401b-ab89-0e4c08064e4c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1788074633" status: 200 len: 346 microversion: 2.1 time: 0.324958 Oct 17 13:26:19.363026 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1237/2406] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1788074633 => generated 346 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:19.377895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ac9cb58-410c-4571-a3ac-f7abbfa0c0e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:19.392919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ac9cb58-410c-4571-a3ac-f7abbfa0c0e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.393703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ac9cb58-410c-4571-a3ac-f7abbfa0c0e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.395018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ac9cb58-410c-4571-a3ac-f7abbfa0c0e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.400144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.400834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:19.418980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.418980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.418980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.438845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.440815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.441991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.482410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ac9cb58-410c-4571-a3ac-f7abbfa0c0e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:26:19.581335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ac9cb58-410c-4571-a3ac-f7abbfa0c0e1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "POST /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef/action" status: 202 len: 0 microversion: 2.1 time: 0.208483 Oct 17 13:26:19.589017 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1170/2407] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:26:19 2022] POST /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:26:19.597270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:19.603636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:19.648995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.649590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.651759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:19.652516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:19.652982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:19.653439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:20.580448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:20.594248 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88ebe23e-bb3b-4192-9478-0996f207ddd1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 1.209855 Oct 17 13:26:20.595310 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1238/2408] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:20.605046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:20.605905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:20.624320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:20.624818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:20.628178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:20.629452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:20.634468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:20.635433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:20.809543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:20.826950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7da8886-e724-46fd-8e24-f56443ed4bfe tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 1.226556 Oct 17 13:26:20.827648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1171/2409] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:19 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:21.530770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1239576814", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "bb8e7f5b-5a0f-4a29-8203-c96344afa7d7"}, {"uuid": "94e346c4-5875-4648-a0c5-78ba78b46b5d"}, {"uuid": "bb8e7f5b-5a0f-4a29-8203-c96344afa7d7"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:21.618751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:21.644027 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b5a72668-3a00-4f30-a448-c7ddc52923e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 1.047546 Oct 17 13:26:21.652466 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1239/2410] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:20 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:21.660236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:21.666059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:21.673304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:21.673890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:21.685811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:21.686763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:21.687261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:21.687713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:21.753091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] validate_networks() for [('bb8e7f5b-5a0f-4a29-8203-c96344afa7d7', None, None, None, None, None), ('94e346c4-5875-4648-a0c5-78ba78b46b5d', None, None, None, None, None), ('bb8e7f5b-5a0f-4a29-8203-c96344afa7d7', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:26:22.805583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:22.815892 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c948ee40-6ecc-4792-9ffd-871142ea90d6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 1.161930 Oct 17 13:26:22.816814 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1240/2411] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:21 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:22.822324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:22.822935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:22.831485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.831972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.832402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:22.833736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:22.834201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:22.834619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:23.220333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:23.232788 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90626507-dddf-4917-b685-fc9c8e24f25d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.414304 Oct 17 13:26:23.237208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1241/2412] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:22 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:23.640823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1127851915", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:23.732022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:26:24.165789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:24.166409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:24.166795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:24.167276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:24.167788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:24.179085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.179924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.180605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.181581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.189091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.190994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.239055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Getting quotas for project d5fe0ce940ff409bb939b04a752dc010. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:24.252092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Getting quotas for user 3e96a6ca3cf74157be8a00df57f646d9 and project d5fe0ce940ff409bb939b04a752dc010. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:24.292860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:24.296791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:24.421018 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26276190-26b9-4b6d-8c00-3bcff334999f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179844 Oct 17 13:26:24.426293 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1242/2413] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:26:24.435823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:24.441236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:24.442220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:24.443253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:24.443991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:24.444560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:24.444990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:24.455072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.455662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.456162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.457122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.457789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.459231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.479427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.480931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.481416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.484956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.485508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.488697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.517519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Getting quotas for project 17152d7dd9b847a884017a9a0331cf69. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:24.524837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Getting quotas for user 60cef07763604d49a9ecd33049d098fa and project 17152d7dd9b847a884017a9a0331cf69. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:24.546572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:24.552716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:24.625475 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-56ab4d1f-73db-4cdb-a4d6-ad263719108f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.099596 Oct 17 13:26:24.626933 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1172/2414] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:26:24.633116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:24.634108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:24.641189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.642959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.643627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.644593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.645722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.647078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.652843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:24.666028 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40122c63-25ba-498b-a3f9-b3d8a554806a tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.238150 Oct 17 13:26:24.683924 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1243/2415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:24 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:24.704902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:24.711386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:24.727015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.727410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.727884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.728606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:24.734030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:24.734657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:24.962788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:24.974909 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1cdf478-d681-4f9b-8540-8a2765169786 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.346548 Oct 17 13:26:24.977444 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1173/2416] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:24 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:24.988647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ce0da8df-e1a8-478a-8866-7994a9b10198 req-8fb5f69b-fcc5-474c-971b-f60409df6486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58496304-7f75-46c9-90aa-0bf036ecf80f", "name": "network-vif-plugged", "status": "completed", "tag": "d552c1e9-48b3-49ef-9b47-f96fe41f5eca"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:25.023487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce0da8df-e1a8-478a-8866-7994a9b10198 req-8fb5f69b-fcc5-474c-971b-f60409df6486 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.026352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce0da8df-e1a8-478a-8866-7994a9b10198 req-8fb5f69b-fcc5-474c-971b-f60409df6486 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.027293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce0da8df-e1a8-478a-8866-7994a9b10198 req-8fb5f69b-fcc5-474c-971b-f60409df6486 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.060273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ce0da8df-e1a8-478a-8866-7994a9b10198 req-8fb5f69b-fcc5-474c-971b-f60409df6486 service nova] Creating event network-vif-plugged:d552c1e9-48b3-49ef-9b47-f96fe41f5eca for instance 58496304-7f75-46c9-90aa-0bf036ecf80f on n-h2-854121-14 Oct 17 13:26:25.070725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ce0da8df-e1a8-478a-8866-7994a9b10198 req-8fb5f69b-fcc5-474c-971b-f60409df6486 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090382 Oct 17 13:26:25.072822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1174/2417] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:25.088447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:25.089762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a0a53a2-d38d-4e20-83e8-5c1e7ae3d2a6 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.091108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a0a53a2-d38d-4e20-83e8-5c1e7ae3d2a6 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.105064 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5399d5f7-c25a-4209-9e74-044c92634e2a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.419624 Oct 17 13:26:25.121526 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1244/2418] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:24 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:25.128901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0ab1af5-6d4f-4939-92e2-88ba0dc60f79 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.146971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0ab1af5-6d4f-4939-92e2-88ba0dc60f79 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.346688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a0a53a2-d38d-4e20-83e8-5c1e7ae3d2a6 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:25.359477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a0a53a2-d38d-4e20-83e8-5c1e7ae3d2a6 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1217 microversion: 2.1 time: 0.284209 Oct 17 13:26:25.370146 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1175/2419] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:25 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1217 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:25.406543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0ab1af5-6d4f-4939-92e2-88ba0dc60f79 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:25.418871 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0ab1af5-6d4f-4939-92e2-88ba0dc60f79 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1213 microversion: 2.1 time: 0.301470 Oct 17 13:26:25.437695 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1245/2420] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:25 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1213 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:25.697032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:25.698137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:25.711583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.715343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.717450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.718905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.722164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.722828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.869015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-2100087413", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:25.955055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:25.955486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:25.955970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:25.956382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:25.956794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:25.976271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.976765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.977388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:25.977979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:25.978437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:25.978858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.002735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Getting quotas for project d62f6e36c11046e3a759cea9d7f99b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:26.030828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Getting quotas for user 22bb1ba21e354e80be041f6cfb81dfec and project d62f6e36c11046e3a759cea9d7f99b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:26.092513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:26.096938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.109509 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6c24171-3641-4b9d-8469-af439ee36523 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.417124 Oct 17 13:26:26.113527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:26.113819 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1246/2421] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:25 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:26.120117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.120730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.138985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.140051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.140700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.143737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.144430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.144969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.183498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0955e3ac-e93e-4b36-acd5-3d77e8477b29 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.811373 Oct 17 13:26:26.184737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1176/2422] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:26:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:26:26.206093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.207061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.209376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:26.217147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.217684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.218136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.218938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.219399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.219830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.407102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.419953 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cd2525f-c1c9-4fa7-bd9e-8f00e1a4f882 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.300238 Oct 17 13:26:26.439548 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1247/2423] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:26.453128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.457347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32597b51-c5f0-4868-a854-5e5596212fce tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.459558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32597b51-c5f0-4868-a854-5e5596212fce tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.467751 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5197193-3afb-496b-b6ad-440970dd19a4 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.279148 Oct 17 13:26:26.468384 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1177/2424] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:26.487237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.490897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.516639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.519637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.520594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.525921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.529818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.530585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.577046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32597b51-c5f0-4868-a854-5e5596212fce tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.596151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32597b51-c5f0-4868-a854-5e5596212fce tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.598115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32597b51-c5f0-4868-a854-5e5596212fce tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.600194 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32597b51-c5f0-4868-a854-5e5596212fce tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad" status: 200 len: 1278 microversion: 2.47 time: 0.151505 Oct 17 13:26:26.600997 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1248/2425] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:26.605855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.606737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:26.624912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.625870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.626401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.627233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.627755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.628402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.746553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.758343 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21bf075a-6015-4d51-9237-594fc1d3edcd tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1277 microversion: 2.1 time: 0.288000 Oct 17 13:26:26.759383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1178/2426] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:26.798060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:26.813425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7715fdf-a9af-4e7a-952b-c95112d85cec tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1265 microversion: 2.1 time: 0.206749 Oct 17 13:26:26.814275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1249/2427] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:26.849679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1055418190", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:26.937798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:26.938331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:26.938793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:26.940663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:26.941325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:26.953654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.955188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.956625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.957938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:26.958901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:26.959584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:26.977237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e064f85e-7c87-4060-bc18-836fcfa02a24 tempest-NetworksTest-193961115 tempest-NetworksTest-193961115-project-admin] Calling method '.version_select at 0x7f41a1f091f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:26.990993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Getting quotas for project d62f6e36c11046e3a759cea9d7f99b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:27.000197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Getting quotas for user 22bb1ba21e354e80be041f6cfb81dfec and project d62f6e36c11046e3a759cea9d7f99b05. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:27.022605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:27.025437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:27.084608 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-377141bd-461b-4b61-ae1f-a61ae2c8f9ba tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.241739 Oct 17 13:26:27.085617 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1250/2428] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 17 13:26:27.101022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38d15dd1-be27-4452-9e23-f14b51688ae2 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:27.107610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38d15dd1-be27-4452-9e23-f14b51688ae2 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.185074 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38d15dd1-be27-4452-9e23-f14b51688ae2 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "PUT /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 992 microversion: 2.47 time: 0.089903 Oct 17 13:26:27.204838 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1251/2429] 10.222.0.65 () {62 vars in 1297 bytes} [Mon Oct 17 13:26:27 2022] PUT /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 992 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:26:27.219283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b9dfa1f6-bbc3-4c3d-b099-fafa24e86f38 req-4abc176d-fa53-408e-bba1-f04a577543d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc", "name": "network-vif-plugged", "status": "completed", "tag": "c55759fd-0f88-4381-af27-9df75fc55a23"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:27.234266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9dfa1f6-bbc3-4c3d-b099-fafa24e86f38 req-4abc176d-fa53-408e-bba1-f04a577543d5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.235532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9dfa1f6-bbc3-4c3d-b099-fafa24e86f38 req-4abc176d-fa53-408e-bba1-f04a577543d5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.236998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9dfa1f6-bbc3-4c3d-b099-fafa24e86f38 req-4abc176d-fa53-408e-bba1-f04a577543d5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.252830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b9dfa1f6-bbc3-4c3d-b099-fafa24e86f38 req-4abc176d-fa53-408e-bba1-f04a577543d5 service nova] Creating event network-vif-plugged:c55759fd-0f88-4381-af27-9df75fc55a23 for instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc on n-h2-854121-14 Oct 17 13:26:27.260747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b9dfa1f6-bbc3-4c3d-b099-fafa24e86f38 req-4abc176d-fa53-408e-bba1-f04a577543d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053640 Oct 17 13:26:27.270079 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1252/2430] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:27.284105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:27.284930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.293154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.293809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.294320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.295109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.297809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.298508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.712453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e064f85e-7c87-4060-bc18-836fcfa02a24 tempest-NetworksTest-193961115 tempest-NetworksTest-193961115-project-admin] 10.222.0.65 "GET /compute/v2.1/os-networks" status: 200 len: 6017 microversion: 2.1 time: 0.951899 Oct 17 13:26:27.719541 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1179/2431] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:26:26 2022] GET /compute/v2.1/os-networks => generated 6017 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:27.744657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3346655a-36fa-4613-b6f3-300a787a0cd3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:27.745961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3346655a-36fa-4613-b6f3-300a787a0cd3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.921088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3346655a-36fa-4613-b6f3-300a787a0cd3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:27.934208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3346655a-36fa-4613-b6f3-300a787a0cd3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:27.943372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3346655a-36fa-4613-b6f3-300a787a0cd3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:27.947501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3346655a-36fa-4613-b6f3-300a787a0cd3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1278 microversion: 2.47 time: 0.226733 Oct 17 13:26:27.948979 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1180/2432] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:27 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:27.950005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:27.956779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:27.957543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.960720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fdde4cd-49dc-4a4e-b8b1-b4dcbbf5f926 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1315 microversion: 2.1 time: 0.687477 Oct 17 13:26:27.972701 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1253/2433] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:27 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:27.974909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.975675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.979426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.982420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:27.983225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:27.983630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.984126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.984573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.991364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.993687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.994614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:27.995936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:27.997815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:27.998296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.273152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:28.288221 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d51bbaa2-e0b6-4ab8-a5ae-f567b61324c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.334569 Oct 17 13:26:28.288865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1181/2434] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:27 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:28.298159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-147899f8-e28c-41db-a622-763b1c4e76c7 tempest-NetworksTest-193961115 tempest-NetworksTest-193961115-project-admin] Calling method '.version_select at 0x7f41a1f929d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.346450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:28.357954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f6fa60f-8529-44fb-b99b-8652ab4fb9af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.383114 Oct 17 13:26:28.359553 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1254/2435] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:27 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:28.378210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.382895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:28.398731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:28.400256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:28.403180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.404520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:28.408365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:28.409072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.569435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:28.577475 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-147899f8-e28c-41db-a622-763b1c4e76c7 tempest-NetworksTest-193961115 tempest-NetworksTest-193961115-project-admin] 10.222.0.65 "GET /compute/v2.1/os-networks/0b535e39-028e-47fc-8e15-34be2f69795d" status: 200 len: 652 microversion: 2.1 time: 0.286501 Oct 17 13:26:28.582596 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1182/2436] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/os-networks/0b535e39-028e-47fc-8e15-34be2f69795d => generated 652 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:28.589889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.591602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:28.598492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:28.599942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:28.600527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.601376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e698a7fe-3016-41cf-95c8-32444ef5b394 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1275 microversion: 2.1 time: 0.238745 Oct 17 13:26:28.601527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:28.602061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:28.602595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:28.603043 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1255/2437] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1275 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:28.632644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75c0855e-19c7-4138-9608-a2d7594ca81b tempest-NetworksTest-193961115 tempest-NetworksTest-193961115-project-admin] Calling method '.version_select at 0x7f419dfc3040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.777979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:28.787946 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-012d2f41-add1-451f-962d-d773dcd482a2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1271 microversion: 2.1 time: 0.203223 Oct 17 13:26:28.791598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1183/2438] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:28.853146 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75c0855e-19c7-4138-9608-a2d7594ca81b tempest-NetworksTest-193961115 tempest-NetworksTest-193961115-project-admin] 10.222.0.65 "GET /compute/v2.1/os-networks" status: 200 len: 6017 microversion: 2.1 time: 0.248143 Oct 17 13:26:28.858323 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1256/2439] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/os-networks => generated 6017 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:28.978671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.979654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:28.990847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:28.991711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.002533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:29.006263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.007370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.009266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.009853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.010813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.011535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.012225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.012878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.025974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.027164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.029640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.033523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.231963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.250408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.256157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.259687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-741019e6-01a3-4c4e-a656-15a850e77a91 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1274 microversion: 2.47 time: 0.285547 Oct 17 13:26:29.264025 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1184/2440] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:26:29.314500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:29.315645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.336381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.337274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.338517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.339557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.340250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.341244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.387937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.400885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:29.406415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4246da8-b678-4ec1-b19d-3303e72ae4d8 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1504 microversion: 2.1 time: 0.418103 Oct 17 13:26:29.429080 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1257/2441] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:28 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1504 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:29.445120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:29.446939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.458020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.458566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.459005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.460271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.460761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.462712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.722876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.741790 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea46d73a-b7d2-4565-a097-2c1344575a32 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1313 microversion: 2.1 time: 0.433639 Oct 17 13:26:29.743017 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1185/2442] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:29 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:29.754068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:29.755838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.771624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.772221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.772559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.780927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.781595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.782229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.801147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:29.840464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:29.867384 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11d8e4e4-5f4b-4c26-b0f5-10471889638c tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.435793 Oct 17 13:26:29.871154 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1258/2443] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:29 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:29.925883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:29.929915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.935874 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c70d954-2921-4da1-b426-4b267c117d1b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "DELETE /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.191432 Oct 17 13:26:29.936925 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1186/2444] 10.222.0.65 () {58 vars in 1296 bytes} [Mon Oct 17 13:26:29 2022] DELETE /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f/os-server-password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:29.947543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:29.948186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:29.958761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.960155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.960889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.961935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.962789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.963442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.964813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.965335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.973910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:29.976755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:29.986661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:29.987334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.392992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:30.403349 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a57b3d6a-a7e2-4e9a-8770-84fb31811d6d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.510123 Oct 17 13:26:30.404701 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1259/2445] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:29 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:30.430396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.431948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.442305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.443290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.444094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.444953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.445818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.446920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.470428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:30.479800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99b121aa-f9ea-449e-97c6-8008e2fbc33e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1313 microversion: 2.1 time: 0.541625 Oct 17 13:26:30.480019 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b2166be-144f-49ad-972a-d1573cbc7164 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.061170 Oct 17 13:26:30.480841 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1187/2446] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:29 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1313 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:30.486225 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1260/2447] 10.222.0.65 () {58 vars in 1293 bytes} [Mon Oct 17 13:26:30 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f/os-server-password => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:26:30.492017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.492524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.497571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.498618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.499146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.499650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.500096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.500815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.501321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.502218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.508962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.509871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.510555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.512572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.513515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.514236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.530887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:30.623059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:30.662119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:30.664844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:30.665366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-468133bc-f457-4aec-adc6-93ddb391a0e7 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "DELETE /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 204 len: 0 microversion: 2.1 time: 0.177756 Oct 17 13:26:30.667617 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1261/2448] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:30 2022] DELETE /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:30.671752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b3ce374-2e35-4acf-b47f-19400051e7d9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1330 microversion: 2.47 time: 0.189481 Oct 17 13:26:30.673757 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1188/2449] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:30 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1330 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:30.683167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.683964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.690855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.691355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.691787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.693024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.693632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.694062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.767806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.770547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.780443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.785925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.787763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.789707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.793838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.794560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.899758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:30.915341 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6e91bee-3009-4d4f-81d7-3222ba1d5e17 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1510 microversion: 2.1 time: 0.242450 Oct 17 13:26:30.916356 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1262/2450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:30 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:30.933558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:30.934405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:30.944201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.945661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.945957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:30.947146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:30.947609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:30.948039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.049958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.064099 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a38673ac-77cb-496c-a06f-d2005462a315 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1463 microversion: 2.1 time: 0.300609 Oct 17 13:26:31.064811 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1189/2451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:30 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:31.144140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.156618 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c14e3278-1199-4a4d-838a-1f18a53b8130 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.239034 Oct 17 13:26:31.157923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1263/2452] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:30 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:31.385181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:31.396558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:31.403879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.405438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.406090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.407843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.408310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.408745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.428545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:31.429357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:31.436676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.438034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.438677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.440797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.441507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.442158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.668160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.678425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-182b7192-2137-4bad-a389-125ab1ffe725 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.254580 Oct 17 13:26:31.679125 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1264/2453] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:31 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:31.684491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:31.685452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:31.693983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.694705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.695146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.696345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.696952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.697561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.825839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39799fb9-0886-4351-abf6-b8b279f13b9a tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1616 microversion: 2.1 time: 0.741425 Oct 17 13:26:31.826800 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1190/2454] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:31 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1616 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:31.847312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a91d099e-6d40-4e1a-aae6-b94bbfe26e42 req-21d508b3-9e7e-4653-88af-0203a0327a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:31.861339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a91d099e-6d40-4e1a-aae6-b94bbfe26e42 req-21d508b3-9e7e-4653-88af-0203a0327a8b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.861836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a91d099e-6d40-4e1a-aae6-b94bbfe26e42 req-21d508b3-9e7e-4653-88af-0203a0327a8b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.862277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a91d099e-6d40-4e1a-aae6-b94bbfe26e42 req-21d508b3-9e7e-4653-88af-0203a0327a8b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.875112 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a91d099e-6d40-4e1a-aae6-b94bbfe26e42 req-21d508b3-9e7e-4653-88af-0203a0327a8b service nova] Creating event network-changed:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:26:31.880199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a91d099e-6d40-4e1a-aae6-b94bbfe26e42 req-21d508b3-9e7e-4653-88af-0203a0327a8b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036817 Oct 17 13:26:31.880980 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1191/2455] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:31.886896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:31.887711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:31.897101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.897768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.898327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.900496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.901403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.902164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.925139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.937046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7eb043c-6085-4c67-be55-18a06f9707e1 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1334 microversion: 2.1 time: 0.256408 Oct 17 13:26:31.938634 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1265/2456] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:31 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1334 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:31.944560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:31.945474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:31.957845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.958683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.959289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.960203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:31.960648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:31.961264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:31.978027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.988012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.990596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:31.991846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-06fa4e76-f283-484e-a4ff-1ca0f061191b tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1348 microversion: 2.47 time: 0.109313 Oct 17 13:26:31.992494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1192/2457] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:31 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1348 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:31.998276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:31.999561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:32.005880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.006600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.007831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.008751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.009446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.010061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.207657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:32.217515 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c7647c9-4341-4b18-b9c4-7675355ad7d4 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1510 microversion: 2.1 time: 0.223359 Oct 17 13:26:32.218460 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1193/2458] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:31 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:32.231589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:32.232611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:32.245256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.246379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.247369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.248339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.248998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.250189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.300332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '238bd4e17419450cb3850f505c67581d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160aea9570904e87b498c61bb6171b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:32.302347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] flavor_id is None. Assuming migration. {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:26:32.303373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:26:32.436012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:32.451838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6d95043-833a-49c5-bbac-93f2057f03be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.225225 Oct 17 13:26:32.452429 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1194/2459] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:32 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:32.701968 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f9e665b-e209-478e-9095-8b035c3e90fc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc/action" status: 202 len: 0 microversion: 2.1 time: 0.762034 Oct 17 13:26:32.705536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:32.705716 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1266/2460] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:26:31 2022] POST /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:26:32.706676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:32.714271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.715091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.715740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.716661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.717402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.718014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.719290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:32.720186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:32.766883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.767698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.768162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:32.768888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:32.771978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:32.773657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.199106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:33.201331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:33.211886 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c88cac02-5280-4ee6-ba2d-f8795b286794 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1472 microversion: 2.1 time: 0.504560 Oct 17 13:26:33.212270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-008063b2-7cf1-4ae3-8de2-0650982f820f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.515111 Oct 17 13:26:33.213086 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1267/2461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:32 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1472 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:33.216535 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1195/2462] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:32 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:33.221316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:33.222175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:33.230142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:33.230816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:33.234965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.236934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.237581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.240126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.241250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.241933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.244196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.246243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.247423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.250603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.251273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.251876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.391718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:33.405428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:33.408344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:33.410635 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b670331-e8c2-4544-8e8b-4ab9440b26e6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1336 microversion: 2.47 time: 0.190880 Oct 17 13:26:33.421744 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1196/2463] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:33 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1336 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:33.425185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:33.425834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:33.438132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.438787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.439321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.440042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.440509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.440939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.883926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:33.892632 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90c9d97b-9be3-45c2-97a0-d38d32f94fc0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.676364 Oct 17 13:26:33.893286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1268/2464] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:33 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:33.898897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:33.899601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:33.906984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.908099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.908754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:33.909773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:33.910609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:33.911773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.064936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.077899 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7659e11-4116-4120-900c-55067fbc26e9 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1510 microversion: 2.1 time: 0.659133 Oct 17 13:26:34.106561 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1197/2465] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:33 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1510 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:34.167865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-596f484c-1755-43c3-9b82-ca4fe84464b4 req-25b21779-eeb0-4f73-9708-abf778e99285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58496304-7f75-46c9-90aa-0bf036ecf80f", "name": "network-vif-deleted", "tag": "d552c1e9-48b3-49ef-9b47-f96fe41f5eca"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:34.189469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-596f484c-1755-43c3-9b82-ca4fe84464b4 req-25b21779-eeb0-4f73-9708-abf778e99285 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.191463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-596f484c-1755-43c3-9b82-ca4fe84464b4 req-25b21779-eeb0-4f73-9708-abf778e99285 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.192106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-596f484c-1755-43c3-9b82-ca4fe84464b4 req-25b21779-eeb0-4f73-9708-abf778e99285 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.206073 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-596f484c-1755-43c3-9b82-ca4fe84464b4 req-25b21779-eeb0-4f73-9708-abf778e99285 service nova] Creating event network-vif-deleted:d552c1e9-48b3-49ef-9b47-f96fe41f5eca for instance 58496304-7f75-46c9-90aa-0bf036ecf80f on n-h2-854121-14 Oct 17 13:26:34.212263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-596f484c-1755-43c3-9b82-ca4fe84464b4 req-25b21779-eeb0-4f73-9708-abf778e99285 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048249 Oct 17 13:26:34.213433 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1198/2466] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:34.258496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.263767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:34.266132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:34.270360 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-567808ee-5fa3-42a2-b542-17b37749a931 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.375560 Oct 17 13:26:34.284863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.287990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.289276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.289521 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1269/2467] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:33 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:34.290384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.293812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.294951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.295413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:34.296542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:34.304829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.305192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.305815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.307236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.307926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.310013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.597658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.608546 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70178846-7687-48da-bf3f-0a3a2623fce7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1472 microversion: 2.1 time: 0.356490 Oct 17 13:26:34.627319 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1199/2468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:34 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:34.634627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:34.635493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:34.637905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.644933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.645948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.647866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.648843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.649044 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c069eb62-9915-45e9-a809-c111a25db969 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.357677 Oct 17 13:26:34.649792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.651202 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1270/2469] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:34 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:34.654775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.750171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.762910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.764989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:34.766418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a9ba2ea-ba1a-46c0-aa2f-4c20e4eb4148 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1336 microversion: 2.47 time: 0.137428 Oct 17 13:26:34.767478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1200/2470] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:34 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1336 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:34.916628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:34.918008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:34.925356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.925939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.926450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.927276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:34.927832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:34.928323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:34.950675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:35.095807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:35.105417 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-636ffe0a-05dc-4c44-a0fc-b52a63115a7f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.192894 Oct 17 13:26:35.107699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:35.108533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:35.117594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.118364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.120114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.121043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.122042 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1271/2471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:34 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:35.122332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.122930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.199229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:35.207239 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eab24d1b-d263-46ae-bad4-9c91d6172d2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1468 microversion: 2.1 time: 0.103412 Oct 17 13:26:35.207824 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1201/2472] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:35 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1468 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:35.296453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:35.297398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:35.318857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.320741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.321928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.322671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.323258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.324060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.336150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bfd705a8-ed5d-4d19-a903-411c80d73e9f req-8f7c8147-c2da-4e0b-9f1a-0a8083667d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "tag": "a2e03a86-449e-4cc4-bd80-6cd5491edb9f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:35.351393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bfd705a8-ed5d-4d19-a903-411c80d73e9f req-8f7c8147-c2da-4e0b-9f1a-0a8083667d35 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.352322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bfd705a8-ed5d-4d19-a903-411c80d73e9f req-8f7c8147-c2da-4e0b-9f1a-0a8083667d35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.352817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bfd705a8-ed5d-4d19-a903-411c80d73e9f req-8f7c8147-c2da-4e0b-9f1a-0a8083667d35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.367494 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bfd705a8-ed5d-4d19-a903-411c80d73e9f req-8f7c8147-c2da-4e0b-9f1a-0a8083667d35 service nova] Creating event network-changed:a2e03a86-449e-4cc4-bd80-6cd5491edb9f for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:35.373878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bfd705a8-ed5d-4d19-a903-411c80d73e9f req-8f7c8147-c2da-4e0b-9f1a-0a8083667d35 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042461 Oct 17 13:26:35.375938 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1202/2473] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:35.504529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:35.514343 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62ba5f34-f389-49c0-bc04-9b057f02d5be tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.222411 Oct 17 13:26:35.515178 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1272/2474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:35 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:35.636517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:35.639029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:35.646382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.646986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.647519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.648316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.648874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.649578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.677794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:35.678771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:35.687058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.687552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.688607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.689368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.690187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.690882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.951713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:35.955248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:35.963843 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e80773ec-1980-40ed-a2c6-4611033bdf9a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1472 microversion: 2.1 time: 0.333819 Oct 17 13:26:35.966322 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1203/2475] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:35 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:35.973277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:35.974601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:35.983338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.985214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.986666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.988093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:35.988793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:35.989259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:35.993405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:36.036460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.045109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9159028-27ac-4f9a-979a-62778faed203 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.373969 Oct 17 13:26:36.045728 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1273/2476] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:35 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:36.115186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.131309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:36.132051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:36.136078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.138051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.139291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4c66c2d-7164-483b-85ed-ac0c01ae04ab tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1336 microversion: 2.47 time: 0.171515 Oct 17 13:26:36.139858 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1204/2477] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:35 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1336 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:36.144206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.145655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.146115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.147312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.147773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.148190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.231453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:36.232070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:36.239070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.240255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.240698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.241451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.241903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.242326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.274916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.275663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.276092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.276705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lazy-loading 'fault' on Instance uuid 58496304-7f75-46c9-90aa-0bf036ecf80f {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:36.370219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.386447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-613fe6d1-7bb2-4f1a-8215-8e3b9e836442 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1305 microversion: 2.1 time: 0.158718 Oct 17 13:26:36.388519 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1205/2478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:36 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:36.472047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.481576 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59c09600-0829-419e-bb48-ebc1bfbf66fc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.354523 Oct 17 13:26:36.482350 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1274/2479] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:36 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:36.541727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:36.541727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:36.547120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.547800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.548304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.549216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:36.549737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:36.550168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:36.784095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:36.800696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b9698d5-6765-48b7-b5eb-101bbf73dbc7 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.265328 Oct 17 13:26:36.801871 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1206/2480] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:36 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:36.991264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:36.991990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:36.994578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:37.000989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.001630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.002180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.002962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.003497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.003995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.009528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=18 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:37.069129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:37.072167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:37.085833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.086342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.086790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.087521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.087984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.089149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.209958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.219270 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-843bfa79-3b44-4a7b-a9a0-e50a52ae21ba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1472 microversion: 2.1 time: 0.232703 Oct 17 13:26:37.239304 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1275/2481] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:36 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:37.244625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:37.245502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:37.252718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.253528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.254131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.255548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.256163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.256740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.299260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.312178 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d13fddf0-e566-4803-9472-2eb2bef34d75 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.248156 Oct 17 13:26:37.325256 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1207/2482] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:37 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:37.406250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e07e89b4-a62e-4fe6-9e60-a412a30c2f90 req-c9cc56a9-f75b-46ab-af34-3f1d13fdbf12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "tag": "0da17d46-46eb-4682-a61d-2650c166bc02"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:37.421888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e07e89b4-a62e-4fe6-9e60-a412a30c2f90 req-c9cc56a9-f75b-46ab-af34-3f1d13fdbf12 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.422379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e07e89b4-a62e-4fe6-9e60-a412a30c2f90 req-c9cc56a9-f75b-46ab-af34-3f1d13fdbf12 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.422813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e07e89b4-a62e-4fe6-9e60-a412a30c2f90 req-c9cc56a9-f75b-46ab-af34-3f1d13fdbf12 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.444010 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e07e89b4-a62e-4fe6-9e60-a412a30c2f90 req-c9cc56a9-f75b-46ab-af34-3f1d13fdbf12 service nova] Creating event network-changed:0da17d46-46eb-4682-a61d-2650c166bc02 for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:37.451152 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e07e89b4-a62e-4fe6-9e60-a412a30c2f90 req-c9cc56a9-f75b-46ab-af34-3f1d13fdbf12 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047359 Oct 17 13:26:37.452204 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1208/2483] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:37.462641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.474436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.476227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.477827 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a648639-21d8-4370-935f-c4c2681b1af1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1336 microversion: 2.47 time: 0.237137 Oct 17 13:26:37.478610 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1276/2484] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:37 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1336 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.497947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.510487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:37.514678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:37.527407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.531439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.532087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.533739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.534404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.535307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.557686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.557913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.558520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.559135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lazy-loading 'fault' on Instance uuid 58496304-7f75-46c9-90aa-0bf036ecf80f {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:37.695489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c288455d66584d91868c588e2879432c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f9ef8693b8b4c28b5186422a6c104c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.706993 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1caaa9e0-b4b8-4d10-bf55-455d4b8b24c1 tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 200 len: 1305 microversion: 2.1 time: 0.233097 Oct 17 13:26:37.707776 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1209/2485] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:37 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 1305 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:37.821934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:37.825440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:37.826327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:37.832661 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8e278c3-41e5-4877-8f2a-2e1fc6046918 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.329859 Oct 17 13:26:37.834333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.834933 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1277/2486] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:37 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:37.835434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.836162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.837138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:37.837768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:37.838362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:37.932842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=22 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:38.071664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:38.086500 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba9bd0bc-3e04-441b-8c0a-34a8981a4ef5 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.266095 Oct 17 13:26:38.088447 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1210/2487] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:37 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:38.245546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:38.246150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:38.254000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.254608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.255361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.256200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.256825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.257274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.432019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-301074412", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:38.467300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:38.480273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c034d1a2-5ce5-4ea9-9e3e-5d4862c102ae tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1472 microversion: 2.1 time: 0.238408 Oct 17 13:26:38.481132 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1278/2488] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:38 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:38.487331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:38.487923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:38.495635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.496347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.497006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.500268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.500400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:26:38.500759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.501305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.754981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:38.764523 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-124949fb-cc66-4042-9069-aa18c29de8a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.281959 Oct 17 13:26:38.765619 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1279/2489] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:38 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:38.779279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:38.780922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:38.798581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.799171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.799680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.800467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.800986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.801496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.840114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:38.840482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:38.841032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:38.841534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:38.841959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:38.854045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.854961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.855598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.856624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.857095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.857560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.878705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Getting quotas for project d1b040c4a92c4f398515ff63af4d3098. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:38.884949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Getting quotas for user a35bcf0aeee749038b6f5ceea6bdb0c5 and project d1b040c4a92c4f398515ff63af4d3098. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:38.894414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:38.902668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:26:38.904749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:38.905338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:26:38.906786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:38.908104 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79217f0c-6f2d-4143-8326-281c83dd0bcf tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1357 microversion: 2.47 time: 0.141442 Oct 17 13:26:38.921288 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1280/2490] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:38 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1357 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:38.921288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:38.921288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] [instance: 58496304-7f75-46c9-90aa-0bf036ecf80f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:38.930771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.930771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.930771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.930771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.930771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.930771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.943134 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] HTTP exception thrown: Instance 58496304-7f75-46c9-90aa-0bf036ecf80f could not be found. Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Request method failure captured: Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f HTTP/1.1 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfcDlq1Gu9B5PlYs0jLID6Lg_7PKmG8SC26WhHj-jF3_RQicZCpX36UXLOziZN0hATUfWbAWMifvktZSmnfOIWSbwPBVQ_6b4Ce0_1OMuxEPrBvrk8q7mi9t5x2vbDLgOXuSszxDzVp-JWHBeM27SvfiGUzeuAMMswya-Rq-hT4Q0U Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 8f9ef8693b8b4c28b5186422a6c104c3 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerPasswordTestJSON-952366988 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/8f9ef8693b8b4c28b5186422a6c104c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f9ef8693b8b4c28b5186422a6c104c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/8f9ef8693b8b4c28b5186422a6c104c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_8f9ef8693b8b4c28b5186422a6c104c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerPasswordTestJSON-952366988 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 8f9ef8693b8b4c28b5186422a6c104c3 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerPasswordTestJSON-952366988 Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerPasswordTestJSON-952366988-project Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c288455d66584d91868c588e2879432c Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerPasswordTestJSON-952366988-project Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 58496304-7f75-46c9-90aa-0bf036ecf80f could not be found. Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '58496304-7f75-46c9-90aa-0bf036ecf80f'} Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58496304-7f75-46c9-90aa-0bf036ecf80f could not be found. Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58496304-7f75-46c9-90aa-0bf036ecf80f could not be found. Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:38.945100 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58496304-7f75-46c9-90aa-0bf036ecf80f could not be found. Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] Returning 404 to user: Instance 58496304-7f75-46c9-90aa-0bf036ecf80f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c990ff91-09a1-4c70-8b63-8e572411bd2b tempest-ServerPasswordTestJSON-952366988 tempest-ServerPasswordTestJSON-952366988-project] 10.222.0.65 "GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f" status: 404 len: 111 microversion: 2.1 time: 0.036543 Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1281/2491] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:38 2022] GET /compute/v2.1/servers/58496304-7f75-46c9-90aa-0bf036ecf80f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:26:38.954476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-802a27ab-2021-4999-8f44-9226ffd16a2b req-395117e7-faff-490f-8864-d3b562219b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "name": "network-vif-plugged", "status": "completed", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:38.965236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-802a27ab-2021-4999-8f44-9226ffd16a2b req-395117e7-faff-490f-8864-d3b562219b7c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:38.965715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-802a27ab-2021-4999-8f44-9226ffd16a2b req-395117e7-faff-490f-8864-d3b562219b7c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:38.966190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-802a27ab-2021-4999-8f44-9226ffd16a2b req-395117e7-faff-490f-8864-d3b562219b7c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:38.969263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-550d58d0-0ade-4494-9226-0208ffbd1c43 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702654 Oct 17 13:26:38.971320 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1211/2492] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:26:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:26:38.980749 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-802a27ab-2021-4999-8f44-9226ffd16a2b req-395117e7-faff-490f-8864-d3b562219b7c service nova] Creating event network-vif-plugged:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:26:38.986433 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-802a27ab-2021-4999-8f44-9226ffd16a2b req-395117e7-faff-490f-8864-d3b562219b7c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 Oct 17 13:26:38.987036 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1282/2493] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:38.992449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:38.993191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:38.997095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:39.000916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.001469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.001969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.002601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.003495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.004116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.004967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.008417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.009109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.009753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.010623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.011225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.011903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.118159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:26:39.118678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:26:39.119275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:26:39.119753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:26:39.120399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:26:39.232489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.252300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.252816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.253421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.254191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.255811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.256330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.299791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e418e483-0aa4-473d-8e3c-890389addfb6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "POST /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f/action" status: 202 len: 1079 microversion: 2.47 time: 0.311253 Oct 17 13:26:39.300706 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1283/2494] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:26:38 2022] POST /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f/action => generated 1079 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:26:39.305839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d198324e-131c-4bd0-9e8d-95dd347f6c7a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:39.306695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d198324e-131c-4bd0-9e8d-95dd347f6c7a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.337870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.347419 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6e6e979-3188-4e52-acf9-f10a395380dc tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.374738 Oct 17 13:26:39.361937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1212/2495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:38 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:39.368949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:39.369602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.375878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.376626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.377415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.378314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.378938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.379542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.398355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d198324e-131c-4bd0-9e8d-95dd347f6c7a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.410871 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d198324e-131c-4bd0-9e8d-95dd347f6c7a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1222 microversion: 2.1 time: 0.108026 Oct 17 13:26:39.411780 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1284/2496] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:39 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:39.418836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:39.419698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.427315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.428104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.429298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.430167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.430886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.431442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.557802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.578381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.579944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.582254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae02dcab-118b-4303-821e-947402e0a66d tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.168566 Oct 17 13:26:39.583286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1285/2497] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:39 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:39.588604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f3e57283-54dc-4b3d-884e-46d62c351c3d req-aaf8613a-03dc-4d89-a8b3-2ea9c61cc991 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "tag": "e5157af0-780b-4cae-a19e-6a11ee826f25"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:39.599149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f3e57283-54dc-4b3d-884e-46d62c351c3d req-aaf8613a-03dc-4d89-a8b3-2ea9c61cc991 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.599732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f3e57283-54dc-4b3d-884e-46d62c351c3d req-aaf8613a-03dc-4d89-a8b3-2ea9c61cc991 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.600185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f3e57283-54dc-4b3d-884e-46d62c351c3d req-aaf8613a-03dc-4d89-a8b3-2ea9c61cc991 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.616551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f3e57283-54dc-4b3d-884e-46d62c351c3d req-aaf8613a-03dc-4d89-a8b3-2ea9c61cc991 service nova] Creating event network-changed:e5157af0-780b-4cae-a19e-6a11ee826f25 for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:39.623501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f3e57283-54dc-4b3d-884e-46d62c351c3d req-aaf8613a-03dc-4d89-a8b3-2ea9c61cc991 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038088 Oct 17 13:26:39.624546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1286/2498] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:39.631477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:39.632056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.644189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.644823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.646092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.647925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.648990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.651400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.761036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.769879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e57e0278-2983-47c4-92d9-21828d73086d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.406588 Oct 17 13:26:39.770470 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1213/2499] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:39 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:39.787004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:39.787626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:39.793815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.794343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.794788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.795494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:39.795952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:39.796378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:39.967278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:39.975901 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6074a5b-344c-4f43-9aa0-4459038292d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.350077 Oct 17 13:26:39.976714 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1287/2500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:39 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:40.046234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:40.056929 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff22bca1-ad6a-4a54-a498-21803a1d14d4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1317 microversion: 2.1 time: 0.273715 Oct 17 13:26:40.057815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1214/2501] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:39 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1317 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:40.374941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:40.375689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:40.383301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.384238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.384937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.385709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.386219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.386907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.441137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:40.442002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:40.451390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.451982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.452503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.453349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.453813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.454249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.589676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:40.600117 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d5ea680-a0d5-4936-82cf-c76abc6dfa4b tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1274 microversion: 2.1 time: 0.164299 Oct 17 13:26:40.600816 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1215/2502] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:40 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:40.613378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:40.617344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:40.621356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.621915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.622422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.623401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.623930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.624360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.692052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:40.700448 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61045174-c325-4f49-b83d-b584b36e4c34 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.329698 Oct 17 13:26:40.709739 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1288/2503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:40 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:40.710536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:40.722370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:40.724614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:40.725946 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ad3442a-888f-41d1-89c2-3167daff7d31 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.117844 Oct 17 13:26:40.735766 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1216/2504] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:40 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:40.794207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:40.794739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:40.803092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.803595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.804034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.804741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:40.805215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:40.805646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:40.810229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:41.000187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:41.001585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:41.009815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.010794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.011377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.012564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.013369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.014146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.504508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:41.515489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff46dd73-35c8-4126-8c01-13027a8c6c4b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.725446 Oct 17 13:26:41.529985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1289/2505] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:40 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:41.539171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:41.539806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:41.546051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.546541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.546978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.547878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.548504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.548933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.672378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:41.681607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b134314-8abb-4605-99fc-ca4a36a1030c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.685340 Oct 17 13:26:41.697197 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1217/2506] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:40 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:41.697197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:41.697197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:41.702722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.703294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.704003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.704892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.705631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.706141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.867802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:41.876242 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef684ec0-ee3a-439f-9d4f-cdc60123834e tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1280 microversion: 2.1 time: 0.186792 Oct 17 13:26:41.890049 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1218/2507] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:41 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1280 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:41.890049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:41.890049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:41.890049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:41.897856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.898692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.899166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.899914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.900382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.900824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.961929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:41.972230 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db5d305c-9be6-4fe0-b59c-a5c65dcb169d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1467 microversion: 2.1 time: 0.438671 Oct 17 13:26:41.973490 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1290/2508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:41 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1467 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:41.981888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:41.982638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:41.992635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.993593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.994604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:41.995541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:41.995993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:41.996441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.113986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:42.124897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:42.127644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:42.129589 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a03927f0-4ffd-4315-b6ba-6ef97f581ee4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.154761 Oct 17 13:26:42.147084 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1291/2509] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:41 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:42.159519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1174639767", "metadata": {"image_type": "test"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:42.163044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:42.171533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.172498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.173562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.174552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.175207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.175735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.206308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:42.221057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7230c3f1-03fc-4911-9d42-e27f278ea31e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.338172 Oct 17 13:26:42.223217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1219/2510] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:41 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:42.237424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Getting quotas for project d5fe0ce940ff409bb939b04a752dc010. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:26:42.246453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Getting quotas for user 3e96a6ca3cf74157be8a00df57f646d9 and project d5fe0ce940ff409bb939b04a752dc010. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:26:42.519454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f23ed2ae-6ec6-4377-ad30-a0abf2eafb96 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "POST /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46/action" status: 202 len: 0 microversion: 2.1 time: 0.370306 Oct 17 13:26:42.520078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1292/2511] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:26:42 2022] POST /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:26:42.533486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9bedcd17-4ff7-40c7-af97-9f86e34cfc22 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a1f92d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.540046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.540761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:42.561260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.561826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.562273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.563301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.563704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.564114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.612520 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9bedcd17-4ff7-40c7-af97-9f86e34cfc22 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.084589 Oct 17 13:26:42.613120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1220/2512] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:42.708861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.709906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:42.721207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.722155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.722851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.723927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.724653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.725320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.777574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:42.786547 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16bf04bc-5549-4c96-8edf-4912a8667e28 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.250717 Oct 17 13:26:42.787355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1293/2513] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:42.903138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:42.904075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:42.916672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.917186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.919050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:42.919799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:42.924507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:42.925291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:43.132179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:43.142982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fba7a251-a3db-48c7-b74c-89cd85f2e22c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.438947 Oct 17 13:26:43.144205 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1221/2514] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:43.162976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:43.163622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:43.173654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:43.174084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:43.174530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:43.175457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:43.176201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:43.176920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:43.184345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:43.200601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:43.217493 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c0c598a-8c32-4cfc-9db5-c80a554e2c44 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.315223 Oct 17 13:26:43.240778 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1294/2515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:42 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:43.254384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:43.255529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:43.275501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:43.276005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:43.276450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:43.277193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:43.277644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:43.278070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:43.349583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:43.368146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:43.370115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:43.371357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4aa26c8-5c72-458e-ab3b-23bb58f48d69 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.214649 Oct 17 13:26:43.382658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1222/2516] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:43 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:43.603564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:43.634146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d044363-1c6a-468d-83f3-b5603d53b1ca tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a20779d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:43.650659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68e35600-06cc-40aa-86f6-ce55adfb70cf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.400127 Oct 17 13:26:43.658383 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1295/2517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:43 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:43.711408 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d044363-1c6a-468d-83f3-b5603d53b1ca tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.086203 Oct 17 13:26:43.713381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1223/2518] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:43 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:43.811934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:43.813213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:43.815590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:43.839944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:43.840158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:43.840570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:43.841322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:43.845236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:43.848320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.134259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:44.155172 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edb15b1a-fcc1-4d52-846a-cba7fbfa84af tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.347091 Oct 17 13:26:44.162113 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1296/2519] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:43 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:44.167610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:44.168243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:44.176895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.177554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.178185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.179320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.179790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.180225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.244471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:44.245604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:44.256511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.257355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.258049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.258943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.259505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.260034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.446056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:44.465424 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2861ab1e-0653-43c4-a738-60a877a7330e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.301881 Oct 17 13:26:44.466101 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1224/2520] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:44 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:44.479118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:44.479751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:44.497633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.498379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.498970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.499897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.500506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.501441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.545950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:44.558150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16ec80bc-3044-43d0-9c63-109f5992b4c8 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.317279 Oct 17 13:26:44.574170 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1297/2521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:44 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:44.589643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:44.601529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:44.603125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:44.604639 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fd544e1-80be-4d88-90b5-16ceeaa14fb8 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.137571 Oct 17 13:26:44.617507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1225/2522] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:44 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:44.678099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:44.687485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:44.705591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.706895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.707591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.708685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.709547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.710571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.732329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-235cde03-5519-4223-9250-86a46a3e330f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a1f749d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:44.809124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-235cde03-5519-4223-9250-86a46a3e330f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.084222 Oct 17 13:26:44.810383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1226/2523] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:44 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:44.817107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-43c8d8f8-54f2-4945-b13d-65e4b6c0d11d req-131cb82c-4a5c-496c-bcd8-1dae6909df75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71f5479-bbd7-4159-8e39-1665f0eec530", "tag": "286393d6-2d3f-41d6-bc19-984afb12d98a"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:44.832527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-43c8d8f8-54f2-4945-b13d-65e4b6c0d11d req-131cb82c-4a5c-496c-bcd8-1dae6909df75 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:44.833537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-43c8d8f8-54f2-4945-b13d-65e4b6c0d11d req-131cb82c-4a5c-496c-bcd8-1dae6909df75 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:44.834499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-43c8d8f8-54f2-4945-b13d-65e4b6c0d11d req-131cb82c-4a5c-496c-bcd8-1dae6909df75 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:44.846630 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-43c8d8f8-54f2-4945-b13d-65e4b6c0d11d req-131cb82c-4a5c-496c-bcd8-1dae6909df75 service nova] Creating event network-changed:286393d6-2d3f-41d6-bc19-984afb12d98a for instance b71f5479-bbd7-4159-8e39-1665f0eec530 on n-h2-854121-14 Oct 17 13:26:44.854868 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-43c8d8f8-54f2-4945-b13d-65e4b6c0d11d req-131cb82c-4a5c-496c-bcd8-1dae6909df75 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041970 Oct 17 13:26:44.856072 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1227/2524] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:45.062603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.073494 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ee8a8913-5c19-477b-89af-ae72d9cf51f3 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.399602 Oct 17 13:26:45.074671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1298/2525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:44 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:45.181622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:45.182654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:45.189436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.189937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.190385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.191106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.191566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.191996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.416262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.424175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2878efbb-2e4b-4f3c-b920-454687626e5b tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.247911 Oct 17 13:26:45.424847 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1228/2526] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:45 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:45.492719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:45.493506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:45.500083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.500568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.501005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.501780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.502263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.502689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.584044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:45.585134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:45.591787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.592627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.593075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.593821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.594283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.594922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.694686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.705281 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f62b8cc-3679-4335-9015-32bc93939644 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.217501 Oct 17 13:26:45.705872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1299/2527] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:45 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:45.719841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:45.720732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:45.727754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.728242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.728679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.729454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:45.730080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:45.730681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:45.767556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.787944 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33e7cf58-ce79-47d7-8f8e-2c36d00e44b5 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.208913 Oct 17 13:26:45.789906 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1229/2528] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:45 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:45.807908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.816810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.818860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:45.825983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a1f091f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:45.830559 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.114947 Oct 17 13:26:45.831870 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1300/2529] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:45 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:45.877292 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.055425 Oct 17 13:26:45.878476 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1230/2530] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:45 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:46.081832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.082914 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b59c192f-7c3e-44e0-874d-adcea5ac47f9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001370 Oct 17 13:26:46.083255 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1301/2531] 10.222.0.65 () {56 vars in 886 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:26:46.091565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.092864 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001815 Oct 17 13:26:46.093459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1231/2532] 10.222.0.65 () {54 vars in 1035 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 17 13:26:46.097645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.099261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:46.101876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.102856 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001362 Oct 17 13:26:46.103281 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1232/2533] 10.222.0.65 () {54 vars in 1041 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:46.109281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.109997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.110689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.111484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.111788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.112395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.112519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cd0ebcd-5fc7-4573-9d0a-b7f8960a8b13 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001174 Oct 17 13:26:46.112821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.112949 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1233/2534] 10.222.0.65 () {56 vars in 886 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 17 13:26:46.274794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:46.288950 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3db18bf7-ab2e-46e4-be06-958f7f84761f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.194824 Oct 17 13:26:46.290214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1302/2535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:46.449295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.449934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:46.457438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.458465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.458558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.459405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.460108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.460648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.618068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:46.627585 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78243d97-e068-4c99-b4cb-6635748ea614 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.183057 Oct 17 13:26:46.628181 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1234/2536] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:46.731331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.731947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:46.739939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.740672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.741294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.742157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.742805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.743234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.817820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:46.818845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:46.828562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.829772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.830411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:46.831582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:46.832840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:46.842918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.043687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.055339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7dfbac1c-7b12-4330-9682-14a7fe3b1de6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.327921 Oct 17 13:26:47.056092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1303/2537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:47.061503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:47.062235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:47.069740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.070367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.070908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.071777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.072463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.073082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.095471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.108426 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b33258ec-1360-43a7-8aec-b4102e049714 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.295914 Oct 17 13:26:47.121483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1235/2538] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:46 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:47.146062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-052c80a3-c40e-4512-8595-e57de4ee3048 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a21315e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:47.181546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.186623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:47.195068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.197428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.199624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d690f14-1b96-4989-8a2f-d9c9416c4b56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.142487 Oct 17 13:26:47.200642 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1304/2539] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:47 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:47.214507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-052c80a3-c40e-4512-8595-e57de4ee3048 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.080911 Oct 17 13:26:47.215289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1236/2540] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:47 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:47.312286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:47.313391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:47.327641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.328573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.329283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.330837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.332032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.332685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.361957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6bb18608-3f39-472e-85d0-437e06d7d3eb req-22ae10a9-977f-4de1-85d2-9b735118c849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "name": "network-vif-plugged", "status": "completed", "tag": "0da17d46-46eb-4682-a61d-2650c166bc02"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:47.379392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6bb18608-3f39-472e-85d0-437e06d7d3eb req-22ae10a9-977f-4de1-85d2-9b735118c849 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.381899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6bb18608-3f39-472e-85d0-437e06d7d3eb req-22ae10a9-977f-4de1-85d2-9b735118c849 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.383349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6bb18608-3f39-472e-85d0-437e06d7d3eb req-22ae10a9-977f-4de1-85d2-9b735118c849 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.410279 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6bb18608-3f39-472e-85d0-437e06d7d3eb req-22ae10a9-977f-4de1-85d2-9b735118c849 service nova] Creating event network-vif-plugged:0da17d46-46eb-4682-a61d-2650c166bc02 for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:47.435924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6bb18608-3f39-472e-85d0-437e06d7d3eb req-22ae10a9-977f-4de1-85d2-9b735118c849 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077517 Oct 17 13:26:47.437663 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1237/2541] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:26:47.572141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.581692 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8c81191-41e4-46b6-ac77-564fec77732f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.273648 Oct 17 13:26:47.582481 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1305/2542] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:47 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:47.661608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:47.662460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:47.673772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.675421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.675855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.677812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:47.678309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:47.678739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:47.851635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:47.861265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91914e18-b413-4729-a1d8-d952f0d5e49d tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.206258 Oct 17 13:26:47.861864 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1238/2543] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:47 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:48.078640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:48.079730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:48.091918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.098458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.098917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.099777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.103068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.104627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.135547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:48.136564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:48.143414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.144017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.144566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.145417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.145945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.146683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.387540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:48.393151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:48.398558 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0be58fd3-1644-4027-bec3-5a66b938bef3 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.267226 Oct 17 13:26:48.399724 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1239/2544] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:48 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:48.404811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:48.405458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:48.412873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.413043 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d9fa041e-26be-4056-a3aa-910325ecfb87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.338738 Oct 17 13:26:48.413820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.414476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.415421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.416090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.416745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.431358 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1306/2545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:48 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:48.436329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-356a70a7-4eda-41c9-b1db-d46feaa69c04 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e225790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:48.517000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:48.530961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:48.532577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:48.533850 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-356a70a7-4eda-41c9-b1db-d46feaa69c04 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.100319 Oct 17 13:26:48.536190 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a48a5e49-3289-4dc8-baf2-66a783ac7d2a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.134086 Oct 17 13:26:48.537478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1240/2546] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:48 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:48.543066 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1307/2547] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:48 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:48.609429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:48.610516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:48.622813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.630800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.633728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.634862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.635417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.635939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.834297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:48.848266 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a379f93-169f-4ea0-ac22-189028e3cc5d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.242448 Oct 17 13:26:48.848905 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1241/2548] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:48 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:48.892740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:48.893498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:48.904984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.912057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.912527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:48.913306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:48.916510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:48.916955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:49.229851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:49.248672 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31762a3c-30d6-4a8a-85a9-5e41ccc371b8 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1523 microversion: 2.1 time: 0.361420 Oct 17 13:26:49.260993 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1308/2549] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:48 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:49.422746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:49.423670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:49.436874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:49.437809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:49.440836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:49.448697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:49.453947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:49.467521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:49.467737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:49.468227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:49.468659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:49.469423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:49.471692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:49.475766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:49.476906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:49.477660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:49.478170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:49.478477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:49.479188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:49.969274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:49.981901 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ced68cc-c670-48be-ab59-f38ca5c0856d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.549113 Oct 17 13:26:49.983051 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1309/2550] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:49 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:49.990569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "name": "network-vif-plugged", "status": "completed", "tag": "e5157af0-780b-4cae-a19e-6a11ee826f25"}, {"server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "name": "network-vif-plugged", "status": "completed", "tag": "a2e03a86-449e-4cc4-bd80-6cd5491edb9f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:50.045272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.045759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.048578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.103305 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] Creating event network-vif-plugged:e5157af0-780b-4cae-a19e-6a11ee826f25 for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:50.104115 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] Creating event network-vif-plugged:a2e03a86-449e-4cc4-bd80-6cd5491edb9f for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:50.117891 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-858ad6d4-2b60-4443-8854-17711fbea2fa req-8bb1e1b8-d403-49ce-a6cb-89a0dcc10922 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.133178 Oct 17 13:26:50.119075 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1310/2551] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:50.124483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b68b51af-2496-4942-868f-5e15aff93b23 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddb35e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:50.144387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.161783 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b51e698d-1730-4210-bbba-8109ddcf7cf6 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.742686 Oct 17 13:26:50.173714 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1242/2552] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:49 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:50.188278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:50.189096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:50.198446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.199465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.200696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.202713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.203204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.205638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.215723 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b68b51af-2496-4942-868f-5e15aff93b23 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.095242 Oct 17 13:26:50.216288 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1311/2553] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:50 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:50.228583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:50.229361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:50.247707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.248418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.248610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.249362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.249829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.253065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.393580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.407656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.409526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.411407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84d3f925-6ecb-4607-9456-d7ce8aa6959a tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.236051 Oct 17 13:26:50.412189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1243/2554] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:50 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:50.419302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:50.420138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:50.427180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.427971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.428648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.429534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.430311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.431250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.593615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.603776 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8bc7e86-e2b7-4d54-bb8d-ea6451774e2e tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.386024 Oct 17 13:26:50.611050 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1312/2555] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:50 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:50.660373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.670458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed381c9a-6600-4945-a83f-7b4c5a16401a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1500 microversion: 2.1 time: 0.256848 Oct 17 13:26:50.672078 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1244/2556] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:50 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1500 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:50.694845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:50.700226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:50.701282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:50.706828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.707503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.708145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.709222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.709865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.710286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.804993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:50.875854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9599777-c4b8-4ea1-a4d8-ae939c3f3a65 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.185042 Oct 17 13:26:50.876445 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1313/2557] 10.222.0.65 () {58 vars in 1154 bytes} [Mon Oct 17 13:26:50 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:50.889947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7e7ccd0-03ce-4fc0-b5dd-16bd76b0c029 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:50.897906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7e7ccd0-03ce-4fc0-b5dd-16bd76b0c029 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.898336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7e7ccd0-03ce-4fc0-b5dd-16bd76b0c029 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:50.898792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7e7ccd0-03ce-4fc0-b5dd-16bd76b0c029 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:50.924626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7e7ccd0-03ce-4fc0-b5dd-16bd76b0c029 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Going to try to start instance {{(pid=120697) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:26:50.978632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7e7ccd0-03ce-4fc0-b5dd-16bd76b0c029 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "POST /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef/action" status: 202 len: 0 microversion: 2.1 time: 0.091050 Oct 17 13:26:50.978632 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1245/2558] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:26:50 2022] POST /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:26:50.988228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:50.989897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:50.998316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:50.998928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.000232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.001883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.002400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.002856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.013858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:51.014664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:51.023326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.023852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.024297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.025021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.025539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.028312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.031712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:51.374406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:51.387626 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0465a2c7-e9da-47a4-ac1c-9c7c0d22260a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1509 microversion: 2.1 time: 0.404806 Oct 17 13:26:51.388941 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1314/2559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:50 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:51.399687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:51.400906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-788197a7-6c65-4b52-a684-ba9224ebaf48 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419e0bfee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:51.408051 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8cafeba2-0313-4186-9bf0-fdc727d8d96a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.401303 Oct 17 13:26:51.408844 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1246/2560] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:51 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:26:51.419552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:51.420193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:51.427547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.428277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.429196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.430445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.431052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.431633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.490336 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-788197a7-6c65-4b52-a684-ba9224ebaf48 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/9d7992b7-b428-41bc-87db-187d644add62" status: 200 len: 351 microversion: 2.1 time: 0.100095 Oct 17 13:26:51.492964 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1315/2561] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:51 2022] GET /compute/v2.1/os-volumes/9d7992b7-b428-41bc-87db-187d644add62 => generated 351 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:51.499488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-def81366-5a29-4f93-8a86-c4c626205b9b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddc8940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:51.603080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-def81366-5a29-4f93-8a86-c4c626205b9b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.107318 Oct 17 13:26:51.604071 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1316/2562] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:51 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:51.622725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:51.623513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:51.632537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.633735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.651746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.652934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.653610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.654055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.656417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:51.667981 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d86ff194-9062-4e25-8b7c-2e2888825bfc tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.258177 Oct 17 13:26:51.670690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1247/2563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:51 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:51.689739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:51.691147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:51.712201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.718531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.718992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:51.719744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:51.727781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:51.729374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.304780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:52.315794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:52.319984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:52.327798 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a753bd9-bd8d-4bd1-9370-0de0588c1837 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.721810 Oct 17 13:26:52.328857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1317/2564] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:51 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:52.338335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "name": "network-vif-plugged", "status": "completed", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}, {"server_uuid": "b71f5479-bbd7-4159-8e39-1665f0eec530", "name": "network-vif-plugged", "status": "completed", "tag": "286393d6-2d3f-41d6-bc19-984afb12d98a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:52.363067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.364545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.365049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.386516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] Creating event network-vif-plugged:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:26:52.387180 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] Creating event network-vif-plugged:286393d6-2d3f-41d6-bc19-984afb12d98a for instance b71f5479-bbd7-4159-8e39-1665f0eec530 on n-h2-854121-14 Oct 17 13:26:52.407059 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-771a5d98-0251-416a-bc83-2f335876bf6e req-56ad1674-49e8-49f7-a63d-62c67e55e49a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076623 Oct 17 13:26:52.408106 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1318/2565] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:52.418172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:52.419566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:52.429896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.430623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.431857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.431987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:52.434047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.436094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.437424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.455909 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3415eccf-c0d7-407a-b538-a831d390896b tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1355 microversion: 2.1 time: 0.776479 Oct 17 13:26:52.457594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1248/2566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:51 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1355 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:52.466903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:52.467770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:52.497180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.500779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.501661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.502594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.503278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.503921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.856864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:52.866007 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f327fad1-d732-42f0-afe1-4bdf4e8db073 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1509 microversion: 2.1 time: 0.456364 Oct 17 13:26:52.867767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:52.869625 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1319/2567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:52 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1509 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:52.874316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dc94d2a-07d9-4ccf-b4cf-39fbb4158e7d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddb3f70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:52.878863 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b076c38-f4e2-4ed0-80d2-b77e681831fa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.419533 Oct 17 13:26:52.884234 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1249/2568] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:52 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:52.908243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:52.912777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:52.925219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.925748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.926265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.927543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:52.929691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:52.930130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:52.956730 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3dc94d2a-07d9-4ccf-b4cf-39fbb4158e7d tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.085936 Oct 17 13:26:52.973334 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1320/2569] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:52 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:53.179617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:53.190797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f57e41ef-cd7e-43a3-ade9-88cdc36f8815 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.300231 Oct 17 13:26:53.191481 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1250/2570] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:52 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:53.357559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:53.358300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:53.369670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.370253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.370953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.371860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.372388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.373009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.441968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:53.452663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:53.454715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:53.455990 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-105b73b4-4ffe-4329-a8a6-912938bdd2b5 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.102999 Oct 17 13:26:53.457069 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1321/2571] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:53 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:53.484172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:53.484791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:53.492701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.493219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.493684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.494389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.494837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.495254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.682710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:53.696292 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc028693-8247-4974-8ac3-e52f6b889dc7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1804 microversion: 2.1 time: 0.216185 Oct 17 13:26:53.697250 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1251/2572] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:53 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1804 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:53.719742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:53.720243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:53.727352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.727939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.728428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.729179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.729662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.730096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.759101 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-385c58d6-0a43-4109-8efd-c8844eeb9aaf tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca/ips" status: 200 len: 217 microversion: 2.1 time: 0.043125 Oct 17 13:26:53.759940 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1322/2573] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:26:53 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca/ips => generated 217 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:53.772236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:53.772741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:53.779910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.779910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.780348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.781302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.781766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.782200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.810997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:53.897214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:53.898304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:53.903479 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10e26860-0c25-4617-b49c-25155069fd75 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "DELETE /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 204 len: 0 microversion: 2.1 time: 0.134851 Oct 17 13:26:53.907018 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1252/2574] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:53 2022] DELETE /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:53.907227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.907227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.907227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.910048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.911464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.911935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.912656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:53.915429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:53.925843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.925843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.925843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:53.925843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:53.926843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:53.927575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.110829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.127351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb3e7236-dc77-4715-bd6d-90c9d978ba98 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1509 microversion: 2.1 time: 0.228830 Oct 17 13:26:54.131205 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1323/2575] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:53 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:54.136222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:54.136839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:54.149972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:54.150585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:54.151028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.154004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:54.154479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:54.154920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.171305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.189095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ee4f848-20b7-401f-a3ec-50330dd2a8e9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.282546 Oct 17 13:26:54.194608 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1253/2576] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:53 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:54.202527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ee76397-3275-45ed-addf-4ce454293ee2 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a1f090d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:54.275519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ee76397-3275-45ed-addf-4ce454293ee2 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.079288 Oct 17 13:26:54.276448 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1254/2577] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:54 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:54.294398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:54.295434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:54.305520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:54.306401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:54.307242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.308202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:54.308872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:54.309551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.480990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.495866 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b11150f-a159-4943-84ee-3871b1191bae tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1810 microversion: 2.1 time: 0.363293 Oct 17 13:26:54.496456 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1324/2578] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:54 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1810 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:54.502569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5bbdfa0b-a277-4a84-b17f-8794315576ed tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419dd145e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:54.540715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.551305 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-615ae093-597d-4700-8a67-ee6fe1deffc2 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1322 microversion: 2.1 time: 0.263607 Oct 17 13:26:54.551949 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1255/2579] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:54 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:54.563579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:54.564207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:54.570651 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5bbdfa0b-a277-4a84-b17f-8794315576ed tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/59425630-c2de-4e1c-8330-e5903e303f2f" status: 200 len: 351 microversion: 2.1 time: 0.073092 Oct 17 13:26:54.571580 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1325/2580] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:54 2022] GET /compute/v2.1/os-volumes/59425630-c2de-4e1c-8330-e5903e303f2f => generated 351 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:54.572054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:54.572977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:54.573775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.574714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:54.575365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:54.575982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:54.663800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.676977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.681291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:54.683920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-abc609af-c41f-48ce-84cc-8485753a467e tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.130912 Oct 17 13:26:54.697189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1256/2581] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:54 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:55.152214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.152832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:55.161234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.161562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.164388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.165347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.165895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.166390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.221184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.222088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:55.234502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.238014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.241622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.242552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.243123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.243642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.441277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:55.441277 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd9def4f-6deb-4808-b441-3a8955b9df6a tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1513 microversion: 2.1 time: 0.283678 Oct 17 13:26:55.441277 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1326/2582] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:55.441277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70a11efc-f1f3-4c12-9e6c-5906c914150a tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddb3f70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.468921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:55.480057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bfc91c07-1fd8-499f-8d79-a296ee09aadf tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.262979 Oct 17 13:26:55.480625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1257/2583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:55.497098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.503791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:55.504255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.servers [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Removing options 'limit' from query {{(pid=120697) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:26:55.505850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:55.507049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.507547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.507982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.508726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.509208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.509701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.510606 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70a11efc-f1f3-4c12-9e6c-5906c914150a tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.075394 Oct 17 13:26:55.519054 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4368d5af-2ef2-406d-865b-3f4319ffdc3f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.029952 Oct 17 13:26:55.519234 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1327/2584] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:55.519341 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1258/2585] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:26:55.521955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.522839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:55.529191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.529807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:55.531887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.532379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.533073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.536626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.537396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.538002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.539327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.540167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.540845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.544720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.545269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.545722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.885598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:55.895219 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59497c4d-13e6-4c27-8384-a19cf7f6e66f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1810 microversion: 2.1 time: 0.377001 Oct 17 13:26:55.910919 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1328/2586] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:55.918929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:55.919531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.920257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:55.927048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.927650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.928178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.929109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.929608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.930137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.930518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db3d6f15-bb14-42fe-a249-827fce875721 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1513 microversion: 2.1 time: 0.409652 Oct 17 13:26:55.931117 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1259/2587] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:55.950396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:55.951160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:55.964023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.968337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.968986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:55.969916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:55.970500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:55.973751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.098169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.111367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.116027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.119484 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb0adbef-b08c-43ce-843f-8bf7b2904c62 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.181070 Oct 17 13:26:56.120129 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1260/2588] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:56.128897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.129597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.147599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.148015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.148457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.149265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.149769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.150201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.195101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.198688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:56.225744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc1b44c5-b099-4643-bd60-202fc5ec1b36 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1472 microversion: 2.1 time: 0.313206 Oct 17 13:26:56.242043 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1329/2589] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:55 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1472 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:56.250320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.251065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.259280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.260074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.260709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.261706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.262827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.263433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.292994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.298462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Request method failure captured: Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530/diagnostics HTTP/1.1 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVgNg5LZCWcJWyJhIuD45kabaPqE_88AqU1Jyprk1mEtPTwkWuJYHm1rhXmhFad6CL1pxQ5OWFdSMWQc5QsolR7UFzRqgg9Sh9sHBD0lVsUpNbC01iBh2p6bE71D6oIL62B73rtaVQ35xz1JwGrgQCsA_nNGWeix3yqDstZ5vIjwLwM Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d1b040c4a92c4f398515ff63af4d3098 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1474315214 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1474315214 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d1b040c4a92c4f398515ff63af4d3098 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1474315214 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerDiagnosticsNegativeTest-1474315214-project Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: a35bcf0aeee749038b6f5ceea6bdb0c5 Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1474315214-project Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': 'b71f5479-bbd7-4159-8e39-1665f0eec530'} Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.304079 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:26:56.308546 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1341a3c4-849d-4bd1-ad36-d28afeac1275 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.060980 Oct 17 13:26:56.313007 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1330/2590] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530/diagnostics => generated 117 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:26:56.316753 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35265767-37a1-45d7-90ef-18deb67df6cd tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 200 len: 1510 microversion: 2.1 time: 0.195546 Oct 17 13:26:56.318546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1261/2591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:56.318882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.319851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.326050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.326544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.326981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.327685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.328135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.328554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.345506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.346834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.359024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.359980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.362822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.363767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.365309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.370882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.371757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:26:56.597207 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9102f7a-bf26-4519-91c5-384146f9f4f1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 204 len: 0 microversion: 2.1 time: 0.282355 Oct 17 13:26:56.604030 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1331/2592] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:26:56 2022] DELETE /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:26:56.624704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.625896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.642971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.643483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.643960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.644678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.650012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.653794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.677918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.694044 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6c8ff99-44c0-424b-99f7-e51ed849aa7e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1512 microversion: 2.1 time: 0.352689 Oct 17 13:26:56.695004 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1262/2593] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1512 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:56.700646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a7caa6c-0f97-4370-83b0-c8e7e6ef9714 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a1f74700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.774550 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a7caa6c-0f97-4370-83b0-c8e7e6ef9714 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.077905 Oct 17 13:26:56.775145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1263/2594] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:56.784371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dcfae88e-77f5-4a75-9840-1fe9f45b38e4 req-a7a2b0f1-3b4e-4fab-8b88-03a07e21b619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "name": "network-vif-deleted", "tag": "a2e03a86-449e-4cc4-bd80-6cd5491edb9f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:56.807766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcfae88e-77f5-4a75-9840-1fe9f45b38e4 req-a7a2b0f1-3b4e-4fab-8b88-03a07e21b619 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.808254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcfae88e-77f5-4a75-9840-1fe9f45b38e4 req-a7a2b0f1-3b4e-4fab-8b88-03a07e21b619 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.808695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcfae88e-77f5-4a75-9840-1fe9f45b38e4 req-a7a2b0f1-3b4e-4fab-8b88-03a07e21b619 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.831271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:26:56.836896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dcfae88e-77f5-4a75-9840-1fe9f45b38e4 req-a7a2b0f1-3b4e-4fab-8b88-03a07e21b619 service nova] Creating event network-vif-deleted:a2e03a86-449e-4cc4-bd80-6cd5491edb9f for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:56.857718 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dcfae88e-77f5-4a75-9840-1fe9f45b38e4 req-a7a2b0f1-3b4e-4fab-8b88-03a07e21b619 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081177 Oct 17 13:26:56.858531 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1264/2595] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:56.868015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.871465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:56.897532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.900295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.900955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.905388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:56.906606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:56.907221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:56.971624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:56.985858 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b851085-8e48-40c4-a7cc-c6603423dd5f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.380395 Oct 17 13:26:56.986644 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1332/2596] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:56.993480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:56.999535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.000306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:57.182404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.184415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.184936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.186044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.186578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.187074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.199635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.214872 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8a81e66-ca7f-4244-90f5-b4eb871c1597 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1478 microversion: 2.1 time: 0.354632 Oct 17 13:26:57.215480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1265/2597] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1478 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:57.246015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.246636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:57.255499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.255996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.256439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.257176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.257656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.258085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.351355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:57.454761 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c87ffda9-48fc-42c0-a78f-9bd71fa3a610 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 0.465887 Oct 17 13:26:57.455353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1333/2598] 10.222.0.65 () {58 vars in 1154 bytes} [Mon Oct 17 13:26:56 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:57.466775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-874a8f23-1d50-4674-aa0a-cdb98e2a5cc1 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419dd47160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.500287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.513670 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61b3b0b9-c10c-4a58-b02e-8902cf22c720 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1653 microversion: 2.1 time: 0.274721 Oct 17 13:26:57.526495 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1266/2599] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1653 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:57.538821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.539805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:57.547847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-874a8f23-1d50-4674-aa0a-cdb98e2a5cc1 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f46f0c5e-d1fb-428e-bd86-086d1503af12" status: 200 len: 351 microversion: 2.1 time: 0.085149 Oct 17 13:26:57.549147 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1334/2600] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/os-volumes/f46f0c5e-d1fb-428e-bd86-086d1503af12 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:57.555279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.557800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:57.560734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.562932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.566562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.568319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.569514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.570206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.570850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.573886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.574584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.575550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.576239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.578391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.675862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.685913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.688159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.689619 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7669e410-35e4-40e6-8161-5307704f08e4 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.161889 Oct 17 13:26:57.690802 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1267/2601] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:57.697501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17e68f20-9749-4ba7-931f-88f20355f022 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419deab430>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.843963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:57.868612 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e32fe2a-9139-4566-8912-a38344cf935e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1513 microversion: 2.1 time: 0.318066 Oct 17 13:26:57.869428 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1335/2602] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1513 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:57.881416 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17e68f20-9749-4ba7-931f-88f20355f022 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.176164 Oct 17 13:26:57.881416 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1268/2603] 10.222.0.65 () {58 vars in 1134 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:57.885900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3da9124a-e7d5-4943-9755-8768dc04ec9a tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419db52ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.886322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90c063ba-0cf8-4f0e-939f-ec5825c136c7 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dd3f0d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.960620 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90c063ba-0cf8-4f0e-939f-ec5825c136c7 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.089869 Oct 17 13:26:57.962134 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1336/2604] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:57.967313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:57.968007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:57.975479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.976039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.976545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:57.977574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:57.978186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:57.978771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.077409 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3da9124a-e7d5-4943-9755-8768dc04ec9a tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.195238 Oct 17 13:26:58.078261 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1269/2605] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:58.085070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:58.086573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:58.100986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.101903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.102567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.103534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.104230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.104891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.351737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:58.368975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63e55679-5b41-4cb3-8cfb-def909c41447 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 200 len: 1510 microversion: 2.1 time: 0.405583 Oct 17 13:26:58.389243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1337/2606] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:57 2022] GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:58.389243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1f2a353-90a9-4520-94ef-985948262a8c tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419dd474c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:58.472709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:58.483488 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e779698d-8805-4798-ba75-f90920bf611e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.403532 Oct 17 13:26:58.484563 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1270/2607] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:58 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:58.499991 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1f2a353-90a9-4520-94ef-985948262a8c tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.115819 Oct 17 13:26:58.500559 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1338/2608] 10.222.0.65 () {58 vars in 1134 bytes} [Mon Oct 17 13:26:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:58.509047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:58.509794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:58.511130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:58.511937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:58.517202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.517869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.518390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.519242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.519780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.520833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.532485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.539338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.540375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.541147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:58.541664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:58.542101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:58.940628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:58.950024 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7983aab6-ebd2-43d0-853b-30f0bb1431c3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1512 microversion: 2.1 time: 0.448067 Oct 17 13:26:58.954527 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1339/2609] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:58 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:58.964889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df966b14-80ae-459f-a705-2b9244c88d0a tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419dd93e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:58.968796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.002646 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-337fc73c-bebc-44b2-ac7f-4f93248b0e39 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1478 microversion: 2.1 time: 0.505737 Oct 17 13:26:59.016221 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1271/2610] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:58 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1478 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:59.026504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.027396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:59.034126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.035409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.036562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.037616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.038186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.038739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.087547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.087547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.087547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.092000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lazy-loading 'fault' on Instance uuid 811dadb1-321d-4db8-9883-26395c20c7ca {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:26:59.146781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df966b14-80ae-459f-a705-2b9244c88d0a tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.190832 Oct 17 13:26:59.148287 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1340/2611] 10.222.0.65 () {58 vars in 1167 bytes} [Mon Oct 17 13:26:58 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:59.153806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.154671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:59.162565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.164451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.165088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.166062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.167324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.167955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.171904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.189107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-112a73ed-acf8-42d4-8c35-e6eb9c51e2c4 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 200 len: 1303 microversion: 2.1 time: 0.171555 Oct 17 13:26:59.211557 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1272/2612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 1303 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:59.216926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "name": "network-vif-deleted", "tag": "0da17d46-46eb-4682-a61d-2650c166bc02"}, {"server_uuid": "811dadb1-321d-4db8-9883-26395c20c7ca", "name": "network-vif-deleted", "tag": "e5157af0-780b-4cae-a19e-6a11ee826f25"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:59.233785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.234817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.234817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.248602 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] Creating event network-vif-deleted:0da17d46-46eb-4682-a61d-2650c166bc02 for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:59.249174 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] Creating event network-vif-deleted:e5157af0-780b-4cae-a19e-6a11ee826f25 for instance 811dadb1-321d-4db8-9883-26395c20c7ca on n-h1-854121-14 Oct 17 13:26:59.255671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-efbbef48-b741-4406-8dd5-7147d7544b94 req-7b9190f0-2c28-49a9-99d4-e3d6a5db2247 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042373 Oct 17 13:26:59.256725 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1273/2613] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:59.262897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ac034a2-2b56-4e68-8e28-128b9861c802 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dae74c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.294693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.311428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.313069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.319592 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7de6b457-dc23-4604-a26b-13410d648980 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.169916 Oct 17 13:26:59.331404 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1341/2614] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:26:59.331404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.342236 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ac034a2-2b56-4e68-8e28-128b9861c802 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.083606 Oct 17 13:26:59.343825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1274/2615] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:59.350159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95f1acfb-ebbc-427c-83f2-feb037b62307 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419e3c94c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.356414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.358345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:26:59.370412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.370990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.371466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.372256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.372771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.373135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.443855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:26:59.499678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.510316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.511400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.512171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.518789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95f1acfb-ebbc-427c-83f2-feb037b62307 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.173478 Oct 17 13:26:59.519392 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1275/2616] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:59.528060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3ab70fec-8f4c-47ec-8128-368b56fe0990 req-5b9c49d8-1cca-4f1c-a100-464b93c4e8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71f5479-bbd7-4159-8e39-1665f0eec530", "name": "network-vif-deleted", "tag": "286393d6-2d3f-41d6-bc19-984afb12d98a"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:26:59.573037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3ab70fec-8f4c-47ec-8128-368b56fe0990 req-5b9c49d8-1cca-4f1c-a100-464b93c4e8c3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.573951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3ab70fec-8f4c-47ec-8128-368b56fe0990 req-5b9c49d8-1cca-4f1c-a100-464b93c4e8c3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.574592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3ab70fec-8f4c-47ec-8128-368b56fe0990 req-5b9c49d8-1cca-4f1c-a100-464b93c4e8c3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.588972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3ab70fec-8f4c-47ec-8128-368b56fe0990 req-5b9c49d8-1cca-4f1c-a100-464b93c4e8c3 service nova] Creating event network-vif-deleted:286393d6-2d3f-41d6-bc19-984afb12d98a for instance b71f5479-bbd7-4159-8e39-1665f0eec530 on n-h2-854121-14 Oct 17 13:26:59.594707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3ab70fec-8f4c-47ec-8128-368b56fe0990 req-5b9c49d8-1cca-4f1c-a100-464b93c4e8c3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073177 Oct 17 13:26:59.596394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1276/2617] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:26:59.602999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.604025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:26:59.623057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.623863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.624540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.625487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:26:59.626169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:26:59.626799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:26:59.743666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6de528b6-a533-4d15-85b7-cf390d943fc1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.422107 Oct 17 13:26:59.757587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1342/2618] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:59.771593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0acb5f7a-8b38-4c02-9126-64a474ecb914 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419ddb3f70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.877597 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0acb5f7a-8b38-4c02-9126-64a474ecb914 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.118695 Oct 17 13:26:59.878773 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1343/2619] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:26:59.884042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:26:59.889480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:26:59.890984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:00.001255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.018080 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c0409b2-1bd5-4653-8358-7b98af796c88 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.419976 Oct 17 13:27:00.041410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.041410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.041410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.041410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.041410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.041410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.046790 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1277/2620] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.052231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da61df80-93e9-43dd-8eb9-68267ba533c2 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f41a21218b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.100599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:00.143590 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7476ce1a-662e-4bbe-829f-8ccb8b219886 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.263133 Oct 17 13:27:00.144567 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1344/2621] 10.222.0.65 () {58 vars in 1150 bytes} [Mon Oct 17 13:26:59 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.156870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.156870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:00.161233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.161749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.162184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.163569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.164273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.164703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.172535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da61df80-93e9-43dd-8eb9-68267ba533c2 tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.124366 Oct 17 13:27:00.184514 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1278/2622] 10.222.0.65 () {58 vars in 1188 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:00.189462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.198422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.199710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:00.211696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.212179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.212617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.212802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.213643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.214023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.214259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.214492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.214803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lazy-loading 'fault' on Instance uuid b71f5479-bbd7-4159-8e39-1665f0eec530 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:00.214913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.275123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a35bcf0aeee749038b6f5ceea6bdb0c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b040c4a92c4f398515ff63af4d3098', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.285055 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b22f01c-b016-4ffe-a035-7a7eb303152a tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 200 len: 1312 microversion: 2.1 time: 0.138313 Oct 17 13:27:00.287012 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1345/2623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.291604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69d5048a-c62b-4874-93bd-be3a23bb218a tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] Calling method '.version_select at 0x7f419dd06d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.358309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:00.406407 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69d5048a-c62b-4874-93bd-be3a23bb218a tempest-VolumesTestJSON-45554268 tempest-VolumesTestJSON-45554268-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.118143 Oct 17 13:27:00.407166 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1346/2624] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.427083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.428494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:00.435386 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8d13003-5d5a-4d24-8b72-5e2df55ed853 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.249655 Oct 17 13:27:00.436122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.436718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.437142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.444305 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1279/2625] 10.222.0.65 () {58 vars in 1212 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.444519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.445154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.445807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.449549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.450403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:00.458431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.458932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.459385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.460120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.460590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.461026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.466678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] HTTP exception thrown: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Request method failure captured: Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca HTTP/1.1 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVf1ADKN775q0w35_I4Sp-7i0F7rIixYx1lHW7wWyhSg8hTRwRGUhtvRora5uiVIjZmhCgEgyv-9nYWqQO8xe-2ykoBaXVVdILoq0Z6u7sY8kmD5yUCyC9aI1gKJSxx4_c70Ge6wx9RL9LiJc5GYlBAjHFIKxy7mezBcXGLYr17EAVk Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestMultiNic-1964178639 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 60cef07763604d49a9ecd33049d098fa Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '811dadb1-321d-4db8-9883-26395c20c7ca'} Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:00.468721 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Returning 404 to user: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:00.473033 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-382430ea-55ed-445c-a715-39633b30f1f9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 404 len: 111 microversion: 2.1 time: 0.049257 Oct 17 13:27:00.475815 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1347/2626] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:00.482460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2eace5a3-2987-4413-8b31-a63228643590 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dd06c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.612460 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2eace5a3-2987-4413-8b31-a63228643590 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.134961 Oct 17 13:27:00.613051 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1348/2627] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.614682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.626621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.628078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.629291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80978dd0-1c68-43ef-aa83-d129a8371bb3 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.183894 Oct 17 13:27:00.630322 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1280/2628] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:00.646177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.655619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.657416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:00.679218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.679703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.680164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.680908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.681384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.742609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.816686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:00.940787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13d7a204-a5cb-4bd1-9ae7-1c84326d67ca tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.317768 Oct 17 13:27:00.941474 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1349/2629] 10.222.0.65 () {58 vars in 1196 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:00.954309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:00.959647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:00.960322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': '1788074633', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:00.978163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:00.980889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.981406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.981851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:00.982628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:00.983305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:00.983739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.050373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.051090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:01.058030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.058518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.058958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.060032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.060484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.060906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.149788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:01.302373 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4f7d2684-04b1-4623-9712-017d36847cb3 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?name=1788074633" status: 200 len: 346 microversion: 2.1 time: 0.346698 Oct 17 13:27:01.303125 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1281/2630] 10.222.0.65 () {58 vars in 1156 bytes} [Mon Oct 17 13:27:00 2022] GET /compute/v2.1/servers?name=1788074633 => generated 346 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:01.326896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.327834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] [instance: b71f5479-bbd7-4159-8e39-1665f0eec530] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:01.332437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:01.337485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:01.338353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.340172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.340994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.343365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.346083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.346754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.354970 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92330a34-d683-460b-9d29-9adf76529ccc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.309603 Oct 17 13:27:01.357984 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1350/2631] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:01.367882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.379808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:01.381855 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] HTTP exception thrown: Instance b71f5479-bbd7-4159-8e39-1665f0eec530 could not be found. Oct 17 13:27:01.383423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Request method failure captured: Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 HTTP/1.1 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVgNg5LZCWcJWyJhIuD45kabaPqE_88AqU1Jyprk1mEtPTwkWuJYHm1rhXmhFad6CL1pxQ5OWFdSMWQc5QsolR7UFzRqgg9Sh9sHBD0lVsUpNbC01iBh2p6bE71D6oIL62B73rtaVQ35xz1JwGrgQCsA_nNGWeix3yqDstZ5vIjwLwM Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d1b040c4a92c4f398515ff63af4d3098 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1474315214 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d1b040c4a92c4f398515ff63af4d3098"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1474315214 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d1b040c4a92c4f398515ff63af4d3098 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1474315214 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiagnosticsNegativeTest-1474315214-project Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: a35bcf0aeee749038b6f5ceea6bdb0c5 Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1474315214-project Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance b71f5479-bbd7-4159-8e39-1665f0eec530 could not be found. Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b71f5479-bbd7-4159-8e39-1665f0eec530'} Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b71f5479-bbd7-4159-8e39-1665f0eec530 could not be found. Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b71f5479-bbd7-4159-8e39-1665f0eec530 could not be found. Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:01.385923 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b71f5479-bbd7-4159-8e39-1665f0eec530 could not be found. Oct 17 13:27:01.390704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:01.395806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] Returning 404 to user: Instance b71f5479-bbd7-4159-8e39-1665f0eec530 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:01.397308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6057be6b-8c00-4b5a-925e-02fa8b6be5e1 tempest-ServerDiagnosticsNegativeTest-1474315214 tempest-ServerDiagnosticsNegativeTest-1474315214-project] 10.222.0.65 "GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530" status: 404 len: 111 microversion: 2.1 time: 0.085124 Oct 17 13:27:01.398292 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1282/2632] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/servers/b71f5479-bbd7-4159-8e39-1665f0eec530 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:01.399389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.400243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.400620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.406103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.406593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.407033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.568841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:01.630688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27075874-fb94-4f00-bf2c-41a87725783a tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dae75e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.671747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1f3dc12-49a3-4331-88b9-3f3a2f35c141 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.312558 Oct 17 13:27:01.694064 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1351/2633] 10.222.0.65 () {58 vars in 1154 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:01.716984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.720658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:01.744760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.745014 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27075874-fb94-4f00-bf2c-41a87725783a tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1422 microversion: 2.1 time: 0.116460 Oct 17 13:27:01.747312 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1283/2634] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1422 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:01.756644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.759398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.760207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.760685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.761844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.765435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:01.798138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:01.803357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-178807463', 'deleted': False, 'project_id': '7f30f289ed3b49d7bf958763126154e9'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:01.828414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.829765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.831490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:01.833438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:01.835879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:01.836484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.133770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:02.262752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:02.272634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:02.283369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:02.284585 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13905d5e-94a1-4f35-b3bc-eda3ac7f5c56 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.587852 Oct 17 13:27:02.288348 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1352/2635] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:02.325887 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad2c9a40-2a53-40f5-95bc-99f7bb2fc826 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-178807463" status: 200 len: 346 microversion: 2.1 time: 0.575265 Oct 17 13:27:02.329682 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1284/2636] 10.222.0.65 () {58 vars in 1228 bytes} [Mon Oct 17 13:27:01 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-178807463 => generated 346 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:02.342817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.342817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:02.348209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.349117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.350139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.350909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.351441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.353784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.385303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.386010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:02.395767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.396258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.396690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.397411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.398039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.398614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.649504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:02.658384 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca18d350-15fe-4e98-b5c5-68d828395389 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.277507 Oct 17 13:27:02.658980 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1285/2637] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:02 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:02.689820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:02.762221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-640a359a-a4bc-4771-a122-8bd25e5239c6 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddbb5e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.820061 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08ce8907-d09c-4db6-9c2f-48e6037cb1f1 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 204 len: 0 microversion: 2.1 time: 0.482269 Oct 17 13:27:02.820820 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1353/2638] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:02 2022] DELETE /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:02.834161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.836534 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-640a359a-a4bc-4771-a122-8bd25e5239c6 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1431 microversion: 2.1 time: 0.078677 Oct 17 13:27:02.836738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:02.837130 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1286/2639] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:02 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1431 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:02.852073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-231a7f32-394e-4e88-b573-99fa1f2c1b94 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a2104dc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.860844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.862479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.863602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.865876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.867705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.868729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.933542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-231a7f32-394e-4e88-b573-99fa1f2c1b94 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 200 len: 1431 microversion: 2.1 time: 0.084836 Oct 17 13:27:02.937355 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1287/2640] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:02 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 1431 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:02.951842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:02.953247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:02.960811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.961680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.962355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:02.963431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:02.964089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:02.965242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:03.202148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:03.213066 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b0b5b59c-50b4-46cb-974b-28c067ccd512 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1518 microversion: 2.1 time: 0.384507 Oct 17 13:27:03.214014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1354/2641] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:02 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1518 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:03.274458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:03.302309 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9f6e548-7d1f-4d22-8874-e5fe4beee574 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1467 microversion: 2.1 time: 0.353521 Oct 17 13:27:03.303671 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1288/2642] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:02 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1467 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:03.332286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:03.334394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:03.336013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a342c04d-3ca3-4906-ba8a-2ec33b5c9431 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419df4e8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:03.340900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:03.343434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:03.344071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:03.344655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:03.345421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:03.346129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:03.346862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:03.397872 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a342c04d-3ca3-4906-ba8a-2ec33b5c9431 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/db51f7c1-415a-4ea9-94a7-afd34c3636cd" status: 200 len: 784 microversion: 2.1 time: 0.070724 Oct 17 13:27:03.399120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1289/2643] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:03 2022] GET /compute/v2.1/images/db51f7c1-415a-4ea9-94a7-afd34c3636cd => generated 784 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:03.415048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19b274c3-f2d4-4ecb-8ce3-4ac4b6b588bb tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:03.431645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19b274c3-f2d4-4ecb-8ce3-4ac4b6b588bb tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022344 Oct 17 13:27:03.432254 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1290/2644] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:27:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:27:03.447853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc602df6-c733-42b7-b019-6c4f68da8f93 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dae7f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:03.480788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:03.498710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:03.502852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:03.505677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b88e9c9a-37c5-4818-a1ad-75937a9f949c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.188527 Oct 17 13:27:03.525629 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1355/2645] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:03 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:03.690605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:03.691655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:03.720972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:03.731831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:03.732945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:03.740163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:03.741549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:03.749857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.198754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:04.211179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73321d68-8199-48da-ac67-d49ddf899478 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.531313 Oct 17 13:27:04.219003 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1356/2646] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:03 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:04.246890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:04.247355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:04.265192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.265519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.265947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.266642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.268997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.269632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.536050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:04.547473 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a265972-136b-47e4-a90d-e27de0fe692e tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1518 microversion: 2.1 time: 0.304438 Oct 17 13:27:04.562895 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1357/2647] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:04 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1518 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:04.585717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:04.587025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:04.594535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.595278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.595907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.596780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.597539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.598154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.736917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:04.747031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:04.748502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:04.749746 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50bdaf3f-7777-442a-9ef3-07450e212a88 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.185591 Oct 17 13:27:04.750492 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1358/2648] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:04 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:04.775766 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc602df6-c733-42b7-b019-6c4f68da8f93 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "DELETE /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 204 len: 0 microversion: 2.1 time: 1.335348 Oct 17 13:27:04.776743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1291/2649] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:03 2022] DELETE /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 0 bytes in 1337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:27:04.785238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c22ad478-1323-4514-aa7d-940c8554c9c3 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dd80dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:04.828610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c22ad478-1323-4514-aa7d-940c8554c9c3 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] HTTP exception thrown: Image not found. Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c22ad478-1323-4514-aa7d-940c8554c9c3 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Request method failure captured: Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb HTTP/1.1 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVf9Ar8uklYHD0QN555U8nxmAakJPluY47o8giCjxPFrxq8Rwkdtrm_AKUfP8GV2J05pedD4M25NQS8btn8zkUia80bUSr2jCpHEyxBP8wefetqeiCoB0rFHyQuegDUhmwvMoTxoK0Jtpr5cjYiLdquq_QaY1wnCXTgYplJcMzdmaT0 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d5fe0ce940ff409bb939b04a752dc010 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d5fe0ce940ff409bb939b04a752dc010 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesOneServerTestJSON-822763636-project Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 3e96a6ca3cf74157be8a00df57f646d9 Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesOneServerTestJSON-822763636-project Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: exception: Image not found. Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a8ed624d-028e-49c7-8753-d66fb8bfcbeb'} Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a8ed624d-028e-49c7-8753-d66fb8bfcbeb Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 17 13:27:04.830969 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8ed624d-028e-49c7-8753-d66fb8bfcbeb could not be found. Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:27:04.835856 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:04.841981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c22ad478-1323-4514-aa7d-940c8554c9c3 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Returning 404 to user: Image not found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:04.843817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c22ad478-1323-4514-aa7d-940c8554c9c3 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 404 len: 62 microversion: 2.1 time: 0.062936 Oct 17 13:27:04.845030 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1359/2650] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:04 2022] GET /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:27:04.859916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-188331532"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:04.862920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:04.874228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.875704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.876374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:04.878022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:04.878982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:04.880696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.258847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:05.259834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:05.271936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.274948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.275819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.276734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.277562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.278186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.279495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:05.443462 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5469848-38fa-4991-bbbc-273c41d12530 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "POST /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46/action" status: 202 len: 0 microversion: 2.1 time: 0.586895 Oct 17 13:27:05.446143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1292/2651] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:27:04 2022] POST /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:27:05.460912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-24e1ee57-4e71-414a-a5fc-34e4c8b23c16 req-77e48f12-4926-4a3f-a6c0-52ebb7a066ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e370f9-ef51-4a16-af3a-97a277a88a0a", "name": "network-vif-deleted", "tag": "77f7e214-6e82-4a54-9b0c-cca3792bfe07"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:05.500404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24e1ee57-4e71-414a-a5fc-34e4c8b23c16 req-77e48f12-4926-4a3f-a6c0-52ebb7a066ce service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.503050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24e1ee57-4e71-414a-a5fc-34e4c8b23c16 req-77e48f12-4926-4a3f-a6c0-52ebb7a066ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.505530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24e1ee57-4e71-414a-a5fc-34e4c8b23c16 req-77e48f12-4926-4a3f-a6c0-52ebb7a066ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.540496 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-24e1ee57-4e71-414a-a5fc-34e4c8b23c16 req-77e48f12-4926-4a3f-a6c0-52ebb7a066ce service nova] Creating event network-vif-deleted:77f7e214-6e82-4a54-9b0c-cca3792bfe07 for instance d2e370f9-ef51-4a16-af3a-97a277a88a0a on n-h1-854121-14 Oct 17 13:27:05.556498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-24e1ee57-4e71-414a-a5fc-34e4c8b23c16 req-77e48f12-4926-4a3f-a6c0-52ebb7a066ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107228 Oct 17 13:27:05.559248 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1293/2652] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:05.575963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a20b86ec-ab39-4ed0-a211-f85065e78a27 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dae7280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:05.650851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a20b86ec-ab39-4ed0-a211-f85065e78a27 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.089629 Oct 17 13:27:05.652251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1294/2653] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:05 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:05.662594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:05.663942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:05.674179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.675519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.676124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.678864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.679510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.680102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.743113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.744861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.745444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.745963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lazy-loading 'fault' on Instance uuid d2e370f9-ef51-4a16-af3a-97a277a88a0a {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:05.851563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:05.864420 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a9a9eee-c650-4461-849c-69c6ef3a24ec tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 200 len: 1311 microversion: 2.1 time: 0.210219 Oct 17 13:27:05.870947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1295/2654] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:05 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:05.883575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:05.884198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:05.895588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.896362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.897031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:05.899847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:05.901707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:05.902489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:06.035477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:06.049244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:06.054079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:06.057244 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99bcebca-2a69-4e70-a580-ae2c549b5868 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.183728 Oct 17 13:27:06.057920 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1296/2655] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:05 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:06.117723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:06.126809 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6435a0dd-da66-4f3c-a86c-91c919b9a3ad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.875156 Oct 17 13:27:06.132035 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1360/2656] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:05 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:06.668337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f6b7aad-feb0-4a46-a726-20eba572990b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e1fe8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:06.735275 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f6b7aad-feb0-4a46-a726-20eba572990b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.071038 Oct 17 13:27:06.736600 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1297/2657] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:06 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:06.892622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:06.893304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: d2e370f9-ef51-4a16-af3a-97a277a88a0a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:06.908759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:06.909685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:06.910334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:06.912463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:06.913185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:06.914042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:06.947564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] HTTP exception thrown: Instance d2e370f9-ef51-4a16-af3a-97a277a88a0a could not be found. Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Request method failure captured: Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a HTTP/1.1 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfQNHPj8tFsona3ROybdCEcQhJft74ahQE6nk1ItuK5aUAKWvinVTeHHj0zlAtcwvFYOR4Xa2CyZkGYMA5V4xrQCi_GPBJQMJIH_qhvAFS19IKKl1PZZsamyt0MruYESTiXfF0C6vKtneickuBbD1saN9bpqrTW541VN2lL0BeGEaU Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 7f30f289ed3b49d7bf958763126154e9 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 7f30f289ed3b49d7bf958763126154e9 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServerFiltersTestJSON-1277219437-project Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6af3ccbc0a6e48288a3bc04014e81922 Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServerFiltersTestJSON-1277219437-project Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance d2e370f9-ef51-4a16-af3a-97a277a88a0a could not be found. Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'd2e370f9-ef51-4a16-af3a-97a277a88a0a'} Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2e370f9-ef51-4a16-af3a-97a277a88a0a could not be found. Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2e370f9-ef51-4a16-af3a-97a277a88a0a could not be found. Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:06.949505 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2e370f9-ef51-4a16-af3a-97a277a88a0a could not be found. Oct 17 13:27:06.954950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:06.956876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Returning 404 to user: Instance d2e370f9-ef51-4a16-af3a-97a277a88a0a could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:06.958846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f4944f8-086f-424f-8847-658a1f069508 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a" status: 404 len: 111 microversion: 2.1 time: 0.070958 Oct 17 13:27:06.963226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1361/2658] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:06 2022] GET /compute/v2.1/servers/d2e370f9-ef51-4a16-af3a-97a277a88a0a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:06.971003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:06.971551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:06.991718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:06.994807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:06.995541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:06.997717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:06.999991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.000659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.031681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:07.088896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:07.089706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:07.106575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.107343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.107986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.116673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.118133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.118839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.157519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d6ead64-a5c4-4064-a661-8fdd0fad95d2 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 204 len: 0 microversion: 2.1 time: 0.192860 Oct 17 13:27:07.158726 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1298/2659] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:06 2022] DELETE /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:27:07.283117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:07.296653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:07.302272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:07.303926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85297830-2764-403e-a95d-9355ecbfd189 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.219943 Oct 17 13:27:07.317965 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1362/2660] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:07 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:07.330768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:07.331876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:07.338591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.339342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.340260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.341564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.342249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.342884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.397345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-305549890", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:07.523319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:07.688267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:07.704320 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c49f3339-19e6-4824-84bb-afeb8e397d0a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.385128 Oct 17 13:27:07.704924 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1363/2661] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:07 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:07.720530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:07.720530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:07.742967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.744409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.745107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.746090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.747773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.762394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.980682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:07.981393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:07.981881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:07.982468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:07.983047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:07.996135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.996728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:07.997187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:07.998604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:07.999079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:08.000040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:08.019469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Getting quotas for project b72acb6417e34de5bedb390948697404. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:08.027108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Getting quotas for user b64c73f4ce814daabd6957812e0d1ff4 and project b72acb6417e34de5bedb390948697404. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:08.046930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:08.050434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:08.057996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:08.067620 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37ae2169-a8b9-4f9f-9cdb-57692e209935 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 200 len: 1516 microversion: 2.1 time: 0.361360 Oct 17 13:27:08.068566 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1364/2662] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:07 2022] GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:08.073849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7a827c2d-56ab-4ba9-bc27-084db4e25980 req-21b8f59b-0584-4830-9ce5-0fd9c5c94a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "name": "network-vif-unplugged", "status": "completed", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:08.085825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7a827c2d-56ab-4ba9-bc27-084db4e25980 req-21b8f59b-0584-4830-9ce5-0fd9c5c94a6f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:08.086653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7a827c2d-56ab-4ba9-bc27-084db4e25980 req-21b8f59b-0584-4830-9ce5-0fd9c5c94a6f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:08.087288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7a827c2d-56ab-4ba9-bc27-084db4e25980 req-21b8f59b-0584-4830-9ce5-0fd9c5c94a6f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:08.101905 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7a827c2d-56ab-4ba9-bc27-084db4e25980 req-21b8f59b-0584-4830-9ce5-0fd9c5c94a6f service nova] Creating event network-vif-unplugged:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:27:08.108401 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7a827c2d-56ab-4ba9-bc27-084db4e25980 req-21b8f59b-0584-4830-9ce5-0fd9c5c94a6f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038354 Oct 17 13:27:08.109386 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1365/2663] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:08.116422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-243792105", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "ad930cb5-cb6d-4405-87ce-10b1104063a7"}, {"uuid": "74e78e66-8b6d-44c2-bc36-5e4fa5229ed3"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:08.162805 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42701f8e-2a01-4561-a7b2-d96b2db2f6f0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002554 Oct 17 13:27:08.165544 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1299/2664] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:08.185875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0d2ca45-8469-4f7f-a41d-f3d767361981 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e07aa60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:08.233782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] validate_networks() for [('ad930cb5-cb6d-4405-87ce-10b1104063a7', None, None, None, None, None), ('74e78e66-8b6d-44c2-bc36-5e4fa5229ed3', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:08.255698 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0d2ca45-8469-4f7f-a41d-f3d767361981 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.088416 Oct 17 13:27:08.266609 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1300/2665] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:08 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:08.272385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-370886415", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:08.339479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:09.495782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:09.831308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:09.832288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:09.833606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:09.834202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:09.834809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:09.856335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:09.857128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:09.857784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:09.859926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:09.861799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:09.862563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:09.932304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Getting quotas for project b72acb6417e34de5bedb390948697404. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:09.946351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Getting quotas for user b64c73f4ce814daabd6957812e0d1ff4 and project b72acb6417e34de5bedb390948697404. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:09.999323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:10.003293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:10.186148 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af5d1034-737a-4016-a29e-17d1e952a054 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916358 Oct 17 13:27:10.189899 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1301/2666] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:10.199806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:10.200429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:10.213213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:10.213824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:10.214286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:10.215210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:10.215676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:10.216105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:10.377112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:10.400524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:10.412387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:10.420888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c81f8693-72e6-4d68-8b6d-bb6eb6f61891 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.227504 Oct 17 13:27:10.421867 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1302/2667] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:10 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:10.455674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:10.456725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:10.479031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:10.482207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:10.483679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:10.484709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:10.489585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:10.491028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.209859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:11.211089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:11.211702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:11.212264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:11.212839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:11.225476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:11.233383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.234116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.237554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.238314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.239611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.244569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.248889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4476a64d-92d5-40e6-9dce-a03dd4dcbd68 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.822621 Oct 17 13:27:11.269558 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1303/2668] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:10 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:11.288692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:11.289406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:11.293619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Getting quotas for project 17152d7dd9b847a884017a9a0331cf69. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:11.300464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.301786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.302968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.307872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Getting quotas for user 60cef07763604d49a9ecd33049d098fa and project 17152d7dd9b847a884017a9a0331cf69. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:11.340419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.341968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.346763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.367021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:11.369511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:11.458708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.462891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.466239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.467216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lazy-loading 'fault' on Instance uuid a230025f-977a-4bf7-a561-c6e69dfb11bb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:11.555854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f76aa6d4-ae7e-4cf6-9ee0-51b1676b2d3d tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.444835 Oct 17 13:27:11.571254 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1366/2669] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:11.586048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ca5da86-fc83-4ead-b114-0506a229ef1f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddb3ee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:11.625784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:11.643654 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f128ce63-0729-446b-96c5-28be8a052032 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 200 len: 1309 microversion: 2.1 time: 0.372733 Oct 17 13:27:11.644459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1304/2670] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:11 2022] GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 1309 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:11.658604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:11.659610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:11.680521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.681998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.683929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.688096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.691205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.697425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.718529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ca5da86-fc83-4ead-b114-0506a229ef1f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.145784 Oct 17 13:27:11.719248 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1367/2671] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:11 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:11.738007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2564d1fb-804d-4832-b93f-b0dc9149480b req-c395d727-dfaf-4586-a617-8dcb47633187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a230025f-977a-4bf7-a561-c6e69dfb11bb", "name": "network-vif-deleted", "tag": "34cd6a64-f4c4-45b7-bd0a-d4209e5076d3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:11.783032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2564d1fb-804d-4832-b93f-b0dc9149480b req-c395d727-dfaf-4586-a617-8dcb47633187 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.789707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2564d1fb-804d-4832-b93f-b0dc9149480b req-c395d727-dfaf-4586-a617-8dcb47633187 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.792255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2564d1fb-804d-4832-b93f-b0dc9149480b req-c395d727-dfaf-4586-a617-8dcb47633187 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.822957 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2564d1fb-804d-4832-b93f-b0dc9149480b req-c395d727-dfaf-4586-a617-8dcb47633187 service nova] Creating event network-vif-deleted:34cd6a64-f4c4-45b7-bd0a-d4209e5076d3 for instance a230025f-977a-4bf7-a561-c6e69dfb11bb on n-h1-854121-14 Oct 17 13:27:11.843172 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2564d1fb-804d-4832-b93f-b0dc9149480b req-c395d727-dfaf-4586-a617-8dcb47633187 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116394 Oct 17 13:27:11.850069 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1368/2672] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:11.858838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:11.860104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:11.882199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.884965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.890962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.896978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:11.897746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:11.898376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:11.901851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:11.913441 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ea386e3-8811-44f9-a16d-74477653cf56 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1209 microversion: 2.1 time: 0.265902 Oct 17 13:27:11.919529 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1305/2673] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:11 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1209 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:11.931230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccd2db70-c574-4466-908f-765bd886a2e9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:11.932332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ccd2db70-c574-4466-908f-765bd886a2e9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.046468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ccd2db70-c574-4466-908f-765bd886a2e9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:12.060536 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ccd2db70-c574-4466-908f-765bd886a2e9 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1212 microversion: 2.1 time: 0.139307 Oct 17 13:27:12.062427 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1306/2674] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:11 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1212 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:12.112284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:12.130190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:12.136868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:12.141454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a1bd4ec-79a6-4fe7-b4f0-0a78dd294c33 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1366 microversion: 2.47 time: 0.287542 Oct 17 13:27:12.161585 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1369/2675] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:11 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:12.286840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.289984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.304893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.306948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.308884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.309866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.310909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.313013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.671602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.672585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: a230025f-977a-4bf7-a561-c6e69dfb11bb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.686827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.688832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.692919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.696038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.716623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.720568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.767956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:12.778019 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] HTTP exception thrown: Instance a230025f-977a-4bf7-a561-c6e69dfb11bb could not be found. Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Request method failure captured: Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb HTTP/1.1 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfQNHPj8tFsona3ROybdCEcQhJft74ahQE6nk1ItuK5aUAKWvinVTeHHj0zlAtcwvFYOR4Xa2CyZkGYMA5V4xrQCi_GPBJQMJIH_qhvAFS19IKKl1PZZsamyt0MruYESTiXfF0C6vKtneickuBbD1saN9bpqrTW541VN2lL0BeGEaU Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 7f30f289ed3b49d7bf958763126154e9 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 7f30f289ed3b49d7bf958763126154e9 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServerFiltersTestJSON-1277219437-project Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6af3ccbc0a6e48288a3bc04014e81922 Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServerFiltersTestJSON-1277219437-project Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance a230025f-977a-4bf7-a561-c6e69dfb11bb could not be found. Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a230025f-977a-4bf7-a561-c6e69dfb11bb'} Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a230025f-977a-4bf7-a561-c6e69dfb11bb could not be found. Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a230025f-977a-4bf7-a561-c6e69dfb11bb could not be found. Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:12.783606 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a230025f-977a-4bf7-a561-c6e69dfb11bb could not be found. Oct 17 13:27:12.788644 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:12.792677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Returning 404 to user: Instance a230025f-977a-4bf7-a561-c6e69dfb11bb could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:12.795374 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-820847fc-6e0a-4b79-a4e5-bfdc0c37ded9 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb" status: 404 len: 111 microversion: 2.1 time: 0.128302 Oct 17 13:27:12.798762 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1370/2676] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:12 2022] GET /compute/v2.1/servers/a230025f-977a-4bf7-a561-c6e69dfb11bb => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:12.818919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9300143a-47ef-46ad-8b37-de72c95fe3a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dd80550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.919324 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9300143a-47ef-46ad-8b37-de72c95fe3a4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.118963 Oct 17 13:27:12.926242 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1371/2677] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:12 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:12.953259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:12.953783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:12.972445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.980332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.982742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:12.983671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:12.984152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:12.984581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.045369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.065381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35ed673b-4d5f-416d-93bf-170a3ab4f77e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1477 microversion: 2.1 time: 0.790104 Oct 17 13:27:13.095317 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1307/2678] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:12 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1477 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:13.099266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:13.121671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:13.131166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:13.148297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.148798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.152944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.153938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.154568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.155157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.371145 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d016f0d5-5bdc-4798-ba75-d37a6a814188 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 204 len: 0 microversion: 2.1 time: 0.443339 Oct 17 13:27:13.372202 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1372/2679] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:12 2022] DELETE /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:13.388806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:13.390835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:13.414631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.415152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.415605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.423673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.424179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.424627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.497479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.522447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c04b2928-7550-422c-9ff3-f2df43f57be6 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1265 microversion: 2.1 time: 0.424708 Oct 17 13:27:13.527354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1308/2680] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:13 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1265 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:13.568311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:13.581345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:13.606477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.617372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.618270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.619132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.619701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.620323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.675797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.699548 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-763e85f3-f3f6-4965-b6fc-181df38d0296 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1208 microversion: 2.1 time: 0.325393 Oct 17 13:27:13.700575 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1373/2681] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:13 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1208 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:13.726016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:13.727014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:13.738287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.745324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.746123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.747094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.747766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.748421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.795530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.813562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.816302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:13.818173 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23be85a1-b707-40a4-88c8-19b588d06db7 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1372 microversion: 2.47 time: 0.254693 Oct 17 13:27:13.819251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1309/2682] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:13 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:13.826201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2fc9387f-f83a-4efa-a822-476a69ed42bf req-e9d4a107-9a0a-4884-8c2e-ce23e9d5be8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "name": "network-vif-plugged", "status": "completed", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:13.848391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fc9387f-f83a-4efa-a822-476a69ed42bf req-e9d4a107-9a0a-4884-8c2e-ce23e9d5be8d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:13.853078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fc9387f-f83a-4efa-a822-476a69ed42bf req-e9d4a107-9a0a-4884-8c2e-ce23e9d5be8d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:13.856693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fc9387f-f83a-4efa-a822-476a69ed42bf req-e9d4a107-9a0a-4884-8c2e-ce23e9d5be8d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:13.919096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2fc9387f-f83a-4efa-a822-476a69ed42bf req-e9d4a107-9a0a-4884-8c2e-ce23e9d5be8d service nova] Creating event network-vif-plugged:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:27:13.949359 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2fc9387f-f83a-4efa-a822-476a69ed42bf req-e9d4a107-9a0a-4884-8c2e-ce23e9d5be8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128311 Oct 17 13:27:13.950522 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1310/2683] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:13.967280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd0513e4-eef4-46e8-b433-6bd88d98220c tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e6380d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.059403 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd0513e4-eef4-46e8-b433-6bd88d98220c tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.104460 Oct 17 13:27:14.068238 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1311/2684] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:13 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:14.100455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.101338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:14.112910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.114078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.115945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.117548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.118374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.119149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.127664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:14.141347 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7200d760-e547-482e-98b9-4e04e38534ef tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1519 microversion: 2.1 time: 0.436596 Oct 17 13:27:14.142338 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1374/2685] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:13 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:14.340069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:14.355618 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f45ee382-8abf-4151-bb96-c7138bdce617 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1476 microversion: 2.1 time: 0.259334 Oct 17 13:27:14.357044 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1312/2686] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:14 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:14.498047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.499149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:14.519832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.521279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.522021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.523439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.524458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.525062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.550594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.552546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:14.565194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.574496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.583315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.585141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.588856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.590567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.799037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:14.801807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:14.816406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed5f7f8a-ebb6-4625-81a4-1df2008fde41 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1271 microversion: 2.1 time: 0.269883 Oct 17 13:27:14.817480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1313/2687] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:14 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1271 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:14.822641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.824737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:14.842295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.858318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.860533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.864389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:14.870002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:14.870599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:14.954630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:14.964799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-878cfc0b-c6ca-479c-882e-a25771eba8d4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.471276 Oct 17 13:27:14.968889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1375/2688] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:14 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:14.977255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:14.983234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:15.005576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.006157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.008766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.011615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.014415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.016006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.104105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:15.128276 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd7a3d39-23b5-4673-b9b8-ee82d0c2b015 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1270 microversion: 2.1 time: 0.309209 Oct 17 13:27:15.131394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1314/2689] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:14 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1270 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:15.137759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:15.153522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:15.154211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:15.155018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:15.157070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:15.160024 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98c5d6b2-39fe-4f26-bf93-bd6eef9f1efc tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1372 microversion: 2.47 time: 0.189818 Oct 17 13:27:15.165834 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1376/2690] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:14 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:15.172333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f4e45b9-9b23-472e-8841-1231a59cc16e tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddb3430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:15.174768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.175544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.176064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.179404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.179891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.180344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.264251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f4e45b9-9b23-472e-8841-1231a59cc16e tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.092930 Oct 17 13:27:15.273625 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1377/2691] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:15 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:15.278771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:15.284140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:15.299532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.300677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.301910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.304628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.306477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.307112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.849557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:15.867308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8249f7bb-0535-4def-99ef-4b83b64cb50c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.733933 Oct 17 13:27:15.868336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1315/2692] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:15 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:15.880871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:15.881999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:15.892615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.894636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.911685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:15.913183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:15.914669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:15.916219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.174269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:16.198621 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9efaa8a2-7f43-4778-889b-5436277d665f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1519 microversion: 2.1 time: 0.920633 Oct 17 13:27:16.201861 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1378/2693] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:15 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1519 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:16.218015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:16.218839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:16.236941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.237471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.237915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.242325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.245861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.248832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.370304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:16.382472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35b4d914-7a5a-4b1b-879e-201a9a8cb472 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1476 microversion: 2.1 time: 0.509992 Oct 17 13:27:16.397187 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1316/2694] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:15 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:16.406284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:16.407155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:16.418877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.420963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.422051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.424905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.425564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.426732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.771865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:16.785419 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26a724b6-bd2d-4537-bf42-a6da9f3f74f7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.398609 Oct 17 13:27:16.786028 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1317/2695] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:16 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:16.813091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:16.821729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:16.822620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:16.830535 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2854d5ad-9b38-4bee-b2d6-b33038ffe5c3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1313 microversion: 2.1 time: 0.627565 Oct 17 13:27:16.835536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.838498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.839030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.840929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.842199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.842919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.848387 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1379/2696] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:16 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:16.862009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:16.865198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:16.878566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.879834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.882300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.883055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:16.883526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:16.886139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:16.941052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:16.955632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e605f177-f9b0-45e5-9400-7ccf1004071c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1270 microversion: 2.1 time: 0.152217 Oct 17 13:27:16.956564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1318/2697] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:16 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:16.963781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da2a209c-0d3b-417f-afef-06376096ceac tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419deab940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:17.040277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:17.060032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da2a209c-0d3b-417f-afef-06376096ceac tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.101347 Oct 17 13:27:17.064419 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1319/2698] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:16 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:17.070500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:17.072447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:17.075457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:17.085997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e569aecf-d135-4156-bf7f-f6df50134043 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1372 microversion: 2.47 time: 0.231794 Oct 17 13:27:17.109774 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1380/2699] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:16 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:17.121201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc", "name": "network-vif-unplugged", "status": "completed", "tag": "c55759fd-0f88-4381-af27-9df75fc55a23"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:17.131588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:17.154151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.154923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.160105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.163615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.164385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.164997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.165941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.166717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.169927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.190995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] Creating event network-vif-unplugged:c55759fd-0f88-4381-af27-9df75fc55a23 for instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc on n-h1-854121-14 Oct 17 13:27:17.221072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:27:17.241764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2e36addd-1cab-47c2-bca1-01bd3f69afc9 req-e2a369d2-c9ca-430f-bd4e-b2bb5b9bcc3f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126987 Oct 17 13:27:17.242606 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1381/2700] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:17.259692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:17.260830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:17.270395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.271326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.272840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.274570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.275213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.275809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.734121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:17.774596 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e7c9b10-6a2e-4743-9dfb-879fbeef3ad5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.703264 Oct 17 13:27:17.775773 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1320/2701] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:17 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:17.791659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:17.794076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:17.798302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:17.822390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.827273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.831050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.832349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.834641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.839580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.959390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:17.969933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9585b0fd-19ec-4157-8dc2-2f7105039c31 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1519 microversion: 2.1 time: 0.725449 Oct 17 13:27:17.972643 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1382/2702] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:17 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1519 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:17.978021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:17.979221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:17.990736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.991821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.992742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:17.993702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:17.994351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:17.994932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:18.416046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:18.434002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c003c001-00a3-4e7c-9067-3f4097e98fc0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1476 microversion: 2.1 time: 0.657123 Oct 17 13:27:18.434932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1321/2703] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:17 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1476 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:18.439629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-633da088-23c5-4027-a260-ea4edd29bed5 req-a9e59687-128f-4665-85b4-22013a7501cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14", "tag": "3374708b-a678-4a47-97db-e0a22f1abd74"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:18.460623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-633da088-23c5-4027-a260-ea4edd29bed5 req-a9e59687-128f-4665-85b4-22013a7501cb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:18.461125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-633da088-23c5-4027-a260-ea4edd29bed5 req-a9e59687-128f-4665-85b4-22013a7501cb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:18.461595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-633da088-23c5-4027-a260-ea4edd29bed5 req-a9e59687-128f-4665-85b4-22013a7501cb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:18.485828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-633da088-23c5-4027-a260-ea4edd29bed5 req-a9e59687-128f-4665-85b4-22013a7501cb service nova] Creating event network-changed:3374708b-a678-4a47-97db-e0a22f1abd74 for instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 on n-h1-854121-14 Oct 17 13:27:18.497591 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-633da088-23c5-4027-a260-ea4edd29bed5 req-a9e59687-128f-4665-85b4-22013a7501cb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061322 Oct 17 13:27:18.498221 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1322/2704] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:18.503573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:18.505000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:18.540439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:18.540943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:18.552657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:18.554808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:18.555335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:18.555789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:19.083266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:19.097706 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f555450b-c359-4b81-bdea-a5a46c247691 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1313 microversion: 2.1 time: 1.122394 Oct 17 13:27:19.100641 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1383/2705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:17 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1313 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:19.109614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10738be9-1736-4e6d-9c63-95647f435eb9 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e2455e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:19.183109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10738be9-1736-4e6d-9c63-95647f435eb9 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.080741 Oct 17 13:27:19.184423 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1384/2706] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:19 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:19.190998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:19.192680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:19.200128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:19.200938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:19.201762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:19.202703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:19.205281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:19.205964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:19.664950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:19.691035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:19.694117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:19.696892 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cf1743d-dde1-4942-9777-efe38baf5ea9 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1372 microversion: 2.47 time: 0.511312 Oct 17 13:27:19.699884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1385/2707] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:19 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1372 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:19.705778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2055222427", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "409d5ac5-1afa-4a2d-b8d2-6def2794c056"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:19.759874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:19.767852 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7aeb8119-d6df-4c9e-a94b-fd6700c67306 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1312 microversion: 2.1 time: 1.268435 Oct 17 13:27:19.791141 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1323/2708] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:18 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1312 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:19.796255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:19.796881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:19.814587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:19.815122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:19.815583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:19.816293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:19.821015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] validate_networks() for [('409d5ac5-1afa-4a2d-b8d2-6def2794c056', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:19.821898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:19.822359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:19.914384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:20.648983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:20.657882 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4fd90ea-f200-4773-a8d3-f83de16231dc tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1519 microversion: 2.1 time: 0.865539 Oct 17 13:27:20.662211 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1324/2709] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:19 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1519 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:20.676104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:20.680208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:20.709594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:20.710094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:20.710535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:20.711245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:20.713662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:20.714152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:21.265608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:21.333346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:22.055474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:22.057770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=14 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:22.073077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f18b33a5-9f4f-45c3-82cd-976343293f3f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1476 microversion: 2.1 time: 1.409611 Oct 17 13:27:22.080542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1325/2710] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:20 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1476 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:22.100885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc", "tag": "c55759fd-0f88-4381-af27-9df75fc55a23"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:22.132260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.133332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.133813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.157797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] Creating event network-changed:c55759fd-0f88-4381-af27-9df75fc55a23 for instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc on n-h1-854121-14 Oct 17 13:27:22.179521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:27:22.200140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c9714e2a-e69b-469a-86a0-d7b5dfed6eae req-083de798-680c-4683-b550-e4cad2dfcc59 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115690 Oct 17 13:27:22.200917 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1326/2711] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:22.207954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:22.208886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:22.216528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.217936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.219200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.220121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.221014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.223565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.670403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:22.689762 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f03b23d2-e086-474e-a1d9-17736c017d15 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1313 microversion: 2.1 time: 0.487296 Oct 17 13:27:22.692688 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1327/2712] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:22 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1313 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:22.705674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05a315cd-3491-4798-80e5-ded34b27d7f4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e34d8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:22.784179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:22.784644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:22.785076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:22.786077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:22.786688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:22.790319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05a315cd-3491-4798-80e5-ded34b27d7f4 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.096198 Oct 17 13:27:22.791081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1328/2713] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:22 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:22.799894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:22.805237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:22.821346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.821542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.822004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.822367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.822631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.823208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.823326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.823663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.824123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.824874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:22.825527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:22.826096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:22.883824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:22.892631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for user 6ad84e1798394f69a409af3c96b6752c and project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:22.916695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:22.919815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:23.025500 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08d21417-1508-43c0-9b68-77b787ebc180 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.320053 Oct 17 13:27:23.032617 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1386/2714] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:23.054249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-817c5e95-e00c-40dc-aa16-21b1d92d9fe5 req-845061b6-a744-4971-8554-0065248a2044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9618fc73-52d1-4c04-a1bd-902ea819fffd", "tag": "bd7dfca4-bc2d-4f70-8136-1428bb210591"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:23.096787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-817c5e95-e00c-40dc-aa16-21b1d92d9fe5 req-845061b6-a744-4971-8554-0065248a2044 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.097577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-817c5e95-e00c-40dc-aa16-21b1d92d9fe5 req-845061b6-a744-4971-8554-0065248a2044 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.099350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-817c5e95-e00c-40dc-aa16-21b1d92d9fe5 req-845061b6-a744-4971-8554-0065248a2044 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.113250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:23.133904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:23.136738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:23.141096 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-817c5e95-e00c-40dc-aa16-21b1d92d9fe5 req-845061b6-a744-4971-8554-0065248a2044 service nova] Creating event network-changed:bd7dfca4-bc2d-4f70-8136-1428bb210591 for instance 9618fc73-52d1-4c04-a1bd-902ea819fffd on n-h1-854121-14 Oct 17 13:27:23.142444 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ea1f8c0-66ca-4f98-8d68-4d0cc3c97263 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1357 microversion: 2.47 time: 0.348444 Oct 17 13:27:23.145829 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1329/2715] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:22 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1357 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:23.155188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:23.161037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:23.168730 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-817c5e95-e00c-40dc-aa16-21b1d92d9fe5 req-845061b6-a744-4971-8554-0065248a2044 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137861 Oct 17 13:27:23.171008 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1387/2716] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:23.174506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.176554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.179627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.180586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.182514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.183171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.187809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:23.196415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:23.211303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.212069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.212728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.213734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.214411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.215055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.258229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.264812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.265437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.266070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lazy-loading 'fault' on Instance uuid 5eb856c7-aefc-4336-8fce-9ca16f6501ef {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:23.580811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6af3ccbc0a6e48288a3bc04014e81922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f30f289ed3b49d7bf958763126154e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:23.616534 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1bb940ca-fc44-433d-b38f-047693c055a6 tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 200 len: 1311 microversion: 2.1 time: 0.444260 Oct 17 13:27:23.635679 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1388/2717] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:23 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 1311 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:23.652895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a82c488a-d2bb-4734-a70a-a691ad256f85 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:23.666452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a82c488a-d2bb-4734-a70a-a691ad256f85 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:23.846908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a82c488a-d2bb-4734-a70a-a691ad256f85 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:23.858056 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a82c488a-d2bb-4734-a70a-a691ad256f85 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1215 microversion: 2.1 time: 0.220789 Oct 17 13:27:23.859144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1389/2718] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:23 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1215 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:23.895155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:23.896111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:23.911962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.912466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.912912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:23.913671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:23.914134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:23.914568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.110974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.119828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ab0ef24-6c47-4f13-b1c4-caa05a1df078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.972534 Oct 17 13:27:24.125708 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1330/2719] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:23 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:24.147053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.162375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.165690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Searching by: {'deleted': False, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:24.195091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.195576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.196009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.196731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.207327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.208634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.296631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.305921 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-662ef7bd-222a-477c-9e93-1ee50b3d382a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1474 microversion: 2.1 time: 0.423312 Oct 17 13:27:24.325506 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1390/2720] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:23 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1474 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:24.331019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.336085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:24.343449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:24.375768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.376819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.377492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.380321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.381199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.381803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.391498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:24.515619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:27:24.675861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.687425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.688317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.688790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.707602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.708033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.709757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:24.716734 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ddbf943-f00c-468a-9a99-ff2a5c7deb8f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1313 microversion: 2.1 time: 0.389766 Oct 17 13:27:24.723060 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1391/2721] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:24 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:24.731737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-697fc28b-4f2c-4612-bd58-56b861ad470f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419de979d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.815438 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-697fc28b-4f2c-4612-bd58-56b861ad470f tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.090936 Oct 17 13:27:24.817396 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1392/2722] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:24 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:24.831449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-612d0413-2c40-46b4-8486-f9d1597be38d req-aafa6309-30e2-409e-af1c-c84be2e813bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb856c7-aefc-4336-8fce-9ca16f6501ef", "name": "network-vif-deleted", "tag": "8c4b10bb-641a-4c5d-b189-7f04fd8da087"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:24.853231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-612d0413-2c40-46b4-8486-f9d1597be38d req-aafa6309-30e2-409e-af1c-c84be2e813bf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.855633 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea277eef-68b4-4b1c-802f-5ed16b464a83 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.724125 Oct 17 13:27:24.855850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-612d0413-2c40-46b4-8486-f9d1597be38d req-aafa6309-30e2-409e-af1c-c84be2e813bf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.856640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-612d0413-2c40-46b4-8486-f9d1597be38d req-aafa6309-30e2-409e-af1c-c84be2e813bf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.864874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1331/2723] 10.222.0.65 () {60 vars in 1187 bytes} [Mon Oct 17 13:27:24 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:24.872430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.881052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] [instance: 5eb856c7-aefc-4336-8fce-9ca16f6501ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:24.886028 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-612d0413-2c40-46b4-8486-f9d1597be38d req-aafa6309-30e2-409e-af1c-c84be2e813bf service nova] Creating event network-vif-deleted:8c4b10bb-641a-4c5d-b189-7f04fd8da087 for instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef on n-h2-854121-14 Oct 17 13:27:24.900319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.901999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.902628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.903550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.904233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.904822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.907047 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-612d0413-2c40-46b4-8486-f9d1597be38d req-aafa6309-30e2-409e-af1c-c84be2e813bf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087040 Oct 17 13:27:24.910108 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1393/2724] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:24.924837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.925603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:24.933312 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] HTTP exception thrown: Instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef could not be found. Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Request method failure captured: Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef HTTP/1.1 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfQNHPj8tFsona3ROybdCEcQhJft74ahQE6nk1ItuK5aUAKWvinVTeHHj0zlAtcwvFYOR4Xa2CyZkGYMA5V4xrQCi_GPBJQMJIH_qhvAFS19IKKl1PZZsamyt0MruYESTiXfF0C6vKtneickuBbD1saN9bpqrTW541VN2lL0BeGEaU Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 7f30f289ed3b49d7bf958763126154e9 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7f30f289ed3b49d7bf958763126154e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 7f30f289ed3b49d7bf958763126154e9 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1277219437 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ListServerFiltersTestJSON-1277219437-project Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6af3ccbc0a6e48288a3bc04014e81922 Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ListServerFiltersTestJSON-1277219437-project Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef could not be found. Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5eb856c7-aefc-4336-8fce-9ca16f6501ef'} Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef could not be found. Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef could not be found. Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:24.935253 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef could not be found. Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] Returning 404 to user: Instance 5eb856c7-aefc-4336-8fce-9ca16f6501ef could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:24.939435 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6595b46f-0f0b-4565-8eee-1c3283b8fe0f tempest-ListServerFiltersTestJSON-1277219437 tempest-ListServerFiltersTestJSON-1277219437-project] 10.222.0.65 "GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef" status: 404 len: 111 microversion: 2.1 time: 0.070854 Oct 17 13:27:24.943469 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1332/2725] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:24 2022] GET /compute/v2.1/servers/5eb856c7-aefc-4336-8fce-9ca16f6501ef => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:24.948413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:24.948584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:24.955323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.955826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.956347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.957126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.958395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.958836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.963769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.968009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.970415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:24.972402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:24.973572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:24.975539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.017395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:25.076441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:25.217544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:25.235150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1d8ce27-312e-4b37-a4f2-ee2c0052406c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1267 microversion: 2.1 time: 0.321959 Oct 17 13:27:25.240040 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1394/2726] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:24 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:25.251950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:25.252645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:25.271050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.272064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.272609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.273302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.275095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.275531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.303184 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e174e4e9-7427-4d27-ab92-813d5c9ea075 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "DELETE /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 204 len: 0 microversion: 2.47 time: 0.358715 Oct 17 13:27:25.312789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1333/2727] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:27:24 2022] DELETE /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:27:25.338531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74966ce5-c657-4212-af89-4ccb1b7be573", "tag": "31ab7c27-f847-4b9c-8b76-cee5d1ae620c"}, {"name": "network-changed", "server_uuid": "74966ce5-c657-4212-af89-4ccb1b7be573", "tag": "ab240d00-5cb7-40b7-9ffd-1bb298abb6fe"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:25.374759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.378478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.379118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.404019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] Creating event network-changed:31ab7c27-f847-4b9c-8b76-cee5d1ae620c for instance 74966ce5-c657-4212-af89-4ccb1b7be573 on n-h1-854121-14 Oct 17 13:27:25.404019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] Creating event network-changed:ab240d00-5cb7-40b7-9ffd-1bb298abb6fe for instance 74966ce5-c657-4212-af89-4ccb1b7be573 on n-h1-854121-14 Oct 17 13:27:25.413943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-32028562-47b1-4199-94fd-af04d1486fe6 req-43d02ce6-08d6-4139-94d8-4211c8dce896 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094644 Oct 17 13:27:25.415179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1334/2728] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:25.426004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:25.427730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:25.445605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.446201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.446646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.448950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.449750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.450970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.793792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:25.810828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:25.812393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:25.819317 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c76507e-17a2-40b9-9c1d-d4acf8c605b6 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1363 microversion: 2.47 time: 0.401426 Oct 17 13:27:25.824660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1335/2729] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:25 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:25.839013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:25.840722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:25.867451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.868615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.868844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:25.870136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:25.870939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:25.871526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.008190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:26.021414 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a18fef0a-6f68-4d91-aa46-3a990255dd8c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.776824 Oct 17 13:27:26.022416 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1395/2730] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:25 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:26.032813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:26.037529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:26.053730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.054501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.055105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.056020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.056644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.057670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.267771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:26.278016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b761150-275a-4aa2-9b9a-ee10ebeef982 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1471 microversion: 2.1 time: 0.451853 Oct 17 13:27:26.278606 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1336/2731] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:25 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:26.283118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87ecc1a3-efbd-417d-81a1-bf8fc48f05b9 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e1fe8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:26.391625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87ecc1a3-efbd-417d-81a1-bf8fc48f05b9 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.111802 Oct 17 13:27:26.392525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1337/2732] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:26 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:26.406561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f3f84c22-2073-494f-8c55-ba9caedab459 req-dacc21bc-df52-4e0c-82d2-c137cf732cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14", "name": "network-vif-plugged", "status": "completed", "tag": "3374708b-a678-4a47-97db-e0a22f1abd74"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:26.430066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f3f84c22-2073-494f-8c55-ba9caedab459 req-dacc21bc-df52-4e0c-82d2-c137cf732cd7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.430873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f3f84c22-2073-494f-8c55-ba9caedab459 req-dacc21bc-df52-4e0c-82d2-c137cf732cd7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.431016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f3f84c22-2073-494f-8c55-ba9caedab459 req-dacc21bc-df52-4e0c-82d2-c137cf732cd7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.456966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f3f84c22-2073-494f-8c55-ba9caedab459 req-dacc21bc-df52-4e0c-82d2-c137cf732cd7 service nova] Creating event network-vif-plugged:3374708b-a678-4a47-97db-e0a22f1abd74 for instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 on n-h1-854121-14 Oct 17 13:27:26.466664 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f3f84c22-2073-494f-8c55-ba9caedab459 req-dacc21bc-df52-4e0c-82d2-c137cf732cd7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072893 Oct 17 13:27:26.476250 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1338/2733] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:26.496650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:26.498235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:26.510101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.510703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.511158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.511901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.512386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.512791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.732918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:26.762025 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73c4279f-8dff-4926-a571-0b2fd4a38ddf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1273 microversion: 2.1 time: 0.286448 Oct 17 13:27:26.763683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1339/2734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:26 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:26.771099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:26.771789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:26.779926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.780424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.780927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.781804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:26.782265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:26.782689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:26.930060 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7baa37e-6f97-4dce-b6f3-9fcf494430d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc/action" status: 204 len: 0 microversion: 2.1 time: 0.163738 Oct 17 13:27:26.954842 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1340/2735] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:27:26 2022] POST /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc/action => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:26.973879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:26.986666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:27.012102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.015414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.016197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.018750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.020383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.021117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.408400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:27.426093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:27.435378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:27.437067 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6b19d7f-09ab-4c83-bcef-3540aac3a841 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1363 microversion: 2.47 time: 0.475423 Oct 17 13:27:27.438242 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1341/2736] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:26 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1363 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:27.447187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:27.454255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:27.466515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.470809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.471557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.472129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:27.473556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.486050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.486900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.495337 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-917a91ee-84ce-4378-b6e4-f528707a64ef tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1313 microversion: 2.1 time: 1.471630 Oct 17 13:27:27.495943 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1396/2737] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:26 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1313 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:27.514483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:27.515117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:27.522380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.522975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.523422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.524141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:27.524602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:27.525030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:27.995697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:28.010405 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-afabc44c-ec3e-46d9-abd5-a5d6f483a3e2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.513309 Oct 17 13:27:28.011119 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1397/2738] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:27 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:28.022461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37dbc4cd-e64c-4635-babe-0c3ea8c6358e tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419ddfe4c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:28.094823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37dbc4cd-e64c-4635-babe-0c3ea8c6358e tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.081914 Oct 17 13:27:28.110000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1398/2739] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:28 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:28.128382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:28.130277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:28.145749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:28.147005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:28.148160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:28.149800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:28.151372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:28.152455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:28.779284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:28.833656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ef76590-f2a3-491a-8591-4df834ca6c9d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1273 microversion: 2.1 time: 0.707973 Oct 17 13:27:28.846405 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1399/2740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:28 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1273 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:28.860230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:28.866449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:28.896926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:28.897812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:28.898682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:28.900165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:28.902637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:28.902637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.224147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:29.259905 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9f703cd-2ec9-456b-a06a-aa903db3214c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1471 microversion: 2.1 time: 1.819930 Oct 17 13:27:29.261702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1342/2741] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:27 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1471 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:29.284511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8f2c5f3b-a2f8-4ae7-bba3-b8fe41a7a456 req-c00a2419-6601-4433-a1c2-74f9b4d9bc7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9618fc73-52d1-4c04-a1bd-902ea819fffd", "name": "network-vif-plugged", "status": "completed", "tag": "bd7dfca4-bc2d-4f70-8136-1428bb210591"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:29.312185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f2c5f3b-a2f8-4ae7-bba3-b8fe41a7a456 req-c00a2419-6601-4433-a1c2-74f9b4d9bc7e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.313016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f2c5f3b-a2f8-4ae7-bba3-b8fe41a7a456 req-c00a2419-6601-4433-a1c2-74f9b4d9bc7e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.326328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f2c5f3b-a2f8-4ae7-bba3-b8fe41a7a456 req-c00a2419-6601-4433-a1c2-74f9b4d9bc7e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.362381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8f2c5f3b-a2f8-4ae7-bba3-b8fe41a7a456 req-c00a2419-6601-4433-a1c2-74f9b4d9bc7e service nova] Creating event network-vif-plugged:bd7dfca4-bc2d-4f70-8136-1428bb210591 for instance 9618fc73-52d1-4c04-a1bd-902ea819fffd on n-h1-854121-14 Oct 17 13:27:29.382548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:29.408120 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8f2c5f3b-a2f8-4ae7-bba3-b8fe41a7a456 req-c00a2419-6601-4433-a1c2-74f9b4d9bc7e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144110 Oct 17 13:27:29.409611 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1343/2742] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:29.423740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:29.437553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:29.446315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84980fb4-700f-4add-8fd0-511e77dbc0d1 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 200 len: 1363 microversion: 2.47 time: 0.608881 Oct 17 13:27:29.448005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:29.453690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:29.454148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1400/2743] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:28 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:29.494708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:29.495211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:29.509352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.511662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.512240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.513093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.514412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.515219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.516063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.516903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.518022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:29.518754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:29.520903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:29.523230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.603916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:30.612970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a474d16-f25d-43be-a870-8054f631d868 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1313 microversion: 2.1 time: 1.193043 Oct 17 13:27:30.619053 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1344/2744] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:29 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1313 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:30.624817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8fb3d79-d127-43d7-b259-ca28de37f2bb tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dc62b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:30.727345 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8fb3d79-d127-43d7-b259-ca28de37f2bb tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.106818 Oct 17 13:27:30.728245 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1345/2745] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:30 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:30.744157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:30.744782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:30.761890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.767226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.767908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.769343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.771001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.771376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.831554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:30.841697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8736572-c8c7-45f6-bd68-d99dc0afd956 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 1.369912 Oct 17 13:27:30.846921 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1401/2746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:29 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:30.862434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:30.865013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:30.904218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.905258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.909228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:30.910690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:30.911409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:30.912342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.184633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:31.207893 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a590cb55-a403-48e5-9f28-c82688671f7d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.461312 Oct 17 13:27:31.210285 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1346/2747] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:30 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:31.221574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:31.222501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 970e2945-5c06-4996-929c-980b335bd09f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:31.241470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.242180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.242654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.243461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.243979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.244411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.269479 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] HTTP exception thrown: Instance 970e2945-5c06-4996-929c-980b335bd09f could not be found. Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Request method failure captured: Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f HTTP/1.1 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVgBcAu4lTUoUo1HpdAjtp286gCkwvHGrNQ1HgweVcty7nReR0cvfbWfixkUdvNVhWOmEHZvfwbKyK9Uq-X21i5Ba7WvOZOoacOS8q2geYw9zIbAuNY0lMsjJ57P0rtPstZsHaF-f-2lG2SwvyvRcAUCMz9Iqg_KprpXFX7lTkgDM_0 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d62f6e36c11046e3a759cea9d7f99b05 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerShowV247Test-2020582959 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerShowV247Test-2020582959 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d62f6e36c11046e3a759cea9d7f99b05 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerShowV247Test-2020582959 Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerShowV247Test-2020582959-project Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 22bb1ba21e354e80be041f6cfb81dfec Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerShowV247Test-2020582959-project Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 970e2945-5c06-4996-929c-980b335bd09f could not be found. Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '970e2945-5c06-4996-929c-980b335bd09f'} Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970e2945-5c06-4996-929c-980b335bd09f could not be found. Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970e2945-5c06-4996-929c-980b335bd09f could not be found. Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:31.271961 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970e2945-5c06-4996-929c-980b335bd09f could not be found. Oct 17 13:27:31.276735 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:31.278217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Returning 404 to user: Instance 970e2945-5c06-4996-929c-980b335bd09f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:31.279493 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3d211c2-6eee-4289-a39f-caa74f0adc77 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f" status: 404 len: 111 microversion: 2.47 time: 0.067030 Oct 17 13:27:31.280240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1347/2748] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:31 2022] GET /compute/v2.1/servers/970e2945-5c06-4996-929c-980b335bd09f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:27:31.291737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:31.294026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:31.301575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.303423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.304042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.305062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.305808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.306396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.339475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:31.496846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcca94d2-44e2-48a3-8ea5-aa79da5dc546 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad" status: 204 len: 0 microversion: 2.47 time: 0.211276 Oct 17 13:27:31.501441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1348/2749] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:27:31 2022] DELETE /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:27:31.509516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-30cd08c4-6ee4-4a40-b527-c6b6eae301c9 req-1f287918-5b12-4af2-9fd4-c1c4f3cd4fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc", "name": "network-vif-plugged", "status": "completed", "tag": "c55759fd-0f88-4381-af27-9df75fc55a23"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:31.522621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-30cd08c4-6ee4-4a40-b527-c6b6eae301c9 req-1f287918-5b12-4af2-9fd4-c1c4f3cd4fb6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.523844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-30cd08c4-6ee4-4a40-b527-c6b6eae301c9 req-1f287918-5b12-4af2-9fd4-c1c4f3cd4fb6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.525581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-30cd08c4-6ee4-4a40-b527-c6b6eae301c9 req-1f287918-5b12-4af2-9fd4-c1c4f3cd4fb6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.541382 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-30cd08c4-6ee4-4a40-b527-c6b6eae301c9 req-1f287918-5b12-4af2-9fd4-c1c4f3cd4fb6 service nova] Creating event network-vif-plugged:c55759fd-0f88-4381-af27-9df75fc55a23 for instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc on n-h1-854121-14 Oct 17 13:27:31.547677 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-30cd08c4-6ee4-4a40-b527-c6b6eae301c9 req-1f287918-5b12-4af2-9fd4-c1c4f3cd4fb6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044084 Oct 17 13:27:31.554467 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1349/2750] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:31.561565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:31.562804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:31.572835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.574616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.575558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.576473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.577143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.577985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.848285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:31.862776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:31.871673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:31.873578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:31.876023 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-428921a9-be34-4674-b770-194510f11530 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad" status: 200 len: 1363 microversion: 2.47 time: 0.320082 Oct 17 13:27:31.892226 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1350/2751] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:31 2022] GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:31.906545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:31.908150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:31.920576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.923557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.924363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.926765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:31.927801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:31.930020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:31.997519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:32.011896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55748701-1006-420a-a661-1966e51315ce tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1471 microversion: 2.1 time: 1.162525 Oct 17 13:27:32.016457 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1402/2752] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:30 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1471 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:32.029626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9305f716-9b32-4d6d-bf2b-345322a48214 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419e8ceaf0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:32.111335 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9305f716-9b32-4d6d-bf2b-345322a48214 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.092821 Oct 17 13:27:32.112269 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1403/2753] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:32 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:32.119745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:32.124582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:32.138572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.139891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.140761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.141977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.142597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.143505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.362807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:32.374904 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0d79765-88e6-4535-9016-68cbd9a074f8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1463 microversion: 2.1 time: 0.480654 Oct 17 13:27:32.396937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1351/2754] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:31 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1463 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:32.402391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:32.403597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:32.411200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.412087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.412685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.413597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.414196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.414768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.530083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:32.540745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba1cab97-53a8-4c6d-87e4-e0eff586ecd0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.426029 Oct 17 13:27:32.541607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1404/2755] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:32 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:32.608074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:32.616187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:32.647915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.648437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.648886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.653595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:32.654147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:32.654700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:32.861322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:33.457505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:33.467535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d08e8d1-48fb-4333-a1af-14acf62a4354 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 1.069062 Oct 17 13:27:33.475503 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1352/2756] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:32 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:33.493433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:33.494351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:33.502271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.502271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.503031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.503422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.503915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.504393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.546511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:33.656578 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe298e00-da2b-495e-8ef2-dd1ef82895a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1462 microversion: 2.1 time: 1.112800 Oct 17 13:27:33.680312 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1405/2757] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:32 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1462 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:33.693685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:33.708090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:33.723560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.724373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.724819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.725748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:33.726203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:33.726636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:33.831642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:33.881651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:33.882242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:33.884147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22bb1ba21e354e80be041f6cfb81dfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62f6e36c11046e3a759cea9d7f99b05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:33.898970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-024f9c8a-5b39-4d51-9e39-049de5570c1c tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad" status: 200 len: 1363 microversion: 2.47 time: 0.417278 Oct 17 13:27:33.903794 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1353/2758] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:33 2022] GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad => generated 1363 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:27:33.911500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5825129-91e7-4d10-b4a4-3eaacef3b4ac tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f41a2108940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:34.022421 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5825129-91e7-4d10-b4a4-3eaacef3b4ac tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1426 microversion: 2.1 time: 0.117059 Oct 17 13:27:34.023143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1354/2759] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:33 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:34.028087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:34.029028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:34.038976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:34.039833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:34.040655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:34.042253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:34.042999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:34.043700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:34.383649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:34.671300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:34.711985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:34.726409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2fbd02a-9a44-45c9-879b-98ad00998703 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1463 microversion: 2.1 time: 1.038312 Oct 17 13:27:34.728088 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1406/2760] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:33 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1463 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:34.738159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-252497950", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:34.808466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:34.852447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:34.859254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65399ab1-2b27-4340-9852-e038c7c542e0 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.834699 Oct 17 13:27:34.860394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1355/2761] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:34 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:34.874851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:34.875642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:34.887265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:34.887948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:34.889232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:34.890262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:34.891440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:34.892028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.723534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:35.738692 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b047d573-6599-4942-8f01-e79144b2c064 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.876932 Oct 17 13:27:35.739307 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1356/2762] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:34 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:35.744031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:35.744637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:35.769005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.770527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.771281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:35.772097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:35.772523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:35.772929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.063066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:36.063840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:36.064388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:36.074747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:36.075695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:36.105887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.106727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.107561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.108981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.109884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.110678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.158715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Getting quotas for project b72acb6417e34de5bedb390948697404. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:36.169650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Getting quotas for user b64c73f4ce814daabd6957812e0d1ff4 and project b72acb6417e34de5bedb390948697404. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:36.190896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:36.194798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:36.284509 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a59a46d6-0abb-481c-b2dd-ab98e7602ad7 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1616 microversion: 2.1 time: 0.543865 Oct 17 13:27:36.284839 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f55d9c6e-233f-418e-b99d-cc0a3c4e5ff0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552999 Oct 17 13:27:36.292690 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1407/2763] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:36.297414 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1357/2764] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:35 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1616 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:36.302366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1145ebac-7cd3-4217-a9f6-bae2f3590dc0 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419db48820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:36.337723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:36.338847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] [instance: 0bb6aca6-1361-46d0-abb0-a2d08163ecad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:36.345719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.346481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.347078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.348103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.349615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.351462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.366907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1145ebac-7cd3-4217-a9f6-bae2f3590dc0 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1435 microversion: 2.1 time: 0.068308 Oct 17 13:27:36.367502 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1358/2765] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:36 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1435 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:36.385955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3a2a7131-6a81-49a9-95be-f31c28966223 req-8254c3f6-39b1-44fb-86db-a5e1fc6e45be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef51f563-9ccb-4bb4-b6c7-ad2d861ae584", "tag": "6a3b244c-f18c-414e-8b60-2ce46572ee5d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:36.390860 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] HTTP exception thrown: Instance 0bb6aca6-1361-46d0-abb0-a2d08163ecad could not be found. Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Request method failure captured: Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad HTTP/1.1 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVgBcAu4lTUoUo1HpdAjtp286gCkwvHGrNQ1HgweVcty7nReR0cvfbWfixkUdvNVhWOmEHZvfwbKyK9Uq-X21i5Ba7WvOZOoacOS8q2geYw9zIbAuNY0lMsjJ57P0rtPstZsHaF-f-2lG2SwvyvRcAUCMz9Iqg_KprpXFX7lTkgDM_0 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: d62f6e36c11046e3a759cea9d7f99b05 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerShowV247Test-2020582959 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d62f6e36c11046e3a759cea9d7f99b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerShowV247Test-2020582959 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: d62f6e36c11046e3a759cea9d7f99b05 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerShowV247Test-2020582959 Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerShowV247Test-2020582959-project Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 22bb1ba21e354e80be041f6cfb81dfec Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerShowV247Test-2020582959-project Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 0bb6aca6-1361-46d0-abb0-a2d08163ecad could not be found. Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0bb6aca6-1361-46d0-abb0-a2d08163ecad'} Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bb6aca6-1361-46d0-abb0-a2d08163ecad could not be found. Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bb6aca6-1361-46d0-abb0-a2d08163ecad could not be found. Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:36.392594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bb6aca6-1361-46d0-abb0-a2d08163ecad could not be found. Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] Returning 404 to user: Instance 0bb6aca6-1361-46d0-abb0-a2d08163ecad could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:36.398957 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-692d32ee-1164-4602-afc8-eb36445b9695 tempest-ServerShowV247Test-2020582959 tempest-ServerShowV247Test-2020582959-project] 10.222.0.65 "GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad" status: 404 len: 111 microversion: 2.47 time: 0.100064 Oct 17 13:27:36.410310 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1408/2766] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:27:36 2022] GET /compute/v2.1/servers/0bb6aca6-1361-46d0-abb0-a2d08163ecad => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:27:36.422946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:36.423575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:36.429435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a2a7131-6a81-49a9-95be-f31c28966223 req-8254c3f6-39b1-44fb-86db-a5e1fc6e45be service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.430329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a2a7131-6a81-49a9-95be-f31c28966223 req-8254c3f6-39b1-44fb-86db-a5e1fc6e45be service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.432518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a2a7131-6a81-49a9-95be-f31c28966223 req-8254c3f6-39b1-44fb-86db-a5e1fc6e45be service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.443542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.444043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.454301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.455077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.463286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3a2a7131-6a81-49a9-95be-f31c28966223 req-8254c3f6-39b1-44fb-86db-a5e1fc6e45be service nova] Creating event network-changed:6a3b244c-f18c-414e-8b60-2ce46572ee5d for instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 on n-h2-854121-14 Oct 17 13:27:36.465566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.466653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:36.478263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3a2a7131-6a81-49a9-95be-f31c28966223 req-8254c3f6-39b1-44fb-86db-a5e1fc6e45be service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105282 Oct 17 13:27:36.479563 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1359/2767] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:36.492754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54082436-cf80-4c07-a463-dc8e6217bbf8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:36.493374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54082436-cf80-4c07-a463-dc8e6217bbf8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:36.894165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-54082436-cf80-4c07-a463-dc8e6217bbf8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:36.920849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54082436-cf80-4c07-a463-dc8e6217bbf8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1213 microversion: 2.1 time: 0.437962 Oct 17 13:27:36.937400 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1360/2768] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:36 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1213 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:36.959677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a9892a6-d36a-4579-9771-2d08467917e6 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '.version_select at 0x7f419db52ca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:36.969226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9892a6-d36a-4579-9771-2d08467917e6 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:36.970339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9892a6-d36a-4579-9771-2d08467917e6 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:36.970787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9892a6-d36a-4579-9771-2d08467917e6 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.000427 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a9892a6-d36a-4579-9771-2d08467917e6 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.060929 Oct 17 13:27:37.002080 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1361/2769] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:27:36 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:37.009030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee656eaf-a338-4e8e-9205-79d2babef187 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419db4ba60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:37.023562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:37.033696 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a08a6f3d-bd70-4423-8874-6f66dc1fb0b2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.622155 Oct 17 13:27:37.037591 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1409/2770] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:36 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:37.044249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:37.045035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:37.061032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:37.062116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:37.062570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.063297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:37.063841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:37.064175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.097264 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee656eaf-a338-4e8e-9205-79d2babef187 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 200 len: 1435 microversion: 2.1 time: 0.091940 Oct 17 13:27:37.098959 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1362/2771] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:37 2022] GET /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 1435 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:37.119710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d9c889cf-67ce-4287-8c6d-9107ce1b9267 req-9e417070-44f8-48ca-8c93-cf4ee514b267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74966ce5-c657-4212-af89-4ccb1b7be573", "name": "network-vif-plugged", "status": "completed", "tag": "31ab7c27-f847-4b9c-8b76-cee5d1ae620c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:37.154053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d9c889cf-67ce-4287-8c6d-9107ce1b9267 req-9e417070-44f8-48ca-8c93-cf4ee514b267 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:37.155967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d9c889cf-67ce-4287-8c6d-9107ce1b9267 req-9e417070-44f8-48ca-8c93-cf4ee514b267 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:37.157428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d9c889cf-67ce-4287-8c6d-9107ce1b9267 req-9e417070-44f8-48ca-8c93-cf4ee514b267 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.188267 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d9c889cf-67ce-4287-8c6d-9107ce1b9267 req-9e417070-44f8-48ca-8c93-cf4ee514b267 service nova] Creating event network-vif-plugged:31ab7c27-f847-4b9c-8b76-cee5d1ae620c for instance 74966ce5-c657-4212-af89-4ccb1b7be573 on n-h1-854121-14 Oct 17 13:27:37.205665 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d9c889cf-67ce-4287-8c6d-9107ce1b9267 req-9e417070-44f8-48ca-8c93-cf4ee514b267 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103364 Oct 17 13:27:37.209003 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1363/2772] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:37.224641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:37.227016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:37.252478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:37.254371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:37.255694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.256467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:37.256940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:37.260592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:37.975198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:37.986986 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8792af3-b0c0-4d54-88e8-a4180f227586 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.948181 Oct 17 13:27:37.997726 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1410/2773] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:37 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:38.005529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:38.008964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-426132306", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:38.011266 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c00993fd-90bd-45de-bee4-569a3aeff679 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1467 microversion: 2.1 time: 0.799259 Oct 17 13:27:38.015570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1364/2774] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:37 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1467 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:38.024051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:38.025038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:38.041983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.045998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.049393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.053436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.054193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.054821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.120436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:38.366777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:38.378702 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-027fe353-7e3c-4a32-90ee-200fddea0e7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1265 microversion: 2.1 time: 0.360808 Oct 17 13:27:38.402405 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1365/2775] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:38 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:38.422346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0adcc92-29e3-4652-86bc-2dc968ef08b7 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dc62160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:38.870538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:38.871086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:38.872174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:38.872852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:38.873411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:38.896997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.899788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.905454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.908180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:38.909853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:38.910876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:38.938865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:38.948827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for user fec0e15aae5c4bf996ee4b8a98a496e2 and project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:38.970375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:38.975614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:39.071829 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6a29c10-593f-48df-873d-ce645e991241 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072990 Oct 17 13:27:39.078544 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1411/2776] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:39.096976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:39.101390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:39.147965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.151368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.155118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.156873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.157642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.160590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.488336 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0adcc92-29e3-4652-86bc-2dc968ef08b7 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "DELETE /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5" status: 204 len: 0 microversion: 2.1 time: 1.076513 Oct 17 13:27:39.489301 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1366/2777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:38 2022] DELETE /compute/v2.1/images/80d68bed-26c8-4d4c-a0e4-2695ae8edac5 => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:39.496912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:39.498116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:39.512627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.513649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.514197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.517885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.518582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.519042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.874428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:39.888776 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-143346b2-f867-4c6d-9c0d-0f9250eea19f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.813045 Oct 17 13:27:39.905009 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1412/2778] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:39 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:39.915216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:39.916063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:39.922636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.923420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.924090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.926760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:39.928200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:39.928657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:39.954580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:40.037656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:40.053111 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-350223b8-67c4-4ec1-98ab-a9305bec5fdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1216 microversion: 2.1 time: 0.145748 Oct 17 13:27:40.057543 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1413/2779] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:39 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:40.065064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74966ce5-c657-4212-af89-4ccb1b7be573", "name": "network-vif-plugged", "status": "completed", "tag": "ab240d00-5cb7-40b7-9ffd-1bb298abb6fe"}, {"server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "name": "network-vif-unplugged", "status": "completed", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:40.091328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.091832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.092270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.129934 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] Creating event network-vif-plugged:ab240d00-5cb7-40b7-9ffd-1bb298abb6fe for instance 74966ce5-c657-4212-af89-4ccb1b7be573 on n-h1-854121-14 Oct 17 13:27:40.130588 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] Creating event network-vif-unplugged:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:27:40.179835 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cbf8297f-c426-40e3-bdc8-2e04fbc60e47 req-dff86aa9-3ce2-40bb-957d-3a1a80a48343 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.120433 Oct 17 13:27:40.182005 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1414/2780] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:40.193997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:40.194317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:40.204277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.205205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.206012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.224479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.227466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.228430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.636183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:40.652128 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b1d55d0-5521-4c5e-ae3e-65502af4577f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 1.160406 Oct 17 13:27:40.653964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1367/2781] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:39 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:40.659358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3232c239-da91-42f9-b2be-e82ce9ffb47b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '.version_select at 0x7f419dc95e50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:40.700961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:40.711442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d4b0056-000b-4c92-b542-9b7fb73a03c9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1271 microversion: 2.1 time: 0.527947 Oct 17 13:27:40.715898 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1415/2782] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:40 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1271 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:40.726300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3232c239-da91-42f9-b2be-e82ce9ffb47b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] HTTP exception thrown: Image not found. Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3232c239-da91-42f9-b2be-e82ce9ffb47b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Request method failure captured: Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb HTTP/1.1 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVf9Ar8uklYHD0QN555U8nxmAakJPluY47o8giCjxPFrxq8Rwkdtrm_AKUfP8GV2J05pedD4M25NQS8btn8zkUia80bUSr2jCpHEyxBP8wefetqeiCoB0rFHyQuegDUhmwvMoTxoK0Jtpr5cjYiLdquq_QaY1wnCXTgYplJcMzdmaT0 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d5fe0ce940ff409bb939b04a752dc010 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d5fe0ce940ff409bb939b04a752dc010 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerTestJSON-822763636-project Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 3e96a6ca3cf74157be8a00df57f646d9 Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerTestJSON-822763636-project Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: exception: Image not found. Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a8ed624d-028e-49c7-8753-d66fb8bfcbeb'} Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8ed624d-028e-49c7-8753-d66fb8bfcbeb to delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8ed624d-028e-49c7-8753-d66fb8bfcbeb could not be found. Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.728741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:40.734391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3232c239-da91-42f9-b2be-e82ce9ffb47b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Returning 404 to user: Image not found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:40.737359 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3232c239-da91-42f9-b2be-e82ce9ffb47b tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "DELETE /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb" status: 404 len: 62 microversion: 2.1 time: 0.078769 Oct 17 13:27:40.737359 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1368/2783] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:40 2022] DELETE /compute/v2.1/images/a8ed624d-028e-49c7-8753-d66fb8bfcbeb => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:27:40.747887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:40.748451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:40.763292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.764640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.765123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.766216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.766798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.767300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.840901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:40.919316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:40.920161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:40.935460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.936117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.936971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:40.940442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:40.941928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:40.942936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.012720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2dabd2ba-9076-4cc6-8127-41bd16056584 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "DELETE /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 204 len: 0 microversion: 2.1 time: 0.268284 Oct 17 13:27:41.017979 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1416/2784] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:40 2022] DELETE /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:41.032698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:41.033687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:41.052573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:41.053089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:41.053654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.054344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:41.054811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:41.055330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.623912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:41.644793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cae26a4-9713-48f0-ba85-62602dcf1015 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1473 microversion: 2.1 time: 0.623561 Oct 17 13:27:41.645822 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1417/2785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:41 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1473 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:41.651415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:41.652280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:41.660865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:41.662669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:41.663490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.664608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:41.665383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:41.666065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.904183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:41.922949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-546d5546-27fe-4e8c-a976-6616d7b72c0e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1282 microversion: 2.1 time: 0.274933 Oct 17 13:27:41.924351 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1418/2786] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:41 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1282 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:41.929875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:41.930798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:41.945439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:41.946472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:41.947767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.950242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:41.951039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:41.954940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:41.994522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:42.009281 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ad39d59-70e8-42ed-99b6-0134da5839df tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 1.095521 Oct 17 13:27:42.009954 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1369/2787] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:40 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:42.021670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:42.023398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:42.035950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.037366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.038075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.040209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.041272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.043341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.449983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:42.462849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:42.472207 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc38d3ac-d5a8-4919-8920-8a5323d59a93 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.545326 Oct 17 13:27:42.474217 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1419/2788] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:41 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:42.477322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6769614-a084-45bf-abdd-19df63c2730e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.461694 Oct 17 13:27:42.490236 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1370/2789] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:42 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:42.671836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:42.676942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:42.686025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.686923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.687605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.688690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.689479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.690207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.905235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:42.918916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9913834-c6b8-4cdb-acce-6d9d6bd9ffa8 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1473 microversion: 2.1 time: 0.252200 Oct 17 13:27:42.921627 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1420/2790] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:42 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1473 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:42.946607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:42.947235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:42.954070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.954571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.955285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:42.956091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:42.956632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:42.957343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.032841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:43.033863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:43.047193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.048537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.052517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.053600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.054350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.055049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.062235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:43.073272 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc50ed71-f0f5-4100-999b-1938c28a068b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1270 microversion: 2.1 time: 0.130376 Oct 17 13:27:43.106301 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1371/2791] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:42 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:43.256365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:43.268284 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac257c29-b8c9-40c2-85b4-e4de80211997 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1333 microversion: 2.1 time: 0.239539 Oct 17 13:27:43.270364 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1421/2792] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:43 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1333 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:43.496289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:43.504822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:43.517108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:43.518305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:43.522186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:43.541087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.543476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.549855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.553203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.554959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.555420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.556187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.558106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:43.560001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.560223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:43.560817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:43.561152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.041514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:44.051666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1d5bfb5-17d3-4d05-8df5-ced0ff661aa2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.539014 Oct 17 13:27:44.053069 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1422/2793] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:43 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:44.058214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:44.059118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:44.071920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.072715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.073369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.074252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.074886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.075484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.080148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:44.089297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb722ca5-79e3-4b30-b518-d539a00145cb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.596797 Oct 17 13:27:44.097462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1372/2794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:43 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:44.102580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:44.105956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:44.117083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.124219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.131623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.133022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.133729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.134652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.349030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:44.374096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3115b9a3-079f-47a3-b7bc-2362af9c7c2b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1270 microversion: 2.1 time: 0.265839 Oct 17 13:27:44.377004 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1373/2795] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:44 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:44.388600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:44.390098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:44.401578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:44.423018 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f3ca191-e2ae-4165-a8e7-8816541b3310 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1473 microversion: 2.1 time: 0.368100 Oct 17 13:27:44.423937 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1423/2796] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:44 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1473 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:44.452606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.454519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.455157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.457377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:44.458463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:44.462124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:44.984894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:45.004260 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a17d332-15cd-49cb-8fa4-270a474371ed tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1666 microversion: 2.1 time: 0.622411 Oct 17 13:27:45.006311 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1374/2797] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:44 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1666 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:45.029027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:45.029916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:45.038480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.039389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.040068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.041010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.041757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.043301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.079404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:45.081001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:45.094005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.099285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.099970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.101298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.103427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.104533 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48c213c5-ead9-4b4a-a61d-6f70b9ff0444 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573/ips" status: 200 len: 177 microversion: 2.1 time: 0.079421 Oct 17 13:27:45.105108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.114886 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1424/2798] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:27:45 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573/ips => generated 177 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:45.129634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:45.131276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:45.147829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.150827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.153720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.154717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.156195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.156860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.172434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:45.595727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:45.611953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5875181c-03fd-4af0-9598-e3545aaac52e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.536598 Oct 17 13:27:45.612822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1375/2799] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:45 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:45.635258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:45.639230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:45.648698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:45.651215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.651719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.652162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.652872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.653562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.654155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.658910 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73433969-fa11-4496-adf2-a52c1d57a360 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.542733 Oct 17 13:27:45.659512 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1425/2800] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:45 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:45.664908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:45.680904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:45.706098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.707131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.710937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.711714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.712191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.712634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.723745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:27:45.906146 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c57f1bf1-3b3b-4a00-9bfd-a0910ad4fc1c tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "DELETE /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 204 len: 0 microversion: 2.1 time: 0.290963 Oct 17 13:27:45.908441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1376/2801] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:27:45 2022] DELETE /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:27:45.917068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:45.918198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:45.935379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.937414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.938121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.939231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:45.939943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:45.940608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:45.991924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:46.007327 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87676b99-1944-4335-b6eb-75ad200a7a30 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.345548 Oct 17 13:27:46.009355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1426/2802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:45 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:46.023836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:46.031616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:46.034453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:46.051677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.055443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.056248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.057545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.058856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.063357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.453766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:46.467757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73c506e3-507a-40eb-abda-b368017b8078 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1672 microversion: 2.1 time: 0.457091 Oct 17 13:27:46.469044 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1427/2803] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:46 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1672 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:46.475537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8f7b590c-52dc-4655-9e35-a80b5b479379 req-9d1e527e-1729-43d1-aaef-4b2a12a0c493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712", "tag": "05070510-029c-4cd1-a759-426e7558525a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:46.491421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8f7b590c-52dc-4655-9e35-a80b5b479379 req-9d1e527e-1729-43d1-aaef-4b2a12a0c493 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.492264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8f7b590c-52dc-4655-9e35-a80b5b479379 req-9d1e527e-1729-43d1-aaef-4b2a12a0c493 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.493313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8f7b590c-52dc-4655-9e35-a80b5b479379 req-9d1e527e-1729-43d1-aaef-4b2a12a0c493 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.512034 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8f7b590c-52dc-4655-9e35-a80b5b479379 req-9d1e527e-1729-43d1-aaef-4b2a12a0c493 service nova] Creating event network-changed:05070510-029c-4cd1-a759-426e7558525a for instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 on n-h1-854121-14 Oct 17 13:27:46.521678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8f7b590c-52dc-4655-9e35-a80b5b479379 req-9d1e527e-1729-43d1-aaef-4b2a12a0c493 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050894 Oct 17 13:27:46.523523 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1428/2804] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:46.548352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1ef86153-3310-49bc-aa37-2ac4397685f7 req-3eb640b8-9069-40d9-95f2-f669480c7bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99005c13-3765-4904-ba74-8138a743cd46", "name": "network-vif-deleted", "tag": "4a03bedc-afef-4df5-9cb0-604ed095e623"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:46.556288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e96a6ca3cf74157be8a00df57f646d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5fe0ce940ff409bb939b04a752dc010', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:46.583250 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-299cd18c-a851-4e5f-a775-770dd9a8d726 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 200 len: 1473 microversion: 2.1 time: 0.673241 Oct 17 13:27:46.599686 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1377/2805] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:45 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 1473 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:46.611866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ef86153-3310-49bc-aa37-2ac4397685f7 req-3eb640b8-9069-40d9-95f2-f669480c7bdd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.612377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ef86153-3310-49bc-aa37-2ac4397685f7 req-3eb640b8-9069-40d9-95f2-f669480c7bdd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.613408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ef86153-3310-49bc-aa37-2ac4397685f7 req-3eb640b8-9069-40d9-95f2-f669480c7bdd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.617459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d72f9406-a5b7-48ac-b5d5-4e1bd2f7820a req-646e0e3d-e802-405c-953f-b46eb85b2439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef51f563-9ccb-4bb4-b6c7-ad2d861ae584", "name": "network-vif-plugged", "status": "completed", "tag": "6a3b244c-f18c-414e-8b60-2ce46572ee5d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:46.638096 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1ef86153-3310-49bc-aa37-2ac4397685f7 req-3eb640b8-9069-40d9-95f2-f669480c7bdd service nova] Creating event network-vif-deleted:4a03bedc-afef-4df5-9cb0-604ed095e623 for instance 99005c13-3765-4904-ba74-8138a743cd46 on n-h1-854121-14 Oct 17 13:27:46.647076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d72f9406-a5b7-48ac-b5d5-4e1bd2f7820a req-646e0e3d-e802-405c-953f-b46eb85b2439 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.647467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d72f9406-a5b7-48ac-b5d5-4e1bd2f7820a req-646e0e3d-e802-405c-953f-b46eb85b2439 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.647914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d72f9406-a5b7-48ac-b5d5-4e1bd2f7820a req-646e0e3d-e802-405c-953f-b46eb85b2439 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.652782 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1ef86153-3310-49bc-aa37-2ac4397685f7 req-3eb640b8-9069-40d9-95f2-f669480c7bdd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108936 Oct 17 13:27:46.654168 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1429/2806] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:46.661869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:46.663032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:46.677442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.677658 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d72f9406-a5b7-48ac-b5d5-4e1bd2f7820a req-646e0e3d-e802-405c-953f-b46eb85b2439 service nova] Creating event network-vif-plugged:6a3b244c-f18c-414e-8b60-2ce46572ee5d for instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 on n-h2-854121-14 Oct 17 13:27:46.678492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.679409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.681581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.682379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.683214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.686982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d72f9406-a5b7-48ac-b5d5-4e1bd2f7820a req-646e0e3d-e802-405c-953f-b46eb85b2439 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080889 Oct 17 13:27:46.688525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1378/2807] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:46.693086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:46.693830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:46.714079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.714825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.715282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.724785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:46.725352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:46.726068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:46.910901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:48.021464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:48.040746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88bc7221-fb0d-4ed9-91dc-21b36c4c36bd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 1.346566 Oct 17 13:27:48.042343 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1379/2808] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:46 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:48.060722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:48.061881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:48.075004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.075513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.075956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.076666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.077118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.082390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.116256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:48.119935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:48.129479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-288b13bf-0ab7-4235-9da1-8480159368cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 1.469023 Oct 17 13:27:48.130473 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1430/2809] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:46 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:48.147291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:48.147917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:48.171663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.172457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.173062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.174043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.174670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.175262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.706491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:48.725821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9da5908b-0f93-4f62-8302-c23131de1e05 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.681161 Oct 17 13:27:48.728399 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1380/2810] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:48 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:48.751962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:48.753285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] [instance: 99005c13-3765-4904-ba74-8138a743cd46] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:48.765127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.765979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.766628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.767917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:48.768605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:48.770681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:48.772410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:48.787351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d06e776-fff3-405d-9f80-8a6078260b0f tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1672 microversion: 2.1 time: 0.655762 Oct 17 13:27:48.787958 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1431/2811] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:48 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1672 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:48.822214 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] HTTP exception thrown: Instance 99005c13-3765-4904-ba74-8138a743cd46 could not be found. Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Request method failure captured: Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 HTTP/1.1 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVf9Ar8uklYHD0QN555U8nxmAakJPluY47o8giCjxPFrxq8Rwkdtrm_AKUfP8GV2J05pedD4M25NQS8btn8zkUia80bUSr2jCpHEyxBP8wefetqeiCoB0rFHyQuegDUhmwvMoTxoK0Jtpr5cjYiLdquq_QaY1wnCXTgYplJcMzdmaT0 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: d5fe0ce940ff409bb939b04a752dc010 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_d5fe0ce940ff409bb939b04a752dc010"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: d5fe0ce940ff409bb939b04a752dc010 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-822763636 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesOneServerTestJSON-822763636-project Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 3e96a6ca3cf74157be8a00df57f646d9 Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesOneServerTestJSON-822763636-project Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 99005c13-3765-4904-ba74-8138a743cd46 could not be found. Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '99005c13-3765-4904-ba74-8138a743cd46'} Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99005c13-3765-4904-ba74-8138a743cd46 could not be found. Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99005c13-3765-4904-ba74-8138a743cd46 could not be found. Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:48.824015 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99005c13-3765-4904-ba74-8138a743cd46 could not be found. Oct 17 13:27:48.828495 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:48.832153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] Returning 404 to user: Instance 99005c13-3765-4904-ba74-8138a743cd46 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:48.835679 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3036e4f6-b45f-44ea-aec9-0008bf1d26e1 tempest-ImagesOneServerTestJSON-822763636 tempest-ImagesOneServerTestJSON-822763636-project] 10.222.0.65 "GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46" status: 404 len: 111 microversion: 2.1 time: 0.105871 Oct 17 13:27:48.836483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1381/2812] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:48 2022] GET /compute/v2.1/servers/99005c13-3765-4904-ba74-8138a743cd46 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:49.065251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:49.067237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:49.072504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:49.073487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:49.092882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.093666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.094333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.095804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.096712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.097535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.155807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:49.156424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:49.169107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.174491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.175044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.175941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.179852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.181124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.672070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:49.688003 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d65bb28a-8b8e-435f-ace6-5133c8c91499 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1315 microversion: 2.1 time: 0.623554 Oct 17 13:27:49.694198 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1432/2813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:49 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:49.756428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:49.757046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:49.767141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.772775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.773246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.778189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.778856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.779318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.838144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:49.852112 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98a7ceaa-624c-4d83-9c76-b24c0288b03b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.700051 Oct 17 13:27:49.852719 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1382/2814] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:49 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:49.883771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:49.897481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:49.922167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.922781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.923229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:49.923951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:49.924563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:49.924999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:50.485479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:50.491424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:50.511966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c8e8edf-fd7c-47a9-a4c3-52f41a3f60f3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.760189 Oct 17 13:27:50.522204 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9929dd0-ce9b-40ca-af4c-7e448050fcfb tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1651 microversion: 2.1 time: 0.668369 Oct 17 13:27:50.524613 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1433/2815] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:49 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:50.528589 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1383/2816] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:49 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1651 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:50.532376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3be5c493-7aa6-4ffb-a5b4-cd601424c067 req-185a5164-1c85-4fa4-b402-c57dabdd146a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74966ce5-c657-4212-af89-4ccb1b7be573", "name": "network-vif-deleted", "tag": "ab240d00-5cb7-40b7-9ffd-1bb298abb6fe"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:50.545882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3be5c493-7aa6-4ffb-a5b4-cd601424c067 req-185a5164-1c85-4fa4-b402-c57dabdd146a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.546622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3be5c493-7aa6-4ffb-a5b4-cd601424c067 req-185a5164-1c85-4fa4-b402-c57dabdd146a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.547223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3be5c493-7aa6-4ffb-a5b4-cd601424c067 req-185a5164-1c85-4fa4-b402-c57dabdd146a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:50.560709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3be5c493-7aa6-4ffb-a5b4-cd601424c067 req-185a5164-1c85-4fa4-b402-c57dabdd146a service nova] Creating event network-vif-deleted:ab240d00-5cb7-40b7-9ffd-1bb298abb6fe for instance 74966ce5-c657-4212-af89-4ccb1b7be573 on n-h1-854121-14 Oct 17 13:27:50.567276 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3be5c493-7aa6-4ffb-a5b4-cd601424c067 req-185a5164-1c85-4fa4-b402-c57dabdd146a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040260 Oct 17 13:27:50.568394 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1434/2817] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:50.719453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:50.720618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:50.729941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.732811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.733750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:50.736081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.737574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.740500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:50.878865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:50.879578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:50.886014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.886674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.887282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:50.888300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:50.888980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:50.889672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:51.229607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:51.233611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:51.282079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be3f1070-f546-4479-810c-452ae62f44f0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1503 microversion: 2.1 time: 0.569117 Oct 17 13:27:51.288500 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41f3a964-1448-4dc9-ac76-6051c8ddde3f tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.412829 Oct 17 13:27:51.290517 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1384/2818] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:50 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:51.293689 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1435/2819] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:50 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:51.302989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-51226813-9fb1-44b5-97ec-4dcdd25d7491 req-bfa390b4-774b-4225-a688-ea58f34bb10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29ceb46-cca5-44b5-9989-31ba3ab4e498", "tag": "22ccbdc7-99a9-4a51-9b3f-008b303eded7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:51.345861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:51.347996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:51.354842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-51226813-9fb1-44b5-97ec-4dcdd25d7491 req-bfa390b4-774b-4225-a688-ea58f34bb10b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:51.362379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-51226813-9fb1-44b5-97ec-4dcdd25d7491 req-bfa390b4-774b-4225-a688-ea58f34bb10b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:51.363473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-51226813-9fb1-44b5-97ec-4dcdd25d7491 req-bfa390b4-774b-4225-a688-ea58f34bb10b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:51.408144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:51.415798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:51.418433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:51.427882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:51.438841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:51.440084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:51.470793 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-51226813-9fb1-44b5-97ec-4dcdd25d7491 req-bfa390b4-774b-4225-a688-ea58f34bb10b service nova] Creating event network-changed:22ccbdc7-99a9-4a51-9b3f-008b303eded7 for instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 on n-h2-854121-14 Oct 17 13:27:51.491046 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-51226813-9fb1-44b5-97ec-4dcdd25d7491 req-bfa390b4-774b-4225-a688-ea58f34bb10b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196333 Oct 17 13:27:51.492832 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1385/2820] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:51.546428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:51.547529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:51.567133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:51.568689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:51.570809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:51.573038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:51.575025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:51.576619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:52.582079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Removing security group 9bffd507-34bf-45d4-993c-463914f1c0b8 from port 6a3b244c-f18c-414e-8b60-2ce46572ee5d Oct 17 13:27:52.658048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:52.669138 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d20e505-5b1e-481f-aaec-d8f4439f5867 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 1.127976 Oct 17 13:27:52.670492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1386/2821] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:51 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:52.675931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:52.676832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:52.684930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.685806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.686991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:52.687976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.688659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.689761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:52.731923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.732482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.733408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:52.733976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lazy-loading 'fault' on Instance uuid 74966ce5-c657-4212-af89-4ccb1b7be573 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:27:52.809634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cef07763604d49a9ecd33049d098fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17152d7dd9b847a884017a9a0331cf69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:52.822839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b9ad957-ddfd-4f91-934f-b44dc171b160 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 200 len: 1302 microversion: 2.1 time: 0.150877 Oct 17 13:27:52.824498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1387/2822] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:52 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:52.829913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:52.831307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:52.850805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.851790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.852268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:52.853082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:52.853624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:52.854222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.139876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:53.153209 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-276b2f96-13ef-4f08-89a9-2ce5adaa0cae tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.327380 Oct 17 13:27:53.156192 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1388/2823] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:52 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:53.169767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-908d228e-c99f-48ba-be90-f422cb771db0 req-b5927478-f92a-42cb-9fac-d9b8e2e6835c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74966ce5-c657-4212-af89-4ccb1b7be573", "name": "network-vif-deleted", "tag": "31ab7c27-f847-4b9c-8b76-cee5d1ae620c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:53.195299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-908d228e-c99f-48ba-be90-f422cb771db0 req-b5927478-f92a-42cb-9fac-d9b8e2e6835c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.195785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-908d228e-c99f-48ba-be90-f422cb771db0 req-b5927478-f92a-42cb-9fac-d9b8e2e6835c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.197519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-908d228e-c99f-48ba-be90-f422cb771db0 req-b5927478-f92a-42cb-9fac-d9b8e2e6835c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.236781 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-908d228e-c99f-48ba-be90-f422cb771db0 req-b5927478-f92a-42cb-9fac-d9b8e2e6835c service nova] Creating event network-vif-deleted:31ab7c27-f847-4b9c-8b76-cee5d1ae620c for instance 74966ce5-c657-4212-af89-4ccb1b7be573 on n-h1-854121-14 Oct 17 13:27:53.264601 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-908d228e-c99f-48ba-be90-f422cb771db0 req-b5927478-f92a-42cb-9fac-d9b8e2e6835c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101595 Oct 17 13:27:53.267218 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1389/2824] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:53.346281 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-919d5ce9-da1d-4f32-8272-7deddb4e1605 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584/action" status: 202 len: 0 microversion: 2.1 time: 2.012219 Oct 17 13:27:53.351514 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1436/2825] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:27:51 2022] POST /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584/action => generated 0 bytes in 2020 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:27:53.360704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:53.361439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:53.369315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.370313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.371210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.372569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.373265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.373881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.539708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:53.553120 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4df7eca3-6d01-4119-ac9d-a19f83786aac tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1461 microversion: 2.1 time: 0.196765 Oct 17 13:27:53.570085 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1390/2826] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:53 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1461 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:53.579369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:53.579990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:53.588785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.589311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.590299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.591031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.591643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.592073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.728057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1716656956", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "72f9dc44-486d-4489-b2a2-29e82c2ef0c5"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:53.820475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:53.845410 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9bdcb2f8-dbcb-450b-ad65-d7eb60d1641c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.270992 Oct 17 13:27:53.846402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] validate_networks() for [('72f9dc44-486d-4489-b2a2-29e82c2ef0c5', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:53.858446 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1391/2827] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:53 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:53.874756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:53.876577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:53.885198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.885918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.886347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:53.887118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:53.887805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:53.888377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.199410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:54.208477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:27:54.216856 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ecc78c92-bc31-440e-8312-772fd9d4324a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.353556 Oct 17 13:27:54.217931 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1392/2828] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:53 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:54.236901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:54.238385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:54.252935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.255812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.256485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.259581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.260190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.260730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.298084 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] HTTP exception thrown: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Request method failure captured: Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 HTTP/1.1 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVf1ADKN775q0w35_I4Sp-7i0F7rIixYx1lHW7wWyhSg8hTRwRGUhtvRora5uiVIjZmhCgEgyv-9nYWqQO8xe-2ykoBaXVVdILoq0Z6u7sY8kmD5yUCyC9aI1gKJSxx4_c70Ge6wx9RL9LiJc5GYlBAjHFIKxy7mezBcXGLYr17EAVk Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestMultiNic-1964178639 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 60cef07763604d49a9ecd33049d098fa Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '74966ce5-c657-4212-af89-4ccb1b7be573'} Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:27:54.305210 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:27:54.309309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:27:54.311625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Returning 404 to user: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:27:54.312719 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6078271c-8dba-47c5-ad8b-7482928c49b6 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 404 len: 111 microversion: 2.1 time: 0.093520 Oct 17 13:27:54.316738 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1393/2829] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:54 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:27:54.328870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:54.329844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:54.344453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.344953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.345429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.346141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.346596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.347024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.737918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:54.751656 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3bf566b-7243-4f3e-b5ac-b4d899ca68a1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.430359 Oct 17 13:27:54.754038 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1394/2830] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:54 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:54.766889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:54.767813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:54.782152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:27:54.784029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.784322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:27:54.784523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.785971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:27:54.786614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:27:54.787039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.787781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.788097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:27:54.788225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.793014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.800867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.802379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.804372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.808690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:54.810844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:54.811676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:54.842468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Getting quotas for project 9138dad943144f92a264271cff2c399f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:27:54.866514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Getting quotas for user fd8a88c8c48c43df9039eaf2369dfe6c and project 9138dad943144f92a264271cff2c399f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:27:54.895089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Going to run 3 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:27:54.898930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:54.961852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=e70b274a-1e38-4724-a4d6-b6202e6fdfd6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:55.042949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=fb9b4d72-e1f8-4dd5-af69-0234de07344b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:27:55.111852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:55.124356 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-433de61c-2cb8-44b0-8beb-9b8255b86606 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.368964 Oct 17 13:27:55.126724 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1395/2831] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:54 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:55.132991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:55.133867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:55.154227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.156777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.157454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.158368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.158820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.161752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.212700 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e3ab47b-35b5-4d6d-9619-d356c6592e56 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.811745 Oct 17 13:27:55.220683 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1437/2832] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:27:55.230643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:55.241669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:55.243000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:27:55.289756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.290842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.291808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.292683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.294624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.295155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.323859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e93ffe61-c61e-452b-ae40-dcd7b868ab47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.099839 Oct 17 13:27:55.325829 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1438/2833] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:27:55 2022] GET /compute/v2.1/servers => generated 1018 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:55.343661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:55.350782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:55.373687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.374213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.377109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.379252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.379765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.381336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.486585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:55.520056 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1dc9eb8-9d0c-4bc5-aca9-18a8a9efa219 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.391981 Oct 17 13:27:55.520768 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1396/2834] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:55 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:55.550477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-143d60fb-6eff-4352-aba6-bb9a86072f40 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:55.563977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-143d60fb-6eff-4352-aba6-bb9a86072f40 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:55.690315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:55.697719 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ab740d5-ac29-4231-988a-5049802c7f10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.361712 Oct 17 13:27:55.715155 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1439/2835] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:55 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:55.720358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cd6d21cf-ce2f-4bc7-af26-e0228c4d3097 req-4d11b8f5-044c-43b5-80b8-9a1908a24ceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef51f563-9ccb-4bb4-b6c7-ad2d861ae584", "tag": "6a3b244c-f18c-414e-8b60-2ce46572ee5d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:55.731552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cd6d21cf-ce2f-4bc7-af26-e0228c4d3097 req-4d11b8f5-044c-43b5-80b8-9a1908a24ceb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.732101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cd6d21cf-ce2f-4bc7-af26-e0228c4d3097 req-4d11b8f5-044c-43b5-80b8-9a1908a24ceb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.732540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cd6d21cf-ce2f-4bc7-af26-e0228c4d3097 req-4d11b8f5-044c-43b5-80b8-9a1908a24ceb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.746853 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cd6d21cf-ce2f-4bc7-af26-e0228c4d3097 req-4d11b8f5-044c-43b5-80b8-9a1908a24ceb service nova] Creating event network-changed:6a3b244c-f18c-414e-8b60-2ce46572ee5d for instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 on n-h2-854121-14 Oct 17 13:27:55.753115 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cd6d21cf-ce2f-4bc7-af26-e0228c4d3097 req-4d11b8f5-044c-43b5-80b8-9a1908a24ceb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Oct 17 13:27:55.755072 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1440/2836] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:55.760835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:55.761578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:55.770403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.770885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.771329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.772127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:55.772589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:55.773019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:55.957106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-143d60fb-6eff-4352-aba6-bb9a86072f40 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:55.968610 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-143d60fb-6eff-4352-aba6-bb9a86072f40 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1223 microversion: 2.1 time: 0.446704 Oct 17 13:27:55.971795 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1397/2837] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:55 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1223 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:55.981044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64d8151e-f4d1-44fe-9269-d8cb4c09866d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dc0a5e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:56.089041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64d8151e-f4d1-44fe-9269-d8cb4c09866d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/62b88a0a-a016-4d59-970c-173231efa354" status: 200 len: 662 microversion: 2.1 time: 0.115088 Oct 17 13:27:56.089658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1398/2838] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:55 2022] GET /compute/v2.1/images/62b88a0a-a016-4d59-970c-173231efa354 => generated 662 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:27:56.108911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11c57e96-320f-4c78-a739-b984bc0a600a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419db52d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:56.170308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11c57e96-320f-4c78-a739-b984bc0a600a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/62b88a0a-a016-4d59-970c-173231efa354" status: 200 len: 662 microversion: 2.1 time: 0.069913 Oct 17 13:27:56.170939 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1399/2839] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:27:56 2022] GET /compute/v2.1/images/62b88a0a-a016-4d59-970c-173231efa354 => generated 662 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:27:56.207702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:56.208617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:56.232310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:56.240203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:56.240965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:56.242352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:56.244624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:56.245631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:56.462822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:56.475021 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c653d4ee-e841-4aba-9110-51310063c5d8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.717459 Oct 17 13:27:56.478010 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1441/2840] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:55 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:56.722891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:56.723780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:56.742024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:56.750778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:56.750778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:56.750778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:56.750778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:56.753617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:57.161673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:57.172802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-913eae3f-889f-4ecb-a028-ecd4ec072d7a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 1.000818 Oct 17 13:27:57.175967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1400/2841] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:56 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:57.188834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-503894689", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "409d5ac5-1afa-4a2d-b8d2-6def2794c056"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:27:57.300584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] validate_networks() for [('409d5ac5-1afa-4a2d-b8d2-6def2794c056', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:27:57.805358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:57.816008 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9db623e2-ee4f-4511-a112-d27f832daca4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 1.097702 Oct 17 13:27:57.843222 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1442/2842] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:56 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:27:57.851811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:57.855455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:57.868115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:57.871628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:57.872322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:57.873285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:57.875613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:57.876255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:59.344941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:27:59.379125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1557d95c-3ff5-4e1f-86b6-b169b78a901b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1219 microversion: 2.1 time: 1.532049 Oct 17 13:27:59.382633 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1443/2843] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:57 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1219 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:27:59.411712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:27:59.414194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:27:59.423917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:59.424577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:59.425994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:27:59.427046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:27:59.427732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:27:59.429045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:00.115476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:00.127006 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-28277325-ae81-40e1-98c5-fdb081672b74 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.739657 Oct 17 13:28:00.146381 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1444/2844] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:27:59 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:00.154952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a3807fc-23e3-42c4-9aff-9126f19e4374 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dd90c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:00.209901 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a3807fc-23e3-42c4-9aff-9126f19e4374 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/02acf753-a947-488c-a7f7-f94ec9d01639" status: 200 len: 662 microversion: 2.1 time: 0.060515 Oct 17 13:28:00.211239 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1445/2845] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:00 2022] GET /compute/v2.1/images/02acf753-a947-488c-a7f7-f94ec9d01639 => generated 662 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:00.216144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:00.216946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:00.229780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:00.230533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:00.231188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:00.232439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:00.233066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:00.234236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:00.815845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:00.829623 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4a6dd90-2995-4ad4-b3cd-dbf5f39017d3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.613431 Oct 17 13:28:00.830380 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1446/2846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:00 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:00.840050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ddf21bb6-88bb-4151-9c58-5b7b78b74b55 req-0d3caf32-afa3-4e0c-855c-9b4138875e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712", "name": "network-vif-plugged", "status": "completed", "tag": "05070510-029c-4cd1-a759-426e7558525a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:00.853284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:00.854279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:00.855039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:00.855635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:00.856230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:00.870473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ddf21bb6-88bb-4151-9c58-5b7b78b74b55 req-0d3caf32-afa3-4e0c-855c-9b4138875e81 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:00.870963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ddf21bb6-88bb-4151-9c58-5b7b78b74b55 req-0d3caf32-afa3-4e0c-855c-9b4138875e81 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:00.871604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ddf21bb6-88bb-4151-9c58-5b7b78b74b55 req-0d3caf32-afa3-4e0c-855c-9b4138875e81 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:00.874355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:00.875055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:00.875743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:00.876668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:00.877805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:00.886126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:00.900773 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ddf21bb6-88bb-4151-9c58-5b7b78b74b55 req-0d3caf32-afa3-4e0c-855c-9b4138875e81 service nova] Creating event network-vif-plugged:05070510-029c-4cd1-a759-426e7558525a for instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 on n-h1-854121-14 Oct 17 13:28:00.917566 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ddf21bb6-88bb-4151-9c58-5b7b78b74b55 req-0d3caf32-afa3-4e0c-855c-9b4138875e81 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081663 Oct 17 13:28:00.920846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1447/2847] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:00.928422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:00.938453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Getting quotas for user 6ad84e1798394f69a409af3c96b6752c and project f1a3c9343ab94c7ea6f4b5dab2f064ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:00.949076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca08d6a1-334d-46eb-98e9-090351655f88 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419db4c0d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:00.971290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:28:00.975232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:28:01.025469 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca08d6a1-334d-46eb-98e9-090351655f88 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/02acf753-a947-488c-a7f7-f94ec9d01639" status: 200 len: 662 microversion: 2.1 time: 0.103083 Oct 17 13:28:01.026422 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1448/2848] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:00 2022] GET /compute/v2.1/images/02acf753-a947-488c-a7f7-f94ec9d01639 => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:01.040132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:01.042281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:01.060284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.061937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.062408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.063151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.063611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.066649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.084645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75ab822a-246f-433f-be4c-d9256199cafe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.907171 Oct 17 13:28:01.095659 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1401/2849] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:27:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:28:01.131544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd789951-c20e-44c4-bad7-97d80f6d8bb9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:01.135257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd789951-c20e-44c4-bad7-97d80f6d8bb9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:01.219080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:01.239343 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4815771-2418-486c-9f09-4358fec338b1 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1281 microversion: 2.1 time: 0.208679 Oct 17 13:28:01.241592 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1449/2850] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:01 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:01.260608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:01.262268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:01.282523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.287628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.289929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.292749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.297048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd789951-c20e-44c4-bad7-97d80f6d8bb9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:01.298026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.301409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.306503 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd789951-c20e-44c4-bad7-97d80f6d8bb9 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1214 microversion: 2.1 time: 0.209118 Oct 17 13:28:01.317186 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1402/2851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:01 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:01.655333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:01.673441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcf51052-2ea6-4948-a8c6-2dd250768cbf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.427335 Oct 17 13:28:01.674650 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1450/2852] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:01 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:01.870418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:01.871060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:01.886366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.889424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.890899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:01.893939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:01.896116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:01.896850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.138857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:02.150630 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3ea971a-4a62-444a-a7f1-f0eb5032940a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.297113 Oct 17 13:28:02.166932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1403/2853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:01 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:02.283275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:02.287068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:02.322796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:02.328834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:02.328834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.332758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:02.336819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:02.337846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.338411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:02.339867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:02.361513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:02.362043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:02.362380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.367866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:02.368373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:02.373799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.630695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:02.655781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cf4f56c5-671f-43d7-ab05-d288c3d0f281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1281 microversion: 2.1 time: 0.385847 Oct 17 13:28:02.657934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1451/2854] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:02 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:02.712398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:02.715346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:02.729580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:02.764786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:02.765402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.766177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:02.766660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:02.767093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:02.896631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:02.916154 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb58d549-64e6-41b9-be70-d5fcccb417cf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1266 microversion: 2.1 time: 0.581036 Oct 17 13:28:02.917212 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1404/2855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:02 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1266 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:02.992092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-aff42518-eeaf-4b12-9c99-0bb9acdba3c7 req-f11ba817-4142-4d92-b9fd-006ed36ba6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29ceb46-cca5-44b5-9989-31ba3ab4e498", "name": "network-vif-plugged", "status": "completed", "tag": "22ccbdc7-99a9-4a51-9b3f-008b303eded7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:03.014624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aff42518-eeaf-4b12-9c99-0bb9acdba3c7 req-f11ba817-4142-4d92-b9fd-006ed36ba6e9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.015667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aff42518-eeaf-4b12-9c99-0bb9acdba3c7 req-f11ba817-4142-4d92-b9fd-006ed36ba6e9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.017324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aff42518-eeaf-4b12-9c99-0bb9acdba3c7 req-f11ba817-4142-4d92-b9fd-006ed36ba6e9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.039297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-aff42518-eeaf-4b12-9c99-0bb9acdba3c7 req-f11ba817-4142-4d92-b9fd-006ed36ba6e9 service nova] Creating event network-vif-plugged:22ccbdc7-99a9-4a51-9b3f-008b303eded7 for instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 on n-h2-854121-14 Oct 17 13:28:03.047732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-aff42518-eeaf-4b12-9c99-0bb9acdba3c7 req-f11ba817-4142-4d92-b9fd-006ed36ba6e9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060166 Oct 17 13:28:03.048954 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1405/2856] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:03.176957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:03.178039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:03.192961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.196372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.200595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.204514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.206392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.208824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.386508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:03.396950 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-086d41ee-a142-4b94-9d97-e57641d636cd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1313 microversion: 2.1 time: 0.702895 Oct 17 13:28:03.414355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1452/2857] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:02 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1313 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:03.444912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61e823d6-946d-4cf2-9182-92e5e8628ffb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419e9be9d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:03.495923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61e823d6-946d-4cf2-9182-92e5e8628ffb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/73056d67-5e8c-4ef9-9678-1890fadec1f9" status: 200 len: 661 microversion: 2.1 time: 0.055666 Oct 17 13:28:03.506624 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1453/2858] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:03 2022] GET /compute/v2.1/images/73056d67-5e8c-4ef9-9678-1890fadec1f9 => generated 661 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:03.514917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37619f53-fca0-4461-a64f-a9c8c046cb4a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419e1bd8b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:03.584716 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37619f53-fca0-4461-a64f-a9c8c046cb4a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/73056d67-5e8c-4ef9-9678-1890fadec1f9" status: 200 len: 661 microversion: 2.1 time: 0.075516 Oct 17 13:28:03.586276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1454/2859] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:03 2022] GET /compute/v2.1/images/73056d67-5e8c-4ef9-9678-1890fadec1f9 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:03.680092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:03.681679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:03.702381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.706692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.707241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.716488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:03.717129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:03.717694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:03.725908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:04.555840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:04.567903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25db1550-ad0f-4495-a11e-7d8acb02c02f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 1.395611 Oct 17 13:28:04.582778 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1406/2860] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:03 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:04.590603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1065806304", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:04.677565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:28:04.756371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:04.766923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc0ab0e0-29e4-41fd-aaaa-e38527602281 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 1.091631 Oct 17 13:28:04.768247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1455/2861] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:03 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:04.775465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:04.776412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:04.784161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:04.784965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:04.787206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:04.788358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:04.788842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:04.789302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:04.886455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:04.931921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:04.943793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2c830f9-ef36-4cf5-a411-0399f8bdc936 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1272 microversion: 2.1 time: 0.173406 Oct 17 13:28:04.950209 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1456/2862] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:04 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1272 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:04.960739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:04.961615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:04.970966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:04.971756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:04.972565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:04.973530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:04.974282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:04.975600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:04.993863 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] HTTP exception thrown: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Request method failure captured: Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 HTTP/1.1 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVf1ADKN775q0w35_I4Sp-7i0F7rIixYx1lHW7wWyhSg8hTRwRGUhtvRora5uiVIjZmhCgEgyv-9nYWqQO8xe-2ykoBaXVVdILoq0Z6u7sY8kmD5yUCyC9aI1gKJSxx4_c70Ge6wx9RL9LiJc5GYlBAjHFIKxy7mezBcXGLYr17EAVk Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 60cef07763604d49a9ecd33049d098fa Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '74966ce5-c657-4212-af89-4ccb1b7be573'} Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:04.995989 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.000891 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.002663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Returning 404 to user: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:05.005753 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0756ed4b-1879-47bf-9e1a-be241eb2bdd2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "DELETE /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 404 len: 111 microversion: 2.1 time: 0.053087 Oct 17 13:28:05.011859 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1457/2863] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:04 2022] DELETE /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:05.020260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:05.021619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:05.028283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.029265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.030336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.031333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.032018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.032623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.310241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:05.335409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:05.336049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:05.336720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:05.337642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:05.338217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:05.356444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.356842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.357314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.373275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.373766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.376624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.415280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Getting quotas for project a093da4643464296a663c7010d07dc36. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:05.421576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Getting quotas for user 7a795921a8c449459f1f4b02852af1a2 and project a093da4643464296a663c7010d07dc36. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:05.428793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:05.455620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:28:05.458421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:28:05.485417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:05.503167 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d9d7a4c2-64d6-4f7b-b307-8c3d3631e9ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1462 microversion: 2.1 time: 0.489531 Oct 17 13:28:05.504639 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1458/2864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:05 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1462 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:05.512779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:05.513982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 74966ce5-c657-4212-af89-4ccb1b7be573] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:05.524653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.525734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.527837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.529873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.530470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.531134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.555947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf26bbf5-425e-41f0-9096-48e2d3e7bb5f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.969600 Oct 17 13:28:05.558356 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1407/2865] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:28:05.569955 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] HTTP exception thrown: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Request method failure captured: Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 HTTP/1.1 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVf1ADKN775q0w35_I4Sp-7i0F7rIixYx1lHW7wWyhSg8hTRwRGUhtvRora5uiVIjZmhCgEgyv-9nYWqQO8xe-2ykoBaXVVdILoq0Z6u7sY8kmD5yUCyC9aI1gKJSxx4_c70Ge6wx9RL9LiJc5GYlBAjHFIKxy7mezBcXGLYr17EAVk Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 60cef07763604d49a9ecd33049d098fa Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '74966ce5-c657-4212-af89-4ccb1b7be573'} Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:05.575292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. Oct 17 13:28:05.580115 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:05.588327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Returning 404 to user: Instance 74966ce5-c657-4212-af89-4ccb1b7be573 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:05.593761 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-661b9616-2e2b-474b-939e-7bbd315a1214 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573" status: 404 len: 111 microversion: 2.1 time: 0.084302 Oct 17 13:28:05.595674 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1459/2866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:05 2022] GET /compute/v2.1/servers/74966ce5-c657-4212-af89-4ccb1b7be573 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:05.609229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:05.611658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:05.622863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.624027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.624747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:05.627580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:05.630465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:05.635154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.207628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:06.215259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'deleted': False, 'project_id': 'b7fd7c6acf7840ddb9b21ec0a232e3a6'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:06.246663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.247163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.247612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.248349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.248809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.258641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:06.262196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.281150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ed125d9-73f9-449a-84db-453972448277 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1312 microversion: 2.1 time: 0.683184 Oct 17 13:28:06.292502 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1460/2867] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:05 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1312 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:06.302450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:06.308132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:06.326584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.333125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.341216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-addfea3d-2573-4d0c-b65a-fdd303cdc580 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.781334 Oct 17 13:28:06.343188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.344197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.344851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.345492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.359574 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1408/2868] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:28:05 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:06.365397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:06.365996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:06.372629 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] HTTP exception thrown: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:06.379328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Request method failure captured: Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca HTTP/1.1 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVf1ADKN775q0w35_I4Sp-7i0F7rIixYx1lHW7wWyhSg8hTRwRGUhtvRora5uiVIjZmhCgEgyv-9nYWqQO8xe-2ykoBaXVVdILoq0Z6u7sY8kmD5yUCyC9aI1gKJSxx4_c70Ge6wx9RL9LiJc5GYlBAjHFIKxy7mezBcXGLYr17EAVk Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 60cef07763604d49a9ecd33049d098fa Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '811dadb1-321d-4db8-9883-26395c20c7ca'} Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:06.382073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:06.386921 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:06.387839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.387956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Returning 404 to user: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:06.388061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.388151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-575d73aa-e2e0-43e6-bf18-65c5e0ff9ed7 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "DELETE /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 404 len: 111 microversion: 2.1 time: 0.089616 Oct 17 13:28:06.388239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:06.388239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:06.388239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:06.388658 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1461/2869] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:06 2022] DELETE /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:06.404514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1937330292", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:06.498319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:28:06.928783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:06.963614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc7fd9c4-8b0b-4988-90c2-a3dfc350475a tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.602489 Oct 17 13:28:06.973480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1409/2870] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:06 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:06.985819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:06.986441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:07.011730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.012238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.013010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.014369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.014837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.015282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.507197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:07.507662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:07.508256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:07.508903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:07.509440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:07.526476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.529892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.530566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.531566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.533642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.535444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.573773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Getting quotas for project a093da4643464296a663c7010d07dc36. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:07.577203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:07.582066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Getting quotas for user 7a795921a8c449459f1f4b02852af1a2 and project a093da4643464296a663c7010d07dc36. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:07.595397 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d64ce7d-effe-4b52-816d-ab1a1e1c544b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 0.620404 Oct 17 13:28:07.596010 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1410/2871] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:06 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:07.614020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:07.626253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'deleted': False} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:07.632035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:28:07.639321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.639812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.640256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.640965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.641441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.645563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.651458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:28:07.744017 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e1826a4-3967-45a1-b137-4b9e3984a468 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350286 Oct 17 13:28:07.753090 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1462/2872] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:28:07.767875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:07.772296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] [instance: 811dadb1-321d-4db8-9883-26395c20c7ca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:07.785413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:07.801225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.801827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.802903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.803695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.804164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.806843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.852166 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] HTTP exception thrown: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Request method failure captured: Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca HTTP/1.1 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVf1ADKN775q0w35_I4Sp-7i0F7rIixYx1lHW7wWyhSg8hTRwRGUhtvRora5uiVIjZmhCgEgyv-9nYWqQO8xe-2ykoBaXVVdILoq0Z6u7sY8kmD5yUCyC9aI1gKJSxx4_c70Ge6wx9RL9LiJc5GYlBAjHFIKxy7mezBcXGLYr17EAVk Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_17152d7dd9b847a884017a9a0331cf69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 17152d7dd9b847a884017a9a0331cf69 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestMultiNic-1964178639 Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 60cef07763604d49a9ecd33049d098fa Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestMultiNic-1964178639-project Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '811dadb1-321d-4db8-9883-26395c20c7ca'} Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:07.856671 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. Oct 17 13:28:07.861853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:07.864147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] Returning 404 to user: Instance 811dadb1-321d-4db8-9883-26395c20c7ca could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:07.867577 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35f507df-ecc1-4654-ad4a-1e33ce48bef2 tempest-ServersTestMultiNic-1964178639 tempest-ServersTestMultiNic-1964178639-project] 10.222.0.65 "GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca" status: 404 len: 111 microversion: 2.1 time: 0.112571 Oct 17 13:28:07.874290 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1463/2873] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:07 2022] GET /compute/v2.1/servers/811dadb1-321d-4db8-9883-26395c20c7ca => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:07.885612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-043d8654-6f3e-48ba-b8ba-6595938788f5 req-9a16a1f5-eea7-48ea-be39-053712914950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e70b274a-1e38-4724-a4d6-b6202e6fdfd6", "tag": "c0c9bd33-dfc4-48c1-a675-795a80faa053"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:07.917087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-043d8654-6f3e-48ba-b8ba-6595938788f5 req-9a16a1f5-eea7-48ea-be39-053712914950 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:07.920671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-043d8654-6f3e-48ba-b8ba-6595938788f5 req-9a16a1f5-eea7-48ea-be39-053712914950 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:07.921708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-043d8654-6f3e-48ba-b8ba-6595938788f5 req-9a16a1f5-eea7-48ea-be39-053712914950 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:07.963393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:07.984170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-043d8654-6f3e-48ba-b8ba-6595938788f5 req-9a16a1f5-eea7-48ea-be39-053712914950 service nova] Creating event network-changed:c0c9bd33-dfc4-48c1-a675-795a80faa053 for instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 on n-h1-854121-14 Oct 17 13:28:07.998695 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-043d8654-6f3e-48ba-b8ba-6595938788f5 req-9a16a1f5-eea7-48ea-be39-053712914950 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120437 Oct 17 13:28:07.999475 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1464/2874] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:08.013117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:08.013941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:08.026059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:08.026758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:08.027444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:08.028435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:08.029190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:08.029846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:08.212952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:08.215225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:08.216822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:09.369663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:09.384590 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46cbe875-7b8a-449d-96f4-deac6197efec tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1462 microversion: 2.1 time: 1.383161 Oct 17 13:28:09.385626 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1465/2875] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:07 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1462 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:09.392232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:09.393149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:09.403738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:09.405020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:09.406041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:09.407811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:09.411437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:09.412382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:09.617712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:09.641441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b4b0abe-5bca-4c4a-a9f8-a8e66657ba29 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1270 microversion: 2.1 time: 0.254320 Oct 17 13:28:09.642379 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1466/2876] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:09 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1270 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:09.649436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:09.650294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:09.658096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:09.660401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:09.661542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:09.662726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:09.663890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:09.664899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:10.282848 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-025d2cef-b3f8-4d60-a7b3-3f5bea4356b6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22003 microversion: 2.1 time: 2.685747 Oct 17 13:28:10.283523 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1411/2877] 10.222.0.65 () {58 vars in 1171 bytes} [Mon Oct 17 13:28:07 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22003 bytes in 2687 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:28:10.290181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:10.291167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:10.298551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:10.306983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:10.307822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:10.308505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:10.309763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:10.310439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:10.311240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:10.321832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d34f5711-8c7d-4113-830e-729115e08592 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.677880 Oct 17 13:28:10.322860 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1467/2878] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:09 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:10.349035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:10.360719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:10.387232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:10.388524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:10.391222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:10.393443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:10.395295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:10.397052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:10.838474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:10.852769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Old instance type m1.heat2, new instance type m1.heat {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:28:10.883788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:10.885710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:10.886367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:10.887394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:10.890395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:11.079903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19f35491-3f1f-48da-86c6-129602f510eb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498/action" status: 202 len: 0 microversion: 2.1 time: 0.755144 Oct 17 13:28:11.084808 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1468/2879] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:10 2022] POST /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:11.110985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e36a9b99-2b41-4c64-9f68-ce993e96c03e", "tag": "ed33f03d-39d2-48d0-982e-4b1b1d87604c"}, {"name": "network-changed", "server_uuid": "bd121492-3e2e-40dd-b7c7-8b8e27ab5934", "tag": "487c0c4e-7889-42d2-9c9e-beff8e7a65dd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:11.139086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.141741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.142535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.183797 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] Creating event network-changed:ed33f03d-39d2-48d0-982e-4b1b1d87604c for instance e36a9b99-2b41-4c64-9f68-ce993e96c03e on n-h2-854121-14 Oct 17 13:28:11.185376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] Creating event network-changed:487c0c4e-7889-42d2-9c9e-beff8e7a65dd for instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 on n-h1-854121-14 Oct 17 13:28:11.196920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-17ce3041-9861-489b-bcea-38e61f24fe8a req-03f7e9cf-82d2-4805-a08f-12f432968e49 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.109759 Oct 17 13:28:11.197902 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1469/2880] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:11.203430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:11.211348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'deleted': False, 'project_id': 'b7fd7c6acf7840ddb9b21ec0a232e3a6'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:11.218899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.220005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.220642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.225368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.226330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.227006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.265801 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb64a6e4-37c2-4f58-bbe8-d4d179f715fd tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/detail?tenant_id=b72acb6417e34de5bedb390948697404" status: 200 len: 15 microversion: 2.1 time: 0.066332 Oct 17 13:28:11.266711 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1470/2881] 10.222.0.65 () {58 vars in 1231 bytes} [Mon Oct 17 13:28:11 2022] GET /compute/v2.1/servers/detail?tenant_id=b72acb6417e34de5bedb390948697404 => generated 15 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:11.272830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:11.274065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:11.292619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.293627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.294320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.295312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.295991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.296637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.413614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:11.425524 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33ff55f9-932f-4870-8dff-bc277457f3c5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 1.140546 Oct 17 13:28:11.448050 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1412/2882] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:10 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:11.458838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:11.460406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:11.461783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:11.469590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.470431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.471129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.472169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.473000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.474261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.476519 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3727b416-7bcb-4e13-9261-b102a934c8c2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1276 microversion: 2.1 time: 0.206696 Oct 17 13:28:11.479893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1471/2883] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:11 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:11.489035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:11.528596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'tenant_id': 'b72acb6417e34de5bedb390948697404', 'deleted': False} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:11.561110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.561633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.562075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.562800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.563284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.574391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:11.635788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:11.704017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:11.704776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:11.705460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.310379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:12.342934 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-537d69f3-9b6d-4b56-9416-6f890ed65f5a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1471 microversion: 2.1 time: 0.891825 Oct 17 13:28:12.346246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1413/2884] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:11 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1471 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:12.396262 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-735de940-1881-4406-821e-5195e6977105 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b72acb6417e34de5bedb390948697404" status: 200 len: 4829 microversion: 2.1 time: 0.914673 Oct 17 13:28:12.396721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1472/2885] 10.222.0.65 () {58 vars in 1257 bytes} [Mon Oct 17 13:28:11 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b72acb6417e34de5bedb390948697404 => generated 4829 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:12.406640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:12.407320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:12.427885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.429189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.429975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.430970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.431712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:12.432267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.432940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.454855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'tenant_id': 'b7fd7c6acf7840ddb9b21ec0a232e3a6', 'deleted': False} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:12.468782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.469500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.469800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.474645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.475475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.476852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.533848 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d50eb458-574a-445d-9ff3-4cafd616cceb tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b7fd7c6acf7840ddb9b21ec0a232e3a6" status: 200 len: 15 microversion: 2.1 time: 0.114858 Oct 17 13:28:12.534858 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1473/2886] 10.222.0.65 () {58 vars in 1257 bytes} [Mon Oct 17 13:28:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b7fd7c6acf7840ddb9b21ec0a232e3a6 => generated 15 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:12.560063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:12.560946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:12.568799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.569704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.570377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:12.571342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:12.572056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:12.572774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.642400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:13.670129 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c6e9a2d-7634-43c0-9409-9f695ac7c12c tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 1.322326 Oct 17 13:28:13.680143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1414/2887] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:12 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:13.698020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:13.698667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:13.726296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.729867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.731752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.734398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.736979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.738199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.757346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:13.783431 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5a3a87c-728c-4727-b480-c5bb15e115b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 1.235163 Oct 17 13:28:13.787124 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1474/2888] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:12 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:13.801657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d882b495-b90d-4fea-8408-c03fa90fd7a8 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:13.831367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d882b495-b90d-4fea-8408-c03fa90fd7a8 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.038377 Oct 17 13:28:13.849285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1475/2889] 10.222.0.65 () {58 vars in 1189 bytes} [Mon Oct 17 13:28:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:13.861070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6c748726-ed1b-4027-80c2-d93dd21e0955 req-9634ac0d-081b-4324-82bb-53c0b62d7c95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70b274a-1e38-4724-a4d6-b6202e6fdfd6", "name": "network-vif-plugged", "status": "completed", "tag": "c0c9bd33-dfc4-48c1-a675-795a80faa053"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:13.876308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6c748726-ed1b-4027-80c2-d93dd21e0955 req-9634ac0d-081b-4324-82bb-53c0b62d7c95 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.877720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6c748726-ed1b-4027-80c2-d93dd21e0955 req-9634ac0d-081b-4324-82bb-53c0b62d7c95 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.878501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6c748726-ed1b-4027-80c2-d93dd21e0955 req-9634ac0d-081b-4324-82bb-53c0b62d7c95 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.896635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6c748726-ed1b-4027-80c2-d93dd21e0955 req-9634ac0d-081b-4324-82bb-53c0b62d7c95 service nova] Creating event network-vif-plugged:c0c9bd33-dfc4-48c1-a675-795a80faa053 for instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 on n-h1-854121-14 Oct 17 13:28:13.904721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6c748726-ed1b-4027-80c2-d93dd21e0955 req-9634ac0d-081b-4324-82bb-53c0b62d7c95 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053639 Oct 17 13:28:13.906777 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1476/2890] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:13.914721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c814de50-b393-4aa2-9bb1-acef202b692d req-711197cb-bd49-4397-9a5a-650f96e9dc78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9b4d72-e1f8-4dd5-af69-0234de07344b", "tag": "3c2dc67e-5174-463f-9606-caff907163f7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:13.927306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c814de50-b393-4aa2-9bb1-acef202b692d req-711197cb-bd49-4397-9a5a-650f96e9dc78 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.928618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c814de50-b393-4aa2-9bb1-acef202b692d req-711197cb-bd49-4397-9a5a-650f96e9dc78 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.929182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c814de50-b393-4aa2-9bb1-acef202b692d req-711197cb-bd49-4397-9a5a-650f96e9dc78 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.944549 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c814de50-b393-4aa2-9bb1-acef202b692d req-711197cb-bd49-4397-9a5a-650f96e9dc78 service nova] Creating event network-changed:3c2dc67e-5174-463f-9606-caff907163f7 for instance fb9b4d72-e1f8-4dd5-af69-0234de07344b on n-h1-854121-14 Oct 17 13:28:13.952722 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c814de50-b393-4aa2-9bb1-acef202b692d req-711197cb-bd49-4397-9a5a-650f96e9dc78 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042879 Oct 17 13:28:13.954078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1477/2891] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:13.961201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:13.962101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:13.970863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.971521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.972184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.973648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:13.974253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:13.976137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:13.981589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:14.327668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:14.336230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19ea91c0-0830-4f81-9efb-ab3f3e5305b7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1276 microversion: 2.1 time: 0.652984 Oct 17 13:28:14.341892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1415/2892] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:13 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1276 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:14.351724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:14.359254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:14.373960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.374450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.374886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.380867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.381479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.381922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.386154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:14.623829 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08a4e9be-faa6-444d-b552-059c510c3206 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 0 microversion: 2.1 time: 0.278063 Oct 17 13:28:14.627459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1416/2893] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:14 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:14.638108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:14.655123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:14.658587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b72acb6417e34de5bedb390948697404'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:14.673621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.676847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.677339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.678147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.678587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.679020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.730336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:14.788474 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1dbab068-dfd4-41ea-a48a-a0181cd10219 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.159707 Oct 17 13:28:14.789133 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1417/2894] 10.222.0.65 () {58 vars in 1150 bytes} [Mon Oct 17 13:28:14 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:14.794368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:14.795231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:14.802746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.803533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.804137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:14.805039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:14.805677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:14.806322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.086899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:15.102242 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d0b3e5f-69e6-465d-a6fb-c55579b6c0e0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1471 microversion: 2.1 time: 1.146458 Oct 17 13:28:15.102840 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1478/2895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:13 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1471 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:15.138329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:15.146562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:15.156035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.157001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.157750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.158957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.164381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.169385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.428107 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-021b0881-37ea-4fd9-a8c0-9571f3d977b4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 0 microversion: 2.1 time: 0.308952 Oct 17 13:28:15.430469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1479/2896] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:15 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:15.438323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:15.439299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:15.450901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.452025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.452649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.453582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.454534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.455578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.730600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:15.741571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3bb5c2a-f95d-4219-8b32-dd13a98d1547 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.950745 Oct 17 13:28:15.742427 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1418/2897] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:14 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:15.749361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:15.750296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:15.757198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.757917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.758514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:15.759382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:15.760088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:15.760672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:16.538923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:16.556344 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d54119b-ed6c-4607-ade6-6ac5645d47b1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 1.120111 Oct 17 13:28:16.556997 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1480/2898] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:15 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:16.592514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:16.593185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:16.617931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:16.618440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:16.631520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:16.633123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:16.637197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:16.637883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:16.833552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:16.848634 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa0110a9-2bd1-4935-b926-a4777e0f39df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1318 microversion: 2.1 time: 1.103218 Oct 17 13:28:16.849785 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1419/2899] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:15 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1318 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:16.856382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:16.857071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:16.882896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:16.883491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:16.884061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:16.886870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:16.887366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:16.887809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:17.011975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a51b1ae3-ac24-4cbd-94fe-c01d8f4b3705 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1615 microversion: 2.1 time: 0.453830 Oct 17 13:28:17.018998 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1481/2900] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:16 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1615 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:17.031446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:17.032458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:17.048044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:17.048871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:17.050338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:17.051429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:17.057138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:17.057988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:17.948879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:17.959495 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37b2045b-c95a-49ae-92d2-dd0f29e42055 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.939261 Oct 17 13:28:17.960664 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1482/2901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:17 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:17.966133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:17.967316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:17.978602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:17.979463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:17.980819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:17.982423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:17.983926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:17.985485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:17.993407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:18.017701 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71b07429-7568-4302-86bf-a2bdf99cb9df tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1471 microversion: 2.1 time: 1.166759 Oct 17 13:28:18.020398 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1420/2902] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:16 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1471 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:18.038683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:18.039937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:18.073858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:18.074993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:18.076774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:18.077903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:18.082448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:18.083820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:18.181707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=18 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:18.467941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:18.489326 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38be2f35-88f8-4e5c-be93-5b52b140e8fd tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 0.462936 Oct 17 13:28:18.491247 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1421/2903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:18 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:18.502619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:18.506799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:18.522474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:18.526634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:18.527736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:18.530077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:18.530826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:18.532623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:18.848347 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a02a083-703c-4e20-8d4b-8163a4996946 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1615 microversion: 2.1 time: 0.886000 Oct 17 13:28:18.853418 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1483/2904] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:17 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1615 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:18.994391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:19.025127 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2b6e37b-9c9c-464e-a16d-bf668e7d506d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1318 microversion: 2.1 time: 0.532019 Oct 17 13:28:19.029508 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1422/2905] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:18 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:19.040415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:19.057717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'host': 'n-h1-854121-14', 'deleted': False} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:19.064770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:19.068670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:19.069927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:19.071205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:19.073252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:19.075147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:19.145240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-861245158", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "a3d7455b-5325-406b-ad01-64534a5759d3"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:19.233900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] validate_networks() for [('a3d7455b-5325-406b-ad01-64534a5759d3', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:28:19.282674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:19.703917 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88d8e8ea-60a8-4773-abd7-9f53c6ad5a65 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers?host=n-h1-854121-14&all_tenants=1" status: 200 len: 2639 microversion: 2.1 time: 0.671208 Oct 17 13:28:19.704544 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1423/2906] 10.222.0.65 () {58 vars in 1192 bytes} [Mon Oct 17 13:28:19 2022] GET /compute/v2.1/servers?host=n-h1-854121-14&all_tenants=1 => generated 2639 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:19.720133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:19.721075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:19.728282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:19.728975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:19.729784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:19.730669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:19.731279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:19.731854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.355142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:20.371529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03d57101-939e-4b58-bfcb-c3adb26e9d47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.655226 Oct 17 13:28:20.375115 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1424/2907] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:19 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:20.390262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:20.391145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:20.408064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:20.412304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:20.412952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.414175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:20.416228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:20.419619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.853878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:20.862353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3c88ef8-9fb1-411d-90db-3cd8f0fa7633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.483109 Oct 17 13:28:20.863241 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1425/2908] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:20 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:20.870164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5535d879-b755-46f6-9703-112a81d946a7 req-c23de91d-7bd3-46da-b333-1b90a6d8cc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd121492-3e2e-40dd-b7c7-8b8e27ab5934", "name": "network-vif-plugged", "status": "completed", "tag": "487c0c4e-7889-42d2-9c9e-beff8e7a65dd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:20.881746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5535d879-b755-46f6-9703-112a81d946a7 req-c23de91d-7bd3-46da-b333-1b90a6d8cc52 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:20.882493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5535d879-b755-46f6-9703-112a81d946a7 req-c23de91d-7bd3-46da-b333-1b90a6d8cc52 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:20.883238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5535d879-b755-46f6-9703-112a81d946a7 req-c23de91d-7bd3-46da-b333-1b90a6d8cc52 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.897997 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5535d879-b755-46f6-9703-112a81d946a7 req-c23de91d-7bd3-46da-b333-1b90a6d8cc52 service nova] Creating event network-vif-plugged:487c0c4e-7889-42d2-9c9e-beff8e7a65dd for instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 on n-h1-854121-14 Oct 17 13:28:20.904766 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5535d879-b755-46f6-9703-112a81d946a7 req-c23de91d-7bd3-46da-b333-1b90a6d8cc52 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039668 Oct 17 13:28:20.906149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1426/2909] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:20.907029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:20.908187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:20.910236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:20.910789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:20.911321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:20.913968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3a7468e9-0d94-4d11-9517-108d67d5d3c0 req-914c27cc-5dac-49c8-939a-51d2fc04be96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:20.927457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:20.928468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:20.930048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.932458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:20.933654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:20.934521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.937894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a7468e9-0d94-4d11-9517-108d67d5d3c0 req-914c27cc-5dac-49c8-939a-51d2fc04be96 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:20.938406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a7468e9-0d94-4d11-9517-108d67d5d3c0 req-914c27cc-5dac-49c8-939a-51d2fc04be96 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:20.938877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a7468e9-0d94-4d11-9517-108d67d5d3c0 req-914c27cc-5dac-49c8-939a-51d2fc04be96 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:20.969572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Getting quotas for project 021ce90b5cae410bb31f6e89f6f7b4b5. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:20.969838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3a7468e9-0d94-4d11-9517-108d67d5d3c0 req-914c27cc-5dac-49c8-939a-51d2fc04be96 service nova] Creating event network-changed:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:28:20.982193 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3a7468e9-0d94-4d11-9517-108d67d5d3c0 req-914c27cc-5dac-49c8-939a-51d2fc04be96 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073858 Oct 17 13:28:20.985509 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1427/2910] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:20.993727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Getting quotas for user 2f13aa7d2eea4f0f9f7d8b7cfe90c1f0 and project 021ce90b5cae410bb31f6e89f6f7b4b5. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:20.997886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:20.998592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:21.010268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.013845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.014357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.014908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:28:21.015134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.019583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:28:21.021130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.021732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.111218 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b29e8500-32a5-487e-9038-4bc5f5f48b30 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.256272 Oct 17 13:28:21.120150 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1484/2911] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:28:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:28:21.127193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:21.137982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:21.151550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.152063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.152508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.153299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.153988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.154553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.257457 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-589ddf9d-bb1c-4e63-ae00-b60acc9b5697 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.135913 Oct 17 13:28:21.258230 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1485/2912] 10.222.0.65 () {58 vars in 1196 bytes} [Mon Oct 17 13:28:21 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:21.262523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-491bf9b0-ed7e-4f80-a219-82b56f1b713f req-f1113a0f-335e-4c41-a635-ca697d23a98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3be2a371-cdcd-4928-a92a-7c4b5118d776", "tag": "57cc1827-dab3-48ea-9688-e790d4b193e9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:21.275486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-491bf9b0-ed7e-4f80-a219-82b56f1b713f req-f1113a0f-335e-4c41-a635-ca697d23a98b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.275972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-491bf9b0-ed7e-4f80-a219-82b56f1b713f req-f1113a0f-335e-4c41-a635-ca697d23a98b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.276407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-491bf9b0-ed7e-4f80-a219-82b56f1b713f req-f1113a0f-335e-4c41-a635-ca697d23a98b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.298374 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-491bf9b0-ed7e-4f80-a219-82b56f1b713f req-f1113a0f-335e-4c41-a635-ca697d23a98b service nova] Creating event network-changed:57cc1827-dab3-48ea-9688-e790d4b193e9 for instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 on n-h1-854121-14 Oct 17 13:28:21.306119 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-491bf9b0-ed7e-4f80-a219-82b56f1b713f req-f1113a0f-335e-4c41-a635-ca697d23a98b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046705 Oct 17 13:28:21.307281 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1486/2913] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:21.313018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:21.314018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:21.321496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.321997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.322438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.323589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.324267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.324782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.646271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:21.656718 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-81b2052a-8064-43b7-b519-fd5054da370d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 0.669681 Oct 17 13:28:21.658163 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1428/2914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:20 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:21.673045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2c8875d-413a-484a-bdb6-1792bb74a64d tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:21.682896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2c8875d-413a-484a-bdb6-1792bb74a64d tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:21.770711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:21.784951 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cdb42abe-91f5-4f28-811f-28bb7bcd8e28 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1318 microversion: 2.1 time: 0.476401 Oct 17 13:28:21.785859 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1487/2915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:21 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:21.812128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:21.816393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e2c8875d-413a-484a-bdb6-1792bb74a64d tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:21.816577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:21.826056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.826915 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2c8875d-413a-484a-bdb6-1792bb74a64d tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1227 microversion: 2.1 time: 0.166707 Oct 17 13:28:21.827065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.827440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.828337 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1429/2916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:21 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1227 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:21.833839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:21.834713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:21.842756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.843355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.843818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.853288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.854100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.854676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.855412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.855900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.856309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:21.976335 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f1eea25-6b17-4035-be0f-3340272e5b7d tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 0 microversion: 2.1 time: 0.187076 Oct 17 13:28:21.982491 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1488/2917] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:21 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:21.988670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:21.989636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:21.998022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:21.998527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:21.998969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.000405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.000879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.002419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.321931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:22.331489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b2cfdc6-6943-4dcf-8f76-fd788c516aa2 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.501805 Oct 17 13:28:22.334407 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1430/2918] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:21 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:22.343508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:22.349614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:22.363202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.363748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.367070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.371179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.373764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.374402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.413656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:22.421397 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f5bd6de-4635-4ab7-af5e-d49cdd0af169 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.437389 Oct 17 13:28:22.427374 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1489/2919] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:21 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:22.515504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:22.515834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:22.516306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:22.516982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:22.517628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:22.642735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:22.668831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:22.682860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:22.683493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:22.695620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.696118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.696404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.697120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.697770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.698658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.699307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.699800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.700494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.701408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.705637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.706716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.757898 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a16f3a00-f6e1-427c-9e37-fc95c768496e tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 1066 microversion: 2.1 time: 0.422318 Oct 17 13:28:22.758818 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1431/2920] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:22 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 1066 bytes in 424 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:28:22.779722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:22.780977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:22.791434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.792156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.792707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:22.794041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:22.794740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:22.795324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.070114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:23.072015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:23.080497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4dfaf275-f6ef-4b9f-a0f0-dba7f8e5f7ac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.305915 Oct 17 13:28:23.082490 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1432/2921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:22 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:23.087223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edb68dce-b528-44c2-a3ca-a595553796b5 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1314 microversion: 2.1 time: 0.407718 Oct 17 13:28:23.088665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:23.089474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:23.095680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.096339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.097752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.098625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.099289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.099933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.101480 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1490/2922] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:22 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:23.117886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:23.119244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:23.128842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.129482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.129920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.130864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.131266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.131679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.261734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:23.273872 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b8136ed-a31f-4bd9-9d29-4b0dfa27217e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1231 microversion: 2.1 time: 0.170935 Oct 17 13:28:23.286902 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1491/2923] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:23 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1231 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:23.297874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36a9b99-2b41-4c64-9f68-ce993e96c03e", "name": "network-vif-plugged", "status": "completed", "tag": "ed33f03d-39d2-48d0-982e-4b1b1d87604c"}, {"server_uuid": "fb9b4d72-e1f8-4dd5-af69-0234de07344b", "name": "network-vif-plugged", "status": "completed", "tag": "3c2dc67e-5174-463f-9606-caff907163f7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:23.312896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.313632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.314582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.334417 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] Creating event network-vif-plugged:ed33f03d-39d2-48d0-982e-4b1b1d87604c for instance e36a9b99-2b41-4c64-9f68-ce993e96c03e on n-h2-854121-14 Oct 17 13:28:23.335209 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] Creating event network-vif-plugged:3c2dc67e-5174-463f-9606-caff907163f7 for instance fb9b4d72-e1f8-4dd5-af69-0234de07344b on n-h1-854121-14 Oct 17 13:28:23.348593 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-42b6bc5d-4aff-49fb-9841-587b9c88ed42 req-f96a4d4a-6dc1-4033-a414-f88432c32154 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065091 Oct 17 13:28:23.349994 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1492/2924] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:23.359454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:23.360740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:23.361500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:23.368962 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6bf7d9ae-de4c-4ace-9a13-2001c598e7ec tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1318 microversion: 2.1 time: 0.285204 Oct 17 13:28:23.369303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.369959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.370610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.371853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.372494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.373283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.382622 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1433/2925] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:23 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:23.448804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:23.449623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:23.459307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.459837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.460289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.461012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:23.461526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:23.461923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:23.626047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:23.647148 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f624f1ff-c895-469b-b037-0626f7e269ca tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.290470 Oct 17 13:28:23.650351 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1493/2926] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:23 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:23.720101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:23.731705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcfdbe99-10f7-4d58-ac1f-386793e3dda2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.287630 Oct 17 13:28:23.732620 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1434/2927] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:23 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:24.105672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:24.106286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:24.113774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.114316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:24.114464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.115044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:24.115592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.116357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.117008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.117917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.123080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.123585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.124030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.124736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.125397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.125983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.142297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:24.590490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:24.599279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c26f007a-2e8c-44fc-9511-b019d831b5cf tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.497353 Oct 17 13:28:24.600188 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1494/2928] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:24 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:24.604808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:24.615090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:24.622758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:24.626333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.627320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.628903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.629845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.630608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.631244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.655227 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-97288c91-ca72-44cd-9ca1-7d9622a4749e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1501 microversion: 2.1 time: 0.543904 Oct 17 13:28:24.657300 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1435/2929] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:24 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1501 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:24.675866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:24.676531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:24.683620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.684117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.684680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.685333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.685759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.686187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.719089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:24.727685 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58f59d65-b0fb-485d-a455-9226f4428747 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1279 microversion: 2.1 time: 0.126476 Oct 17 13:28:24.728264 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1495/2930] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:24 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:24.732767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:24.733659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:24.740321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.741173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.741697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.742466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:24.742989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:24.743480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:24.981493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:24.991224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4dd4ce15-12b1-439a-ad0d-68ce762f0506 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1318 microversion: 2.1 time: 0.332078 Oct 17 13:28:25.005984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:25.006649 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1436/2931] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:24 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:25.012838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9af5ef6-bd2a-4a29-8db4-0c3fa810b26d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.282074 Oct 17 13:28:25.012838 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1496/2932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:24 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:25.013587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:25.014354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:25.020798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.021335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.021989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.022919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.023573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.024212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.032016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:25.032919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:25.047389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.048240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.048876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.050489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.051322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.051959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.128249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bb5bffe-9737-4a25-8867-4fde7353031d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934/action" status: 202 len: 0 microversion: 2.1 time: 0.119883 Oct 17 13:28:25.129639 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1437/2933] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:25 2022] POST /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:25.138097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:25.138893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:25.145716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.146374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.146892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.147687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.148231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.148926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.317902 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:28:25.319975 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 13:28:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 (ip 10.222.0.65) !!! Oct 17 13:28:25.327238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:25.343227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a620b06e-3cb3-423a-8bac-924a9d0d7f73 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.328883 Oct 17 13:28:25.346672 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1497/2934] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:25 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:25.370335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:25.374215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a7a39e9b-3443-488e-853c-eb6a7adbd377 req-a4e7a776-0567-4912-a31c-72793620caea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be2a371-cdcd-4928-a92a-7c4b5118d776", "name": "network-vif-plugged", "status": "completed", "tag": "57cc1827-dab3-48ea-9688-e790d4b193e9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:25.381103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c978a490-5682-4bb8-9a33-bfc0ebdaa80d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1506 microversion: 2.1 time: 0.247494 Oct 17 13:28:25.382107 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1438/2935] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:25 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:25.398085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a7a39e9b-3443-488e-853c-eb6a7adbd377 req-a4e7a776-0567-4912-a31c-72793620caea service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.398085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a7a39e9b-3443-488e-853c-eb6a7adbd377 req-a4e7a776-0567-4912-a31c-72793620caea service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.398085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a7a39e9b-3443-488e-853c-eb6a7adbd377 req-a4e7a776-0567-4912-a31c-72793620caea service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.407757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a7a39e9b-3443-488e-853c-eb6a7adbd377 req-a4e7a776-0567-4912-a31c-72793620caea service nova] Creating event network-vif-plugged:57cc1827-dab3-48ea-9688-e790d4b193e9 for instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 on n-h1-854121-14 Oct 17 13:28:25.413822 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a7a39e9b-3443-488e-853c-eb6a7adbd377 req-a4e7a776-0567-4912-a31c-72793620caea service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045733 Oct 17 13:28:25.414851 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1498/2936] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:25.624439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:25.625279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:25.638904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.639464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.639953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.641418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.641881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.642310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.752965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:25.754082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:25.761900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.764813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.765625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.766599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:25.767202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:25.767991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:25.918940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:25.927809 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-333ff5c5-c4f9-4288-802f-5bcc842a8595 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1279 microversion: 2.1 time: 0.179656 Oct 17 13:28:25.929370 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1499/2937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:25 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1279 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:25.971173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:25.986138 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35470a75-06a1-4036-bf8a-94c1ee8acbe2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.365054 Oct 17 13:28:25.988990 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1439/2938] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:25 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:26.021699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:26.022323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:26.028911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.029104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.038152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:26.039848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.040077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:26.040766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.041308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.041792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.051153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.051900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.052625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.053818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.054448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.055811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.237950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:26.249078 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17e53356-115c-4378-a300-701999cb5e12 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1318 microversion: 2.1 time: 0.232850 Oct 17 13:28:26.256541 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1500/2939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:26 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:26.346307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:26.360010 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8dd426a2-4fe6-490c-9c93-a62f0b4a62f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1323 microversion: 2.1 time: 0.327892 Oct 17 13:28:26.365891 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1440/2940] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:26 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:26.371747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:26.372375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:26.387676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.388893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.389544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.391617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.392275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.395182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.406233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:26.407233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:26.415789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.416959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.427348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:26.428477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:26.429863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:26.430518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.011513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:27.021807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52157469-45a6-4947-b496-cd1be791a4e3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1486 microversion: 2.1 time: 0.621103 Oct 17 13:28:27.022680 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1441/2941] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:26 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1486 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:27.039142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:27.039891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.050161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.050873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.051511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.052404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.053050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.059305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.089934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:27.103412 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7053877f-fc7a-44de-97d1-21379f07d947 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.737022 Oct 17 13:28:27.104228 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1501/2942] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:26 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:27.129151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:27.130272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.133303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:27.139352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.140306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.140943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.146003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.146733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.147366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.191466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:27.208522 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-931ede49-b37f-41a8-82a2-55de4eab3505 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1285 microversion: 2.1 time: 0.183638 Oct 17 13:28:27.215945 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1442/2943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:27 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1285 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:27.224562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:27.225106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.248375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.249111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.250746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.251899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.254628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.255491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.299067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lazy-loading 'flavor' on Instance uuid bd121492-3e2e-40dd-b7c7-8b8e27ab5934 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:28:27.518459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:27.534996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca911695-84f2-449e-a0e7-060533b5e5a9 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.409501 Oct 17 13:28:27.538999 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1502/2944] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:27 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:27.555741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:27.566474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.590073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.590598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.591743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.592503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.592970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.597830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.709456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22a1dec0-3bff-453f-aacd-a97369c1c561 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934/action" status: 202 len: 0 microversion: 2.1 time: 0.481168 Oct 17 13:28:27.717614 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1443/2945] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:27 2022] POST /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:28:27.732994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:27.749728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:27.770082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.770981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.771605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:27.773527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:27.774177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:27.774715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.124072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:28.137142 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d59a7fa-b22b-4e33-b099-a2dd20ab516c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1468 microversion: 2.1 time: 0.597015 Oct 17 13:28:28.137768 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1503/2946] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:27 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1468 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:28.142542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:28.150407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:28.167364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.173135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.174222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.175961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.176752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.177557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.282419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:28.285210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:28.292931 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7edc4bec-012d-4ef6-a747-b1d9980a2359 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1517 microversion: 2.1 time: 0.573204 Oct 17 13:28:28.293764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1444/2947] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:27 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1517 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:28.314528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:28.315526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:28.322907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.323393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.323849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.324575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.325040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.325504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.761704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:28.787688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a6061f34-fa45-423d-a191-03f484b1f716 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1492 microversion: 2.1 time: 0.648604 Oct 17 13:28:28.789297 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1504/2948] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:28 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1492 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:28.794422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:28.809709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3b5cab4-403b-432d-9efd-a87f873505b7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.514286 Oct 17 13:28:28.815766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:28.816928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:28.822166 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1445/2949] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:28 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:28.825352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.826042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.826706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.827797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.828396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.829190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.835055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:28.835689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:28.843039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.843537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.844169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.844874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:28.845540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:28.846128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:28.970835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:28.979528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35639ee6-b99b-4818-8b57-9a6a7e5b0ce9 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1285 microversion: 2.1 time: 0.151926 Oct 17 13:28:28.980506 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1446/2950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:28 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1285 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:29.003774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:29.004598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:29.011399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.011885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.012354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.013048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.013525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.014174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.117697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:29.288522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:29.302149 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b870490e-75a9-4c8f-bfcb-dd156f63690e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1318 microversion: 2.1 time: 0.497513 Oct 17 13:28:29.318512 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1505/2951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:28 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:29.326961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:29.327899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:29.334941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.335821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.336472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.337479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.339525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.340276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.530522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:29.540043 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d67358f-a050-4af0-9154-cdc5a2ca2b34 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 200 len: 1516 microversion: 2.1 time: 0.557973 Oct 17 13:28:29.540670 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1447/2952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:28 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 1516 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:29.565015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:29.566524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:29.578752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.582016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.582751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.583734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.584443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.585220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.932630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:29.947032 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74fceb10-dfd8-4c94-a39a-4dd8369e5954 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.625890 Oct 17 13:28:29.948642 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1506/2953] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:29 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:29.954229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:29.955167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:29.968593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.969434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.969879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:29.972161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:29.972890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:29.973505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:30.408189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:30.424756 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e302d27e-81a3-4955-8aae-37c998759307 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 200 len: 1517 microversion: 2.1 time: 0.863514 Oct 17 13:28:30.441257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1448/2954] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:29 2022] GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 1517 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:30.450885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:30.452526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:30.455434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:30.459607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:30.471222 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e0155cd-9427-4799-bd02-90cab8a7d054 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1513 microversion: 2.1 time: 0.519908 Oct 17 13:28:30.471958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:30.472854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:30.473014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1507/2955] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:29 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1513 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:30.473396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:30.474145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:30.474605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:30.475029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:30.489889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:30.492193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:30.507057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:30.507707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:30.508209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:30.510531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:30.511401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:30.512089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:30.969476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:30.978413 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd392c06-b0cc-4a1b-883b-163109a242fd tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.503835 Oct 17 13:28:30.979017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1508/2956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:30 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:30.983688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6d153c8f-13c0-4d35-accd-e0561d5f6b9f req-50b36851-1748-452d-bec2-577314961b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "name": "network-vif-plugged", "status": "completed", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:30.994655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6d153c8f-13c0-4d35-accd-e0561d5f6b9f req-50b36851-1748-452d-bec2-577314961b6d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:30.995103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6d153c8f-13c0-4d35-accd-e0561d5f6b9f req-50b36851-1748-452d-bec2-577314961b6d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:30.995545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6d153c8f-13c0-4d35-accd-e0561d5f6b9f req-50b36851-1748-452d-bec2-577314961b6d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.007474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:31.013564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6d153c8f-13c0-4d35-accd-e0561d5f6b9f req-50b36851-1748-452d-bec2-577314961b6d service nova] Creating event network-vif-plugged:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:28:31.025499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:31.038616 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6d153c8f-13c0-4d35-accd-e0561d5f6b9f req-50b36851-1748-452d-bec2-577314961b6d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058170 Oct 17 13:28:31.039328 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1509/2957] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:31.051932 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f73c5d96-08b4-4fac-8126-42ccda1a8830 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.613106 Oct 17 13:28:31.054129 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1449/2958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:30 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:31.056873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:31.057784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:31.060887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:31.061729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:31.072509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.075783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.075988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.077199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.078083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.078546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.078801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.079346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.079499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.080375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.081068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.081868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.142539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:28:31.210472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:31.260330 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be073517-ed03-439e-9b32-d008aea37ca4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 204 len: 0 microversion: 2.1 time: 0.203917 Oct 17 13:28:31.265913 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1450/2959] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:31 2022] DELETE /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:28:31.276213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:31.277329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:31.285474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.285881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.286422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.287138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.287746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.288014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.650047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:31.663986 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1823ead-e114-4362-a270-7957b4a2f77e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1318 microversion: 2.1 time: 0.621255 Oct 17 13:28:31.682062 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1510/2960] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:31 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1318 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:31.687007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:31.687629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:31.694107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.694862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.695464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.696333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.696947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.697565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.731802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:31.746006 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e0d5692-3edb-41f8-9d4e-da3d3e3fb2a5 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.477729 Oct 17 13:28:31.750345 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1451/2961] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:31 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:31.755976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:31.758978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:31.766907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.767397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.767844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.768664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:31.769128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:31.769806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:31.821306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:32.100810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:32.109839 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d959128d-30e7-48f4-acbb-155ea8c472e6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 200 len: 1523 microversion: 2.1 time: 0.426630 Oct 17 13:28:32.110619 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1511/2962] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:31 2022] GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:32.115732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:32.116327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:32.122775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.123498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.124134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.124972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.125607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.126011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.147562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:32.149788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:32.172216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-495ec465-745b-4cb6-a1fa-2d6c275636df tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.420087 Oct 17 13:28:32.173606 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1452/2963] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:31 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:32.182013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-db1daf6a-7f9f-4f33-a7b7-f9e28e4ec364 req-f5d46467-6495-43e2-8710-4d7ad5898eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d3d891-15db-40fe-9d21-084bab689217", "tag": "17b49473-8cf2-4b74-9f72-c0b3cfd3a601"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:32.196135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-db1daf6a-7f9f-4f33-a7b7-f9e28e4ec364 req-f5d46467-6495-43e2-8710-4d7ad5898eab service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.196768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-db1daf6a-7f9f-4f33-a7b7-f9e28e4ec364 req-f5d46467-6495-43e2-8710-4d7ad5898eab service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.197504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-db1daf6a-7f9f-4f33-a7b7-f9e28e4ec364 req-f5d46467-6495-43e2-8710-4d7ad5898eab service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.210748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-db1daf6a-7f9f-4f33-a7b7-f9e28e4ec364 req-f5d46467-6495-43e2-8710-4d7ad5898eab service nova] Creating event network-changed:17b49473-8cf2-4b74-9f72-c0b3cfd3a601 for instance 12d3d891-15db-40fe-9d21-084bab689217 on n-h2-854121-14 Oct 17 13:28:32.215804 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-db1daf6a-7f9f-4f33-a7b7-f9e28e4ec364 req-f5d46467-6495-43e2-8710-4d7ad5898eab service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039810 Oct 17 13:28:32.216502 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1453/2964] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:32.222834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:32.223652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:32.230215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.230770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.231225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.231962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.232422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.232854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.492773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:32.502453 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c09ebcfc-6081-4e28-9b26-8eb22250ee81 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.390777 Oct 17 13:28:32.503913 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1512/2965] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:32 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:32.524994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:32.534420 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25e23602-af77-493e-98ca-c2190449ca13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.315560 Oct 17 13:28:32.546226 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1454/2966] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:32 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:32.688509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:32.689594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:32.696951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.697474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.698297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.699556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.700190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.701524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.770717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:32.771338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:32.777756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.778490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.779207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:32.780436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:32.781067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:32.782263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.240095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:33.258172 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-20d4f294-a638-47bd-a409-fb1c3619f648 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.491760 Oct 17 13:28:33.258786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1455/2967] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:32 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:33.263951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f3124406-56a7-434e-810f-f3ac4a82b573 req-3b193987-d2a8-48c5-bd7a-9d59938d6004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd121492-3e2e-40dd-b7c7-8b8e27ab5934", "name": "network-vif-plugged", "status": "completed", "tag": "487c0c4e-7889-42d2-9c9e-beff8e7a65dd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:33.287123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f3124406-56a7-434e-810f-f3ac4a82b573 req-3b193987-d2a8-48c5-bd7a-9d59938d6004 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.287755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f3124406-56a7-434e-810f-f3ac4a82b573 req-3b193987-d2a8-48c5-bd7a-9d59938d6004 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.288263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f3124406-56a7-434e-810f-f3ac4a82b573 req-3b193987-d2a8-48c5-bd7a-9d59938d6004 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.301620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:33.306609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f3124406-56a7-434e-810f-f3ac4a82b573 req-3b193987-d2a8-48c5-bd7a-9d59938d6004 service nova] Creating event network-vif-plugged:487c0c4e-7889-42d2-9c9e-beff8e7a65dd for instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 on n-h1-854121-14 Oct 17 13:28:33.310793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-208c95ae-a34b-44ba-a73e-65e193164b75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1318 microversion: 2.1 time: 0.626320 Oct 17 13:28:33.312554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f3124406-56a7-434e-810f-f3ac4a82b573 req-3b193987-d2a8-48c5-bd7a-9d59938d6004 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052567 Oct 17 13:28:33.313867 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1456/2968] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:33.321752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:33.322705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:33.327689 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1513/2969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:32 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:33.331838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.332614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.333314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.334296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.335462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.336091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.337280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:33.337904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:33.359388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.359911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.360370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.361101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:33.361591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:33.362055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:33.981783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:33.992496 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c24124ff-ba10-4ef7-aff2-d3fd6b85210f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.663619 Oct 17 13:28:33.999486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1514/2970] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:33 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:34.011866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:34.012909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:34.029506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.031411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.037649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.038697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.039410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.040029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.077774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:34.088504 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1dd46451-6db7-49d4-8293-89864abd3eda tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 200 len: 1523 microversion: 2.1 time: 0.771144 Oct 17 13:28:34.125251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1457/2971] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:33 2022] GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 1523 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:34.127272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:34.130263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:34.144405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.145228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.145837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.146723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.147353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.148079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.427682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:34.443677 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e54efce-d617-4a7c-97b3-5520552023a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.326973 Oct 17 13:28:34.444284 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1458/2972] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:34 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:34.453420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c9883781-25c8-4ac4-b3ff-adc8ab0a0ef7 req-59263205-f99f-4230-8c11-90cadf6e4aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e70b274a-1e38-4724-a4d6-b6202e6fdfd6", "name": "network-vif-deleted", "tag": "c0c9bd33-dfc4-48c1-a675-795a80faa053"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:34.493846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9883781-25c8-4ac4-b3ff-adc8ab0a0ef7 req-59263205-f99f-4230-8c11-90cadf6e4aa3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.494583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9883781-25c8-4ac4-b3ff-adc8ab0a0ef7 req-59263205-f99f-4230-8c11-90cadf6e4aa3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.495324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9883781-25c8-4ac4-b3ff-adc8ab0a0ef7 req-59263205-f99f-4230-8c11-90cadf6e4aa3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.513073 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c9883781-25c8-4ac4-b3ff-adc8ab0a0ef7 req-59263205-f99f-4230-8c11-90cadf6e4aa3 service nova] Creating event network-vif-deleted:c0c9bd33-dfc4-48c1-a675-795a80faa053 for instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 on n-h1-854121-14 Oct 17 13:28:34.521729 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c9883781-25c8-4ac4-b3ff-adc8ab0a0ef7 req-59263205-f99f-4230-8c11-90cadf6e4aa3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075970 Oct 17 13:28:34.523237 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1459/2973] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:34.577389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:34.587837 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1eb1a268-b5d1-4bda-9d96-8fb1dd2ca8d6 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.586941 Oct 17 13:28:34.591477 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1515/2974] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:33 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:34.597000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:34.597830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:34.604249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.604960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.605613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.606565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.607178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.607765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.766793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1816427424", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "99a30118-d7c2-4414-85aa-d0c48dec24c1"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:34.785874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:34.794893 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c2f4138-ad1e-4757-a793-5c309f88e170 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.202156 Oct 17 13:28:34.798537 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1516/2975] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:34 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:34.820198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:34.821123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:34.839617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.840122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.840570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.841315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:34.841775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:34.842204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:34.881795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] validate_networks() for [('99a30118-d7c2-4414-85aa-d0c48dec24c1', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:28:35.156194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:35.169052 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89a688d2-d998-4108-8dd9-b5c6f24d7815 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1467 microversion: 2.1 time: 0.364700 Oct 17 13:28:35.182267 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1517/2976] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:34 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1467 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:35.196411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:35.197424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:35.205560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.207355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.208034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.209020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.209780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.210412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.492422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:35.501520 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eca42cab-7290-44e1-96b1-cc9ebc8d76fa tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.315762 Oct 17 13:28:35.521188 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1518/2977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:35 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:35.527061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:35.527061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:35.532837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.533596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.534225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.535634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.535908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.536340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.555409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] HTTP exception thrown: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 HTTP/1.1 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e70b274a-1e38-4724-a4d6-b6202e6fdfd6'} Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:35.557760 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 404 to user: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f87437ea-aec2-4716-a013-ee81ebbe91bd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 404 len: 111 microversion: 2.1 time: 0.049038 Oct 17 13:28:35.563552 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1519/2978] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:35 2022] GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:35.567462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-502207609"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:35.570435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:35.577296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.577836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.578381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.578960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.579394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.579811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.709997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:35.710588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:35.711372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:35.711884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:35.712397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:35.724743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.725408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.725936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.727040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.727741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.728584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.754460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Getting quotas for project bf8d2529de0a43119965e8ededb97bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:35.761809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Getting quotas for user 17f16d27aa024ca091d45cbac8c00cbf and project bf8d2529de0a43119965e8ededb97bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:35.779172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:28:35.796042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:28:35.871347 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e416085c-46df-41e2-9ef8-be6034fa75c8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "POST /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401/action" status: 202 len: 0 microversion: 2.1 time: 0.309830 Oct 17 13:28:35.872273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1520/2979] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:35 2022] POST /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:28:35.877367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-535bfbf8-b563-4b99-9db6-69a71fd66b63 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351773 Oct 17 13:28:35.885517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:35.886140 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1460/2980] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:28:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:28:35.886270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:35.891868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:35.894454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.895056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.895648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.896456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.897029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.897702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.898926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:35.900074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:35.910821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.911587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.912221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:35.913196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:35.913896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:35.914488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.011912 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac3c6830-a689-4043-996c-5d0f22d4be5e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.124169 Oct 17 13:28:36.012763 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1461/2981] 10.222.0.65 () {58 vars in 1230 bytes} [Mon Oct 17 13:28:35 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:36.029213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.030096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:36.038587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.040468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.041351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.042834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.043530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.044516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.113336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:36.125964 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0e3bf46-2c6d-4524-9c86-67c26d8f0746 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.245178 Oct 17 13:28:36.126564 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1521/2982] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:35 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:36.135496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.136135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:36.170983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.172168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.172168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.172682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.173098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.189007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.401206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:36.425472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9623ad7-51be-4fb0-bfb3-24213c27d1b7 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.399692 Oct 17 13:28:36.431210 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1462/2983] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:36.441996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e67f4325-b97b-401a-8487-26d6502c2d1b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419e34db80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.481504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:36.503393 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da8065ff-9334-4c91-84c4-40a9e3221e1c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.371552 Oct 17 13:28:36.503979 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1522/2984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:36.522846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae3d2b14-b575-4af5-9a93-55c49ad23a20 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.523894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae3d2b14-b575-4af5-9a93-55c49ad23a20 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:36.586709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e67f4325-b97b-401a-8487-26d6502c2d1b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.143653 Oct 17 13:28:36.594490 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1463/2985] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:36.610534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36eba69c-026d-40ec-b24f-9783d71d2cce tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36eba69c-026d-40ec-b24f-9783d71d2cce tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:28:36.642993 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 17 13:28:36.648021 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:36.654908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae3d2b14-b575-4af5-9a93-55c49ad23a20 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:36.658574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36eba69c-026d-40ec-b24f-9783d71d2cce tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:36.663649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36eba69c-026d-40ec-b24f-9783d71d2cce tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.067543 Oct 17 13:28:36.664837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1464/2986] 10.222.0.65 () {58 vars in 1182 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:28:36.668764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae3d2b14-b575-4af5-9a93-55c49ad23a20 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1218 microversion: 2.1 time: 0.150463 Oct 17 13:28:36.679401 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1523/2987] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:36.694414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.695232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:36.695761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.706396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:36.707360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:36.714752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.720134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.720618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.726707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.727780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.728414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.728839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.730321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.731609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.732708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.734177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.735486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.791546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:36.813890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:36.866903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57c87340-5c51-4f2e-a71d-a99521c3921d tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.179614 Oct 17 13:28:36.870632 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1524/2988] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers => generated 683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:36.882129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:36.898311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:36.901814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.servers [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Removing options 'limit' from query {{(pid=120698) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 17 13:28:36.902714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:36.911871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.912697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.913377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.920994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:36.921748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:36.922397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:36.957270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:36.994398 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8a5e391-4b7b-49cb-8530-25475de3c0a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.116992 Oct 17 13:28:36.996424 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1525/2989] 10.222.0.65 () {58 vars in 1144 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:28:37.011627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-053461ca-83aa-47f4-8e05-c2bd7b371a2b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-053461ca-83aa-47f4-8e05-c2bd7b371a2b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: action_args: {} Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi '-1' Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:28:37.016566 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 17 13:28:37.024020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.028059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-053461ca-83aa-47f4-8e05-c2bd7b371a2b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:37.029211 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-053461ca-83aa-47f4-8e05-c2bd7b371a2b tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.022658 Oct 17 13:28:37.030312 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1526/2990] 10.222.0.65 () {58 vars in 1142 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:28:37.041252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b09e18cb-7204-4483-9127-9439c07fbfde tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b09e18cb-7204-4483-9127-9439c07fbfde tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: action_args: {} Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'testing' Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 17 13:28:37.046181 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 17 13:28:37.050619 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:37.053755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b09e18cb-7204-4483-9127-9439c07fbfde tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:37.054876 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b09e18cb-7204-4483-9127-9439c07fbfde tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019321 Oct 17 13:28:37.055936 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1527/2991] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:28:37.068331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.080565 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-79e4309c-feda-42f7-adfa-0e41e07a729b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.414414 Oct 17 13:28:37.090011 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1465/2992] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:36 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:37.091261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-681bb146-d82c-4582-b231-f8b56667f3dc tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.097786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-681bb146-d82c-4582-b231-f8b56667f3dc tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.098845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-681bb146-d82c-4582-b231-f8b56667f3dc tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:37.106748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.servers [None req-681bb146-d82c-4582-b231-f8b56667f3dc tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Flavor 'non_existing_flavor' could not be found {{(pid=120698) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 17 13:28:37.108348 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-681bb146-d82c-4582-b231-f8b56667f3dc tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.022767 Oct 17 13:28:37.109661 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1528/2993] 10.222.0.65 () {58 vars in 1178 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:37.124769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.141274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.142751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:37.151237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.152164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.152848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.153862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.154648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.155094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.155258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:37.156004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.165313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.165812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.166648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.167531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.168146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.168884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.323457 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a226e854-214b-46a5-ad62-1b87b5d038bf tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.203119 Oct 17 13:28:37.333384 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1466/2994] 10.222.0.65 () {58 vars in 1174 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:37.338843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.344495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.345199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:37.371779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.372029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.373385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.374695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.375036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.375528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.445405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.493452 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6c6911a-95c1-4e6e-b24a-ef1d6617deac tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.339178 Oct 17 13:28:37.498480 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1529/2995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:37.510040 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-afb54989-f57b-4f40-868c-66b17d65238e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.175375 Oct 17 13:28:37.510649 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1467/2996] 10.222.0.65 () {58 vars in 1184 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:37.517784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.526284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:37.547503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:37.554413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.555423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:37.562117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.562862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.563450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.564853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.566332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.566931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.588138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.588641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.589083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.616457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.617018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.621532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:37.622125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:37.701486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:37.709841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:37.710591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:37.711199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.339449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:38.351930 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ff4948a-c8a2-48d2-8d51-6ded4c3b1d26 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.849620 Oct 17 13:28:38.361462 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1530/2997] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:38.376806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:38.379050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:38.395796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.402074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.402803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.404347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.404835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.405668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.408478 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6fd0109-1496-4185-8240-459cdc9f7c22 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.871549 Oct 17 13:28:38.411251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1468/2998] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:28:37 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:38.417092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17df1f99-82fb-4dfa-8822-ec3ee1a8b787 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419e34d670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:38.506962 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17df1f99-82fb-4dfa-8822-ec3ee1a8b787 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.094096 Oct 17 13:28:38.507715 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1469/2999] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:38 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:38.521244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:38.524534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:38.541142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.542063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.542220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.544045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.544530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.548232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.697451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:38.705797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01f30fcc-44de-4e8e-ab80-4100a70e6cf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1276 microversion: 2.1 time: 0.195140 Oct 17 13:28:38.712055 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1470/3000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:38 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:38.722921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:38.726017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:38.743620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.745082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.747657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:38.748889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:38.750201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:38.753576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.152119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:39.160414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:39.165486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-676d942e-bde8-4a64-8bc2-11a213af8fcb tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.799795 Oct 17 13:28:39.166564 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1531/3001] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:38 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:39.178747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-469f8daf-897e-4932-a7cc-7c61be1f52a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.189238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-469f8daf-897e-4932-a7cc-7c61be1f52a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:39.191643 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-469f8daf-897e-4932-a7cc-7c61be1f52a6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.022897 Oct 17 13:28:39.197346 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1532/3002] 10.222.0.65 () {58 vars in 1178 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:28:39.215106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.216110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:39.228584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.229735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.230425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.231398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.232076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.232728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.378673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:39.397501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c6ceb463-cb3d-47a3-b4c5-e8f5f26f932d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.683585 Oct 17 13:28:39.401762 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1471/3003] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:38 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:39.421376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.427961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:39.429953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Searching by: {'deleted': False, 'project_id': '9138dad943144f92a264271cff2c399f'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:28:39.443473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.443992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.444442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.447227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.447735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.448171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.505525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:39.525943 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d15d6aa0-eacc-4d3f-8c06-c3e78360b021 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.332111 Oct 17 13:28:39.526483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1533/3004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:39.545948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.547310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:28:39.549928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:39.575543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.576308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.576928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.578069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.578693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.579464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.625198 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2eebf04-71a7-428d-b1f8-fae2cddbfba9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.222230 Oct 17 13:28:39.626535 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1472/3005] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:39.660070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-06bc7fe7-a5ca-408f-9786-1d4e6a5005e1 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419e3c9d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.791512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-06bc7fe7-a5ca-408f-9786-1d4e6a5005e1 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.158443 Oct 17 13:28:39.792584 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1473/3006] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:39.797889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.802731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:39.819320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.823266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.824241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.826068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.827779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.829054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.849809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] HTTP exception thrown: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 HTTP/1.1 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e70b274a-1e38-4724-a4d6-b6202e6fdfd6'} Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:39.851885 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:39.856045 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:39.856810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:39.858552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 404 to user: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:39.859865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89d70b5b-8d12-48b9-90e3-cd30c6a04896 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 404 len: 111 microversion: 2.1 time: 0.065865 Oct 17 13:28:39.860968 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1474/3007] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:39 2022] DELETE /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:39.870976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.871967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:39.876492 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0c416a32-e227-4bca-844c-19a058d4cd94 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.347582 Oct 17 13:28:39.891350 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1534/3008] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:39.891350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:39.891350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:39.894476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.895993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.896696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.897797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.899023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.899661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.899777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.900279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.901538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.902335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:39.904027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:39.905127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:39.945588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:28:40.152904 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af6eb711-eb23-4a7e-820d-633866276505 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 204 len: 0 microversion: 2.1 time: 0.272554 Oct 17 13:28:40.157755 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1535/3009] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:39 2022] DELETE /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:28:40.180342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.181817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.191918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.193908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.194712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.196935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.197759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.198542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.231486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:40.240232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:28:40.242814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22788299-7b54-4228-9590-10bd62c5ea47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.379868 Oct 17 13:28:40.243876 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1475/3010] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:39 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:40.248895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.249638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.256870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.257704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.258383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.259332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.259992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.260628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.410575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d97720a1-faba-4a1c-919c-a9d606458b47 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 204 len: 0 microversion: 2.1 time: 0.240190 Oct 17 13:28:40.414468 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1536/3011] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:40 2022] DELETE /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:28:40.420202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.420898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e70b274a-1e38-4724-a4d6-b6202e6fdfd6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.428564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.430610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.430610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.430610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.430926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.431188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.448271 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] HTTP exception thrown: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 HTTP/1.1 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e70b274a-1e38-4724-a4d6-b6202e6fdfd6'} Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:40.450303 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 404 to user: Instance e70b274a-1e38-4724-a4d6-b6202e6fdfd6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:40.456166 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a28290b7-fac4-418d-b21f-20b867e3cbf3 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6" status: 404 len: 111 microversion: 2.1 time: 0.036682 Oct 17 13:28:40.457852 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1537/3012] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/e70b274a-1e38-4724-a4d6-b6202e6fdfd6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:28:40.463112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.463720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.477571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.479020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.479691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.480776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.481620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.482540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.511979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:40.521814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a17e8940-90e4-4b9d-96f5-d56f3ec9a15b tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.276380 Oct 17 13:28:40.522688 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1476/3013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:40.528299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.530147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.537870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.538574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.539363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.540235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.540841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.541444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.720714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:40.730110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d7b345d-5797-4a9b-93e5-02906f610fe3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.271062 Oct 17 13:28:40.734218 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1538/3014] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:40.755104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.758533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.770263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.771052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.771691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.773218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.774207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.774837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.787591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:40.797218 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc8ec8a2-e00f-440c-b253-9d3bfc2494e0 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 200 len: 1522 microversion: 2.1 time: 0.273345 Oct 17 13:28:40.800109 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1477/3015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:40.809772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4e1fca4-9981-415e-a465-ca139fc167e0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ddbbb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.880785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4e1fca4-9981-415e-a465-ca139fc167e0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.075920 Oct 17 13:28:40.885840 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1478/3016] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:40.904035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:40.905389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:40.913673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.914504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.915210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:40.917131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:40.920816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:40.921607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.039950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:41.064537 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb77b13f-5aed-4935-a791-df2336896688 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.329038 Oct 17 13:28:41.072614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1539/3017] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:41.127256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:41.139362 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e5e47fe-b294-4952-88a8-fd3d7201e350 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.239258 Oct 17 13:28:41.140158 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1479/3018] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:40 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:41.270301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:41.271317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:41.281450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:41.282208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:41.282796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.284272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:41.285208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:41.285945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.549195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:41.550106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:41.573249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:41.574745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:41.575482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.576845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:41.578366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:41.579421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.579983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:41.617257 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-824ddcfc-02cb-45ed-85ef-a6200662f004 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.351702 Oct 17 13:28:41.617844 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1540/3019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:41 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:41.763166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:41.765740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:41.773908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:41.775364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:41.776035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:41.777143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:41.777909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:41.778536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.178716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:42.189843 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd65625d-ee0d-4cc3-bcc7-9675d14ec937 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.645930 Oct 17 13:28:42.192329 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1480/3020] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:41 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:42.202565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:42.204137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:42.220138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.224372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.225315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.227502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.228213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.240923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.449264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:42.457380 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb293024-cea5-4088-b0dc-1626687351f4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.699096 Oct 17 13:28:42.465073 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1541/3021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:41 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:42.470272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1eb2fc9d-61b8-4683-a6ce-81b7e85e6a47 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fac5e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:42.569823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:42.582994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d672400-0099-4d8e-a7f3-603d4808ecd4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 200 len: 1522 microversion: 2.1 time: 0.388206 Oct 17 13:28:42.585658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1481/3022] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:42 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:42.597410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-be1e444e-0963-4f23-a5e5-b860881fcbd2 req-25e84a87-79b6-4273-9a47-fd0260f6e319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d3d891-15db-40fe-9d21-084bab689217", "name": "network-vif-plugged", "status": "completed", "tag": "17b49473-8cf2-4b74-9f72-c0b3cfd3a601"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:42.626879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-be1e444e-0963-4f23-a5e5-b860881fcbd2 req-25e84a87-79b6-4273-9a47-fd0260f6e319 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.627936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-be1e444e-0963-4f23-a5e5-b860881fcbd2 req-25e84a87-79b6-4273-9a47-fd0260f6e319 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.628381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-be1e444e-0963-4f23-a5e5-b860881fcbd2 req-25e84a87-79b6-4273-9a47-fd0260f6e319 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.661857 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-be1e444e-0963-4f23-a5e5-b860881fcbd2 req-25e84a87-79b6-4273-9a47-fd0260f6e319 service nova] Creating event network-vif-plugged:17b49473-8cf2-4b74-9f72-c0b3cfd3a601 for instance 12d3d891-15db-40fe-9d21-084bab689217 on n-h2-854121-14 Oct 17 13:28:42.673400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-be1e444e-0963-4f23-a5e5-b860881fcbd2 req-25e84a87-79b6-4273-9a47-fd0260f6e319 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086336 Oct 17 13:28:42.677596 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1482/3023] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:42.691987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:42.693236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:42.727854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.732084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.732554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.734121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.746757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.747270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.825431 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1eb2fc9d-61b8-4683-a6ce-81b7e85e6a47 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.359214 Oct 17 13:28:42.826983 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1542/3024] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:42 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:42.832735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:42.837088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:42.859190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.862294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.862996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:42.866922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:42.867632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:42.868342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:43.296622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:43.320038 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84d87070-a5a9-4e21-a145-5337e2956b10 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1476 microversion: 2.1 time: 0.638174 Oct 17 13:28:43.320937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1483/3025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:42 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1476 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:43.334528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:43.335532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:43.351110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:43.351881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:43.352485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:43.356469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:43.357197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:43.357813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:43.444131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:43.457470 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7c828a0-07b1-4bac-aba1-86d980e4321c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.628811 Oct 17 13:28:43.459275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1543/3026] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:42 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:43.483808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ea19f227-1a8d-48fd-84c6-46acb2960387 req-08dbaf50-1044-4005-9e06-da097d7495db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bb93367-f14d-409d-8d88-134889651af4", "tag": "532af776-8b88-4fd1-898b-dac5a280e3bd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:43.528708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea19f227-1a8d-48fd-84c6-46acb2960387 req-08dbaf50-1044-4005-9e06-da097d7495db service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:43.532072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea19f227-1a8d-48fd-84c6-46acb2960387 req-08dbaf50-1044-4005-9e06-da097d7495db service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:43.535809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea19f227-1a8d-48fd-84c6-46acb2960387 req-08dbaf50-1044-4005-9e06-da097d7495db service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:43.576204 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ea19f227-1a8d-48fd-84c6-46acb2960387 req-08dbaf50-1044-4005-9e06-da097d7495db service nova] Creating event network-changed:532af776-8b88-4fd1-898b-dac5a280e3bd for instance 7bb93367-f14d-409d-8d88-134889651af4 on n-h1-854121-14 Oct 17 13:28:43.591025 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ea19f227-1a8d-48fd-84c6-46acb2960387 req-08dbaf50-1044-4005-9e06-da097d7495db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126936 Oct 17 13:28:43.593128 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1544/3027] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:43.611438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:43.612512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:43.640579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:43.641508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:43.642756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:43.644359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:43.645072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:43.645898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.176817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:44.190332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3879397-32df-439f-8cfa-d242eca9855f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.861763 Oct 17 13:28:44.191006 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1484/3028] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:43 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:44.226187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:44.226820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:44.243586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:44.251081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.256076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d6d93ec-4f4a-46e0-b967-96944e6a3e89 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.660971 Oct 17 13:28:44.256255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.256598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.271511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.271511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.271511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.274593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1545/3029] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:43 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:44.284908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:44.285863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:44.293538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.294285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.295656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.296592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.297234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.297815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.391516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:44.412950 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af342741-ad56-45cf-92eb-cc2517fbe6fd tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 200 len: 1480 microversion: 2.1 time: 0.133275 Oct 17 13:28:44.416706 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1546/3030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:44 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 1480 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:44.426868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7db1c1a1-00d3-48e8-86fc-7cd3ceeb255f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419db4cb80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:44.538199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7db1c1a1-00d3-48e8-86fc-7cd3ceeb255f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.119592 Oct 17 13:28:44.541973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1547/3031] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:44 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:44.550235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-57681133-1716-4699-ad88-63cf0613e423 req-7d0074b5-1ad6-4c90-839a-e1af381d414d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9b4d72-e1f8-4dd5-af69-0234de07344b", "name": "network-vif-deleted", "tag": "3c2dc67e-5174-463f-9606-caff907163f7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:44.569464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-57681133-1716-4699-ad88-63cf0613e423 req-7d0074b5-1ad6-4c90-839a-e1af381d414d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.570746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-57681133-1716-4699-ad88-63cf0613e423 req-7d0074b5-1ad6-4c90-839a-e1af381d414d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.571356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-57681133-1716-4699-ad88-63cf0613e423 req-7d0074b5-1ad6-4c90-839a-e1af381d414d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.588798 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-57681133-1716-4699-ad88-63cf0613e423 req-7d0074b5-1ad6-4c90-839a-e1af381d414d service nova] Creating event network-vif-deleted:3c2dc67e-5174-463f-9606-caff907163f7 for instance fb9b4d72-e1f8-4dd5-af69-0234de07344b on n-h1-854121-14 Oct 17 13:28:44.595121 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-57681133-1716-4699-ad88-63cf0613e423 req-7d0074b5-1ad6-4c90-839a-e1af381d414d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051273 Oct 17 13:28:44.595748 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1548/3032] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:44.602934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:44.603635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:44.613622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.614472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.615096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.616239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.617545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.618300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.743470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:44.755105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d947aff-5542-44ab-8805-e08ac272e4a8 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.541534 Oct 17 13:28:44.756082 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1485/3033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:44 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:44.773169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:44.774252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:44.806081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.813694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.814512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.815669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:44.816338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:44.821050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:44.845211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:44.989921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:45.010172 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf535adb-51ab-4fea-b783-3999bec60c64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1475 microversion: 2.1 time: 0.411812 Oct 17 13:28:45.010995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1549/3034] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:44 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1475 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:45.016636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "name": "network-vif-plugged", "status": "completed", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}, {"server_uuid": "d29ceb46-cca5-44b5-9989-31ba3ab4e498", "name": "network-vif-unplugged", "status": "completed", "tag": "22ccbdc7-99a9-4a51-9b3f-008b303eded7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:45.030917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:45.048791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.054071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.054794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.059624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:45.096997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Creating event network-vif-plugged:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:28:45.097567 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Creating event network-vif-unplugged:22ccbdc7-99a9-4a51-9b3f-008b303eded7 for instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 on n-h2-854121-14 Oct 17 13:28:45.105114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:28:45.175997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-14e2f15d-07e0-4525-ad8e-54a70cf6fce1 req-4f65a76a-b68b-4de3-ba8c-01e5815188c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.141438 Oct 17 13:28:45.176857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1550/3035] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:45.219371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:45.220422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:45.228613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.229610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.229720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.232778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.233460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.234235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.244517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:45.256368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4efe134-4e4f-4bb0-91b8-d55e18bff986 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1327 microversion: 2.1 time: 0.499003 Oct 17 13:28:45.269873 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1486/3036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:44 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1327 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:45.288934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:45.290291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:45.306522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.307278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.307882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.308771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.310116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.310879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.558205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:45.567696 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90219a79-1a64-4aa9-8bb3-dfe79ce945e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.352798 Oct 17 13:28:45.577677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:45.583582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1551/3037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:45 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:45.586186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b42199f2-defd-48e5-8966-ff5a0385d178 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1470 microversion: 2.1 time: 0.304364 Oct 17 13:28:45.590526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:45.591132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:45.593951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1487/3038] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:45 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1470 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:45.600993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3a6c428-4979-466b-a8d0-ee0f50a78eee tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dc1d280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:45.626012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.628984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.630526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.631484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.635411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.637282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.707576 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3a6c428-4979-466b-a8d0-ee0f50a78eee tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.112329 Oct 17 13:28:45.711186 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1488/3039] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:45 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:45.769628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:45.783008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:45.784842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:45.803646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.804898 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bdce426c-289c-4604-be05-14f5707de2f4 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 200 len: 1308 microversion: 2.1 time: 0.220016 Oct 17 13:28:45.811299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.811936 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1552/3040] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:45 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:45.812621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:45.813660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:45.814354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:45.815200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.041458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:46.045297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:46.061829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.064958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.065687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.068311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.072486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.073362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.094366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:46.103414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a558bfd3-63d5-483d-b568-f2d0d484391b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.324968 Oct 17 13:28:46.106307 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1489/3041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:45 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:46.287062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:46.288506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:46.299642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.300919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.301720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.302740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.306001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.309072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.662895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:46.801674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:46.835934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:46.842239 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-979674a3-b64d-403d-84fc-8d691a28f55e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1475 microversion: 2.1 time: 0.795281 Oct 17 13:28:46.845517 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1553/3042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:46 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1475 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:46.872142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e8d76d5-0298-4a1b-ad50-f187ca56d12e tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1528 microversion: 2.1 time: 0.591169 Oct 17 13:28:46.881617 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1490/3043] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:46 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1528 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:46.888340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:46.889149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:46.904638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:46.905824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:46.914015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.914517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.914953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.915659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.916136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.916564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.919034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.920059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.920709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.921665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:46.922455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:46.923078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:46.953824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:47.208775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:47.217929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:47.219660 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ad6ca4d-84e2-45cc-8822-c7292445a2ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1476 microversion: 2.1 time: 0.336862 Oct 17 13:28:47.221554 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1491/3044] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:46 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:47.226931 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f47799c-30f8-412a-9e35-894fd091f7d9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.368687 Oct 17 13:28:47.229092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-aec9fe11-664b-420e-85ac-b528172b4f79 req-f9fb2ef2-5d17-45c1-9b39-9d17aa43cc26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36a9b99-2b41-4c64-9f68-ce993e96c03e", "name": "network-vif-deleted", "tag": "ed33f03d-39d2-48d0-982e-4b1b1d87604c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:47.236506 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1554/3045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:46 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:47.247786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aec9fe11-664b-420e-85ac-b528172b4f79 req-f9fb2ef2-5d17-45c1-9b39-9d17aa43cc26 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.248521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aec9fe11-664b-420e-85ac-b528172b4f79 req-f9fb2ef2-5d17-45c1-9b39-9d17aa43cc26 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.249118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aec9fe11-664b-420e-85ac-b528172b4f79 req-f9fb2ef2-5d17-45c1-9b39-9d17aa43cc26 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.250678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c90d71d4-d9e8-426d-8ceb-d46d27a728db tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a20f9b80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:47.284987 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-aec9fe11-664b-420e-85ac-b528172b4f79 req-f9fb2ef2-5d17-45c1-9b39-9d17aa43cc26 service nova] Creating event network-vif-deleted:ed33f03d-39d2-48d0-982e-4b1b1d87604c for instance e36a9b99-2b41-4c64-9f68-ce993e96c03e on n-h2-854121-14 Oct 17 13:28:47.297435 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-aec9fe11-664b-420e-85ac-b528172b4f79 req-f9fb2ef2-5d17-45c1-9b39-9d17aa43cc26 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074221 Oct 17 13:28:47.300948 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1492/3046] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:47.312135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:47.312880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:47.328814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.329548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.330327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.331263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.331850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.332276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.333791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c90d71d4-d9e8-426d-8ceb-d46d27a728db tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.095134 Oct 17 13:28:47.334381 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1555/3047] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:47 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:47.352019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:47.352664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:47.368901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.370695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.372047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.373077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.374465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.375142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.392431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:47.396460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.397378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.398569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.399345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lazy-loading 'fault' on Instance uuid fb9b4d72-e1f8-4dd5-af69-0234de07344b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:28:47.462613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:47.475013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6e34b7a-c6dc-4a3e-b505-6bbe2043a433 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 200 len: 1313 microversion: 2.1 time: 0.171297 Oct 17 13:28:47.492326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1493/3048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:47 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:47.510577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:47.511343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:47.517998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.518924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.519371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.520086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.530830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.531299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.608825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:47.620608 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fa41f2a-f1de-4e21-843e-42216124299a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1528 microversion: 2.1 time: 0.280678 Oct 17 13:28:47.623729 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1556/3049] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:47 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:47.700015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:47.781624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:47.791768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84a10fc5-5be8-4cc2-a440-e2ef5b325902 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.298225 Oct 17 13:28:47.797235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1494/3050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:47 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:47.890442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:47.891035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:47.911178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.911684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.912124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:47.916886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:47.917607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:47.918200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.000529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:48.003266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:48.010012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.010560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.011003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.011714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.012163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.012774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.030571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] HTTP exception thrown: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Request method failure captured: Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 HTTP/1.1 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhyvn1dZ3wFrCpUKMJC1ty_SB8bOX0IBbPuwev4WPgavFuybMdk1XfDImquwvC0T_Gz0Vttz6u_udnzn3LtfIu4hZNIjU6MIGYYWtC4CSLwxtZPFgyrk4dbTbEbXUL4MdUa1LUD8e7E-Q3jZJU0nmE1mXtQZdjRQnXgsQ5L09Czap0 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7299cf7b44f407c8790e48068df8999 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1389617397 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7299cf7b44f407c8790e48068df8999"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7299cf7b44f407c8790e48068df8999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7299cf7b44f407c8790e48068df8999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7299cf7b44f407c8790e48068df8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1389617397 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7299cf7b44f407c8790e48068df8999 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1389617397 Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1389617397-project Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ade591c8a6f24269a5fe22be205bb02a Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1389617397-project Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '12d3d891-15db-40fe-9d21-084bab689217'} Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:48.032276 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Returning 404 to user: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97dc6169-2910-4f1f-af57-1297538d6c3d tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] 10.222.0.65 "DELETE /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 404 len: 111 microversion: 2.1 time: 0.388322 Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1557/3051] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:47 2022] DELETE /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 111 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:48.045334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:48.051813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.052311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.052760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.053499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.054090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.054726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.512540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:48.546955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ddd44fd-1d90-49c5-ba07-451332889bb8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1473 microversion: 2.1 time: 0.640801 Oct 17 13:28:48.550163 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1495/3052] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:47 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1473 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:28:48.562696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:48.567195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:48.578573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.579475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.580116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.581790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.582473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.583137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.586957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:48.599242 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c06c85cc-87e9-4158-bfb0-e139dd45cd4a tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1528 microversion: 2.1 time: 0.558739 Oct 17 13:28:48.603267 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1558/3053] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:48 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1528 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:48.619311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:48.620556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:48.664364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.668698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.671778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.673654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:48.674888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:48.677894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:48.983170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:48.993029 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ffdd4e8-00db-4d37-8491-9161a2dc57a2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.388295 Oct 17 13:28:48.994945 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1559/3054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:48 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:49.000720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-376896f9-9ec9-42eb-8538-67cc29d16896 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f175e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.036377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:49.047871 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fc12025-d17c-469c-a18e-bb72f220756c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1476 microversion: 2.1 time: 0.495534 Oct 17 13:28:49.048937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1496/3055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:48 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1476 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:49.057793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.058984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: fb9b4d72-e1f8-4dd5-af69-0234de07344b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.078899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.081716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.082351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.083335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.084045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.084785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.090608 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-376896f9-9ec9-42eb-8538-67cc29d16896 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.094244 Oct 17 13:28:49.091691 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1560/3056] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:48 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:49.098838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Action: 'update', calling method: >, body: {"server": {"name": "12d3d891-15db-40fe-9d21-084bab689217_new"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:49.102074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.110556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.111327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.112381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.113475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.114368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.115595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.118532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] HTTP exception thrown: Instance fb9b4d72-e1f8-4dd5-af69-0234de07344b could not be found. Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b HTTP/1.1 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance fb9b4d72-e1f8-4dd5-af69-0234de07344b could not be found. Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'fb9b4d72-e1f8-4dd5-af69-0234de07344b'} Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9b4d72-e1f8-4dd5-af69-0234de07344b could not be found. Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9b4d72-e1f8-4dd5-af69-0234de07344b could not be found. Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.126342 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9b4d72-e1f8-4dd5-af69-0234de07344b could not be found. Oct 17 13:28:49.131343 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.133427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 404 to user: Instance fb9b4d72-e1f8-4dd5-af69-0234de07344b could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:49.137624 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-494814bd-3b52-4f70-9589-a5249c139fb6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b" status: 404 len: 111 microversion: 2.1 time: 0.086920 Oct 17 13:28:49.137982 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] HTTP exception thrown: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Request method failure captured: Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 HTTP/1.1 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 64 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhyvn1dZ3wFrCpUKMJC1ty_SB8bOX0IBbPuwev4WPgavFuybMdk1XfDImquwvC0T_Gz0Vttz6u_udnzn3LtfIu4hZNIjU6MIGYYWtC4CSLwxtZPFgyrk4dbTbEbXUL4MdUa1LUD8e7E-Q3jZJU0nmE1mXtQZdjRQnXgsQ5L09Czap0 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7299cf7b44f407c8790e48068df8999 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1389617397 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7299cf7b44f407c8790e48068df8999"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7299cf7b44f407c8790e48068df8999"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7299cf7b44f407c8790e48068df8999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7299cf7b44f407c8790e48068df8999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1389617397 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7299cf7b44f407c8790e48068df8999 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1389617397 Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1389617397-project Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ade591c8a6f24269a5fe22be205bb02a Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1389617397-project Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "12d3d891-15db-40fe-9d21-084bab689217_new"}} Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '12d3d891-15db-40fe-9d21-084bab689217', 'body': {'server': {'name': '12d3d891-15db-40fe-9d21-084bab689217_new'}}} Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:28:49.141882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:49.146667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] Returning 404 to user: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:49.147785 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a03cc62-7e72-4301-bd0f-1eb78883f8f9 tempest-ServersNegativeTestMultiTenantJSON-1389617397 tempest-ServersNegativeTestMultiTenantJSON-1389617397-project] 10.222.0.65 "PUT /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 404 len: 111 microversion: 2.1 time: 0.053970 Oct 17 13:28:49.148246 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1561/3057] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:28:49 2022] PUT /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:49.152743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1497/3058] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:49 2022] GET /compute/v2.1/servers/fb9b4d72-e1f8-4dd5-af69-0234de07344b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:49.154728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.156333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.162375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d3b9469f-6457-461d-ad64-e72b1f973ebe req-af42dcaa-0cfd-4281-99ef-8d6b59202518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb93367-f14d-409d-8d88-134889651af4", "name": "network-vif-plugged", "status": "completed", "tag": "532af776-8b88-4fd1-898b-dac5a280e3bd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:49.166594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.168006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.168794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.169921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.170540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.171288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.172998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d3b9469f-6457-461d-ad64-e72b1f973ebe req-af42dcaa-0cfd-4281-99ef-8d6b59202518 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.173644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d3b9469f-6457-461d-ad64-e72b1f973ebe req-af42dcaa-0cfd-4281-99ef-8d6b59202518 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.174744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d3b9469f-6457-461d-ad64-e72b1f973ebe req-af42dcaa-0cfd-4281-99ef-8d6b59202518 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.188903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d3b9469f-6457-461d-ad64-e72b1f973ebe req-af42dcaa-0cfd-4281-99ef-8d6b59202518 service nova] Creating event network-vif-plugged:532af776-8b88-4fd1-898b-dac5a280e3bd for instance 7bb93367-f14d-409d-8d88-134889651af4 on n-h1-854121-14 Oct 17 13:28:49.194549 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d3b9469f-6457-461d-ad64-e72b1f973ebe req-af42dcaa-0cfd-4281-99ef-8d6b59202518 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040315 Oct 17 13:28:49.195257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1498/3059] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:49.200857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.201720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.210029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.210854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.211480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.212364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.213003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.213707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.283490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.286319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.287548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.289692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lazy-loading 'fault' on Instance uuid e36a9b99-2b41-4c64-9f68-ce993e96c03e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:28:49.391814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:49.403862 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bb1c466-c488-44ee-a9ca-dbe0abd334d6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1313 microversion: 2.1 time: 0.206890 Oct 17 13:28:49.425957 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1499/3060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:49 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:49.429957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:49.441095 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-afd67ac3-d31a-4370-ada8-2c22462e240b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.290427 Oct 17 13:28:49.442512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.448096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.450343 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1562/3061] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:49 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:49.460843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.461625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.462263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.463202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.466917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.467372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.480966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:49.513663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:28:49.575599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.577317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.607405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.608452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.613494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.615006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.618960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.619616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.795425 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3713704-a60f-4542-9eb9-2e8a779c2bb2 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "DELETE /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 204 len: 0 microversion: 2.1 time: 0.362444 Oct 17 13:28:49.796213 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1500/3062] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:28:49 2022] DELETE /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:28:49.807425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:49.809025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:49.831849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.832371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.833288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:49.833578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:49.834019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:49.836231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.046291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:50.062496 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d914358-0813-4105-9da8-a604d567e9e2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1473 microversion: 2.1 time: 0.487117 Oct 17 13:28:50.063748 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1563/3063] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:49 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1473 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:50.082272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:50.091532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c1e1dfb-7467-43cb-9cd7-cb46222caf63 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1534 microversion: 2.1 time: 0.290855 Oct 17 13:28:50.105189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1501/3064] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:49 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1534 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:50.105189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:50.105189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:50.106791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.107402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.107853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.108571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.109027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.109484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.215271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Calling method '.version_select at 0x7f41a20ba0d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:50.217972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.218533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.219031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.241816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.242426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.243109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.256946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.257891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.258743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.267842 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0c3ab7d-600d-41c2-b9ba-916eedaec2a2 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1077767494-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.202791 Oct 17 13:28:50.278367 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1564/3065] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:28:50 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:50.283861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:50.285046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:50.291426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.291930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.292367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.293083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.293570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.293986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.370001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:50.385259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-93cf7830-6435-41f0-90ff-0324dc421df5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1318 microversion: 2.1 time: 0.291111 Oct 17 13:28:50.388607 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1502/3066] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:50 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:50.403127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d07f2c8b-28e7-4844-89c5-a6177283e345 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dd87f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:50.527924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d07f2c8b-28e7-4844-89c5-a6177283e345 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.135535 Oct 17 13:28:50.528488 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1503/3067] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:50 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:50.540698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:50.545522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:50.555008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.555484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.555923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.556634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.557080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.557548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.601617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:50.612024 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf9d3841-53d8-406b-81ea-cc4dfc247253 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1476 microversion: 2.1 time: 0.330305 Oct 17 13:28:50.612024 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1565/3068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:50 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:50.622203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:50.625361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.625866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.626404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.626944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lazy-loading 'fault' on Instance uuid e36a9b99-2b41-4c64-9f68-ce993e96c03e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:28:50.629914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:50.631179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:50.640437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.640947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.641618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.642353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:50.642858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:50.643396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:50.688754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:50.698609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f462a40a-de13-4db0-a72c-963065e34fe6 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1313 microversion: 2.1 time: 0.169205 Oct 17 13:28:50.699533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1504/3069] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:50 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:50.824173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:50.833483 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46c1f24e-2cac-4194-82cb-04b3e539c14d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.218421 Oct 17 13:28:50.833483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1566/3070] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:50 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:51.088589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:51.089619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:51.098646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.099766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.100379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.101321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.101943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.102540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.124415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:51.125589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:51.140454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.141435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.143149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.145969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.146631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.147254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.488300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:51.500236 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe2898f0-07b3-4b46-9c0a-60ddcc5b7501 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1534 microversion: 2.1 time: 0.380851 Oct 17 13:28:51.505801 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1567/3071] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:51 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1534 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:51.507862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:51.513034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:51.513886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:51.519142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40ee3cd8-6107-4cb9-97b9-f5292c34fbaa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1473 microversion: 2.1 time: 0.435039 Oct 17 13:28:51.520207 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1505/3072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:51 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:51.535520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.538555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.540321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.541636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.542297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.546551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.561490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91415993-44b7-45db-b905-9758a1b32f8a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a215b9d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:51.642492 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91415993-44b7-45db-b905-9758a1b32f8a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.100716 Oct 17 13:28:51.644594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1506/3073] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:51 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:51.669014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:51.672615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:51.710198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.711956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.713321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:51.717815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:51.722529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:51.723887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.118288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:52.127094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a5c335c-272b-4f76-9989-b6eee41283e8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1509 microversion: 2.1 time: 0.620011 Oct 17 13:28:52.141811 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1568/3074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:51 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1509 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:52.151888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f67e706c-293b-4996-8cee-88e1f075cceb req-bcde5200-e37a-420c-a053-d137eb0d442e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14", "name": "network-vif-plugged", "status": "completed", "tag": "3374708b-a678-4a47-97db-e0a22f1abd74"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:52.164385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f67e706c-293b-4996-8cee-88e1f075cceb req-bcde5200-e37a-420c-a053-d137eb0d442e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.165115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f67e706c-293b-4996-8cee-88e1f075cceb req-bcde5200-e37a-420c-a053-d137eb0d442e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.165741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f67e706c-293b-4996-8cee-88e1f075cceb req-bcde5200-e37a-420c-a053-d137eb0d442e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.181366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f67e706c-293b-4996-8cee-88e1f075cceb req-bcde5200-e37a-420c-a053-d137eb0d442e service nova] Creating event network-vif-plugged:3374708b-a678-4a47-97db-e0a22f1abd74 for instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 on n-h1-854121-14 Oct 17 13:28:52.186833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f67e706c-293b-4996-8cee-88e1f075cceb req-bcde5200-e37a-420c-a053-d137eb0d442e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043790 Oct 17 13:28:52.187432 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1569/3075] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:52.192923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:52.194175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:52.202317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.203335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.204073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.204924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.206273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.206892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.247911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.248155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.249054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.249545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lazy-loading 'fault' on Instance uuid e36a9b99-2b41-4c64-9f68-ce993e96c03e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:28:52.258498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:52.271969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9e43454-f8ca-4150-96af-a4b7c7470f6c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1476 microversion: 2.1 time: 0.625762 Oct 17 13:28:52.273063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1507/3076] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:51 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1476 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:52.285651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:52.286639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:52.302216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.304709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.305223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.314272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.318121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.319210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.422191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd8a88c8c48c43df9039eaf2369dfe6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9138dad943144f92a264271cff2c399f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:52.426964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:52.433362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d4d6644-f1f3-4b8f-b22f-595ea237807e tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 200 len: 1313 microversion: 2.1 time: 0.244566 Oct 17 13:28:52.434638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1570/3077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:52 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:52.441668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:52.443463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:52.450727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.451395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.452013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.452889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.453537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.454148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.623761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:52.637114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53e595b2-a93d-4921-b97b-09dae58d777a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.362822 Oct 17 13:28:52.649987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1508/3078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:52 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:52.662284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:52.663095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:52.669974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.670462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.670895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.671604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.672041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.673755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.877382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f13aa7d2eea4f0f9f7d8b7cfe90c1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '021ce90b5cae410bb31f6e89f6f7b4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:52.903746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:52.911067 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dfca2490-d1f9-4090-82f5-88e066778c75 tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 200 len: 1492 microversion: 2.1 time: 0.259748 Oct 17 13:28:52.912310 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1509/3079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:52 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 1492 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:52.931647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d12b5e0b-6361-4296-bf2e-5c6076db5fe8 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1509 microversion: 2.1 time: 0.494370 Oct 17 13:28:52.932631 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1571/3080] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:52 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1509 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:52.945964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66ff5182-0e13-4ecf-ac4c-f1e76d95d421 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a206b670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:52.958836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:52.960284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:52.968178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.969958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.970714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:52.971853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:52.972545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:52.973642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.068167 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66ff5182-0e13-4ecf-ac4c-f1e76d95d421 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.129249 Oct 17 13:28:53.068834 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1572/3081] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:52 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:53.093846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:53.106123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:53.133922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.137960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.139275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.141260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.144720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.145513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.389763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:53.390299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:53.393577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:53.396421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:53.397269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:53.413745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:53.432253 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41f469a2-1a16-4e9c-8ddc-2d94cc725e87 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1470 microversion: 2.1 time: 0.518195 Oct 17 13:28:53.433643 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1510/3082] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:52 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:53.442438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dd218986-a848-4834-b5fe-c82ca712d86d req-5d393146-ecef-49f4-a95a-4ae0e08a2cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d3d891-15db-40fe-9d21-084bab689217", "name": "network-vif-deleted", "tag": "17b49473-8cf2-4b74-9f72-c0b3cfd3a601"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:53.461591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd218986-a848-4834-b5fe-c82ca712d86d req-5d393146-ecef-49f4-a95a-4ae0e08a2cd7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.462602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd218986-a848-4834-b5fe-c82ca712d86d req-5d393146-ecef-49f4-a95a-4ae0e08a2cd7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.463199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd218986-a848-4834-b5fe-c82ca712d86d req-5d393146-ecef-49f4-a95a-4ae0e08a2cd7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.510789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dd218986-a848-4834-b5fe-c82ca712d86d req-5d393146-ecef-49f4-a95a-4ae0e08a2cd7 service nova] Creating event network-vif-deleted:17b49473-8cf2-4b74-9f72-c0b3cfd3a601 for instance 12d3d891-15db-40fe-9d21-084bab689217 on n-h2-854121-14 Oct 17 13:28:53.526625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dd218986-a848-4834-b5fe-c82ca712d86d req-5d393146-ecef-49f4-a95a-4ae0e08a2cd7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090424 Oct 17 13:28:53.531850 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1511/3083] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:53.551118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:53.554771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:53.573388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.574295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.574910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.575925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.587978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.593554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:53.594553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.602104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.602946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.603722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.604665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.605416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.606158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.667264 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-040d2705-ebf1-4802-bd15-226f7a7765c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "POST /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4/action" status: 202 len: 1111 microversion: 2.1 time: 0.590770 Oct 17 13:28:53.670104 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1573/3084] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:53 2022] POST /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4/action => generated 1111 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:28:53.686128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:53.688006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] [instance: e36a9b99-2b41-4c64-9f68-ce993e96c03e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:53.702237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.703676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.704365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.706054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.707132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.707732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.740158 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] HTTP exception thrown: Instance e36a9b99-2b41-4c64-9f68-ce993e96c03e could not be found. Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Request method failure captured: Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e HTTP/1.1 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhZ68fo-BMG1fMY1v4Uy_c5kY3znxWvnFq4wIKv7KRSfkrEyOam7-y5fasUDzTod2YUY-XY-qRxzxFiZaPLUbQ0tPr3eD74Yd-R1sqNSVjKVk7Knz0NObHCl_tfnWxZvmvhanuxqa2iZ7K7yvjVRxsuOcBTk5ab15Xf0vacH0F4rho Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9138dad943144f92a264271cff2c399f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9138dad943144f92a264271cff2c399f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9138dad943144f92a264271cff2c399f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9138dad943144f92a264271cff2c399f Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-767791865 Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fd8a88c8c48c43df9039eaf2369dfe6c Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListServersNegativeTestJSON-767791865-project Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance e36a9b99-2b41-4c64-9f68-ce993e96c03e could not be found. Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e36a9b99-2b41-4c64-9f68-ce993e96c03e'} Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e36a9b99-2b41-4c64-9f68-ce993e96c03e could not be found. Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e36a9b99-2b41-4c64-9f68-ce993e96c03e could not be found. Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:53.748863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e36a9b99-2b41-4c64-9f68-ce993e96c03e could not be found. Oct 17 13:28:53.755659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:28:53.757788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] Returning 404 to user: Instance e36a9b99-2b41-4c64-9f68-ce993e96c03e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:53.758524 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e364e7cb-1903-476f-b0bd-fd737bbff5a9 tempest-ListServersNegativeTestJSON-767791865 tempest-ListServersNegativeTestJSON-767791865-project] 10.222.0.65 "GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e" status: 404 len: 111 microversion: 2.1 time: 0.085183 Oct 17 13:28:53.759554 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1574/3085] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:53 2022] GET /compute/v2.1/servers/e36a9b99-2b41-4c64-9f68-ce993e96c03e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:53.764514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:53.765061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:53.772491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.772988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.773537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.774322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.774681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.775106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.868675 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c065d584-c969-4e2f-9b50-a7d42a0fe7ea tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498/action" status: 204 len: 0 microversion: 2.1 time: 0.107742 Oct 17 13:28:53.869494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1575/3086] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:53 2022] POST /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498/action => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:28:53.896052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:53.896783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:53.917695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.918208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.918739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:53.919361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:53.919817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:53.920241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:54.369556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:54.384785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-016cde82-c63f-47b7-a1f3-41f7e31a4880 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1476 microversion: 2.1 time: 0.851422 Oct 17 13:28:54.399753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1512/3087] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:53 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1476 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:54.425098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:54.436374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:54.465925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:54.466786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:54.467441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:54.468386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:54.470066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:54.470720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:54.786533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:54.796140 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab1f67ec-72e1-469f-9b4e-bd4e805133ce tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1505 microversion: 2.1 time: 0.916178 Oct 17 13:28:54.796991 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1576/3088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:53 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1505 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:54.802152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:54.803102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:54.810256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:54.811076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:54.811774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:54.812756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:54.813535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:54.814243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.145738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:55.159287 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8050ab2a-2701-476a-b1c8-6abccbc5993c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.740446 Oct 17 13:28:55.159963 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1513/3089] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:54 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:55.172698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:55.173449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] [instance: 12d3d891-15db-40fe-9d21-084bab689217] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:55.184236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.184725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.185194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.191753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.192945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.193548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.227920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] HTTP exception thrown: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Request method failure captured: Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 HTTP/1.1 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVhagoogVF1jblz-BOyAt9yfItdsyHxLUv2VPKfYdFk2kD_WgxdCNP5HCSMvgD5cl38WUGjSU5nOCDQ6aya-8aNZaRVnRcRVlxk2WHIK1f6PzfMf2hxIGTVsw3TdpRU8mxWtquNCNl046GWra-LoDTotydhPHk-7Xojk0pKYImBz8O0 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 021ce90b5cae410bb31f6e89f6f7b4b5 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-514495865 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/021ce90b5cae410bb31f6e89f6f7b4b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/021ce90b5cae410bb31f6e89f6f7b4b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/021ce90b5cae410bb31f6e89f6f7b4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_021ce90b5cae410bb31f6e89f6f7b4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-514495865 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 021ce90b5cae410bb31f6e89f6f7b4b5 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-514495865 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestMultiTenantJSON-514495865-project Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 2f13aa7d2eea4f0f9f7d8b7cfe90c1f0 Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-514495865-project Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '12d3d891-15db-40fe-9d21-084bab689217'} Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:55.229559 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] Returning 404 to user: Instance 12d3d891-15db-40fe-9d21-084bab689217 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e50d515c-306e-4813-97d6-f57f02387a1c tempest-ServersNegativeTestMultiTenantJSON-514495865 tempest-ServersNegativeTestMultiTenantJSON-514495865-project] 10.222.0.65 "GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217" status: 404 len: 111 microversion: 2.1 time: 0.070042 Oct 17 13:28:55.235440 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1514/3090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:55 2022] GET /compute/v2.1/servers/12d3d891-15db-40fe-9d21-084bab689217 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:28:55.249140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a92af40-106e-4f52-9ae0-0df2c4bf30d7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2160c10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:55.314254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a92af40-106e-4f52-9ae0-0df2c4bf30d7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.081715 Oct 17 13:28:55.315474 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1515/3091] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:55 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:55.330132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29ceb46-cca5-44b5-9989-31ba3ab4e498", "name": "network-vif-plugged", "status": "completed", "tag": "22ccbdc7-99a9-4a51-9b3f-008b303eded7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:55.356089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.356575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.357004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.372187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:55.391735 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] Creating event network-vif-plugged:22ccbdc7-99a9-4a51-9b3f-008b303eded7 for instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 on n-h2-854121-14 Oct 17 13:28:55.392362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-562a7e1b-1878-44d6-8a31-81083148ccc4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1470 microversion: 2.1 time: 0.593515 Oct 17 13:28:55.400506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:28:55.405735 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1577/3092] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:54 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1470 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:55.408420 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-01974669-eb5a-47ab-ae45-19a250c7ab6c req-88c960bf-c2fb-4fe9-ba39-c4168ddfb30e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081933 Oct 17 13:28:55.425955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:55.427590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:55.437580 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1516/3093] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:55.443713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.444661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.446458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.447697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.448557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.449405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.821774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:55.823543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:55.831505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.832025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.832476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:55.833251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:55.833721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:55.834157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:56.275267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:56.286904 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a65dfc5-5745-4569-8ea3-cb8f8ee3e0ce tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1462 microversion: 2.1 time: 0.874291 Oct 17 13:28:56.287975 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1578/3094] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:55 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1462 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:56.298256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:56.308026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:56.326010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:56.326828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:56.327426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:56.328303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:56.328909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:56.329648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:56.391681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:56.404485 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73285a04-de3c-481f-8296-024d66057ce4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1505 microversion: 2.1 time: 0.586406 Oct 17 13:28:56.407448 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1517/3095] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:55 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:56.420424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:56.425674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:56.438382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:56.443655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:56.444442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:56.446503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:56.447172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:56.449443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:56.995432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:57.008879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd8c2f75-cce0-407e-b927-4384b02b6857 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1462 microversion: 2.1 time: 0.599358 Oct 17 13:28:57.015752 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1518/3096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:56 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1462 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:57.035559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-439d24a4-fe4a-4d15-b6bc-e15fb7a6f420 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a20551f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:57.044152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:57.067193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62df025a-ba06-45d5-a6e3-ddad4b29f022 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.772540 Oct 17 13:28:57.069134 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1579/3097] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:56 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:57.074721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:57.075558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:57.097932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.105453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.106578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.108840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.110561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.111359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.189003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-439d24a4-fe4a-4d15-b6bc-e15fb7a6f420 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.171922 Oct 17 13:28:57.190544 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1519/3098] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:57 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:57.196099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:57.203377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:57.235211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.235979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.237252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.238231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.239070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.247635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.447629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:28:57.450733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:28:57.451511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:28:57.456862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:28:57.457731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:28:57.623275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:57.634976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.639539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.641087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.645272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.646305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.647190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.723088 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38ce9522-4ca8-4944-b3c7-0f29752bef30 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 1066 microversion: 2.1 time: 0.530916 Oct 17 13:28:57.728458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:57.738132 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1520/3099] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:28:57 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 1066 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:28:57.740435 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1c97d46-41ed-4cbb-85cf-580348f26067 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1462 microversion: 2.1 time: 0.669826 Oct 17 13:28:57.745762 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1580/3100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:57 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1462 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:57.746687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:57.747570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:57.759164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.763236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.763956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.764907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.765567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.766164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.783421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-dedf87a3-3009-4dd3-b1bb-de1906c1ff17 req-63af7f66-80c0-4721-9e01-8d0773021f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd121492-3e2e-40dd-b7c7-8b8e27ab5934", "name": "network-vif-unplugged", "status": "completed", "tag": "487c0c4e-7889-42d2-9c9e-beff8e7a65dd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:57.836288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dedf87a3-3009-4dd3-b1bb-de1906c1ff17 req-63af7f66-80c0-4721-9e01-8d0773021f7a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.841622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dedf87a3-3009-4dd3-b1bb-de1906c1ff17 req-63af7f66-80c0-4721-9e01-8d0773021f7a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.844479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dedf87a3-3009-4dd3-b1bb-de1906c1ff17 req-63af7f66-80c0-4721-9e01-8d0773021f7a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.876813 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-dedf87a3-3009-4dd3-b1bb-de1906c1ff17 req-63af7f66-80c0-4721-9e01-8d0773021f7a service nova] Creating event network-vif-unplugged:487c0c4e-7889-42d2-9c9e-beff8e7a65dd for instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 on n-h1-854121-14 Oct 17 13:28:57.896079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-dedf87a3-3009-4dd3-b1bb-de1906c1ff17 req-63af7f66-80c0-4721-9e01-8d0773021f7a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145590 Oct 17 13:28:57.896831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1581/3101] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:28:57.907054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:57.908015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:57.925578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.926739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.927418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:57.928340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:57.928996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:57.929636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:58.489032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:58.499737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:58.511474 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bdf4ad7-b6c9-4e45-b613-432bdc904dc1 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 200 len: 1508 microversion: 2.1 time: 0.772236 Oct 17 13:28:58.513664 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1521/3102] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:57 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 1508 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:58.521858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:58.522848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:58.530260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11253871-0e1f-4a94-b13c-ca12e0fff9fc tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.607361 Oct 17 13:28:58.530926 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1582/3103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:57 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:58.531905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:58.534693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:58.535662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:58.536902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:58.537469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:58.538097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:58.538347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:58.539360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:58.555642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:58.556313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:58.559449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:58.560509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:58.561305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:58.562534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:58.958824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:58.976691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:58.990738 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc47e156-96df-4291-8a3c-a0ca7946737c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1462 microversion: 2.1 time: 0.474895 Oct 17 13:28:58.991626 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97414100-3eec-4d90-8fa9-c5cf9e47d81c tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.455507 Oct 17 13:28:58.992841 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1583/3104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:58 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:58.997953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d597db3-4f9d-44af-9edd-c26bd1098e10 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2090b80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:58.998537 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1522/3105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:58 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1462 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:59.026347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:59.034975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:59.047426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:59.064278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:59.065586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:59.066507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:59.069867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:59.070521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:59.097193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d597db3-4f9d-44af-9edd-c26bd1098e10 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.103031 Oct 17 13:28:59.105654 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1584/3106] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:28:58 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:59.123099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fac6c2a0-5ddd-4b06-a80d-10c115299096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'create', calling method: .version_select at 0x7f41a2046c10>, body: {"keypair": {"name": "tempest-keypair-1166434864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmo8aFl3Ev2Hz8wYQOfOBTXeETjsoGs0LJm/EwBAAsMfFL13zBbMMgpcU16Zt72uzwlAlMV1CpJGCCk89iugl2GdzzmT+aVxfcVN/WHWva3b9Sb2lJ0pOfCaFZ3/MuoEA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:28:59.164844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fac6c2a0-5ddd-4b06-a80d-10c115299096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for project 72898d2193744efcb00118587dcf3bea. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:28:59.177370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fac6c2a0-5ddd-4b06-a80d-10c115299096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for user fec0e15aae5c4bf996ee4b8a98a496e2 and project 72898d2193744efcb00118587dcf3bea. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:28:59.193418 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fac6c2a0-5ddd-4b06-a80d-10c115299096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [38c12e21-730b-4665-a16a-58172f95ed86] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:28:59.746453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:28:59.749061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:28:59.762183 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67f094f8-87f3-41e0-afa2-426298a4bd5b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.761925 Oct 17 13:28:59.762563 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1523/3107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:58 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:28:59.814048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:28:59.815446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:28:59.824038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:59.824548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:59.825671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:28:59.826918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:28:59.827394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:28:59.827829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:00.221499 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-fac6c2a0-5ddd-4b06-a80d-10c115299096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [38c12e21-730b-4665-a16a-58172f95ed86] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 35178. Oct 17 13:29:00.239922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fac6c2a0-5ddd-4b06-a80d-10c115299096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.132751 Oct 17 13:29:00.241973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1585/3108] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:28:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:00.247901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:00.249341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:00.258788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:00.260271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:00.260954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:00.262001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:00.262711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:00.263520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:00.294878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:00.323105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-55bb0bf8-02ba-4ea8-884d-6f4627f09351 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.546704 Oct 17 13:29:00.325647 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1524/3109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:28:59 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:00.345137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:00.346577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:00.381827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:00.382328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:00.383815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:00.384555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:00.385029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:00.389720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:01.274212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:01.287399 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91a9ae8e-b9a3-4439-a293-87bf94e1747d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.043161 Oct 17 13:29:01.289992 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1586/3110] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:00 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:01.310443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97e33ee6-e3fa-4e2e-b556-0d6df9f7b239 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2090ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:01.371711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:01.395270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5a0c5bb-41e9-4f19-8514-d04ff92abd0e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 1.066017 Oct 17 13:29:01.399034 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1525/3111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:00 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:01.430268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:01.431097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:01.437527 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97e33ee6-e3fa-4e2e-b556-0d6df9f7b239 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.144325 Oct 17 13:29:01.438990 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1587/3112] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:01 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:01.448504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:01.449970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:01.450323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:01.451805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:01.452549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:01.453579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:01.454265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:01.454954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:01.493422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:01.493920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:01.502335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:01.503178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:01.503671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:01.504117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.175937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:02.187365 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca5f9757-8c29-4177-9799-dbce3cc12c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.787058 Oct 17 13:29:02.199876 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1526/3113] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:01 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:02.225545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:02.226259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:02.232406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:02.240078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:02.240898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:02.241381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.242083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:02.244656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5414e5aa-9d0e-4ed2-8234-da344fa86889 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.800078 Oct 17 13:29:02.246991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:02.247493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.264347 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1588/3114] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:01 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:02.426282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:02.426973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:02.442364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:02.442944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:02.443401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.446800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:02.451471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:02.452787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:02.932611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:02.935422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:02.957355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4f21fdc-bc91-47cb-87d0-523fcf565d47 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.540550 Oct 17 13:29:02.958476 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1589/3115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:02 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:02.972925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-422c58e6-812a-4226-a9b5-d98d2a9abe66 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f533a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:03.082868 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-422c58e6-812a-4226-a9b5-d98d2a9abe66 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.123107 Oct 17 13:29:03.083639 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1590/3116] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:02 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:03.157622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:03.184171 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b48d5699-6dce-4f42-9c2e-d43ffb8b1abf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.959615 Oct 17 13:29:03.189183 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1527/3117] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:02 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:03.211156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dab4309e-24f8-449b-8c70-651947f61a4b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:03.219498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab4309e-24f8-449b-8c70-651947f61a4b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:03.220005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab4309e-24f8-449b-8c70-651947f61a4b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:03.220448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab4309e-24f8-449b-8c70-651947f61a4b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:03.275210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:03.275753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:03.291644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:03.292356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:03.292972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:03.293921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dab4309e-24f8-449b-8c70-651947f61a4b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:29:03.294350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:03.295177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:03.297068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:03.468103 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dab4309e-24f8-449b-8c70-651947f61a4b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.260792 Oct 17 13:29:03.477658 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1591/3118] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:03 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:03.507636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:03.510919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:03.532174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:03.532683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:03.533288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:03.534041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:03.534480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:03.534910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:03.731523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:03.740328 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4327299-9444-44ed-9d2f-0ea8cc785142 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.469144 Oct 17 13:29:03.747882 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1528/3119] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:03 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:03.853782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:03.871982 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14eb8c7c-d143-4b0c-a6d6-b5830af4834b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.388136 Oct 17 13:29:03.876006 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1592/3120] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:03 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:03.986948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:03.987731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:04.000329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.004129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.006951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.008021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.008732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.010447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.114662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65ad836a-af26-44c4-9719-813ee643fc69 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cfd0700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:04.226148 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65ad836a-af26-44c4-9719-813ee643fc69 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.131796 Oct 17 13:29:04.234618 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1593/3121] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:04 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:04.543363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:04.557393 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-edd70cf2-e265-4da4-b836-6815ef834014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.576028 Oct 17 13:29:04.559273 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1529/3122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:03 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:04.767863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:04.768812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:04.777193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.780738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.786169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.787135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.787775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.788405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.900995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:04.902217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:04.912626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.915976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.916569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:04.917408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:04.918170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:04.918723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:05.714837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:05.755751 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4ba75d3-d0d4-48ae-af76-ee841050bb29 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.986674 Oct 17 13:29:05.780115 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1594/3123] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:04 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:05.802190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02a2a322-039e-45a8-a9a6-63d56435bf75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f538b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:05.812556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:05.830741 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a752ce66-954d-4f1d-bd28-34afd2276cfe tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.935172 Oct 17 13:29:05.831602 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1530/3124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:04 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:05.839463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:05.840354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:05.860605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:05.862032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:05.862639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:05.863589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:05.864219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:05.864838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:05.929997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02a2a322-039e-45a8-a9a6-63d56435bf75 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.147480 Oct 17 13:29:05.931095 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1595/3125] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:05 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:06.374440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:06.391332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5041f0b5-7bd4-4ced-99cb-118506a102fb tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.556276 Oct 17 13:29:06.392049 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1531/3126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:05 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:06.514063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-175fc36a-a1de-47bc-a1c2-fd8a7b15de2b tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '.version_select at 0x7f419cfd0160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:06.514063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-175fc36a-a1de-47bc-a1c2-fd8a7b15de2b tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:06.514063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-175fc36a-a1de-47bc-a1c2-fd8a7b15de2b tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:06.514063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-175fc36a-a1de-47bc-a1c2-fd8a7b15de2b tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:06.520529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-175fc36a-a1de-47bc-a1c2-fd8a7b15de2b tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.050421 Oct 17 13:29:06.542985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01cf330e-0aa5-452f-81dd-a2bf9395a621 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:06.552197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1596/3127] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:29:06 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:06.561516 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01cf330e-0aa5-452f-81dd-a2bf9395a621 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020050 Oct 17 13:29:06.565441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1532/3128] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:29:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:06.578130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33bd8e3f-1143-43e1-80c1-066e8e559045 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-75799687", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:06.655965 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33bd8e3f-1143-43e1-80c1-066e8e559045 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.083953 Oct 17 13:29:06.669226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1597/3129] 10.222.0.65 () {60 vars in 1146 bytes} [Mon Oct 17 13:29:06 2022] POST /compute/v2.1/flavors => generated 497 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:06.677803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4e6c800-986c-4731-a2c8-394b53c0b08f tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:06.693561 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4e6c800-986c-4731-a2c8-394b53c0b08f tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018000 Oct 17 13:29:06.694202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1533/3130] 10.222.0.65 () {58 vars in 1182 bytes} [Mon Oct 17 13:29:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:29:06.784881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:06.785606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:06.793402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:06.797913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:06.798445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:06.801772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:06.802265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:06.802700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:06.859500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:06.860671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:06.873600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:06.876033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:06.880410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:06.881509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:06.882157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:06.882760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:07.301337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:07.310891 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fde85c83-0c34-4068-a9f3-e4f6b0d37ea0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.530568 Oct 17 13:29:07.320570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:07.329799 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1598/3131] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:06 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:07.331291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4bbe16d-fe24-4cdf-89a4-f2c10c869557 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.477222 Oct 17 13:29:07.351662 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1534/3132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:07.352333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-433560745", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "ab6df50d-4a54-4457-bb8c-ff5103aa650d"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:07.362894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aca1fe01-b2a1-4d28-9db8-8b89030246df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fe7f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:07.378119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:07.535601 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aca1fe01-b2a1-4d28-9db8-8b89030246df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.182563 Oct 17 13:29:07.537015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1535/3133] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:07 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:07.549423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:07.565503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:07.581102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:29:07.589406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:07.594330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:07.595061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:07.596042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:07.596604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:07.597098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.100363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:08.135101 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b5a41b0-693c-4b4f-a701-9f4af2a76e96 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.591874 Oct 17 13:29:08.135865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1536/3134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:07 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:08.337224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:29:08.344168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:08.344861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:29:08.345493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:29:08.347501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:08.347709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:29:08.350947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:29:08.371769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:08.374841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:08.375385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.376324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:08.376915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:08.379347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.386490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:08.387301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:08.387919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.389294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:08.389914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:08.390338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.441916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:29:08.447948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for user fec0e15aae5c4bf996ee4b8a98a496e2 and project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:29:08.487518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:29:08.489952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:29:08.550945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5631bd4-7f9e-4408-b832-5666d191fbb6 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219185 Oct 17 13:29:08.551877 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1599/3135] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:29:08.564343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:08.565819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:08.574327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:08.575869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:08.576767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.578596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:08.579421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:08.580063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:08.866905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:08.876182 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7367126a-8817-4e91-8978-be9521b1cc02 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.535683 Oct 17 13:29:08.882928 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1537/3136] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:08 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:08.897831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f14bb0f6-e789-4ab1-9054-f83a98cb3ec7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fe73a0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:08.995151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:09.005713 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50618aae-7636-4353-9632-8b943ba116a7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.445980 Oct 17 13:29:09.006678 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1600/3137] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:08 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:09.011322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f14bb0f6-e789-4ab1-9054-f83a98cb3ec7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.126953 Oct 17 13:29:09.012488 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1538/3138] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:08 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:09.028567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53e9e8df-0f02-44bd-b3b9-ddb874ce68a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:09.030688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53e9e8df-0f02-44bd-b3b9-ddb874ce68a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:09.163424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:09.164639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:09.173570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:09.175050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:09.175736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:09.176698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:09.177501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:09.178161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:09.296200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53e9e8df-0f02-44bd-b3b9-ddb874ce68a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:09.308897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53e9e8df-0f02-44bd-b3b9-ddb874ce68a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1278 microversion: 2.1 time: 0.300753 Oct 17 13:29:09.310182 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1601/3139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:09 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1278 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:09.493575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:09.513274 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fae05246-9d26-49bd-b29c-c9d31921f981 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.352905 Oct 17 13:29:09.513981 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1539/3140] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:09 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:09.913432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:09.914063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:09.933877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:09.934380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:09.934827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:09.935553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:09.959507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:09.960008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:10.032930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58cd03ed-6750-4147-aab2-f0b8e84bdda6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a21084c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:10.131807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58cd03ed-6750-4147-aab2-f0b8e84bdda6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.103910 Oct 17 13:29:10.134180 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1540/3141] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:10 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:10.145745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:10.146584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:10.178251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:10.178870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:10.180478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:10.181248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:10.181724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:10.182437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:11.296335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:11.341591 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc872714-15f7-4fe6-8e3d-3fc2101a2db2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 1.418261 Oct 17 13:29:11.345247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1602/3142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:09 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:11.362541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:11.364276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:11.389209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:11.390615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:11.391635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:11.406878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:11.408096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:11.408894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:11.708273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:11.723470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:11.735098 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-212d927d-900b-45de-b5fc-2c05dc76f94b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1336 microversion: 2.1 time: 0.387753 Oct 17 13:29:11.736222 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1603/3143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:11 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1336 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:11.741848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:11.742651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:11.751746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25849ee6-3949-4805-bcdc-a1c177477ba4 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 1.616264 Oct 17 13:29:11.766799 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1541/3144] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:10 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:11.776106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c708f102-009c-40d2-8fe3-22d9889231d7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fdeb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:11.788590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:11.790293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:11.792944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:11.797832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:11.816766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:11.817801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:11.868357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c708f102-009c-40d2-8fe3-22d9889231d7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.099582 Oct 17 13:29:11.870171 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1542/3145] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:11 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:12.379312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:12.379982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:12.410927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:12.416079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:12.421665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:12.422791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a9a7e6a-495a-436d-8768-8d59fdb980c4 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.683950 Oct 17 13:29:12.423411 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1604/3146] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:11 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:12.425207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:12.428680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:12.432447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:12.433276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:12.763454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:12.764076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:12.780203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:12.780951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:12.781667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:12.782567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:12.783762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:12.788627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:13.103059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:13.118966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47e68e8f-b900-4a61-b7b5-4f1ed71d58cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1336 microversion: 2.1 time: 0.359284 Oct 17 13:29:13.130635 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1605/3147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:12 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1336 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:13.145739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:13.146815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:13.155594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:13.159698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:13.161251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:13.163407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:13.164104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:13.164739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:13.876630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:13.891196 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-804fe030-dede-4472-bcbc-721b533fa730 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 1.518994 Oct 17 13:29:13.906781 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1543/3148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:12 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:13.922304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0406a690-bb54-4fa7-8db5-be6da7dfb709 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2068160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:13.954220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:13.969591 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e335d7d4-003d-4f88-b9b6-73b2a68079e2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1681 microversion: 2.1 time: 0.837394 Oct 17 13:29:13.975334 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1606/3149] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:13 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1681 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:14.009203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:14.011865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:14.055194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:14.058571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0406a690-bb54-4fa7-8db5-be6da7dfb709 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1452 microversion: 2.1 time: 0.150320 Oct 17 13:29:14.059689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:14.062098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:14.064336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:14.064488 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1544/3150] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:13 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:14.073878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:14.077968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:14.148093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:14.148987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:14.152925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:14.186732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:14.187282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:14.187735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:14.188487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:14.190779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:14.191482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:15.015032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:15.032214 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c707d0d-f7cf-468a-9164-d0c1a93966b8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.887111 Oct 17 13:29:15.035283 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1545/3151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:14 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:15.323359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:15.331847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-569306c5-f18c-4828-a6d3-e4011fca0c68 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 1.353824 Oct 17 13:29:15.332289 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1607/3152] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:13 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:15.364560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:15.365269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:15.371856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1395802236", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "bf2c3f84-94fc-4b0f-86d2-bf5ff6bb3bde"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:15.395775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:15.396291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:15.396739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:15.397495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:15.398054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:15.398371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:15.521560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] validate_networks() for [('bf2c3f84-94fc-4b0f-86d2-bf5ff6bb3bde', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:29:16.541631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:16.550277 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfdcac54-7308-4fd8-8388-bbe9506b0eac tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 1.216936 Oct 17 13:29:16.550868 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1608/3153] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:15 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:16.579011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:16.579631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:16.601081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:16.601609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:16.602037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:16.602754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:16.603211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:16.603636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:16.996409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:17.012446 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e75f311-1b9c-48e0-991b-f2dba3d5a04d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1658 microversion: 2.1 time: 0.437628 Oct 17 13:29:17.019930 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1609/3154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:16 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1658 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:17.026964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09ab00c5-4ad9-4753-80d6-699e2566fcb8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a20ba8b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:17.107292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09ab00c5-4ad9-4753-80d6-699e2566fcb8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1461 microversion: 2.1 time: 0.085775 Oct 17 13:29:17.108264 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1610/3155] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:17 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1461 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:17.122368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:29:17.123477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:29:17.124185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:29:17.124794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:29:17.125424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:29:17.180504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.181361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.182073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.184567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.185299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.185921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.232520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Getting quotas for project a2cf5720dc3d44ae97ebd94094807c4c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:29:17.250047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Getting quotas for user 89774ee20d9345ff812c55a37477363a and project a2cf5720dc3d44ae97ebd94094807c4c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:29:17.267171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Calling method '.version_select at 0x7f41a20fcee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:17.269104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.269618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.270284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.277893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:29:17.280753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:29:17.311170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.315171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.316044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.339837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.342650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.345828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.350343 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3e32a63-50df-4ab8-b62e-c894fb182bed tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313701 Oct 17 13:29:17.351013 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1546/3156] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:29:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:29:17.357316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:17.358515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:17.359410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7a00f0d-a969-4505-b094-9c8f581d414a tempest-PortsAdminExtendedAttrsTestJSON-313971127 tempest-PortsAdminExtendedAttrsTestJSON-313971127-project-admin] 10.222.0.65 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.248672 Oct 17 13:29:17.360366 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1611/3157] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:29:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:17.370069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.371491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.372121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.373573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.373754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:17.374916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:17.375493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.377459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.387737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.390622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.391154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.394298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:17.394961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:17.396163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:17.926214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:17.945441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:17.988132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-801d5263-e773-495b-80ae-39d251b7d6bc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.620497 Oct 17 13:29:17.988785 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1612/3158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:17 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:18.003778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d3bb9c97-b374-4b12-8bee-d7e379697c49 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:18.025282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3bb9c97-b374-4b12-8bee-d7e379697c49 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.025780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3bb9c97-b374-4b12-8bee-d7e379697c49 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.026219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3bb9c97-b374-4b12-8bee-d7e379697c49 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.092694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d3bb9c97-b374-4b12-8bee-d7e379697c49 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:29:18.108709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:18.123032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a10aed28-dc16-4832-bc91-2e2fc9ac03cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.769934 Oct 17 13:29:18.124644 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1547/3159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:17 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:18.150382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3610ff8-c20c-471d-a0ae-c72ab6185173 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fdeb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:18.202686 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d3bb9c97-b374-4b12-8bee-d7e379697c49 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.203092 Oct 17 13:29:18.209043 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1613/3160] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:17 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:18.217375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf6d12cb-01fd-43d6-977d-8f90401bc03a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:18.219206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf6d12cb-01fd-43d6-977d-8f90401bc03a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:18.234999 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3610ff8-c20c-471d-a0ae-c72ab6185173 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 200 len: 1461 microversion: 2.1 time: 0.109038 Oct 17 13:29:18.244147 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1548/3161] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:18 2022] GET /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:18.252461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:18.253389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:18.263968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.264715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.265629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.266533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.267161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.267784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.309328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:18.371310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bf6d12cb-01fd-43d6-977d-8f90401bc03a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:18.379045 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf6d12cb-01fd-43d6-977d-8f90401bc03a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1217 microversion: 2.1 time: 0.168140 Oct 17 13:29:18.383642 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1614/3162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:18 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:18.392646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-32a89f5e-fc86-490d-ba5e-23a9b224eab8 req-af3d711f-25d4-454a-9fa1-e738abb0f5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:18.414738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:18.417443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-32a89f5e-fc86-490d-ba5e-23a9b224eab8 req-af3d711f-25d4-454a-9fa1-e738abb0f5cb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.418791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-32a89f5e-fc86-490d-ba5e-23a9b224eab8 req-af3d711f-25d4-454a-9fa1-e738abb0f5cb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.418791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-32a89f5e-fc86-490d-ba5e-23a9b224eab8 req-af3d711f-25d4-454a-9fa1-e738abb0f5cb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.433179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-32a89f5e-fc86-490d-ba5e-23a9b224eab8 req-af3d711f-25d4-454a-9fa1-e738abb0f5cb service nova] Creating event network-changed:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h1-854121-14 Oct 17 13:29:18.440331 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-32a89f5e-fc86-490d-ba5e-23a9b224eab8 req-af3d711f-25d4-454a-9fa1-e738abb0f5cb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055119 Oct 17 13:29:18.441671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1615/3163] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:18.448752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:18.449742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:18.457050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.457916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.458601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.459525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.460679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.461523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.858701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:18.880951 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12044937-ef53-4cb1-9fe8-cfd63c7d4463 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.633937 Oct 17 13:29:18.884887 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1549/3164] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:18 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:18.898365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:18.901902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:18.921923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.923404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.925566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.926731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:18.928445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:18.928929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:18.929435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:18.937897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9321b069-c4c2-44e6-a7f3-407e2db5cc1e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1667 microversion: 2.1 time: 0.494769 Oct 17 13:29:18.945283 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1616/3165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:18 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1667 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:19.012064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:19.014822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:19.029453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.036088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.044594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.046276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.047003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.047827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.272312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:19.284666 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d64e181a-f9c9-4f3e-84ed-b21f443e50b0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1467 microversion: 2.1 time: 0.397826 Oct 17 13:29:19.286325 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1550/3166] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:18 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1467 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:19.291471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:19.292362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:19.299501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.300331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.301069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.302201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.303048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.303769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.319714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:19.331436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-695d7a8b-b89e-4102-89dd-fd18e9555fd2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.323884 Oct 17 13:29:19.356829 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1617/3167] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:19 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:19.372363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1627756646"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:19.386982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:19.411433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.415156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.418268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.419261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.422547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.425074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.549027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:19.573321 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fffad071-b297-4706-aabe-e64549b76096 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.285304 Oct 17 13:29:19.574895 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1551/3168] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:19 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:19.582224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:19.583157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:19.589801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.590590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.591650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.592688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.593409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.594205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.708750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:19.728368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07420772-7a82-41b8-937e-61fef7c2df37 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1269 microversion: 2.1 time: 0.150715 Oct 17 13:29:19.730339 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1552/3169] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:19 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:19.818630 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49ac5567-7729-48b2-a231-04aa1f0aa42e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "POST /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776/action" status: 202 len: 0 microversion: 2.1 time: 0.453747 Oct 17 13:29:19.819718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1618/3170] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:19 2022] POST /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:29:19.832445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0bd34df-8cbc-4a01-8223-f91849a81f66 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419e6333a0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:19.893175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0bd34df-8cbc-4a01-8223-f91849a81f66 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.065129 Oct 17 13:29:19.894601 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1553/3171] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:19 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:19.910746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:19.911894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:19.932848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.933501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.933834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.934903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.935728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.936163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.974900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:19.975450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:19.984637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.989282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.989760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:19.990529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:19.991011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:19.991705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.377759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:20.394443 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd75da27-9f68-4d70-9705-da4b23368e87 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.488617 Oct 17 13:29:20.396553 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1619/3172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:19 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:20.404203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:20.405082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:20.432637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:20.434303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:20.436622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:20.438295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.439905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:20.443464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08edefcb-6e82-4215-97cf-5f4b49c795e0 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1667 microversion: 2.1 time: 0.473852 Oct 17 13:29:20.445078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:20.445813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.450942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1554/3173] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:19 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1667 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:20.600611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:20.601283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:20.607990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:20.609171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:20.609856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.610791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:20.612304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:20.612970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.709846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:20.721793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f6b95d2-0e6f-43c5-bcf7-fbc49c62d732 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1516 microversion: 2.1 time: 0.323915 Oct 17 13:29:20.723376 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1620/3174] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:20 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:20.756615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:20.757601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:20.764788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:20.765324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:20.765794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.766504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:20.766955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:20.768075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:20.883777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:20.896386 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b63e1f6-8cb5-4b4c-9b63-f31f632c898a tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1269 microversion: 2.1 time: 0.143635 Oct 17 13:29:20.910623 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1621/3175] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:20 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:20.917797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:20.934030 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-feb21f64-4b8b-47c4-a1c3-89b4aea8f70f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.337506 Oct 17 13:29:20.934573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96c08a05-a5a0-4b90-87b3-f2a763533d38 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2046550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:20.935733 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1555/3176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:20 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:21.006106 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96c08a05-a5a0-4b90-87b3-f2a763533d38 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.092195 Oct 17 13:29:21.006823 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1622/3177] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:20 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:21.037311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-22cc08ad-5fe2-4110-9f5b-a098308f157b req-c5582f0e-0008-4578-8863-93ea874b1029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "name": "network-vif-unplugged", "status": "completed", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:21.049095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-22cc08ad-5fe2-4110-9f5b-a098308f157b req-c5582f0e-0008-4578-8863-93ea874b1029 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:21.050352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-22cc08ad-5fe2-4110-9f5b-a098308f157b req-c5582f0e-0008-4578-8863-93ea874b1029 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:21.051092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-22cc08ad-5fe2-4110-9f5b-a098308f157b req-c5582f0e-0008-4578-8863-93ea874b1029 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:21.073371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-22cc08ad-5fe2-4110-9f5b-a098308f157b req-c5582f0e-0008-4578-8863-93ea874b1029 service nova] Creating event network-vif-unplugged:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:29:21.080637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-22cc08ad-5fe2-4110-9f5b-a098308f157b req-c5582f0e-0008-4578-8863-93ea874b1029 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046858 Oct 17 13:29:21.082665 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1556/3178] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:21.422194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:21.423276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:21.432920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:21.434326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:21.434973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:21.435925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:21.436638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:21.437316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:21.476562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:21.478773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:21.494566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:21.498880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:21.504745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:21.506898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:21.507466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:21.509235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.103921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:22.116993 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b8f491f-f32e-40d8-86d2-0c50ed7b1a67 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.698811 Oct 17 13:29:22.118271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1623/3179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:21 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:22.124339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.125709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:22.132972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.133827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.135192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.139892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.150010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.152002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.187999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:22.206140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10654d6b-ae25-42cb-87b6-58309426343d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.730337 Oct 17 13:29:22.211091 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1557/3180] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:21 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:22.225487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.225487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:22.238826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.239365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.239820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.240562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.246454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.246901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.383982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:22.392910 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2e0883a-9077-4af8-9df4-18fa99cc4de6 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1287 microversion: 2.1 time: 0.180182 Oct 17 13:29:22.410171 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1558/3181] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1287 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:22.418601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.419275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:22.428609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.429095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.429749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.430451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.430903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.431329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.514566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:22.521916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b4002d8-f964-4a88-b4d4-9abda8c6175f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1522 microversion: 2.1 time: 0.402323 Oct 17 13:29:22.522496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1624/3182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:22.538223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8971836c-f3d6-4f2d-9df1-0d3ef67ea4ce tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f53310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.620088 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8971836c-f3d6-4f2d-9df1-0d3ef67ea4ce tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.096229 Oct 17 13:29:22.621141 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1625/3183] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:22.627115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.627738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:22.640641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.641146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.641625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.642375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.642829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.643252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.679653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:22.690387 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77da2fc2-e1d0-4475-8842-1a025be8daca tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.276408 Oct 17 13:29:22.691547 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1559/3184] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:22.857115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85057536-5c14-47a6-ad25-eb1b38721231 tempest-ExtensionsTest-2003740468 tempest-ExtensionsTest-2003740468-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.858800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85057536-5c14-47a6-ad25-eb1b38721231 tempest-ExtensionsTest-2003740468 tempest-ExtensionsTest-2003740468-project] 10.222.0.65 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.122745 Oct 17 13:29:22.859348 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1560/3185] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:22.869219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96593a1f-545b-41a7-844b-4ea96170ad31 tempest-ExtensionsTest-2003740468 tempest-ExtensionsTest-2003740468-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.871332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96593a1f-545b-41a7-844b-4ea96170ad31 tempest-ExtensionsTest-2003740468 tempest-ExtensionsTest-2003740468-project] 10.222.0.65 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006076 Oct 17 13:29:22.871950 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1561/3186] 10.222.0.65 () {58 vars in 1134 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:29:22.887204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:22.897680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82a0fe9e-6bad-433c-8a1d-3a971669180a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.274977 Oct 17 13:29:22.899223 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1626/3187] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:22.923102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:22.924222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:22.931087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.931893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.932503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:22.933253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:22.933713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:22.934142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.128048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:23.136648 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f5a1ce0-a127-4f97-baa8-8e1920784d58 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.217518 Oct 17 13:29:23.141933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:23.143248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:23.150176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.150665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.151104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.151806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.152257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.152681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.157447 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1562/3188] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:22 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:23.180828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:23.181840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:23.188270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.188767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.189276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.190546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.191313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.191744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.495474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:23.511666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e11cc221-78fc-4228-a8b2-c6bffc700bb2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.372182 Oct 17 13:29:23.513366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:23.525838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27132022-51b5-4e94-83d6-7ac86289729d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.349244 Oct 17 13:29:23.526960 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1563/3189] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:23 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:23.527822 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1627/3190] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:23 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:23.533660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:23.538140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:23.544855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.545600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.546203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.547113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.547749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.548340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.550096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:23.550822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:23.563741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.564923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.566039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.566997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.567625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.568278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.708114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:23.722174 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d584af68-bb81-41e3-99a0-8877b50278bb tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1275 microversion: 2.1 time: 0.192098 Oct 17 13:29:23.725129 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1564/3191] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:23 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:23.735044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-528b75e8-3838-41b1-be97-c0987369930b req-e1bf08d8-ba90-47f5-a38d-b9c449d2ca63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "name": "network-vif-plugged", "status": "completed", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:23.759673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-528b75e8-3838-41b1-be97-c0987369930b req-e1bf08d8-ba90-47f5-a38d-b9c449d2ca63 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.761539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-528b75e8-3838-41b1-be97-c0987369930b req-e1bf08d8-ba90-47f5-a38d-b9c449d2ca63 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.762177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-528b75e8-3838-41b1-be97-c0987369930b req-e1bf08d8-ba90-47f5-a38d-b9c449d2ca63 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.793228 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-528b75e8-3838-41b1-be97-c0987369930b req-e1bf08d8-ba90-47f5-a38d-b9c449d2ca63 service nova] Creating event network-vif-plugged:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h1-854121-14 Oct 17 13:29:23.806189 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-528b75e8-3838-41b1-be97-c0987369930b req-e1bf08d8-ba90-47f5-a38d-b9c449d2ca63 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078204 Oct 17 13:29:23.810875 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1565/3192] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:23.827551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:23.831388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:23.850407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.851185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.851854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.852856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:23.854479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:23.854999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:23.925658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:23.939888 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ad5c5dc-b86b-4143-8206-4be9dabd8456 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1522 microversion: 2.1 time: 0.396688 Oct 17 13:29:23.943636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1628/3193] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:23 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:23.950077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c23097d-cf69-4262-926e-2c846f1e81c3 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2046ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:24.027409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c23097d-cf69-4262-926e-2c846f1e81c3 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.082530 Oct 17 13:29:24.028089 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1629/3194] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:23 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:24.042375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:24.042995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:24.050063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.050778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.051366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.052220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.052847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.053294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.230097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:24.239919 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17dcea09-2873-4a78-845b-284c1b668b14 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.426505 Oct 17 13:29:24.240896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1566/3195] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:23 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:24.264143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:24.264692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:24.277333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.277832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.278716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.280046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.280614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.281285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.293098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:24.307754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lazy-loading 'flavor' on Instance uuid c6846508-cc19-42bb-b770-e04bb565f35b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:29:24.310067 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-933fdb1d-a766-4149-aa3c-c19406973e28 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.271471 Oct 17 13:29:24.311279 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1630/3196] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:24 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:24.422036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-891fbdfc-a2b3-42ca-a316-c86d405da464 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.161788 Oct 17 13:29:24.423389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1567/3197] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:24 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:24.431565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:24.432609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:24.445023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.446051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.446697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.447655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.448207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.448623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.550301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:24.552208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:24.563690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.565132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.566572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.567488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.568118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.568723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.598821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:24.690633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:24.691658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:24.699170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64b79e4e-f6e2-45fa-8f53-5609fb931129 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1679 microversion: 2.1 time: 0.271889 Oct 17 13:29:24.700400 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1631/3198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:24 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:24.755570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:24.757497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:24.772513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.777237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.777954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.779023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:24.780158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:24.781017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:24.990369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:24.999178 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5206210b-1f7e-4d0f-9994-a3625b0ac66d tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.455807 Oct 17 13:29:25.000321 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1568/3199] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:24 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:25.006986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:25.007877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:25.015571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:25.016284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:25.016979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:25.017957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:25.018419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:25.018839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:25.089752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:25.104698 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d011e16-abb3-4681-864a-a5a31955e852 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1317 microversion: 2.1 time: 0.355511 Oct 17 13:29:25.124649 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1632/3200] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:24 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:25.131975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81b5b354-1e47-4c0f-b454-6ff7cc93a3c0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fac5e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:25.199009 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-81b5b354-1e47-4c0f-b454-6ff7cc93a3c0 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.072554 Oct 17 13:29:25.199831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1633/3201] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:25 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:25.269238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:25.294739 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6aea5786-eb0f-4eb2-af5c-acb47f841dea tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1522 microversion: 2.1 time: 0.292337 Oct 17 13:29:25.295336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1569/3202] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:25 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:25.338522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:25.339132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:25.348521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:25.349040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:25.350824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:25.353381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:25.353870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:25.354466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:25.727699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:25.728939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:25.745245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:25.746371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:25.746995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:25.748065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:25.748810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:25.749496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:25.872165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:25.887263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11b64a96-052a-4fec-a902-5f50220dac15 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1378 microversion: 2.1 time: 0.552724 Oct 17 13:29:25.887866 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1634/3203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:25 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1378 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:26.012216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e4ab494c-9a0a-4c42-8d3c-a2c05ad90799 req-78a9f464-1ce2-4837-98e6-6edc2cdc40b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb93367-f14d-409d-8d88-134889651af4", "name": "network-vif-unplugged", "status": "completed", "tag": "532af776-8b88-4fd1-898b-dac5a280e3bd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:26.061980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e4ab494c-9a0a-4c42-8d3c-a2c05ad90799 req-78a9f464-1ce2-4837-98e6-6edc2cdc40b9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.064517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e4ab494c-9a0a-4c42-8d3c-a2c05ad90799 req-78a9f464-1ce2-4837-98e6-6edc2cdc40b9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.067398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e4ab494c-9a0a-4c42-8d3c-a2c05ad90799 req-78a9f464-1ce2-4837-98e6-6edc2cdc40b9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.114699 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e4ab494c-9a0a-4c42-8d3c-a2c05ad90799 req-78a9f464-1ce2-4837-98e6-6edc2cdc40b9 service nova] Creating event network-vif-unplugged:532af776-8b88-4fd1-898b-dac5a280e3bd for instance 7bb93367-f14d-409d-8d88-134889651af4 on n-h1-854121-14 Oct 17 13:29:26.121957 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e4ab494c-9a0a-4c42-8d3c-a2c05ad90799 req-78a9f464-1ce2-4837-98e6-6edc2cdc40b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119099 Oct 17 13:29:26.123439 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1635/3204] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:26.136992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:26.138146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:26.148052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.148963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.149747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.151285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.152806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.153597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.181764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:26.194924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-521acad8-46e7-4318-afd7-ca740f8bed44 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1662 microversion: 2.1 time: 0.470887 Oct 17 13:29:26.195949 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1570/3205] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:25 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1662 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:26.201755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:26.202646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:26.234166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.235188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.236459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.237655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.238975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.239827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.577198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:26.586612 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7bc7501-5891-4d4e-bac0-a9693f071730 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1317 microversion: 2.1 time: 0.388817 Oct 17 13:29:26.591643 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1571/3206] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:26 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:26.597007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dc4152d4-bf1f-418d-9ea3-8199656bcd34 req-7fca3862-414a-44d2-9064-becd3566fbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc7e13b-6cd5-4858-aff6-6f2cb0817921", "tag": "45b5f53a-d08e-425b-8a12-96d7c1b86adf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:26.632266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dc4152d4-bf1f-418d-9ea3-8199656bcd34 req-7fca3862-414a-44d2-9064-becd3566fbe5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.632854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dc4152d4-bf1f-418d-9ea3-8199656bcd34 req-7fca3862-414a-44d2-9064-becd3566fbe5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.633333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dc4152d4-bf1f-418d-9ea3-8199656bcd34 req-7fca3862-414a-44d2-9064-becd3566fbe5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.658577 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dc4152d4-bf1f-418d-9ea3-8199656bcd34 req-7fca3862-414a-44d2-9064-becd3566fbe5 service nova] Creating event network-changed:45b5f53a-d08e-425b-8a12-96d7c1b86adf for instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 on n-h1-854121-14 Oct 17 13:29:26.670983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dc4152d4-bf1f-418d-9ea3-8199656bcd34 req-7fca3862-414a-44d2-9064-becd3566fbe5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078009 Oct 17 13:29:26.675494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1572/3207] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:26.680949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4f8a3c00-330d-4c0d-91fb-62960cf3be45 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fdeb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:26.734588 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4f8a3c00-330d-4c0d-91fb-62960cf3be45 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.056661 Oct 17 13:29:26.735424 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1573/3208] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:26 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:26.743344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:26.744076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:26.747328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:26.750613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.751096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.751560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.752478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.753132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.753757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.757218 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d7624b0-c4de-43eb-a5f5-baa89a593ba2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 0.632331 Oct 17 13:29:26.757821 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1636/3209] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:26 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:26.768700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:26.780041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:26.790349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.790855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.791293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.792002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.792453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.792879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.845686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d434d818-5323-4a90-ab45-097ebfc09957 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action" status: 202 len: 0 microversion: 2.1 time: 0.107322 Oct 17 13:29:26.846619 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1574/3210] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:26 2022] POST /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:26.876059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:26.877123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:26.885106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.885989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.887242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:26.888245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:26.888868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:26.889520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:27.203450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:27.267968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:27.442509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:27.450513 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23dfe7a2-82d0-43de-b80a-43dde3e87cc3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1522 microversion: 2.1 time: 0.686130 Oct 17 13:29:27.460827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:27.467304 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1637/3211] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:26 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:27.505472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-878a5d93-1841-44e1-904c-8b38dae7b552 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1668 microversion: 2.1 time: 0.640106 Oct 17 13:29:27.511324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:27.512913 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1575/3212] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:26 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1668 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:27.516360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:27.528548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:27.530773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:27.536163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:27.537267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:27.537938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:27.538559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:27.611892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:27.612511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:27.626483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:27.627098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:27.627760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:27.628677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:27.632110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:27.632883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:27.994497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:28.008002 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57cddb9f-5847-472b-b6f1-9b38b143b7d8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1528 microversion: 2.1 time: 0.504138 Oct 17 13:29:28.035399 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1638/3213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:27 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:28.043353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-758508c1-103f-453e-a8a2-2e16a3b1cb50 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf72dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:28.144314 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-758508c1-103f-453e-a8a2-2e16a3b1cb50 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.104997 Oct 17 13:29:28.145692 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1639/3214] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:28 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:28.171188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:28.175088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:28.206946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.212670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.213753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:28.217891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.218123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:28.220565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.224020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:28.230259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de23b01e-fc5c-46d6-80da-7b5d69f36037 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1317 microversion: 2.1 time: 0.622269 Oct 17 13:29:28.230877 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1576/3215] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:27 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1317 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:28.247927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:28.249320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:28.268149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.269033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.270365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:28.275882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.276805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.277554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:28.417529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:28.855012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:28.871385 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-097285a8-fb88-409f-a36c-0fc085e0156a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1528 microversion: 2.1 time: 0.635387 Oct 17 13:29:28.872660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1577/3216] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:28 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1528 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:28.887983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7d10e294-3771-4e94-b22b-25fba1cc8ef5 req-572a5b58-1967-4044-ad78-61bc2ff23c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be2a371-cdcd-4928-a92a-7c4b5118d776", "name": "network-vif-plugged", "status": "completed", "tag": "57cc1827-dab3-48ea-9688-e790d4b193e9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:28.915640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7d10e294-3771-4e94-b22b-25fba1cc8ef5 req-572a5b58-1967-4044-ad78-61bc2ff23c6a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.916176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7d10e294-3771-4e94-b22b-25fba1cc8ef5 req-572a5b58-1967-4044-ad78-61bc2ff23c6a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.916570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7d10e294-3771-4e94-b22b-25fba1cc8ef5 req-572a5b58-1967-4044-ad78-61bc2ff23c6a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:28.940980 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7d10e294-3771-4e94-b22b-25fba1cc8ef5 req-572a5b58-1967-4044-ad78-61bc2ff23c6a service nova] Creating event network-vif-plugged:57cc1827-dab3-48ea-9688-e790d4b193e9 for instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 on n-h1-854121-14 Oct 17 13:29:28.959087 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7d10e294-3771-4e94-b22b-25fba1cc8ef5 req-572a5b58-1967-4044-ad78-61bc2ff23c6a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084674 Oct 17 13:29:28.959709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1578/3217] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:28.965207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:28.973305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:28.986881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.990024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.990492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:28.991253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:28.991976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:28.992417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:29.164368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:29.180509 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d3be1960-dffe-4bf7-b640-1a7c8bbaae96 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1471 microversion: 2.1 time: 1.032252 Oct 17 13:29:29.182670 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1640/3218] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:28 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1471 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:29.216673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:29.218589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:29.229710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:29.230628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:29.231932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:29.233588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:29.234281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:29.234959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:29.572994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:29.622158 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af6e1aa5-ec25-462a-9a40-7a7c639a8e69 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1522 microversion: 2.1 time: 0.660956 Oct 17 13:29:29.651650 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1579/3219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:28 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:29.659978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6c51932-d392-4561-932f-ffb3197c5199 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:29.703392 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6c51932-d392-4561-932f-ffb3197c5199 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/ab6df50d-4a54-4457-bb8c-ff5103aa650d" status: 202 len: 0 microversion: 2.1 time: 0.050208 Oct 17 13:29:29.704632 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1580/3220] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:29 2022] DELETE /compute/v2.1/flavors/ab6df50d-4a54-4457-bb8c-ff5103aa650d => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:29.709919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99dff5e1-44ab-4925-b4ab-2a5f57c35d0f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2104820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:29.794256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99dff5e1-44ab-4925-b4ab-2a5f57c35d0f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.088279 Oct 17 13:29:29.795892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1581/3221] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:29 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:29.801926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:29.803859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:29.818299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:29.819313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:29.819990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:29.821245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:29.822078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:29.822780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.034920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:30.054501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b32b9ee-017e-4465-8f38-cf27fb065580 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1668 microversion: 2.1 time: 0.855602 Oct 17 13:29:30.055214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1641/3222] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:29 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1668 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:30.075056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-950b53e9-22bd-433a-ad42-7f8f29d2a8dc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:30.100996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-950b53e9-22bd-433a-ad42-7f8f29d2a8dc tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044011 Oct 17 13:29:30.118976 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1642/3223] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 13:29:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:30.125277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:30.128577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:30.136154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:30.136844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:30.138663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.139876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:30.140525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:30.140962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.176039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:30.182185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Old instance type tempest-test_resize_flavor_-75799687, new instance type m1.heat {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:29:30.190231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:29:30.191042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:29:30.191693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:29:30.192309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:29:30.192948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:29:30.197937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:30.287908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c220f716-7496-487f-a84d-8406ca146aad tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0/action" status: 202 len: 0 microversion: 2.1 time: 0.166896 Oct 17 13:29:30.289566 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1643/3224] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:30 2022] POST /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:30.299448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:30.300487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:30.301671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:30.316854 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0bb6ec1c-1093-4fb2-9ca1-90982d1f7d5e tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1317 microversion: 2.1 time: 0.519575 Oct 17 13:29:30.320909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:30.323351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:30.326008 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1582/3225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:29 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:30.328213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.329360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:30.331746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:30.332148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:30.332642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.335270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:30.362701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:30.365823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:30.366455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.377712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:30.378389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:30.378954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:30.954248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:30.970260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0bc6d9d-b49e-4ad2-ad91-6d403bb7cd48 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1477 microversion: 2.1 time: 0.675074 Oct 17 13:29:30.974753 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1644/3226] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:30 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1477 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:30.996909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:30.997815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:31.015632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.019268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.020843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:31.022610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.023278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.023875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:31.039458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:31.048566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69441f86-752d-4642-a610-ae2672773950 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1537 microversion: 2.1 time: 0.721244 Oct 17 13:29:31.055117 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1583/3227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:30 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1537 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:31.060395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-287a4a13-7651-42b5-8aa3-ac031f6d4bc7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a210c1f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:31.179145 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-287a4a13-7651-42b5-8aa3-ac031f6d4bc7 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.122357 Oct 17 13:29:31.180345 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1584/3228] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:31 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:31.191977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-de0da066-863d-4f57-827b-b7ed0c1eee06 req-916f4520-8ae2-48f4-9f8e-13cd2f69b48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb93367-f14d-409d-8d88-134889651af4", "name": "network-vif-plugged", "status": "completed", "tag": "532af776-8b88-4fd1-898b-dac5a280e3bd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:31.219161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de0da066-863d-4f57-827b-b7ed0c1eee06 req-916f4520-8ae2-48f4-9f8e-13cd2f69b48a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.219831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de0da066-863d-4f57-827b-b7ed0c1eee06 req-916f4520-8ae2-48f4-9f8e-13cd2f69b48a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.221742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de0da066-863d-4f57-827b-b7ed0c1eee06 req-916f4520-8ae2-48f4-9f8e-13cd2f69b48a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:31.248140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-de0da066-863d-4f57-827b-b7ed0c1eee06 req-916f4520-8ae2-48f4-9f8e-13cd2f69b48a service nova] Creating event network-vif-plugged:532af776-8b88-4fd1-898b-dac5a280e3bd for instance 7bb93367-f14d-409d-8d88-134889651af4 on n-h1-854121-14 Oct 17 13:29:31.261376 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-de0da066-863d-4f57-827b-b7ed0c1eee06 req-916f4520-8ae2-48f4-9f8e-13cd2f69b48a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079375 Oct 17 13:29:31.264779 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1585/3229] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:31.286406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:31.287136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:31.316645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.316973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.321605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:31.322726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.325712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.326344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:31.655201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:31.672877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f3d312b-0589-4f2b-8442-399adf4b2bfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1522 microversion: 2.1 time: 0.694865 Oct 17 13:29:31.674482 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1645/3230] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:30 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:31.680166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:31.681904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:31.692121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.692620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.693062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:31.693984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:31.694453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:31.694877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:32.587054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:32.596325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:32.602032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7a18c2e-2f7a-41f6-9fbd-0f56dd3ff66d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 1.333717 Oct 17 13:29:32.604051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1586/3231] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:31 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:32.616874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e6a1958-9f8e-41e3-b3b4-7c6457e74f12 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1317 microversion: 2.1 time: 0.940655 Oct 17 13:29:32.621373 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1646/3232] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:31 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:32.630631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:32.635604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:32.650672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:32.651365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:32.651767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:32.652293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:32.652733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:32.653479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:32.653935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:32.654362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:32.672114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:32.672606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:32.673037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:32.673812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:32.674356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:32.674786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:33.163048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:33.173624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dbfcfd39-ef85-4b2e-8e48-c9443d1dc49f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1537 microversion: 2.1 time: 0.550544 Oct 17 13:29:33.175250 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1647/3233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:32 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1537 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:33.182076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2f5bce0-ffd5-410a-8b6b-fbb33f0251f9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf34430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:33.297631 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2f5bce0-ffd5-410a-8b6b-fbb33f0251f9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.118513 Oct 17 13:29:33.304100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:33.314667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1648/3234] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:33 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:33.324869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:33.326147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cdef48f-534f-4102-808d-4e46407b4250 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1477 microversion: 2.1 time: 0.720443 Oct 17 13:29:33.327199 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1587/3235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:32 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1477 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:33.333225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:33.340470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:33.344664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:33.346774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:33.351511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:33.354523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:33.355671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:33.356877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:33.359452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:33.363783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:33.364747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:33.365505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:33.367436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:33.368486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:33.371727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:33.920102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:33.929918 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed835576-e756-440f-9bac-31cd23c0c24f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1671 microversion: 2.1 time: 0.613265 Oct 17 13:29:33.934755 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1649/3236] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:33 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1671 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:33.948465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc7e13b-6cd5-4858-aff6-6f2cb0817921", "name": "network-vif-plugged", "status": "completed", "tag": "45b5f53a-d08e-425b-8a12-96d7c1b86adf"}, {"server_uuid": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14", "name": "network-vif-unplugged", "status": "completed", "tag": "3374708b-a678-4a47-97db-e0a22f1abd74"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:33.982831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:33.983718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:33.984167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.001069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:34.022537 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3eb5220-4ed9-43ae-9199-7fdd991c4014 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1507 microversion: 2.1 time: 0.693899 Oct 17 13:29:34.041328 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1588/3237] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:33 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1507 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:34.046593 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] Creating event network-vif-plugged:45b5f53a-d08e-425b-8a12-96d7c1b86adf for instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 on n-h1-854121-14 Oct 17 13:29:34.054015 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] Creating event network-vif-unplugged:3374708b-a678-4a47-97db-e0a22f1abd74 for instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 on n-h1-854121-14 Oct 17 13:29:34.060558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:34.061621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:34.071949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-38b1841d-f057-4f90-89df-1e35626d2104 req-8e8c6337-5ba2-4687-b892-0ff40cbd6772 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.135031 Oct 17 13:29:34.073515 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1650/3238] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:34.081448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:34.082591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:34.083271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.084818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:34.085265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:34.085900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:34.086437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:34.087096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.098231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:34.098734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:34.099172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.106301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:34.106849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:34.107316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.171383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:34.194672 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.compute.api [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Working on deleting snapshot 39e620a9-53e8-48ad-a914-ac3ba575d735 from shelved instance... Oct 17 13:29:34.586374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:34.601134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad82ffee-998c-4e54-a682-460087ad2298 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1317 microversion: 2.1 time: 0.557247 Oct 17 13:29:34.620957 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1589/3239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:34 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:34.636318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:34.638289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:34.647755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:34.648472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:34.649124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.650054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:34.650697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:34.651322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:34.656766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:35.030673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:35.046797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ffe596f1-d7dd-4607-a9a6-a0aacd22b2be tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 200 len: 1507 microversion: 2.1 time: 0.423329 Oct 17 13:29:35.048681 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1590/3240] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:34 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:35.069430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:35.070449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:35.090826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:35.091599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:35.094173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:35.097645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:35.099132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:35.101832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:35.482024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:35.502528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f197c10d-ca50-41d1-a61a-f3672e8af732 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1537 microversion: 2.1 time: 0.446570 Oct 17 13:29:35.504407 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1591/3241] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:35 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1537 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:35.525820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1710b1b-1f68-43a8-b78b-55bcc56d7244 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2104550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:35.734595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:35.758795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1710b1b-1f68-43a8-b78b-55bcc56d7244 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.250783 Oct 17 13:29:35.761735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1592/3242] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:35 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:35.774310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:35.777215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:35.789722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Doing local delete in cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=120698) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 13:29:35.792160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:35.793947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:35.794614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:35.795045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:35.796526 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.compute.api [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 13:29:35.800497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:35.801293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:35.801924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:35.803494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:35.806422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:35.807312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] deallocate_for_instance() {{(pid=120698) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 13:29:35.807764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:36.268597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:36.280125 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9a3dd1e-1b8a-40f1-9176-3de35140e1dd tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1477 microversion: 2.1 time: 0.517060 Oct 17 13:29:36.284083 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1593/3243] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:35 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1477 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:36.296149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:36.299107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:36.310446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:36.315070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:36.315880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:36.316812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:36.319547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:36.324128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:36.392582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:36.599378 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebaf5e64-41e3-4890-85a3-4eb305e07d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 204 len: 0 microversion: 2.1 time: 0.310884 Oct 17 13:29:36.609201 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1594/3244] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:36 2022] DELETE /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:36.627241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:36.629452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:36.646416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:36.646932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:36.647390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:36.650254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:36.650788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:36.651243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:36.929501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:36.938158 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a84b965-2bdb-4032-9c45-53d919b6ad14 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1506 microversion: 2.1 time: 0.326637 Oct 17 13:29:36.941257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1595/3245] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:36 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:36.953816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:36.961567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:36.979129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:36.981473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:36.981948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:36.982684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:36.983150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:36.983574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:37.338659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:37.355264 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-040e2d53-10c4-41d6-a6d3-ba3d094a7cb9 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.412624 Oct 17 13:29:37.356946 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1596/3246] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:36 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:37.382381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5e26b96a-b95d-42a8-920f-09d2c6236b58 req-e943fbf8-88bc-4d34-afe0-36ec4dd11268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14", "name": "network-vif-plugged", "status": "completed", "tag": "3374708b-a678-4a47-97db-e0a22f1abd74"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:37.409943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5e26b96a-b95d-42a8-920f-09d2c6236b58 req-e943fbf8-88bc-4d34-afe0-36ec4dd11268 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:37.410500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5e26b96a-b95d-42a8-920f-09d2c6236b58 req-e943fbf8-88bc-4d34-afe0-36ec4dd11268 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:37.412930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5e26b96a-b95d-42a8-920f-09d2c6236b58 req-e943fbf8-88bc-4d34-afe0-36ec4dd11268 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:37.465215 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5e26b96a-b95d-42a8-920f-09d2c6236b58 req-e943fbf8-88bc-4d34-afe0-36ec4dd11268 service nova] Creating event network-vif-plugged:3374708b-a678-4a47-97db-e0a22f1abd74 for instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 on n-h1-854121-14 Oct 17 13:29:37.479399 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5e26b96a-b95d-42a8-920f-09d2c6236b58 req-e943fbf8-88bc-4d34-afe0-36ec4dd11268 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107567 Oct 17 13:29:37.484503 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1597/3247] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:37.498544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3840addc-48ec-4082-8bbb-bffce4ff795f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f7d820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:37.596684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3840addc-48ec-4082-8bbb-bffce4ff795f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.110443 Oct 17 13:29:37.597268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1598/3248] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:37 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:37.623155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1943476621", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "99a30118-d7c2-4414-85aa-d0c48dec24c1"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:37.625358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Updating instance_info_cache with network_info: [] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:29:37.748243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] validate_networks() for [('99a30118-d7c2-4414-85aa-d0c48dec24c1', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:29:38.261907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd33eb53-dff4-4b5c-b027-832ba7adc29e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 204 len: 0 microversion: 2.1 time: 4.187232 Oct 17 13:29:38.262542 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1651/3249] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:34 2022] DELETE /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 0 bytes in 4189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:38.275179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:38.277831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:38.293328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:38.296663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:38.297734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:38.302590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:38.303941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:38.304542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:38.401231 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69a0a573-425f-49fd-80ee-6d45f2d4a4ff tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921/ips" status: 200 len: 109 microversion: 2.1 time: 0.135103 Oct 17 13:29:38.409953 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1652/3250] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:29:38 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921/ips => generated 109 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:38.431945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:38.440878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:38.458659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:38.459005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:38.459439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:38.463912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:38.465836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:38.474268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:38.843498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:38.867085 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0243bcde-af65-4e44-b531-85161267f0a1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1477 microversion: 2.1 time: 0.453971 Oct 17 13:29:38.874337 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1653/3251] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:38 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1477 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:38.898707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-bf9cbc2a-02d5-4959-a549-b8b9fcf065d4 req-8a24aacd-011e-4a02-a0a3-9a0e1fb88dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd121492-3e2e-40dd-b7c7-8b8e27ab5934", "name": "network-vif-deleted", "tag": "487c0c4e-7889-42d2-9c9e-beff8e7a65dd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:38.927064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bf9cbc2a-02d5-4959-a549-b8b9fcf065d4 req-8a24aacd-011e-4a02-a0a3-9a0e1fb88dc2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:38.928097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bf9cbc2a-02d5-4959-a549-b8b9fcf065d4 req-8a24aacd-011e-4a02-a0a3-9a0e1fb88dc2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:38.929539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bf9cbc2a-02d5-4959-a549-b8b9fcf065d4 req-8a24aacd-011e-4a02-a0a3-9a0e1fb88dc2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:38.975180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.server_external_events [req-bf9cbc2a-02d5-4959-a549-b8b9fcf065d4 req-8a24aacd-011e-4a02-a0a3-9a0e1fb88dc2 service nova] Unable to find a host for instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934. Dropping event network-vif-deleted {{(pid=120698) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:29:38.977297 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-bf9cbc2a-02d5-4959-a549-b8b9fcf065d4 req-8a24aacd-011e-4a02-a0a3-9a0e1fb88dc2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.101043 Oct 17 13:29:38.978267 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1654/3252] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 103 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:29:38.986145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:38.987516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: bd121492-3e2e-40dd-b7c7-8b8e27ab5934] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:38.996880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:38.998262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:38.998935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.000005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.000623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.002107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.037666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] HTTP exception thrown: Instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 could not be found. Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Request method failure captured: Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 HTTP/1.1 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXrXOq1J8GlTQWot-zAG3WlRWt-QdhKUznWYj0YFe614sXohh7tqN32E9k2SZUeu6BhKCRkVm1AefILJCKP8kJFxL8S-j92iLTPCugVISVd78CkJiNf2tsIFecAhZasPSBaWXgvE_xfzQlsyjsd3WurSHhdYF9YhkGfOjgcKJ6tUzY Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6ad84e1798394f69a409af3c96b6752c Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 could not be found. Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'bd121492-3e2e-40dd-b7c7-8b8e27ab5934'} Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 could not be found. Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 could not be found. Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:39.039685 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 could not be found. Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Returning 404 to user: Instance bd121492-3e2e-40dd-b7c7-8b8e27ab5934 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:29:39.045780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38d802c1-e535-4cc8-afcf-11930bd3a9c2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934" status: 404 len: 111 microversion: 2.1 time: 0.061978 Oct 17 13:29:39.046620 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1655/3253] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:38 2022] GET /compute/v2.1/servers/bd121492-3e2e-40dd-b7c7-8b8e27ab5934 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:29:39.051665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:39.052268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:39.055546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:29:39.056066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:29:39.056442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:29:39.057189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:29:39.058740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:29:39.059125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.059620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.060051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.060892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.061511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.062094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.087000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.087546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.088173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.089112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.089661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.090617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.178046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Getting quotas for project bf8d2529de0a43119965e8ededb97bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:29:39.209565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Getting quotas for user 17f16d27aa024ca091d45cbac8c00cbf and project bf8d2529de0a43119965e8ededb97bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:29:39.230135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:29:39.232911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:29:39.364902 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-116a1072-27a5-4301-a853-c6757d6f64b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757505 Oct 17 13:29:39.365992 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1599/3254] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:29:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:29:39.371716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:39.372741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:39.384598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.385403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.386047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.387917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.393476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.394218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.435062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a147b6ce-c7dc-4e2c-9f53-3bbfd23b4545 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921/ips" status: 200 len: 109 microversion: 2.1 time: 0.067397 Oct 17 13:29:39.435942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1600/3255] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:29:39 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921/ips => generated 109 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:39.451238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a9d1908-928a-420b-83b3-85fc6b3253fa tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f67700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:39.453215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:39.484805 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2dd632f6-c244-4da5-bfc3-675dfa50d95d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.437520 Oct 17 13:29:39.507453 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1656/3256] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:39 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:39.572708 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a9d1908-928a-420b-83b3-85fc6b3253fa tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.132031 Oct 17 13:29:39.581688 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1601/3257] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:39 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:39.588728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:39.589431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:39.601907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.602650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.603788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.604893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:39.606074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:39.618762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:39.717423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:39.963310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fd1d97f-cc2c-4e0e-a127-7dc7295ca797 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'create', calling method: .version_select at 0x7f419cf5e1f0>, body: {"keypair": {"name": "tempest-keypair-1692010821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7PzMqlwtkzYumjqYkxodDW+zyNbboHMktn3aANMr2C+yR17p4CJJvfhbaQ3KtzzW8u8WjIXlzJEFF1nr2lzCctsgGnQ2xZ+Oqs1F7NatjDuvcoPJGfAfgcegGWUooQuQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:40.014976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1fd1d97f-cc2c-4e0e-a127-7dc7295ca797 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for project f1c551f3219d4f78a100f1c60213c87a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:29:40.032655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1fd1d97f-cc2c-4e0e-a127-7dc7295ca797 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for user fa21bb7cfd2244a3ba5f0d3bdc41e437 and project f1c551f3219d4f78a100f1c60213c87a. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:29:40.040614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9cacfd7-083a-4cfe-9a23-fc82dba82b68 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 204 len: 0 microversion: 2.1 time: 0.455008 Oct 17 13:29:40.046130 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1602/3258] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:39 2022] DELETE /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:40.063009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-129c9a3b-c4a8-4b0c-aeb7-2596a35ae039 req-2f5bfb40-8773-471e-9d02-cb889883cf01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bb93367-f14d-409d-8d88-134889651af4", "name": "network-vif-deleted", "tag": "532af776-8b88-4fd1-898b-dac5a280e3bd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:40.085424 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fd1d97f-cc2c-4e0e-a127-7dc7295ca797 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.584971 Oct 17 13:29:40.086538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1657/3259] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:29:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 589 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:29:40.092202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0ccd979-401c-4a89-b9e3-3b9a296f2b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:40.105329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-129c9a3b-c4a8-4b0c-aeb7-2596a35ae039 req-2f5bfb40-8773-471e-9d02-cb889883cf01 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.111850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-129c9a3b-c4a8-4b0c-aeb7-2596a35ae039 req-2f5bfb40-8773-471e-9d02-cb889883cf01 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.112675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-129c9a3b-c4a8-4b0c-aeb7-2596a35ae039 req-2f5bfb40-8773-471e-9d02-cb889883cf01 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.123276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0ccd979-401c-4a89-b9e3-3b9a296f2b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:40.164930 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-129c9a3b-c4a8-4b0c-aeb7-2596a35ae039 req-2f5bfb40-8773-471e-9d02-cb889883cf01 service nova] Creating event network-vif-deleted:532af776-8b88-4fd1-898b-dac5a280e3bd for instance 7bb93367-f14d-409d-8d88-134889651af4 on n-h1-854121-14 Oct 17 13:29:40.196335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-129c9a3b-c4a8-4b0c-aeb7-2596a35ae039 req-2f5bfb40-8773-471e-9d02-cb889883cf01 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147670 Oct 17 13:29:40.197753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1603/3260] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:40.221768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:40.223701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:40.240585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.241489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.242379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.243261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.244092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.245834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.328911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e209627-5e5c-4a48-9bf4-5d789540afb9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921/ips/tempest-ServerAddressesTestJSON-300233796-network" status: 200 len: 94 microversion: 2.1 time: 0.129653 Oct 17 13:29:40.335246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1604/3261] 10.222.0.65 () {58 vars in 1398 bytes} [Mon Oct 17 13:29:40 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921/ips/tempest-ServerAddressesTestJSON-300233796-network => generated 94 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:29:40.360432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0ccd979-401c-4a89-b9e3-3b9a296f2b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:40.368892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:40.370058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:40.374774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0ccd979-401c-4a89-b9e3-3b9a296f2b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1218 microversion: 2.1 time: 0.286672 Oct 17 13:29:40.393559 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1658/3262] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:40 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1218 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:40.400000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.404308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.404839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.407851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.408390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.413947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.420503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:40.422793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:40.444592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.447672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.449686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.453801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.454492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.455232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.647582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:40.670245 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c65b361-7ed2-4d11-be50-96151a69e50b tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1467 microversion: 2.1 time: 0.271177 Oct 17 13:29:40.673789 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1659/3263] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:40 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1467 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:40.678720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:40.690314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:40.708438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.711446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.712128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.715942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:40.717854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:40.718929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:40.864119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:41.081229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:41.091291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1386369-6138-4f25-865c-424077ca5e59 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1462 microversion: 2.1 time: 0.750123 Oct 17 13:29:41.092458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1605/3264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:40 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1462 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:41.098111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:41.099010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:41.105928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.106675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.107270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.108133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.108765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.109419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.126227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aad39163-b94f-4af2-aa0a-539907d704d9 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 204 len: 0 microversion: 2.1 time: 0.450190 Oct 17 13:29:41.141598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1660/3265] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:40 2022] DELETE /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:41.161873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5327b09-ca2a-4962-923c-aea17cce4cdf tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cee9f70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:41.320718 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5327b09-ca2a-4962-923c-aea17cce4cdf tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.173049 Oct 17 13:29:41.322569 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1661/3266] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:41 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:41.333204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:41.338545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:41.368864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.370125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.371773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.375850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.401925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.403615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.550979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:41.566199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c46e0a97-1757-4bf5-85d1-aed22f74a324 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.469990 Oct 17 13:29:41.570248 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1606/3267] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:41 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:41.587171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:41.589004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:41.605073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.618430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.619494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.620982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.623505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.624165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.740262 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-411662de-76c1-4661-a031-2fdb8037731c tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 0 microversion: 2.1 time: 0.415563 Oct 17 13:29:41.744737 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1662/3268] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:41 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:41.772717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:41.778574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:41.797753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.799956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.800409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:41.804084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:41.804577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:41.805021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:42.062134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:42.089470 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f38042b2-b312-4233-991c-3c5eeea11b1e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1214 microversion: 2.1 time: 0.336151 Oct 17 13:29:42.094999 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1663/3269] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:41 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1214 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:42.105379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:42.108242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:42.123193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:42.124072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:42.124719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:42.128091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:42.129706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:42.133695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:42.206273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:42.794151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:42.820476 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-311d7e14-bea3-4345-acce-b0e5eb9e4ab0 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1512 microversion: 2.1 time: 1.249106 Oct 17 13:29:42.833290 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1607/3270] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:41 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1512 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:42.838846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:42.847881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:42.860763 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-009d4064-22a3-4ffb-9cd6-b9084e25108d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1467 microversion: 2.1 time: 0.763937 Oct 17 13:29:42.861895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:42.871340 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1664/3271] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:42 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1467 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:42.894946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73f99977-10ab-4ca9-af5c-58288002ce26 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf68ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:42.906244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:42.906923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:42.914534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:42.918037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:42.918652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:42.921590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:42.994506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73f99977-10ab-4ca9-af5c-58288002ce26 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.103581 Oct 17 13:29:42.999680 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1665/3272] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:42 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:43.005129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:43.014013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:43.058692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:43.061416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:43.062114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:43.068327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:43.068481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:43.069367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:43.070129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:43.070398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:43.070943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lazy-loading 'fault' on Instance uuid ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:29:43.071609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:43.700910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:43.715987 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-248c507f-0adc-4e87-8ba8-bcf7fa0dcbc6 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1598 microversion: 2.1 time: 0.889186 Oct 17 13:29:43.717326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1608/3273] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:42 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1598 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:43.728785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:43.732802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:43.752741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:43.754608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:43.760858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:43.766983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:43.769752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:43.771635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.135001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:44.145354 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05f258aa-7df0-4deb-8d7f-f0782bd8101c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 1.144207 Oct 17 13:29:44.166205 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1666/3274] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:42 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:44.167898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:44.176991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52e11a1d-a971-45e5-99e3-f16c6e7b3f8e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1276 microversion: 2.1 time: 0.455499 Oct 17 13:29:44.177200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:44.184595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:44.184823 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1609/3275] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:43 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:44.191425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:44.197329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:44.202597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:44.212962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:44.214359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.215260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:44.216084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:44.217584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.222895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:44.229421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:44.230837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.231684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:44.232198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:44.232744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.466364 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85dacb5f-4a53-469b-881f-26070457ced4 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action" status: 202 len: 0 microversion: 2.1 time: 0.301111 Oct 17 13:29:44.467502 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1667/3276] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:44 2022] POST /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:29:44.481203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:44.482061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:44.494492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:44.494916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:44.495362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.496079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:44.496540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:44.497504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:44.769775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:44.792975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d78b33fa-4a05-4be4-a72e-6616d6550e21 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 200 len: 1300 microversion: 2.1 time: 0.323467 Oct 17 13:29:44.805500 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1668/3277] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:44 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 1300 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:44.831660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-191328cc-0cdb-41d6-b12e-4feb905e2b7f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf5b9d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:44.966162 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-191328cc-0cdb-41d6-b12e-4feb905e2b7f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.158674 Oct 17 13:29:44.968820 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1669/3278] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:44 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:44.981842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8e672ded-eb9b-4cef-9df5-e266fb3b06ac req-a41abb58-597b-4778-93ce-9f3ad509e54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef51f563-9ccb-4bb4-b6c7-ad2d861ae584", "name": "network-vif-deleted", "tag": "6a3b244c-f18c-414e-8b60-2ce46572ee5d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:45.021578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e672ded-eb9b-4cef-9df5-e266fb3b06ac req-a41abb58-597b-4778-93ce-9f3ad509e54f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.021995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e672ded-eb9b-4cef-9df5-e266fb3b06ac req-a41abb58-597b-4778-93ce-9f3ad509e54f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.024739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e672ded-eb9b-4cef-9df5-e266fb3b06ac req-a41abb58-597b-4778-93ce-9f3ad509e54f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.069080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8e672ded-eb9b-4cef-9df5-e266fb3b06ac req-a41abb58-597b-4778-93ce-9f3ad509e54f service nova] Creating event network-vif-deleted:6a3b244c-f18c-414e-8b60-2ce46572ee5d for instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 on n-h2-854121-14 Oct 17 13:29:45.083137 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8e672ded-eb9b-4cef-9df5-e266fb3b06ac req-a41abb58-597b-4778-93ce-9f3ad509e54f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111194 Oct 17 13:29:45.084269 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1670/3279] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:45.091628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:45.092857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:45.120407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.121621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.123623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.124738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.126946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.128888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.198064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89774ee20d9345ff812c55a37477363a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2cf5720dc3d44ae97ebd94094807c4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:45.211008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34cb5ebc-f231-4b16-be6a-92575d9775e5 tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 200 len: 1512 microversion: 2.1 time: 1.024815 Oct 17 13:29:45.212286 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1610/3280] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:44 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 1512 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:45.224898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:45.225561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:45.253198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.253702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.254353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.255279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.255759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.256176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.853342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:45.868710 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77d8b565-c204-449d-947d-b1fef85a1b39 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.652630 Oct 17 13:29:45.873206 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1611/3281] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:45 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:45.894096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:45.895006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:45.905085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.905933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.906617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.912813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:45.913577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:45.914841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:45.960321 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57807fd4-da97-4371-8fba-91a7b49fa213 tempest-ServersAdminTestJSON-367064469 tempest-ServersAdminTestJSON-367064469-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1615 microversion: 2.1 time: 0.873945 Oct 17 13:29:45.971169 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1671/3282] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:45 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1615 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:45.976924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-250882478", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce425253-e80d-4938-9ad9-d53e5569ddc3"}], "security_groups": [{"name": "tempest-securitygroup--813136119"}], "key_name": "tempest-keypair-1692010821", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:46.184187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:46.195003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-505545ca-94ce-48eb-bfe8-dde03509f66e tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1276 microversion: 2.1 time: 0.319405 Oct 17 13:29:46.198579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1612/3283] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:45 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1276 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:46.210476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:46.212143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: ef51f563-9ccb-4bb4-b6c7-ad2d861ae584] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:46.219022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.228765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.229814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.230764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.231432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.232629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.270795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] HTTP exception thrown: Instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 could not be found. Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Request method failure captured: Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 HTTP/1.1 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVXrXOq1J8GlTQWot-zAG3WlRWt-QdhKUznWYj0YFe614sXohh7tqN32E9k2SZUeu6BhKCRkVm1AefILJCKP8kJFxL8S-j92iLTPCugVISVd78CkJiNf2tsIFecAhZasPSBaWXgvE_xfzQlsyjsd3WurSHhdYF9YhkGfOjgcKJ6tUzY Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 6ad84e1798394f69a409af3c96b6752c Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 could not be found. Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ef51f563-9ccb-4bb4-b6c7-ad2d861ae584'} Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 could not be found. Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 could not be found. Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:46.273107 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 could not be found. Oct 17 13:29:46.278607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.280641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Returning 404 to user: Instance ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:29:46.281984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d852123-056b-461a-bf78-1710418a8730 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584" status: 404 len: 111 microversion: 2.1 time: 0.082257 Oct 17 13:29:46.283783 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1613/3284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:46 2022] GET /compute/v2.1/servers/ef51f563-9ccb-4bb4-b6c7-ad2d861ae584 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:29:46.289051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aac6c07a-d27c-42ee-8bd8-5456649d6c93 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a210c550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:46.319316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] validate_networks() for [('ce425253-e80d-4938-9ad9-d53e5569ddc3', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:29:46.351777 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aac6c07a-d27c-42ee-8bd8-5456649d6c93 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.066798 Oct 17 13:29:46.361149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1614/3285] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:46 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:46.366595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:46.367591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:46.376091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.376865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.377581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.378548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.379170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.379746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.419003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:46.536276 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16919ed7-5d25-42f9-b1f6-9c9b2aa5736a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 204 len: 0 microversion: 2.1 time: 0.172763 Oct 17 13:29:46.537400 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1615/3286] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:46 2022] DELETE /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:46.546249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:46.548603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] [instance: 4dc7e13b-6cd5-4858-aff6-6f2cb0817921] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:46.557246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.560507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.561221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.562143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.562768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.563384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.585837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] HTTP exception thrown: Instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 could not be found. Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Request method failure captured: Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 HTTP/1.1 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTViqJzb6KBR6zxTkknw5CMIvjDhAzvrgz-3ZkjELwcQCEbGwifTWhrDf_KMtC9q0Vs8XTiSxurGZbX_jCnc1_1YELj-wT3Z5C6rbJuVi9nE3zpesxBPOEey-p1Vu9xKUkCQ3BjCzqX3kOK1Y4NhOsKxaHJtCQB56SbXabc1E_oVxQW0 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a2cf5720dc3d44ae97ebd94094807c4c Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerAddressesTestJSON-967162903 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a2cf5720dc3d44ae97ebd94094807c4c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a2cf5720dc3d44ae97ebd94094807c4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a2cf5720dc3d44ae97ebd94094807c4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a2cf5720dc3d44ae97ebd94094807c4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerAddressesTestJSON-967162903 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a2cf5720dc3d44ae97ebd94094807c4c Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerAddressesTestJSON-967162903 Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerAddressesTestJSON-967162903-project Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 89774ee20d9345ff812c55a37477363a Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerAddressesTestJSON-967162903-project Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 could not be found. Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4dc7e13b-6cd5-4858-aff6-6f2cb0817921'} Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 could not be found. Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 could not be found. Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:46.588243 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 could not be found. Oct 17 13:29:46.593618 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:29:46.596072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] Returning 404 to user: Instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:29:46.597342 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-736c4b5b-a246-4076-b825-9b3b02f3a4fd tempest-ServerAddressesTestJSON-967162903 tempest-ServerAddressesTestJSON-967162903-project] 10.222.0.65 "GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921" status: 404 len: 111 microversion: 2.1 time: 0.058287 Oct 17 13:29:46.598393 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1616/3287] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:46 2022] GET /compute/v2.1/servers/4dc7e13b-6cd5-4858-aff6-6f2cb0817921 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:29:46.603345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:46.603851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:46.611927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.612718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.613370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.614267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.615226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.615820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.652436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:46.822390 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58eb7670-d7dd-44d1-bf52-37646c2f80eb tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 204 len: 0 microversion: 2.1 time: 0.222507 Oct 17 13:29:46.822995 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1617/3288] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:46 2022] DELETE /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:46.838545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:46.839553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:46.857457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.861150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.861925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:46.862956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:46.863610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:46.864229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.317804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:29:47.318815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:29:47.319546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:29:47.320196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:29:47.320770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:29:47.340623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.341773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.342476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.346126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.346917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.349283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.364659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:47.384433 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5829bf5-6fb3-4abc-b104-fd8a48c1de17 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1468 microversion: 2.1 time: 0.555902 Oct 17 13:29:47.385789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1618/3289] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:46 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1468 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:47.392747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:47.398744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for project f1c551f3219d4f78a100f1c60213c87a. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:29:47.401785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:47.415773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for user fa21bb7cfd2244a3ba5f0d3bdc41e437 and project f1c551f3219d4f78a100f1c60213c87a. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:29:47.420615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.421124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.421604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.422328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.423073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.423395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.473461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:29:47.475824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:29:47.621096 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-146a8abb-33e1-4d50-81e2-077cea9726d8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.648531 Oct 17 13:29:47.622309 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1672/3290] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:29:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:29:47.627282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:47.628150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:47.650198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.652653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.653335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.658456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.667702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.668324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.755017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:47.764032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ef0569c-74f2-4244-af77-416e700961f3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1507 microversion: 2.1 time: 0.375749 Oct 17 13:29:47.771699 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1619/3291] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:47 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:47.783666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9fa6d810-e09d-49c9-ba01-e73a1a73f804 req-5c4e78be-3585-4c1a-a3ad-2790c89b74bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc7e13b-6cd5-4858-aff6-6f2cb0817921", "name": "network-vif-deleted", "tag": "45b5f53a-d08e-425b-8a12-96d7c1b86adf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:47.810341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9fa6d810-e09d-49c9-ba01-e73a1a73f804 req-5c4e78be-3585-4c1a-a3ad-2790c89b74bb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.812441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9fa6d810-e09d-49c9-ba01-e73a1a73f804 req-5c4e78be-3585-4c1a-a3ad-2790c89b74bb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.820288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9fa6d810-e09d-49c9-ba01-e73a1a73f804 req-5c4e78be-3585-4c1a-a3ad-2790c89b74bb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.846273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9fa6d810-e09d-49c9-ba01-e73a1a73f804 req-5c4e78be-3585-4c1a-a3ad-2790c89b74bb service nova] Creating event network-vif-deleted:45b5f53a-d08e-425b-8a12-96d7c1b86adf for instance 4dc7e13b-6cd5-4858-aff6-6f2cb0817921 on n-h1-854121-14 Oct 17 13:29:47.862109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9fa6d810-e09d-49c9-ba01-e73a1a73f804 req-5c4e78be-3585-4c1a-a3ad-2790c89b74bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089918 Oct 17 13:29:47.867564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1620/3292] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:47.882537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:47.888056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:47.909758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.911595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.913098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:47.914029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:47.914533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:47.914960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:48.300261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:48.314771 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84fd6c19-1874-4277-b96e-79b33ab301af tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.688900 Oct 17 13:29:48.336113 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1673/3293] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:47 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:48.351323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8ec3a24-de89-4a88-a199-d27af7411323 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf0cb80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:48.424013 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8ec3a24-de89-4a88-a199-d27af7411323 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.084790 Oct 17 13:29:48.428135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:48.432428 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1674/3294] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:48 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:48.442713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-652f2507-1d32-4413-892e-af209bd22e0e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:48.446369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-652f2507-1d32-4413-892e-af209bd22e0e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:48.460286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1c217b0-31ae-4389-85fb-6c6fa1bb49ee tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.591112 Oct 17 13:29:48.461016 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1621/3295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:47 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:48.466464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:48.466464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:48.507212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:48.507920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:48.508680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:48.511168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:48.511735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:48.512473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:48.935297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-652f2507-1d32-4413-892e-af209bd22e0e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:48.980571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-652f2507-1d32-4413-892e-af209bd22e0e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:48.982917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-652f2507-1d32-4413-892e-af209bd22e0e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:48.984100 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-652f2507-1d32-4413-892e-af209bd22e0e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1281 microversion: 2.20 time: 0.549281 Oct 17 13:29:48.988796 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1675/3296] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:48 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1281 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:49.001353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:49.016066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:49.026722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:49.028307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:49.028784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:49.029941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:49.031853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:49.033058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:49.033718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:49.125057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:49.223892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:49.464959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:49.489803 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c8b5ad4-fad1-46e0-944c-7073a1dd7528 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1468 microversion: 2.1 time: 1.027642 Oct 17 13:29:49.491706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1622/3297] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:48 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1468 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:49.498984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:49.502015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:49.505780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:49.513994 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0516068f-ad90-4a41-8432-003772654b82 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1507 microversion: 2.1 time: 0.523104 Oct 17 13:29:49.538370 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1676/3298] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:48 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:49.541452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:49.542341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:49.542928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:49.545385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:49.546209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:49.546907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:49.547238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a7b27a8-5199-4f31-9c81-bb884e4710a8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ceb83a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:49.639164 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a7b27a8-5199-4f31-9c81-bb884e4710a8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1453 microversion: 2.1 time: 0.099480 Oct 17 13:29:49.670768 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1677/3299] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:49 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:49.706370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:49.709956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:49.729448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:49.732179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:49.732753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:49.733528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:49.733999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:49.736551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.223622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.240625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1dc1e5c-4b76-46b9-b295-a7bbdf51f5ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.745709 Oct 17 13:29:50.244957 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1623/3300] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:49 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:50.263033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-80e90c40-dc70-4f2d-bae3-96991f92b362 req-351302df-6e53-485e-8aaf-789bec6074cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbf01b0-b079-4ebf-ba60-e6c131a57494", "name": "network-vif-deleted", "tag": "49a40318-afa6-45e7-8334-0e2b5f563c1f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:50.293403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-80e90c40-dc70-4f2d-bae3-96991f92b362 req-351302df-6e53-485e-8aaf-789bec6074cc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.299694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-80e90c40-dc70-4f2d-bae3-96991f92b362 req-351302df-6e53-485e-8aaf-789bec6074cc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.301621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-80e90c40-dc70-4f2d-bae3-96991f92b362 req-351302df-6e53-485e-8aaf-789bec6074cc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.321357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.328878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-80e90c40-dc70-4f2d-bae3-96991f92b362 req-351302df-6e53-485e-8aaf-789bec6074cc service nova] Creating event network-vif-deleted:49a40318-afa6-45e7-8334-0e2b5f563c1f for instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 on n-h2-854121-14 Oct 17 13:29:50.333247 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b689b00-26b4-44b9-a01d-b0ee5c83e44b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.653821 Oct 17 13:29:50.337476 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-80e90c40-dc70-4f2d-bae3-96991f92b362 req-351302df-6e53-485e-8aaf-789bec6074cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091013 Oct 17 13:29:50.338322 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1624/3301] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:50.344485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.346086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:50.350300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1678/3302] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:49 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:50.355761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.356274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.357265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.358293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.358763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.359779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.398713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d3cecba8-79b0-46a7-b3ad-a3a387c03594 req-84b30e5a-c57b-4cbe-af5b-64cac880366f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "208b6878-95d7-40a3-9107-0c1f4882c463", "tag": "4f157780-b51f-4f5f-ab5c-87c51cc051f3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:50.410194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3cecba8-79b0-46a7-b3ad-a3a387c03594 req-84b30e5a-c57b-4cbe-af5b-64cac880366f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.411010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3cecba8-79b0-46a7-b3ad-a3a387c03594 req-84b30e5a-c57b-4cbe-af5b-64cac880366f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.411603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3cecba8-79b0-46a7-b3ad-a3a387c03594 req-84b30e5a-c57b-4cbe-af5b-64cac880366f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.430208 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d3cecba8-79b0-46a7-b3ad-a3a387c03594 req-84b30e5a-c57b-4cbe-af5b-64cac880366f service nova] Creating event network-changed:4f157780-b51f-4f5f-ab5c-87c51cc051f3 for instance 208b6878-95d7-40a3-9107-0c1f4882c463 on n-h2-854121-14 Oct 17 13:29:50.438303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d3cecba8-79b0-46a7-b3ad-a3a387c03594 req-84b30e5a-c57b-4cbe-af5b-64cac880366f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046609 Oct 17 13:29:50.440014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1679/3303] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:50.463858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.466481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:50.476358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.478256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.479498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d813bf17-9c78-4063-8c75-cfb0afe765b1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1339 microversion: 2.20 time: 0.139997 Oct 17 13:29:50.480412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1625/3304] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:50 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:50.519602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.520327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:50.527118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.527622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.528060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.528888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.529394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.529824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.558625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.559316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:50.562915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:50.570386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.570890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.571338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.572056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.572520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.572953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.615664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.616387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.617195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.617725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lazy-loading 'fault' on Instance uuid cbbf01b0-b079-4ebf-ba60-e6c131a57494 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:29:50.679980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.703961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23e63f46-e085-407c-a88a-3a9b9ff6bdee tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 200 len: 1304 microversion: 2.1 time: 0.149141 Oct 17 13:29:50.705732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1626/3305] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:50 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:50.727692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9d72870-87b8-4c7d-bd1d-ee6badab33ca tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1fc7b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.787723 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9d72870-87b8-4c7d-bd1d-ee6badab33ca tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1462 microversion: 2.1 time: 0.068001 Oct 17 13:29:50.789114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:50.789296 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1627/3306] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:50 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1462 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:50.798632 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43742a23-6c26-4240-a870-1c5eb27fb7d1 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1468 microversion: 2.1 time: 0.283073 Oct 17 13:29:50.799533 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1680/3307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:50 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:50.808415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6aedaa1d-e084-4036-bc84-2a77ac28ce7b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2077b80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.871837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6aedaa1d-e084-4036-bc84-2a77ac28ce7b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 200 len: 1462 microversion: 2.1 time: 0.068066 Oct 17 13:29:50.882986 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1628/3308] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:50 2022] GET /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 1462 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:50.888417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:50.889650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:50.899121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.900022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.900863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:50.901909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:50.902608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:50.903578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.169631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:51.179657 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac3f4248-8ce1-47a9-9ec4-af188aa67da2 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1468 microversion: 2.1 time: 0.296478 Oct 17 13:29:51.180252 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1681/3309] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:50 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:51.202789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1400344620"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:51.205730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:51.211973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.212467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.213125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.214020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.214642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.215259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.268543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:51.269152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:51.275988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.276544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.277650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.278423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.279031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.279816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.607408 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bbedd6e-16f6-464f-bfec-9b70ac9a9936 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "POST /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401/action" status: 202 len: 0 microversion: 2.1 time: 0.407183 Oct 17 13:29:51.613036 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1629/3310] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:29:51 2022] POST /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 13:29:51.655947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:51.659231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:51.685726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.686481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.687128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.688123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.689637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.690203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.704885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:51.717191 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fb5e0f4-8b4f-4776-8631-9a885272d69a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.453098 Oct 17 13:29:51.717819 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1682/3311] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:51 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:51.739511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:51.740134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:51.748564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.749060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.763425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.764608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:51.765087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:51.765546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:51.914660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:51.926195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:51.930906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:51.934900 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-582be1a8-63db-48d3-8832-63a0b8cde76a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1339 microversion: 2.20 time: 0.216125 Oct 17 13:29:51.936629 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1683/3312] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:51 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:51.961579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cdafc0c9-eb8e-4d1b-92b5-a72d1f0e5a18 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf5bee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.022428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cdafc0c9-eb8e-4d1b-92b5-a72d1f0e5a18 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.071437 Oct 17 13:29:52.024282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1684/3313] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:51 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:52.029910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.031214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: cbbf01b0-b079-4ebf-ba60-e6c131a57494] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.037719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:52.038650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.040161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.040846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.041824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.042766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.043424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.047502 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76f0a94f-cd21-4ffe-94db-fe55322ea98d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.432833 Oct 17 13:29:52.051976 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1630/3314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:51 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:52.058197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.058845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.061744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] HTTP exception thrown: Instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 could not be found. Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Request method failure captured: Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 HTTP/1.1 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXrXOq1J8GlTQWot-zAG3WlRWt-QdhKUznWYj0YFe614sXohh7tqN32E9k2SZUeu6BhKCRkVm1AefILJCKP8kJFxL8S-j92iLTPCugVISVd78CkJiNf2tsIFecAhZasPSBaWXgvE_xfzQlsyjsd3WurSHhdYF9YhkGfOjgcKJ6tUzY Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6ad84e1798394f69a409af3c96b6752c Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 could not be found. Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'cbbf01b0-b079-4ebf-ba60-e6c131a57494'} Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 could not be found. Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 could not be found. Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:52.064217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 could not be found. Oct 17 13:29:52.068719 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:52.070773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Returning 404 to user: Instance cbbf01b0-b079-4ebf-ba60-e6c131a57494 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:29:52.071831 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-912cfba7-f128-4be4-959a-80d67804b431 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494" status: 404 len: 111 microversion: 2.1 time: 0.046498 Oct 17 13:29:52.072847 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1685/3315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:52 2022] GET /compute/v2.1/servers/cbbf01b0-b079-4ebf-ba60-e6c131a57494 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:29:52.085538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.090333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.090856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.091197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.091665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.092570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.093040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.093509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.103962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.104776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.105524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.106644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.107455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.108127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.150984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:52.155432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.155939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.162106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.162862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lazy-loading 'fault' on Instance uuid 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:29:52.227507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:52.258452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:52.298003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4dfc4224-c213-4267-ad38-d0b08141aee3 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 200 len: 1303 microversion: 2.1 time: 0.242904 Oct 17 13:29:52.298662 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1631/3316] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:52 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:52.314896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b4960cf-8ad0-4a86-a241-590d53014539 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 204 len: 0 microversion: 2.1 time: 0.223307 Oct 17 13:29:52.314896 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1686/3317] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:52 2022] DELETE /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:52.318115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.318748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.326211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.326698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.327176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.328075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.328725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.329821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.490484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:52.506091 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad19257d-8242-4c49-b31c-48026bed0f3f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1496 microversion: 2.1 time: 0.197877 Oct 17 13:29:52.506729 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1632/3318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:52 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1496 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:52.683878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-73a7ee01-a37b-4fcb-b02d-67aee97a9f1f req-c11c63c7-6d42-4352-b4a7-0c4657beb7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712", "name": "network-vif-deleted", "tag": "05070510-029c-4cd1-a759-426e7558525a"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:52.699754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-73a7ee01-a37b-4fcb-b02d-67aee97a9f1f req-c11c63c7-6d42-4352-b4a7-0c4657beb7d9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.700492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-73a7ee01-a37b-4fcb-b02d-67aee97a9f1f req-c11c63c7-6d42-4352-b4a7-0c4657beb7d9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.701115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-73a7ee01-a37b-4fcb-b02d-67aee97a9f1f req-c11c63c7-6d42-4352-b4a7-0c4657beb7d9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.715799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-73a7ee01-a37b-4fcb-b02d-67aee97a9f1f req-c11c63c7-6d42-4352-b4a7-0c4657beb7d9 service nova] Creating event network-vif-deleted:05070510-029c-4cd1-a759-426e7558525a for instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 on n-h1-854121-14 Oct 17 13:29:52.723819 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-73a7ee01-a37b-4fcb-b02d-67aee97a9f1f req-c11c63c7-6d42-4352-b4a7-0c4657beb7d9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045197 Oct 17 13:29:52.725243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1687/3319] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:52.748829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.749730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.763009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.763450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.763925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.764787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.765096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:52.765544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:52.975828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:52.976543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:52.994839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:52.995321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.004373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.007104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.009209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.013766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.060444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:53.069864 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4beab1e1-5a18-426e-a2b7-1ad1704784f8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.326413 Oct 17 13:29:53.074049 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1633/3320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:52 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:53.091169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2bcd06c-c841-446c-ba51-bb7b20b97dbf tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a20258b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.159480 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2bcd06c-c841-446c-ba51-bb7b20b97dbf tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.083899 Oct 17 13:29:53.168947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1634/3321] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:53 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:53.175033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.175662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.208203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.208700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.209139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.223363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.224446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.225241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.574879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:53.584455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:53.587158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:53.590383 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c306c150-edd9-483b-b0f0-9f9afe427940 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.624626 Oct 17 13:29:53.591914 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1688/3322] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:52 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:53.600054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.601388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.621769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.622468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.623200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.623852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.624313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.624739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.654761 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] HTTP exception thrown: Instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 could not be found. Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Request method failure captured: Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 HTTP/1.1 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVgpx5xU8rM6o03SA_8NBC_OeJb8XeN9hvq9j5jiMQNZoVHMAAqgfNIoeLcpdq6-rwK_YotBBwFcn1KBFPIAugH0PfdMPWftB2usAj3YVO690ba_4OY69tq-9bZjELQG_rLjdaiCChGjPFz0Vh2RpiCEaudXO6KziETnPE6LFsp9jLM Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: b72acb6417e34de5bedb390948697404 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminTestJSON-24741556 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b72acb6417e34de5bedb390948697404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b72acb6417e34de5bedb390948697404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b72acb6417e34de5bedb390948697404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b72acb6417e34de5bedb390948697404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminTestJSON-24741556 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: b72acb6417e34de5bedb390948697404 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminTestJSON-24741556 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminTestJSON-24741556-project Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: b64c73f4ce814daabd6957812e0d1ff4 Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminTestJSON-24741556-project Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 could not be found. Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712'} Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 could not be found. Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 could not be found. Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:29:53.656906 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 could not be found. Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Returning 404 to user: Instance 8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:29:53.661791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3bb0bc4-82d6-4347-b4a6-be330163b352 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712" status: 404 len: 111 microversion: 2.1 time: 0.066248 Oct 17 13:29:53.662388 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1689/3323] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:53 2022] GET /compute/v2.1/servers/8cf6f020-bb6b-4e4d-8ac8-b685e4ffb712 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:29:53.668512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.669247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:53.669418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.676665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.677458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.677904 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-81a9abc6-65d7-48aa-b210-a12c5579abfd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.507502 Oct 17 13:29:53.678336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.679554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.680222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.680805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.681485 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1635/3324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:53 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:53.686241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.686746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.709987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.710504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.710959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.712326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.712799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.713276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.755838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:29:53.887614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f07ae1b0-f1ce-48fa-ab24-1a05213a7e84 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 204 len: 0 microversion: 2.1 time: 0.203200 Oct 17 13:29:53.890031 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1636/3325] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:29:53 2022] DELETE /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:29:53.896349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-146b0f9b-19e4-431d-ad7a-85b50001428f req-91b04812-e994-4644-b9c2-f47c1cf0c063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be2a371-cdcd-4928-a92a-7c4b5118d776", "name": "network-vif-unplugged", "status": "completed", "tag": "57cc1827-dab3-48ea-9688-e790d4b193e9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:53.922807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-146b0f9b-19e4-431d-ad7a-85b50001428f req-91b04812-e994-4644-b9c2-f47c1cf0c063 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.923652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-146b0f9b-19e4-431d-ad7a-85b50001428f req-91b04812-e994-4644-b9c2-f47c1cf0c063 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.924297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-146b0f9b-19e4-431d-ad7a-85b50001428f req-91b04812-e994-4644-b9c2-f47c1cf0c063 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.949208 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-146b0f9b-19e4-431d-ad7a-85b50001428f req-91b04812-e994-4644-b9c2-f47c1cf0c063 service nova] Creating event network-vif-unplugged:57cc1827-dab3-48ea-9688-e790d4b193e9 for instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 on n-h1-854121-14 Oct 17 13:29:53.955239 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-146b0f9b-19e4-431d-ad7a-85b50001428f req-91b04812-e994-4644-b9c2-f47c1cf0c063 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063241 Oct 17 13:29:53.956050 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1637/3326] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:53.962651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:53.964286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:53.971799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.972993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.974202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:53.975512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:53.976163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:53.976822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.437555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.446277 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9905a11-34b0-4dfd-8860-3c6a678a6c25 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1496 microversion: 2.1 time: 0.782284 Oct 17 13:29:54.447697 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1690/3327] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:53 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1496 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:54.452987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:54.454005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:54.462190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.463018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.464040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.465027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.465754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.466424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.566015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.575320 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d95c9d1d-433c-49dc-996e-b02257a7b89c tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1469 microversion: 2.1 time: 0.617876 Oct 17 13:29:54.576293 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1638/3328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:53 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:54.583140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b3d9c5f-7e46-4cfd-87d1-dce8dc6ff0aa tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dc9ad30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:54.638881 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b3d9c5f-7e46-4cfd-87d1-dce8dc6ff0aa tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.061196 Oct 17 13:29:54.639470 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1639/3329] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:54 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:54.646863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:54.647762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:54.660054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.660232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.661293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.661419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.662026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.662332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.794429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.802828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a9f29e6-f73e-49e1-93bd-6adf1f0817c2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.353793 Oct 17 13:29:54.803557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1691/3330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:54 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:54.809391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:54.810266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:54.821786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.822426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.822963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.823915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:54.824437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:54.824925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:54.965555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.974665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.977108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:54.978159 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-355aefc4-4d05-4992-98fd-a8353e8d538a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.337662 Oct 17 13:29:54.983934 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1640/3331] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:54 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:55.058942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:55.068265 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3c5515a-aa4d-4092-9fb5-c517f29c8617 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.263410 Oct 17 13:29:55.069073 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1692/3332] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:54 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:55.185251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-77342eae-d4e3-4da1-8098-8200b61c6a10 req-b9d8a303-3ee3-433d-b77a-ef1d033c1156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:55.207274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-77342eae-d4e3-4da1-8098-8200b61c6a10 req-b9d8a303-3ee3-433d-b77a-ef1d033c1156 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.208191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-77342eae-d4e3-4da1-8098-8200b61c6a10 req-b9d8a303-3ee3-433d-b77a-ef1d033c1156 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.209437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-77342eae-d4e3-4da1-8098-8200b61c6a10 req-b9d8a303-3ee3-433d-b77a-ef1d033c1156 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:55.253814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-77342eae-d4e3-4da1-8098-8200b61c6a10 req-b9d8a303-3ee3-433d-b77a-ef1d033c1156 service nova] Creating event network-changed:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:29:55.260942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-77342eae-d4e3-4da1-8098-8200b61c6a10 req-b9d8a303-3ee3-433d-b77a-ef1d033c1156 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088230 Oct 17 13:29:55.262168 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1641/3333] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:55.474933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:55.478327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:55.487173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.488045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.488719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:55.489694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.490367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.491009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:55.605815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:55.606538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:55.617466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.621713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.622181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:55.622932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:55.623398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:55.629967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:55.951603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:55.978177 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4ffa896-97f6-4548-8e32-97c6dae6afb3 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1496 microversion: 2.1 time: 0.510020 Oct 17 13:29:55.979501 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1693/3334] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:55 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1496 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:55.984873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d4e2119-4c08-4dde-b4c4-1778f041008b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a20903a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:56.071636 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d4e2119-4c08-4dde-b4c4-1778f041008b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.090795 Oct 17 13:29:56.073519 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1694/3335] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:55 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:56.081550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:56.083501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:56.105761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.106027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.107147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.107787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.108721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.109532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.110274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.114124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd046149-88d8-4c42-b762-f090129915e0 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1469 microversion: 2.1 time: 0.515877 Oct 17 13:29:56.114725 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1642/3336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:55 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1469 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:56.119520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9e5b1788-0baf-4fd5-9969-843220869003 req-9699e439-8155-4b7b-a0db-07cfd0d408a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfb8d82-d37e-40fe-9c0e-44feee8ce0de", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b6212b-b845-4e49-8b8f-09af425bb042"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:56.131210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e5b1788-0baf-4fd5-9969-843220869003 req-9699e439-8155-4b7b-a0db-07cfd0d408a3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.131995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e5b1788-0baf-4fd5-9969-843220869003 req-9699e439-8155-4b7b-a0db-07cfd0d408a3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.132609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e5b1788-0baf-4fd5-9969-843220869003 req-9699e439-8155-4b7b-a0db-07cfd0d408a3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.167021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9e5b1788-0baf-4fd5-9969-843220869003 req-9699e439-8155-4b7b-a0db-07cfd0d408a3 service nova] Creating event network-vif-unplugged:c4b6212b-b845-4e49-8b8f-09af425bb042 for instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de on n-h2-854121-14 Oct 17 13:29:56.178782 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9e5b1788-0baf-4fd5-9969-843220869003 req-9699e439-8155-4b7b-a0db-07cfd0d408a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061724 Oct 17 13:29:56.182979 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1643/3337] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:56.192205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:56.193928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:56.208628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.209569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.210172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.211080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.211700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.212293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.591924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.594443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:56.612548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.612874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.616638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.619099 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4886683-9c21-4ef0-bde0-98cade3c335e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.434686 Oct 17 13:29:56.633839 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c2badec-0a76-4819-ba64-ef9cca857584 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.552224 Oct 17 13:29:56.634318 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1695/3338] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:56 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:56.635333 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1644/3339] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:56 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:56.646868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:56.650099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:56.664736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.667160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.669419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.670633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:56.674323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:56.676320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:56.874781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:56.885109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57c39271-1b08-466f-a1fc-244f789c9075 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.249082 Oct 17 13:29:56.885803 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1696/3340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:56 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:57.003951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:57.005059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:57.013952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.014452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.015088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.015943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.017090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.017858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.089850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fe14c32-56b7-423d-824e-c5165e223283 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce66670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:57.155932 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fe14c32-56b7-423d-824e-c5165e223283 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.071263 Oct 17 13:29:57.156822 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1697/3341] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:57 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:57.163378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:57.164207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:57.172197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.173600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.174233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.175202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.175814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.176388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.255018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:57.264913 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d65b080-7505-4736-804f-8bcede83acb2 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1496 microversion: 2.1 time: 0.264877 Oct 17 13:29:57.266207 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1645/3342] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:56 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1496 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:57.268269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:57.280493 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7f2eb30-8a5c-40a7-b203-cf82bcf0b02a tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1427 microversion: 2.1 time: 0.122231 Oct 17 13:29:57.281146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1698/3343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:57 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:57.290127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fb04d0b5-93ce-4bb7-ac8e-672e6d0fb8b0 req-ae5b7f43-5ff5-4c8e-a350-e72ddf708cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9618fc73-52d1-4c04-a1bd-902ea819fffd", "name": "network-vif-deleted", "tag": "bd7dfca4-bc2d-4f70-8136-1428bb210591"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:57.301208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fb04d0b5-93ce-4bb7-ac8e-672e6d0fb8b0 req-ae5b7f43-5ff5-4c8e-a350-e72ddf708cf8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.301805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fb04d0b5-93ce-4bb7-ac8e-672e6d0fb8b0 req-ae5b7f43-5ff5-4c8e-a350-e72ddf708cf8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.302785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fb04d0b5-93ce-4bb7-ac8e-672e6d0fb8b0 req-ae5b7f43-5ff5-4c8e-a350-e72ddf708cf8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.318889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fb04d0b5-93ce-4bb7-ac8e-672e6d0fb8b0 req-ae5b7f43-5ff5-4c8e-a350-e72ddf708cf8 service nova] Creating event network-vif-deleted:bd7dfca4-bc2d-4f70-8136-1428bb210591 for instance 9618fc73-52d1-4c04-a1bd-902ea819fffd on n-h1-854121-14 Oct 17 13:29:57.326014 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fb04d0b5-93ce-4bb7-ac8e-672e6d0fb8b0 req-ae5b7f43-5ff5-4c8e-a350-e72ddf708cf8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039550 Oct 17 13:29:57.326621 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1646/3344] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:29:57.652647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:57.653914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:57.657290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:57.658439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:57.660631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:57.664098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.664893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.665579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.666563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.667239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.667916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.678792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.678792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.679052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:57.679784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:57.680303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:57.680748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.073407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.087574 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd267371-d584-4217-a126-fa998ea99202 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1542 microversion: 2.1 time: 0.434616 Oct 17 13:29:58.088203 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1647/3345] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:57 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1542 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:58.109463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:58.111410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:58.111798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.121718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.122884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.123453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.124030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.124596 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-948b2331-d322-4e9e-bd9e-50b6cce59c76 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.476593 Oct 17 13:29:58.124970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.137506 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1699/3346] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:57 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:58.155859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.156640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.157858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.171895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b63f7d5-e11c-42fc-9f16-9c0786041ac6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ceb8670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:58.237046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b63f7d5-e11c-42fc-9f16-9c0786041ac6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.069412 Oct 17 13:29:58.237500 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1700/3347] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:58 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:58.289503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:58.290043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:58.302190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.302387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.302853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.303538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.306076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.306574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.436640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.446456 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ae2105d-ed94-44e7-b125-2ac021f7f71d tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 200 len: 1454 microversion: 2.1 time: 0.161739 Oct 17 13:29:58.453531 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1701/3348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:58 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:29:58.470935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:58.472786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:58.481119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.487208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.488176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.491442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.492412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.493753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.532924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.554931 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0b8fa8f-f33d-48b2-a84e-7df06cba5043 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.452329 Oct 17 13:29:58.565542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1648/3349] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:58 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:58.573955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a40eb799-ea40-4838-a005-28d4903c2e3b req-0f3ec396-d5e4-4d85-958d-6fe473c2c3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dfb8d82-d37e-40fe-9c0e-44feee8ce0de", "name": "network-vif-deleted", "tag": "c4b6212b-b845-4e49-8b8f-09af425bb042"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:29:58.603547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a40eb799-ea40-4838-a005-28d4903c2e3b req-0f3ec396-d5e4-4d85-958d-6fe473c2c3b9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:58.604037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a40eb799-ea40-4838-a005-28d4903c2e3b req-0f3ec396-d5e4-4d85-958d-6fe473c2c3b9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:58.604473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a40eb799-ea40-4838-a005-28d4903c2e3b req-0f3ec396-d5e4-4d85-958d-6fe473c2c3b9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:58.680470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a40eb799-ea40-4838-a005-28d4903c2e3b req-0f3ec396-d5e4-4d85-958d-6fe473c2c3b9 service nova] Creating event network-vif-deleted:c4b6212b-b845-4e49-8b8f-09af425bb042 for instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de on n-h2-854121-14 Oct 17 13:29:58.699074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a40eb799-ea40-4838-a005-28d4903c2e3b req-0f3ec396-d5e4-4d85-958d-6fe473c2c3b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132131 Oct 17 13:29:58.699709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1649/3350] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:29:58.759118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:58.790659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11c913cf-6392-4d3c-aac5-17cbd2543b88 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 200 len: 1298 microversion: 2.1 time: 0.331246 Oct 17 13:29:58.792162 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1702/3351] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:58 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 1298 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:59.119709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:59.120423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:59.127813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:59.128295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:59.128732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:59.129510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:59.130318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:59.130934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:59.155078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:59.155554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:29:59.157494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:29:59.163753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:59.164662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:59.165114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:59.165862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:29:59.166412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:29:59.166839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:29:59.934187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:59.953019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33707de5-49e3-4607-a4e5-d9206d82c798 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1541 microversion: 2.1 time: 0.838775 Oct 17 13:29:59.957489 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1650/3352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:59 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1541 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:29:59.962662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:59.965546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4442ec40-80f8-4a1e-881b-93c027c2138b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a2166670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:59.981031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:59.983014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:29:59.985262 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ebabe1a-40fc-45f1-9750-5eb4d450e99e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.834222 Oct 17 13:29:59.990797 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1703/3353] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:29:59 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:29:59.996575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:29:59.997228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.015433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.015938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.016900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.023990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.024757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.025404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.049732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4442ec40-80f8-4a1e-881b-93c027c2138b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.090569 Oct 17 13:30:00.051075 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1651/3354] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:29:59 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:00.067350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.068521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.069833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] HTTP exception thrown: Instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de could not be found. Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Request method failure captured: Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de HTTP/1.1 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXrXOq1J8GlTQWot-zAG3WlRWt-QdhKUznWYj0YFe614sXohh7tqN32E9k2SZUeu6BhKCRkVm1AefILJCKP8kJFxL8S-j92iLTPCugVISVd78CkJiNf2tsIFecAhZasPSBaWXgvE_xfzQlsyjsd3WurSHhdYF9YhkGfOjgcKJ6tUzY Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-397715486 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6ad84e1798394f69a409af3c96b6752c Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de could not be found. Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0dfb8d82-d37e-40fe-9c0e-44feee8ce0de'} Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de could not be found. Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de could not be found. Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:00.073539 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de could not be found. Oct 17 13:30:00.081659 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.085628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.086132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.086576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.087300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.087756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.088538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.102327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Returning 404 to user: Instance 0dfb8d82-d37e-40fe-9c0e-44feee8ce0de could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:00.104135 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d5e7f5d-d0d2-4222-b04f-565a120dc96f tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de" status: 404 len: 111 microversion: 2.1 time: 0.112092 Oct 17 13:30:00.105549 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1704/3355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:29:59 2022] GET /compute/v2.1/servers/0dfb8d82-d37e-40fe-9c0e-44feee8ce0de => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:00.112506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.113724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: 9618fc73-52d1-4c04-a1bd-902ea819fffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.122085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.122999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.124595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.126831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.127711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.128509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.155890 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] HTTP exception thrown: Instance 9618fc73-52d1-4c04-a1bd-902ea819fffd could not be found. Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Request method failure captured: Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd HTTP/1.1 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVgpx5xU8rM6o03SA_8NBC_OeJb8XeN9hvq9j5jiMQNZoVHMAAqgfNIoeLcpdq6-rwK_YotBBwFcn1KBFPIAugH0PfdMPWftB2usAj3YVO690ba_4OY69tq-9bZjELQG_rLjdaiCChGjPFz0Vh2RpiCEaudXO6KziETnPE6LFsp9jLM Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: b72acb6417e34de5bedb390948697404 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminTestJSON-24741556 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b72acb6417e34de5bedb390948697404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b72acb6417e34de5bedb390948697404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b72acb6417e34de5bedb390948697404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b72acb6417e34de5bedb390948697404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminTestJSON-24741556 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: b72acb6417e34de5bedb390948697404 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminTestJSON-24741556 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminTestJSON-24741556-project Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: b64c73f4ce814daabd6957812e0d1ff4 Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminTestJSON-24741556-project Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 9618fc73-52d1-4c04-a1bd-902ea819fffd could not be found. Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '9618fc73-52d1-4c04-a1bd-902ea819fffd'} Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9618fc73-52d1-4c04-a1bd-902ea819fffd could not be found. Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9618fc73-52d1-4c04-a1bd-902ea819fffd could not be found. Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:00.159920 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9618fc73-52d1-4c04-a1bd-902ea819fffd could not be found. Oct 17 13:30:00.167590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:00.170360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Returning 404 to user: Instance 9618fc73-52d1-4c04-a1bd-902ea819fffd could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:00.171512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-160e9d8e-1ffe-4270-bbde-90edcee5f298 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd" status: 404 len: 111 microversion: 2.1 time: 0.064622 Oct 17 13:30:00.173130 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1705/3356] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:00 2022] GET /compute/v2.1/servers/9618fc73-52d1-4c04-a1bd-902ea819fffd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:00.181938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.182924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.193911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.195292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.196023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.197582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.198288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.198939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.261196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:00.438880 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5dae3534-6613-48a7-8d02-58e490dcf0bf tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 204 len: 0 microversion: 2.1 time: 0.262634 Oct 17 13:30:00.439751 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1706/3357] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:00 2022] DELETE /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:00.445506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.446109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.465337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.466132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.466731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.467588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.468198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.468796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.478654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:00.529825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:00.717116 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6251eb0-9d81-44eb-9c98-d492a8e369b8 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 204 len: 0 microversion: 2.1 time: 0.275789 Oct 17 13:30:00.722484 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1707/3358] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:00 2022] DELETE /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:00.727629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:00.731106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.731892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.741263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.741762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.742794 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0580a89d-d536-4f09-bac6-f74d58c6cd38 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.689955 Oct 17 13:30:00.743528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.744231 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1652/3359] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:00 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:00.746370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.747070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.748750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.754671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0422954b-ce06-4f02-97b7-214c7e789c09 req-0fdff797-206b-4e69-9cc5-99bd33485022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "name": "network-vif-plugged", "status": "completed", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:00.782609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0422954b-ce06-4f02-97b7-214c7e789c09 req-0fdff797-206b-4e69-9cc5-99bd33485022 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.783530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0422954b-ce06-4f02-97b7-214c7e789c09 req-0fdff797-206b-4e69-9cc5-99bd33485022 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.784054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0422954b-ce06-4f02-97b7-214c7e789c09 req-0fdff797-206b-4e69-9cc5-99bd33485022 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.800278 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0422954b-ce06-4f02-97b7-214c7e789c09 req-0fdff797-206b-4e69-9cc5-99bd33485022 service nova] Creating event network-vif-plugged:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:30:00.806048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0422954b-ce06-4f02-97b7-214c7e789c09 req-0fdff797-206b-4e69-9cc5-99bd33485022 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059661 Oct 17 13:30:00.806879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1653/3360] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:00.815439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:00.816142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:00.823331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.824089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.824684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:00.825623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:00.826230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:00.827577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.211509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.212113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.220623 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-deb40896-9fa2-41ff-b034-abded56f38ec tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1468 microversion: 2.1 time: 0.411814 Oct 17 13:30:01.233497 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db86f6cf-04d3-47c0-aa91-21da3c8abdd7 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1677 microversion: 2.1 time: 0.504788 Oct 17 13:30:01.233497 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1708/3361] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:00 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1677 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:01.234332 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1654/3362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:00 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:01.238405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "name": "network-vif-unplugged", "status": "completed", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:01.244448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:01.245070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:01.252612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.252864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.253367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.253808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.254165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.254693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.255052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.255175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.255559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.272186 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] Creating event network-vif-unplugged:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h2-854121-14 Oct 17 13:30:01.284265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:30:01.302403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-98a57fcb-ecd3-44e9-8020-978e57da82a6 req-a34106e0-f22d-46eb-9c08-2b837c46fdf2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069290 Oct 17 13:30:01.303727 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1709/3363] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:01.310598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:01.311526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:01.323274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.324605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.325646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.326522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.327132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.327740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.558053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.567299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2790064-e2d6-42e9-860a-a391c3afedab tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1541 microversion: 2.1 time: 0.331617 Oct 17 13:30:01.577887 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1655/3364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:01 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1541 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:01.583337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e859219-41f8-4730-9a35-ce4f41f320ff tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419d073ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:01.635303 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e859219-41f8-4730-9a35-ce4f41f320ff tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.056170 Oct 17 13:30:01.636056 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1656/3365] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:01 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:01.636848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.653617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.667503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:01.670923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab8c7db6-4d54-4257-8a4e-a429c39d1711 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.365680 Oct 17 13:30:01.671987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1710/3366] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:01 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:01.772711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:01.773374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:01.810166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.813674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.814596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:01.815546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:01.816185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:01.816912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.256142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:02.256825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:02.274762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:02.275744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.276296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.276750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.277785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.278403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.278814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.293097 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6196146d-ffcb-4a53-b606-dcdc5916e372 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.522226 Oct 17 13:30:02.314277 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1657/3367] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:01 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:02.325263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:02.327083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:02.346553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.347376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.348213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.349150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.349857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.350500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.694993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:02.703747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-938f953c-da4e-4860-bf76-fa16f989b014 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1468 microversion: 2.1 time: 0.457102 Oct 17 13:30:02.718083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:02.724356 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1711/3368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:02 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1468 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:02.733230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c87e62d8-8a87-4ea0-ad3a-382c3972d27a tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1677 microversion: 2.1 time: 0.407999 Oct 17 13:30:02.733230 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1658/3369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:02 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1677 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:02.733230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-642b45c0-fa9f-44d6-be0f-d794aad79806 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419deff8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:02.733869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:02.741585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:02.761796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.765447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.765911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.767602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.768071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.768504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.825212 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-642b45c0-fa9f-44d6-be0f-d794aad79806 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.099383 Oct 17 13:30:02.826252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1659/3370] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:02 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:02.832604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:02.833453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:02.845826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.846612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.847951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:02.848983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:02.850818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:02.851480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.089506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:03.102292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad46794b-d1ae-4f08-976f-14b15129535e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1541 microversion: 2.1 time: 0.377359 Oct 17 13:30:03.106661 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1712/3371] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:02 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1541 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:03.112174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a053f549-0c29-452b-b9ac-54f0c93c65bc req-f7032ed0-96da-4b07-87a3-2ad455cd3cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "name": "network-vif-plugged", "status": "completed", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:03.142848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a053f549-0c29-452b-b9ac-54f0c93c65bc req-f7032ed0-96da-4b07-87a3-2ad455cd3cdb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.143704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a053f549-0c29-452b-b9ac-54f0c93c65bc req-f7032ed0-96da-4b07-87a3-2ad455cd3cdb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.144518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a053f549-0c29-452b-b9ac-54f0c93c65bc req-f7032ed0-96da-4b07-87a3-2ad455cd3cdb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.147037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:03.157384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:03.163458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a053f549-0c29-452b-b9ac-54f0c93c65bc req-f7032ed0-96da-4b07-87a3-2ad455cd3cdb service nova] Creating event network-vif-plugged:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:30:03.169563 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a053f549-0c29-452b-b9ac-54f0c93c65bc req-f7032ed0-96da-4b07-87a3-2ad455cd3cdb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060778 Oct 17 13:30:03.170191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1713/3372] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:03.180235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:03.182749 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b167ad9a-f982-4b48-8212-249d1b97bea4 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.355178 Oct 17 13:30:03.183864 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1660/3373] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:02 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:03.321816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:03.323142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:03.332961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.333712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.334375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.342243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:03.353128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.357268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.358068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.363401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.364202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.364789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.379818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] Creating event network-changed:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h2-854121-14 Oct 17 13:30:03.390567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:30:03.405758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d0f1138f-7e14-4ce5-924c-2d87ac94e527 req-3c4debed-cae0-4946-9aa9-65c6d0562abf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069367 Oct 17 13:30:03.407271 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1661/3374] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:03.612159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:03.628295 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69ac002a-578a-4e15-aca7-48e69d9c9955 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.308807 Oct 17 13:30:03.635401 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1714/3375] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:03 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:03.730688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:03.731574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:03.741699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.742930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.743619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.745151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.745970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.746672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.754247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:03.755245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:03.763888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.765254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.765859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:03.767152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:03.767775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:03.768629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.005794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.015013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83605a18-e989-4d23-861d-5b1026efbae2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1468 microversion: 2.1 time: 0.289180 Oct 17 13:30:04.017863 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1662/3376] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:03 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:04.027796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60d4c1d5-683a-48bf-8a54-bd44ee46439f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f945e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:04.052453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.062180 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1eacd8fb-e433-43ad-99e5-433a03680e69 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1677 microversion: 2.1 time: 0.316273 Oct 17 13:30:04.066061 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1715/3377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:03 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1677 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:04.082353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60d4c1d5-683a-48bf-8a54-bd44ee46439f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.062769 Oct 17 13:30:04.083048 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1663/3378] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:04 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:04.130073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:04.130791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:04.136977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.137503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.137942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.138648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.139102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.139529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.216591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:04.217925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:04.227552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.227779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.228339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.234053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.234847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.239214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.309087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.327002 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a670f0b3-2c1f-4748-a368-a2b692c09fd0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1473 microversion: 2.1 time: 0.200725 Oct 17 13:30:04.330697 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1716/3379] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:04 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1473 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:04.405025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.416615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.418377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.420236 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa504ecf-c9f2-4892-b123-264b5e9a3634 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1406 microversion: 2.20 time: 0.213507 Oct 17 13:30:04.421126 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1664/3380] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:04 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:30:04.651731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:04.652759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:04.660525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.661328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.661764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.662467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:04.662918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:04.663336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:04.810552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:04.821624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f20eb8f8-4970-450d-80a5-fbc70c120171 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.173036 Oct 17 13:30:04.822218 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1717/3381] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:04 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:05.040430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:05.041315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:05.048993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.049647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.050008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.051192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.051495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.051944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.078493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3de94f11-1c6e-4f8f-af79-866f4a975cff req-41d46df7-e6ea-4825-bbca-a566629272dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14", "name": "network-vif-deleted", "tag": "3374708b-a678-4a47-97db-e0a22f1abd74"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:05.103054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3de94f11-1c6e-4f8f-af79-866f4a975cff req-41d46df7-e6ea-4825-bbca-a566629272dd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.103595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3de94f11-1c6e-4f8f-af79-866f4a975cff req-41d46df7-e6ea-4825-bbca-a566629272dd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.104034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3de94f11-1c6e-4f8f-af79-866f4a975cff req-41d46df7-e6ea-4825-bbca-a566629272dd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.124016 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3de94f11-1c6e-4f8f-af79-866f4a975cff req-41d46df7-e6ea-4825-bbca-a566629272dd service nova] Creating event network-vif-deleted:3374708b-a678-4a47-97db-e0a22f1abd74 for instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 on n-h1-854121-14 Oct 17 13:30:05.131913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b64c73f4ce814daabd6957812e0d1ff4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b72acb6417e34de5bedb390948697404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:05.134964 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3de94f11-1c6e-4f8f-af79-866f4a975cff req-41d46df7-e6ea-4825-bbca-a566629272dd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072461 Oct 17 13:30:05.136804 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1718/3382] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:05.142708 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28e754eb-b548-44f4-a96b-b493d067d309 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 200 len: 1426 microversion: 2.1 time: 0.105234 Oct 17 13:30:05.144425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:05.145144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:05.152916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.153448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.153882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.154647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.155104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.155722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.158482 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1665/3383] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:05 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 1426 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:05.166130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c0eb6eb-f740-43be-8992-89fbc0cb4c2c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dbb7ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:05.229252 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c0eb6eb-f740-43be-8992-89fbc0cb4c2c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.069202 Oct 17 13:30:05.230730 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1666/3384] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:05 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:05.239235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ed71f1d4-50f8-4e73-bca0-ca0cd65c4f3c req-058dcdfc-093f-429d-b74c-96f7fb12bf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208b6878-95d7-40a3-9107-0c1f4882c463", "name": "network-vif-plugged", "status": "completed", "tag": "4f157780-b51f-4f5f-ab5c-87c51cc051f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:05.252957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed71f1d4-50f8-4e73-bca0-ca0cd65c4f3c req-058dcdfc-093f-429d-b74c-96f7fb12bf08 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.253811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed71f1d4-50f8-4e73-bca0-ca0cd65c4f3c req-058dcdfc-093f-429d-b74c-96f7fb12bf08 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.254712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed71f1d4-50f8-4e73-bca0-ca0cd65c4f3c req-058dcdfc-093f-429d-b74c-96f7fb12bf08 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.269902 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ed71f1d4-50f8-4e73-bca0-ca0cd65c4f3c req-058dcdfc-093f-429d-b74c-96f7fb12bf08 service nova] Creating event network-vif-plugged:4f157780-b51f-4f5f-ab5c-87c51cc051f3 for instance 208b6878-95d7-40a3-9107-0c1f4882c463 on n-h2-854121-14 Oct 17 13:30:05.277293 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ed71f1d4-50f8-4e73-bca0-ca0cd65c4f3c req-058dcdfc-093f-429d-b74c-96f7fb12bf08 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043487 Oct 17 13:30:05.278484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1667/3385] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:05.355196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:05.356029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:05.365179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.365760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.366284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.367059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.367991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.368487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.851680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:05.862044 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65d69d10-2032-4784-8bdd-6b25d7a6e48b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1473 microversion: 2.1 time: 0.512146 Oct 17 13:30:05.863702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1668/3386] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:05 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1473 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:05.870391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:05.871014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:05.881688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.882750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.883202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.884313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.885503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.886043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.890199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:05.898611 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d058124-9389-4239-b380-629e1a798854 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1677 microversion: 2.1 time: 0.760490 Oct 17 13:30:05.900279 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1719/3387] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:05 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1677 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:05.904948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:05.906496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:05.907653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:05.914638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.915716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.916752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:05.918332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:05.919122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:05.919856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.086565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:06.097620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:06.099429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:06.100619 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2883b2e-9140-463b-8717-7517d6e56921 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1598 microversion: 2.20 time: 0.235990 Oct 17 13:30:06.101373 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1669/3388] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:05 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:06.121817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:06.128303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:06.128598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:06.134897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13f0e74d-666d-402c-b700-e7b3b8d93b58 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 0.231163 Oct 17 13:30:06.135875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1720/3389] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:05 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:06.137564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.149577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.149577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.149577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.149577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.150082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.170485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:06.171847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] [instance: ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:06.178545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.179373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.182206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.183361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.184174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.184768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.209948 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] HTTP exception thrown: Instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 could not be found. Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Request method failure captured: Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 HTTP/1.1 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVgpx5xU8rM6o03SA_8NBC_OeJb8XeN9hvq9j5jiMQNZoVHMAAqgfNIoeLcpdq6-rwK_YotBBwFcn1KBFPIAugH0PfdMPWftB2usAj3YVO690ba_4OY69tq-9bZjELQG_rLjdaiCChGjPFz0Vh2RpiCEaudXO6KziETnPE6LFsp9jLM Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: b72acb6417e34de5bedb390948697404 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminTestJSON-24741556 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b72acb6417e34de5bedb390948697404"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b72acb6417e34de5bedb390948697404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b72acb6417e34de5bedb390948697404"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b72acb6417e34de5bedb390948697404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminTestJSON-24741556 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: b72acb6417e34de5bedb390948697404 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminTestJSON-24741556 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminTestJSON-24741556-project Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: b64c73f4ce814daabd6957812e0d1ff4 Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminTestJSON-24741556-project Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 could not be found. Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14'} Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 could not be found. Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 could not be found. Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:06.212402 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 could not be found. Oct 17 13:30:06.219145 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:06.223028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] Returning 404 to user: Instance ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:06.226025 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2dc2615-b116-45a3-bdd1-55caac9016b2 tempest-ServersAdminTestJSON-24741556 tempest-ServersAdminTestJSON-24741556-project] 10.222.0.65 "GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14" status: 404 len: 111 microversion: 2.1 time: 0.059400 Oct 17 13:30:06.231004 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1721/3390] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:06 2022] GET /compute/v2.1/servers/ac1c4a03-8088-41f6-bc8f-c6e70fc4aa14 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:30:06.274822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc2a7800-9baf-4b34-ab49-e11a7fd724bb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce7bc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:06.380888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af5d48d9-cad9-4478-88ab-4c4c5e2b6f3b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.257240 Oct 17 13:30:06.382107 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1670/3391] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:30:06 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-interface => generated 284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:30:06.411042 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc2a7800-9baf-4b34-ab49-e11a7fd724bb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.164585 Oct 17 13:30:06.423276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1722/3392] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:06 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:06.901340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:06.903132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:06.913565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.913949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.914389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.915099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.915617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.916038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.929656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:06.930409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:06.933877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:06.942487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.943413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.944139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:06.945086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:06.945964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:06.946602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:07.409898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ad84e1798394f69a409af3c96b6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a3c9343ab94c7ea6f4b5dab2f064ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:07.418790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a26c3473-1953-4bd7-9e68-ecd76b621022 tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 200 len: 1609 microversion: 2.1 time: 0.497807 Oct 17 13:30:07.419333 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1723/3393] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:06 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 1609 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:07.437051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:07.437938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:07.457303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:07.458127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:07.458766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:07.459660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:07.460283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:07.460875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:07.940864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:07.954860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f1a4ee6-cec3-44db-bd0e-d0eb13f4f06d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1473 microversion: 2.1 time: 1.066042 Oct 17 13:30:07.969596 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1671/3394] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:06 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1473 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:07.998144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9fbe32a2-fd69-4d36-9a74-a6c134f3cb0a req-60636f21-201d-43fa-9284-77b1946dfc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6846508-cc19-42bb-b770-e04bb565f35b", "name": "network-vif-deleted", "tag": "0e8af6ce-e116-42e7-a006-b79fa72cca00"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:08.024763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9fbe32a2-fd69-4d36-9a74-a6c134f3cb0a req-60636f21-201d-43fa-9284-77b1946dfc14 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.027106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9fbe32a2-fd69-4d36-9a74-a6c134f3cb0a req-60636f21-201d-43fa-9284-77b1946dfc14 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.027675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9fbe32a2-fd69-4d36-9a74-a6c134f3cb0a req-60636f21-201d-43fa-9284-77b1946dfc14 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.041524 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9fbe32a2-fd69-4d36-9a74-a6c134f3cb0a req-60636f21-201d-43fa-9284-77b1946dfc14 service nova] Creating event network-vif-deleted:0e8af6ce-e116-42e7-a006-b79fa72cca00 for instance c6846508-cc19-42bb-b770-e04bb565f35b on n-h2-854121-14 Oct 17 13:30:08.048449 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9fbe32a2-fd69-4d36-9a74-a6c134f3cb0a req-60636f21-201d-43fa-9284-77b1946dfc14 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075981 Oct 17 13:30:08.049573 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1672/3395] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:08.056055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d20d310-a786-4963-aa53-a58cc1c23b0d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dc9a790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:08.461370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:08.475278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02d25639-5d9e-41f6-8781-daf48374aee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 1.054871 Oct 17 13:30:08.477705 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1724/3396] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:07 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:08.535999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:08.536831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] [instance: c6846508-cc19-42bb-b770-e04bb565f35b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:08.575719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.576228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.576682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.581096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.581795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.583452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.623417 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] HTTP exception thrown: Instance c6846508-cc19-42bb-b770-e04bb565f35b could not be found. Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Request method failure captured: Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b HTTP/1.1 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVXrXOq1J8GlTQWot-zAG3WlRWt-QdhKUznWYj0YFe614sXohh7tqN32E9k2SZUeu6BhKCRkVm1AefILJCKP8kJFxL8S-j92iLTPCugVISVd78CkJiNf2tsIFecAhZasPSBaWXgvE_xfzQlsyjsd3WurSHhdYF9YhkGfOjgcKJ6tUzY Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1a3c9343ab94c7ea6f4b5dab2f064ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-397715486 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1a3c9343ab94c7ea6f4b5dab2f064ac Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-397715486 Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 6ad84e1798394f69a409af3c96b6752c Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-397715486-project Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance c6846508-cc19-42bb-b770-e04bb565f35b could not be found. Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'c6846508-cc19-42bb-b770-e04bb565f35b'} Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6846508-cc19-42bb-b770-e04bb565f35b could not be found. Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6846508-cc19-42bb-b770-e04bb565f35b could not be found. Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:08.625128 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6846508-cc19-42bb-b770-e04bb565f35b could not be found. Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Returning 404 to user: Instance c6846508-cc19-42bb-b770-e04bb565f35b could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:08.629655 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a49775fd-ce22-416d-bc92-dfd356018b7e tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b" status: 404 len: 111 microversion: 2.1 time: 0.146412 Oct 17 13:30:08.632578 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1725/3397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:08 2022] GET /compute/v2.1/servers/c6846508-cc19-42bb-b770-e04bb565f35b => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:08.649969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8a30673-e7cd-47f7-9bae-66a66689806c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] Calling method '.version_select at 0x7f419ce8e790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:08.653821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d20d310-a786-4963-aa53-a58cc1c23b0d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.590486 Oct 17 13:30:08.654478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1673/3398] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:08 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:08.698420 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8a30673-e7cd-47f7-9bae-66a66689806c tempest-ServerActionsTestJSON-397715486 tempest-ServerActionsTestJSON-397715486-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889660122" status: 202 len: 0 microversion: 2.1 time: 0.061085 Oct 17 13:30:08.699056 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1726/3399] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:30:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1889660122 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:30:08.982397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:08.983776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:08.996237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:08.997098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:08.997748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:08.998636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.001691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.002341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.542782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:09.542782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:09.546533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:09.546533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c024848e-1fba-4dbc-9a51-88a997ae9205 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1470 microversion: 2.1 time: 0.564695 Oct 17 13:30:09.556634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.557226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.557911 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1674/3400] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:08 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1470 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:09.561010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.562331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.562820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.564005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.565862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:09.566380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:09.573022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.573812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.574407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.575317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.576088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.576672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.581640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:09.649367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.649858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.650298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.651021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:09.654690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:09.655231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:09.720269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:09.732967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for user fec0e15aae5c4bf996ee4b8a98a496e2 and project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:09.764240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:09.933088 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78088ecd-edda-4191-adde-1d3e4b0b5907 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0/action" status: 202 len: 0 microversion: 2.1 time: 0.371603 Oct 17 13:30:09.934896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1675/3401] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:30:09 2022] POST /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:30:09.941892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74412394-0e82-4e84-b236-d11b40065079 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce16a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:10.052086 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74412394-0e82-4e84-b236-d11b40065079 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.113930 Oct 17 13:30:10.055219 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1676/3402] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:09 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:10.079499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:10.086236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:10.101051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:10.102317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:10.103441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:10.104484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:10.105411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:10.106075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.066882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:11.078315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-479a34f7-2fbc-41b8-a079-e20ec6777721 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1318 microversion: 2.1 time: 1.573042 Oct 17 13:30:11.081808 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1727/3403] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:09 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1318 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:11.319291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.330874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.331505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.331789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.332522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.332966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.333415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.414367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a901abd2-5319-4af2-9960-1cc2cdcfb75b tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.329632 Oct 17 13:30:11.415538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1728/3404] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/os-services => generated 949 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:11.424886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b88bc82-cd21-4ccd-bcf7-66919048d31c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cf5be50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.508458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b88bc82-cd21-4ccd-bcf7-66919048d31c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.091578 Oct 17 13:30:11.509843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1729/3405] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:11.516171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.522177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.523041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.523923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.525124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.525992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.526676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.644596 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-284e1d20-d8d1-44d6-964c-7f5b088e0e8f tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.121518 Oct 17 13:30:11.645336 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1730/3406] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:11.663721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.668019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.668914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.670317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.671502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.693242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.695188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.751336 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-676093e4-4a04-4efa-80d1-70d37ead50a5 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.093754 Oct 17 13:30:11.752320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1731/3407] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/os-services => generated 949 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:11.764487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.776557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.777792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.778758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.782941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.783655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.784159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.863506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a6e59b7-c2a8-4fc6-97b4-4b44bd1ba8e4 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?host=n-d-854121-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.102893 Oct 17 13:30:11.868127 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1732/3408] 10.222.0.65 () {58 vars in 1196 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/os-services?host=n-d-854121-14&binary=xxx => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:30:11.879886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:11.894109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.894885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.896981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.899525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:11.903701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:11.904732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:11.982539 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac022a4c-4aa5-4f04-92de-dd1ac8813186 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.108203 Oct 17 13:30:11.989566 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1733/3409] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/os-services => generated 949 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:12.003582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:12.013372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.014245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.016495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.018460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.020040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.021677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.091961 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec28f182-dfd0-419c-8cf4-74f4d7b9b415 tempest-ServicesAdminNegativeTestJSON-597137660 tempest-ServicesAdminNegativeTestJSON-597137660-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.092628 Oct 17 13:30:12.101253 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1734/3410] 10.222.0.65 () {58 vars in 1198 bytes} [Mon Oct 17 13:30:11 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:30:12.105723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:12.106334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:12.120847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.134011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.134779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.135697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.136320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.136981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.196106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:12.212871 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b332893e-5606-48c1-bde5-6c11e4f15c31 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1469 microversion: 2.1 time: 2.155970 Oct 17 13:30:12.215935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1677/3411] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:10 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1469 bytes in 2160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:12.501432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5dfbe57b-98ab-4d0f-8d9e-fc0aefb8f9de tempest-ServicesAdminNegativeTestJSON-1815397795 tempest-ServicesAdminNegativeTestJSON-1815397795-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:12.509514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5dfbe57b-98ab-4d0f-8d9e-fc0aefb8f9de tempest-ServicesAdminNegativeTestJSON-1815397795 tempest-ServicesAdminNegativeTestJSON-1815397795-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '56d8f041b3194b749c48d10bb0c3a101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1025753e4d6543288bb6cb7804d116a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5dfbe57b-98ab-4d0f-8d9e-fc0aefb8f9de tempest-ServicesAdminNegativeTestJSON-1815397795 tempest-ServicesAdminNegativeTestJSON-1815397795-project] Request method failure captured: Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjhI-3A3qVee-aLTLufKt636rmS-IGlmc6F4R2tNsTe9Szjsk8JTXuNjS_v61M1bz5eQE0klKnFilzjEh1DWYTulQ6ntXLvh6PYbJj-5S8iSXsR14yygEO5dRZ7LnbWC3YwM-6ByK5ZvtyTHsR_leKSePgs1VZO8F7cRGwHrU2pWZM Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1025753e4d6543288bb6cb7804d116a8 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1815397795 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1025753e4d6543288bb6cb7804d116a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1025753e4d6543288bb6cb7804d116a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1025753e4d6543288bb6cb7804d116a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1025753e4d6543288bb6cb7804d116a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1815397795 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1025753e4d6543288bb6cb7804d116a8 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1815397795 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServicesAdminNegativeTestJSON-1815397795-project Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 56d8f041b3194b749c48d10bb0c3a101 Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1815397795-project Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: action_args: {} Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise self.value Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:30:12.523575 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5dfbe57b-98ab-4d0f-8d9e-fc0aefb8f9de tempest-ServicesAdminNegativeTestJSON-1815397795 tempest-ServicesAdminNegativeTestJSON-1815397795-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5dfbe57b-98ab-4d0f-8d9e-fc0aefb8f9de tempest-ServicesAdminNegativeTestJSON-1815397795 tempest-ServicesAdminNegativeTestJSON-1815397795-project] 10.222.0.65 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.290547 Oct 17 13:30:12.528335 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1678/3412] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:30:12 2022] GET /compute/v2.1/os-services => generated 112 bytes in 293 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:12.537911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "name": "network-vif-plugged", "status": "completed", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:12.560236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.563950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.564529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.589495 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] Creating event network-vif-plugged:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h2-854121-14 Oct 17 13:30:12.616788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:30:12.656221 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-97421ce4-9ac5-4985-b9c5-ab8f4fe55d65 req-c5571898-ee88-43fa-92dd-10608ab64a46 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128227 Oct 17 13:30:12.657837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1679/3413] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:12.668626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98f1c429-1041-4f1c-8d8b-c2a3dae34319 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419de42ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:12.784932 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98f1c429-1041-4f1c-8d8b-c2a3dae34319 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.125719 Oct 17 13:30:12.785721 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1680/3414] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:12 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:12.795611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f0921afb-c95b-4d7e-a221-fb257510f77a req-49c3f6b0-32a2-495e-899c-984fad2d914b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:12.819285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0921afb-c95b-4d7e-a221-fb257510f77a req-49c3f6b0-32a2-495e-899c-984fad2d914b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:12.821282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0921afb-c95b-4d7e-a221-fb257510f77a req-49c3f6b0-32a2-495e-899c-984fad2d914b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:12.823873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0921afb-c95b-4d7e-a221-fb257510f77a req-49c3f6b0-32a2-495e-899c-984fad2d914b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:12.846618 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f0921afb-c95b-4d7e-a221-fb257510f77a req-49c3f6b0-32a2-495e-899c-984fad2d914b service nova] Creating event network-changed:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:30:12.868105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f0921afb-c95b-4d7e-a221-fb257510f77a req-49c3f6b0-32a2-495e-899c-984fad2d914b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075769 Oct 17 13:30:12.874365 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1681/3415] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:12.959470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:12.972718 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50395711-08f4-48ae-9c8e-9f3681ddce50 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1509 microversion: 2.1 time: 0.870810 Oct 17 13:30:12.979256 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1735/3416] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:12 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1509 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:13.004909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:13.006414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:13.015363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.016546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.017422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.020023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.020801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.023331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.240519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:13.241813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:13.265924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.268756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.269434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:13.272385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:13.274561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:13.275878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:14.759206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:14.779710 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc9721d8-2253-464c-939e-40e29e623780 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1469 microversion: 2.1 time: 1.544974 Oct 17 13:30:14.796975 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1736/3417] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:13 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1469 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:14.803513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-770f1921-80d7-465b-a6fe-07e24680ae60 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce86280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:14.873085 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-770f1921-80d7-465b-a6fe-07e24680ae60 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.074764 Oct 17 13:30:14.873963 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1737/3418] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:14 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:14.982094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:15.004637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d54f70f-dd70-4561-be5b-10967cd0ee4d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1509 microversion: 2.1 time: 1.999841 Oct 17 13:30:15.005658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1682/3419] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:12 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1509 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:15.032917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:15.036463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:15.061906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.062405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.063284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.070328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.074809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.075778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.256171 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dea7f416-21c4-44b3-962a-2f4603fed1b7 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "PUT /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1081 microversion: 2.1 time: 0.228968 Oct 17 13:30:15.269190 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1738/3420] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:30:15 2022] PUT /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1081 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:15.276597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:15.277530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:15.304033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.304827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.306259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.307199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.307834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.308433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.807604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:15.808364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:15.825589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.827338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.829048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:15.830689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:15.833225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:15.835529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:16.110877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:16.126587 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9daf2ff1-fad3-41ff-bed6-c7b211318ee5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1507 microversion: 2.1 time: 0.852457 Oct 17 13:30:16.127955 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1683/3421] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:15 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1507 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:16.150944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88e0ff45-15ea-48f6-b08b-30c871351563 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419d0731f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:16.250319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88e0ff45-15ea-48f6-b08b-30c871351563 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.118919 Oct 17 13:30:16.251637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1684/3422] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:16 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:16.256623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:16.257577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:16.269625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:16.270495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:16.271180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:16.272202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:16.272666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:16.273201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:17.041943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:17.059471 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0158cdb8-a2aa-4493-bdac-1e285383d9a4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1469 microversion: 2.1 time: 1.258112 Oct 17 13:30:17.060333 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1739/3423] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:15 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1469 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:17.177748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:17.201903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e13585db-4967-418a-b4ba-c479d8ce47d2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1507 microversion: 2.1 time: 0.945218 Oct 17 13:30:17.206168 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1685/3424] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:16 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1507 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:17.236174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:17.239398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:17.255108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:17.255936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:17.256734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:17.257842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:17.259015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:17.267542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-058f2041-dca4-44b4-94d6-7acc4b4ce846 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce02550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:17.274564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:17.346957 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-058f2041-dca4-44b4-94d6-7acc4b4ce846 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.083936 Oct 17 13:30:17.347546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1686/3425] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:17 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:17.531130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:17.532726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:17.533493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:17.534113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:17.535041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:17.806437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:17.835782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:17.840448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:17.848146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:17.852766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:17.853808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:17.857693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.015901 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36e1956c-9e8a-445e-980f-8ae8fc5ac271 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "POST /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463/action" status: 202 len: 1113 microversion: 2.1 time: 0.785209 Oct 17 13:30:18.034025 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1740/3426] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:30:17 2022] POST /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463/action => generated 1113 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 13:30:18.041671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:18.042570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:18.051976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.053022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.054498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.055823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.056954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.058118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.203727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-053cdd4a-3771-4b24-9353-ac9ffbd2b267 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Action: 'create', calling method: .version_select at 0x7f419cdba790>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1053356425", "policies": ["affinity"]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:18.282178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-053cdd4a-3771-4b24-9353-ac9ffbd2b267 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:18.307130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-053cdd4a-3771-4b24-9353-ac9ffbd2b267 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:18.596824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-053cdd4a-3771-4b24-9353-ac9ffbd2b267 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:18.604117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-053cdd4a-3771-4b24-9353-ac9ffbd2b267 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:18.667701 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-053cdd4a-3771-4b24-9353-ac9ffbd2b267 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.161195 Oct 17 13:30:18.671843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1687/3427] 10.222.0.65 () {60 vars in 1174 bytes} [Mon Oct 17 13:30:17 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:18.691879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:18.694357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:18.695141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:18.709438 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d78eb3d-38f1-4284-a878-aa76fcb20786 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 0.673439 Oct 17 13:30:18.710552 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1741/3428] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:18 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:18.733708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1c8102e-5a87-4681-a036-c29bf32b48ab tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce66f70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:18.735085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.741381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.741843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.745634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:18.746376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:18.750400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:18.824313 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1c8102e-5a87-4681-a036-c29bf32b48ab tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.112387 Oct 17 13:30:18.834069 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1742/3429] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:18 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:18.856915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73250ff4-9800-4e2e-8c7e-d57bfb9071ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Action: 'create', calling method: .version_select at 0x7f419ce863a0>, body: {"server_group": {"name": "tempest-server-group-1778685698", "policies": ["affinity"]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:18.908950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-73250ff4-9800-4e2e-8c7e-d57bfb9071ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:18.919589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-73250ff4-9800-4e2e-8c7e-d57bfb9071ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:19.138259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-73250ff4-9800-4e2e-8c7e-d57bfb9071ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:19.193002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-73250ff4-9800-4e2e-8c7e-d57bfb9071ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:19.276658 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73250ff4-9800-4e2e-8c7e-d57bfb9071ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.440997 Oct 17 13:30:19.286017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1743/3430] 10.222.0.65 () {60 vars in 1173 bytes} [Mon Oct 17 13:30:18 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:19.296689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6d89ee0-6ee0-452e-99ad-ec92fac26535 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Action: 'create', calling method: .version_select at 0x7f419ce665e0>, body: {"server_group": {"name": "tempest-server-group-1778685698", "policies": ["affinity"]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:19.343316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6d89ee0-6ee0-452e-99ad-ec92fac26535 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:19.356474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6d89ee0-6ee0-452e-99ad-ec92fac26535 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:19.517395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6d89ee0-6ee0-452e-99ad-ec92fac26535 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:19.538405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:19.598976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6d89ee0-6ee0-452e-99ad-ec92fac26535 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:19.621400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:19.637739 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-892bb5b0-05a1-4c80-94e7-89d3c8dcb70c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1469 microversion: 2.1 time: 0.960596 Oct 17 13:30:19.640915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1688/3431] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:18 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1469 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:19.728503 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6d89ee0-6ee0-452e-99ad-ec92fac26535 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.435538 Oct 17 13:30:19.738990 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1744/3432] 10.222.0.65 () {60 vars in 1173 bytes} [Mon Oct 17 13:30:19 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:30:19.746216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:19.747088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:19.750240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-faba8883-67ae-41de-a1ea-0ecb3d4f1ca3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:19.756508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:19.763176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:19.764607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:19.765083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:19.769984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:19.770375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:19.772755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:19.960062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-faba8883-67ae-41de-a1ea-0ecb3d4f1ca3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/f757e97f-d62d-4577-94be-85f409e4ec9b" status: 204 len: 0 microversion: 2.1 time: 0.214278 Oct 17 13:30:19.960656 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1745/3433] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:30:19 2022] DELETE /compute/v2.1/os-server-groups/f757e97f-d62d-4577-94be-85f409e4ec9b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:30:19.990106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f82dc85-b8d0-42ba-946d-828f1952b853 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce78310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.093251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f82dc85-b8d0-42ba-946d-828f1952b853 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.125253 Oct 17 13:30:20.095656 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1746/3434] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:19 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:20.100520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0f963b2-6b8e-4efc-9762-9804f5ce289e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.153732 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0f963b2-6b8e-4efc-9762-9804f5ce289e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.056748 Oct 17 13:30:20.155173 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1747/3435] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:30:20 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:20.167903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39048ffb-39d7-46ab-a316-6571147dc50b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.219418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39048ffb-39d7-46ab-a316-6571147dc50b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/5dbe51c7-299c-415e-b39d-2e949cbc51f5" status: 204 len: 0 microversion: 2.1 time: 0.056091 Oct 17 13:30:20.222642 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1748/3436] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:30:20 2022] DELETE /compute/v2.1/os-server-groups/5dbe51c7-299c-415e-b39d-2e949cbc51f5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:20.230930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40ff0e5b-486b-41f0-940d-b232d3f2b6be tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.263111 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40ff0e5b-486b-41f0-940d-b232d3f2b6be tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036393 Oct 17 13:30:20.268846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1749/3437] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:30:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:30:20.285144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d883880-4183-4d67-8fa5-5207f30c43eb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Action: 'create', calling method: .version_select at 0x7f419ce7b4c0>, body: {"server_group": {"name": "tempest-server-group-934376915", "policies": ["affinity"]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:20.320867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-6d883880-4183-4d67-8fa5-5207f30c43eb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:20.334551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-6d883880-4183-4d67-8fa5-5207f30c43eb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:20.498936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-6d883880-4183-4d67-8fa5-5207f30c43eb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:20.535369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-6d883880-4183-4d67-8fa5-5207f30c43eb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:20.621874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d883880-4183-4d67-8fa5-5207f30c43eb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.341457 Oct 17 13:30:20.628232 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1750/3438] 10.222.0.65 () {60 vars in 1173 bytes} [Mon Oct 17 13:30:20 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:20.654703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:20.667896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7823468-e4ea-4829-a62b-44a6a59634af tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 0.931203 Oct 17 13:30:20.682572 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1689/3439] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:19 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:20.700039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ba57444-b383-4c8a-a01e-6621d246b961 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.732917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.743267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:20.824243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:20.832475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:20.841229 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7ba57444-b383-4c8a-a01e-6621d246b961 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/2bd830ce-67b6-4d23-a4ce-82d3425fb459" status: 204 len: 0 microversion: 2.1 time: 0.206680 Oct 17 13:30:20.844029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:20.849299 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1751/3440] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:30:20 2022] DELETE /compute/v2.1/os-server-groups/2bd830ce-67b6-4d23-a4ce-82d3425fb459 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:20.854322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:20.855020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:20.858563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:20.860304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95fbe7bc-82a4-4ce6-b324-a9f703390814 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:20.877704 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95fbe7bc-82a4-4ce6-b324-a9f703390814 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026999 Oct 17 13:30:20.885393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1752/3441] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:30:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:20.893388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3b7e8d3-dd3a-4a57-a594-18f9fbcd19f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Action: 'create', calling method: .version_select at 0x7f419ce7bb80>, body: {"server_group": {"name": "tempest-server-group-1493427580", "policies": ["anti-affinity"]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:20.920541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-a3b7e8d3-dd3a-4a57-a594-18f9fbcd19f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:20.935120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-a3b7e8d3-dd3a-4a57-a594-18f9fbcd19f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:21.124688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-a3b7e8d3-dd3a-4a57-a594-18f9fbcd19f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:21.150920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-a3b7e8d3-dd3a-4a57-a594-18f9fbcd19f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_groups'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:21.213625 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3b7e8d3-dd3a-4a57-a594-18f9fbcd19f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.323992 Oct 17 13:30:21.220331 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1753/3442] 10.222.0.65 () {60 vars in 1173 bytes} [Mon Oct 17 13:30:20 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:21.228383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f698b294-f174-4bf1-ae9d-ed9789187a56 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce7b8b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.337317 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f698b294-f174-4bf1-ae9d-ed9789187a56 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.115092 Oct 17 13:30:21.338353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1754/3443] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:21 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:21.349501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-350bad4b-8c46-4424-9f33-995cb2b70e02 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.406463 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-350bad4b-8c46-4424-9f33-995cb2b70e02 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/ba2d5edf-acab-43e3-9606-1999a6beb0f4" status: 204 len: 0 microversion: 2.1 time: 0.066690 Oct 17 13:30:21.407731 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1755/3444] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:30:21 2022] DELETE /compute/v2.1/os-server-groups/ba2d5edf-acab-43e3-9606-1999a6beb0f4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:21.417756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-637ae690-23b5-4d6c-ad5e-24fc5c98a4fd tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.443865 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-637ae690-23b5-4d6c-ad5e-24fc5c98a4fd tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030924 Oct 17 13:30:21.446354 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1756/3445] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:30:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:30:21.558076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:21.567810 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4f0c6000-7df1-4cbf-902e-6753d98ce924 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1535 microversion: 2.1 time: 0.864486 Oct 17 13:30:21.572874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1690/3446] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:20 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1535 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:21.709428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:21.710055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:21.726867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:21.733176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1613885355", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "f8fcc9ac-89fb-473a-875b-53804ede3f14"}]}, "os:scheduler_hints": {"group": "e74d6299-0966-46f6-af09-6a7812d18b23"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:21.735717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.744237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.744777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.745624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:21.752507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:21.752965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:21.909200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] validate_networks() for [('f8fcc9ac-89fb-473a-875b-53804ede3f14', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:30:22.046102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:22.894253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:22.910163 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aaa88329-ebc8-4acc-8c4c-3427af432377 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 1.204911 Oct 17 13:30:22.910937 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1757/3447] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:21 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:22.936544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbc76dfb-5bc9-4a7e-a841-77ab2387ef5c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce665e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:23.038993 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbc76dfb-5bc9-4a7e-a841-77ab2387ef5c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.126911 Oct 17 13:30:23.039720 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1758/3448] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:22 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:23.052748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "name": "network-vif-unplugged", "status": "completed", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:23.081039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.081590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.082054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.119823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] Creating event network-vif-unplugged:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h1-854121-14 Oct 17 13:30:23.130584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:30:23.157531 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-90dc01cf-55f9-4631-a6e8-79dcf986c588 req-9cc50d63-5dd7-4cdb-a373-9011a2e2a234 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113847 Oct 17 13:30:23.166150 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1759/3449] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:23.189706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:23.197327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:23.221220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.224126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.224583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.225549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.227178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.227784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.827696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:23.842256 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73011334-e1c6-414e-8cd6-186e621773f0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1535 microversion: 2.1 time: 0.674510 Oct 17 13:30:23.843157 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1760/3450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:23 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1535 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:23.938548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:23.939524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:23.952096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.959381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.962501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:23.966256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:23.969863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:23.974402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:25.153746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:25.163858 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f850130-0884-4b22-b628-8412438d522d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 1.229747 Oct 17 13:30:25.173136 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1761/3451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:23 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:25.189022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd137705-3092-400d-b964-fd978c19bd9b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce9e940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:25.250113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:25.251832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:25.252515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:25.253088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:25.253729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:25.294585 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd137705-3092-400d-b964-fd978c19bd9b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.118987 Oct 17 13:30:25.295962 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1762/3452] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:25 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:25.365623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:25.366591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:25.369686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:25.372626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:25.377897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:25.378674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:25.423501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:25.446554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:25.464150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:30:25.473921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:30:25.605132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120697) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 13:30:25.667836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_group_members'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:25.687782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_group_members'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:25.779305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1820805754", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:25.812769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for project a104760f38d941fd8b603be9c644d784. Resources: {'server_group_members'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:25.834402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Getting quotas for user ac4e032f9c2e4a7e9c521e79f2186b9d and project a104760f38d941fd8b603be9c644d784. Resources: {'server_group_members'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:25.914233 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cee45ba-0753-4a79-803f-6118e2afcc30 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.183377 Oct 17 13:30:25.916576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1691/3453] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:30:25.918376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:30:25.930676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:25.933209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:25.956037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:25.956725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:25.957452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:25.958316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:25.958788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:25.959641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:26.966822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:26.979650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:26.993206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8551a38-c5b8-4f1c-9f06-6fe1fc011007 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1535 microversion: 2.1 time: 1.071514 Oct 17 13:30:26.994183 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1692/3454] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:25 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1535 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:26.999505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:27.002565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:27.017364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.018986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.019739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.020820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.021311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.021838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.053355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:27.053857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:27.054208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:27.054662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:27.055298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:27.087428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.087910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.088344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.089305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.089760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.090189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.170081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Getting quotas for project 507d0adda30f42ecbf339005b9bcfe90. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:27.196022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Getting quotas for user 09e95e23a6e24fc6ada73b5fc532b472 and project 507d0adda30f42ecbf339005b9bcfe90. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:27.261289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:30:27.263643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:30:27.356575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:27.366109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-949d8098-9c55-46c1-aa27-07cf9a16d1a5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1217 microversion: 2.1 time: 0.370453 Oct 17 13:30:27.370737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1693/3455] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:26 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1217 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:27.463635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-925e715a-35c0-43f1-ad7f-c00cd8ffb456 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.161595 Oct 17 13:30:27.465115 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1763/3456] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:30:27.480849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:27.481513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:27.572553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.574313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.588818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.592361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:27.594257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:27.598655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:27.994394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:28.022890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.025244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.039695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:28.053308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.075698 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a741b8f2-bf8d-42e9-be49-3888e85ef820 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 0.598589 Oct 17 13:30:28.077835 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1764/3457] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:27 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:28.111754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9dffdd66-d418-4c5a-b782-aced6cc3ad0a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce8eca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:28.193382 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] Creating event network-changed:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h1-854121-14 Oct 17 13:30:28.225458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:30:28.256087 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b644b73e-55df-4f9b-80e6-a1f93ff3dd92 req-feee82fd-3e6d-48cd-a59a-414ab2414773 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.883208 Oct 17 13:30:28.261546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1694/3458] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:28.270490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9dffdd66-d418-4c5a-b782-aced6cc3ad0a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.167849 Oct 17 13:30:28.272044 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1765/3459] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:28 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:28.276517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6de7bd28-a00e-4d2c-817c-cb6e9dea631f tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:28.279642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6de7bd28-a00e-4d2c-817c-cb6e9dea631f tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:28.286602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:28.288935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:28.292040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:28.314154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.320097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.321084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.322141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.325117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.326133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.426060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:28.546217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6de7bd28-a00e-4d2c-817c-cb6e9dea631f tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:28.561108 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6de7bd28-a00e-4d2c-817c-cb6e9dea631f tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1214 microversion: 2.1 time: 0.297919 Oct 17 13:30:28.563140 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1695/3460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:28 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1214 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:28.585680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:28.586608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:28.620811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.623178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.625989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:28.628603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:28.631684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:28.632626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:29.553249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:29.576100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0df31ea-3d82-4fff-93f0-bfb51fcb1322 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1273 microversion: 2.1 time: 1.008185 Oct 17 13:30:29.577379 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1696/3461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:28 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1273 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:29.598921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:29.601995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:29.623069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:29.623970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:29.626595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:29.628597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:29.629232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:29.632350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:30.032936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:30.074582 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22e87357-c801-4a8d-b11b-7ba54d4f0b47 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1535 microversion: 2.1 time: 1.801170 Oct 17 13:30:30.078432 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1766/3462] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:28 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1535 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:30.086518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1017a646-20ff-4dae-b8f5-4b22e4e58942 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce9eb80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:30.194438 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1017a646-20ff-4dae-b8f5-4b22e4e58942 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.113817 Oct 17 13:30:30.207654 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1767/3463] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:30 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:30.252412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:30.260094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:30.272024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:30.272940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:30.273764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:30.274998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:30.275707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:30.276798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:30.428750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:30.457270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9956ddb-bf7d-4609-ab66-f88c75d5d7b1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 0.871918 Oct 17 13:30:30.459667 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1697/3464] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:29 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:30.507067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:30.549414 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c92731e-6d1a-44c8-aae3-7bc102fc8271 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1266 microversion: 2.1 time: 0.314182 Oct 17 13:30:30.552519 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1768/3465] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:30 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:30.605944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:30.607253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:30.621555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:30.626839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:30.627485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:30.629728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:30.631441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:30.632021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:31.110520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:31.116266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:31.149521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:31.150458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:31.151846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:31.156619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:31.160842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:31.162744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:31.436354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:31.455023 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9383e70-59b1-4600-abcf-c3a523930e5b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1271 microversion: 2.1 time: 0.844196 Oct 17 13:30:31.457563 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1698/3466] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:30 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1271 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:31.462866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-988276b0-1938-4cd0-8650-24e5ac8d928d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419deff310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:31.566342 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-988276b0-1938-4cd0-8650-24e5ac8d928d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.101698 Oct 17 13:30:31.572484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1699/3467] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:31 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:31.592019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:31.593748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:31.610264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:31.617047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:31.618049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:31.626926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:31.627861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:31.628494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.383419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:32.401894 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29edf556-e66f-41d0-b3bc-af6d2a82ecf9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 0.821785 Oct 17 13:30:32.403244 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1700/3468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:31 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:32.409133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:32.422711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:32.429505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.430386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.431090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.432180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.433908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.434664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.543835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:32.558983 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e569b9d-5efb-448d-a9e9-2c1336438b8e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1528 microversion: 2.1 time: 1.459308 Oct 17 13:30:32.571377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1769/3469] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:31 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1528 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:32.582655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fde6cc46-04f8-4eb6-9f08-fcd86afe507b req-28d3a34d-dd63-4ffd-863c-8b7ccd9a032a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "name": "network-vif-plugged", "status": "completed", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:32.614263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fde6cc46-04f8-4eb6-9f08-fcd86afe507b req-28d3a34d-dd63-4ffd-863c-8b7ccd9a032a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.615232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fde6cc46-04f8-4eb6-9f08-fcd86afe507b req-28d3a34d-dd63-4ffd-863c-8b7ccd9a032a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.617301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fde6cc46-04f8-4eb6-9f08-fcd86afe507b req-28d3a34d-dd63-4ffd-863c-8b7ccd9a032a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.653299 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fde6cc46-04f8-4eb6-9f08-fcd86afe507b req-28d3a34d-dd63-4ffd-863c-8b7ccd9a032a service nova] Creating event network-vif-plugged:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h1-854121-14 Oct 17 13:30:32.667151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fde6cc46-04f8-4eb6-9f08-fcd86afe507b req-28d3a34d-dd63-4ffd-863c-8b7ccd9a032a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092430 Oct 17 13:30:32.672344 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1770/3470] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:32.683688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:32.685983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:32.693584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:32.703911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a8d2760-775d-432a-ad40-eae26e8483dd tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1272 microversion: 2.1 time: 0.298716 Oct 17 13:30:32.711636 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1701/3471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:32 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:32.716750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28328258-acfc-42cc-8428-263b5033fafd tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd4da60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:32.719117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.726115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.729029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.730140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.731298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.731925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.836117 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28328258-acfc-42cc-8428-263b5033fafd tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.123027 Oct 17 13:30:32.837279 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1702/3472] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:32 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:32.863001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:32.869552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:32.899555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.902414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.904523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:32.909280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:32.911992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:32.913101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:33.462480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:33.491077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0066136-748c-4ab4-b73c-ec388cb107f2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.817162 Oct 17 13:30:33.495074 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1771/3473] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:32 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:33.523357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:33.526351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:33.567172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:33.568723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:33.569423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:33.570340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:33.571951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:33.572563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:33.686036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:33.700954 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72b766a3-655b-4e07-af94-c9b6c9360eee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1528 microversion: 2.1 time: 0.861851 Oct 17 13:30:33.702387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1703/3474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:32 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1528 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:33.730650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12c88190-709b-480a-a58e-d0fa54c49288 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:33.742327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-12c88190-709b-480a-a58e-d0fa54c49288 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] HTTP exception thrown: Flavor ab6df50d-4a54-4457-bb8c-ff5103aa650d could not be found. Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12c88190-709b-480a-a58e-d0fa54c49288 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Request method failure captured: Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/flavors/ab6df50d-4a54-4457-bb8c-ff5103aa650d HTTP/1.1 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfezTuh4ZPSKRzCKJWieJeL5kv_VdpvyqKF_xI8bCEao72o8d0LlgJcb4whcG2oGV8aYgxcHSRa4k49_4hC2dHkwbweUwaZoevbhNF3fYLSaP2itO7eMOUfi9mp4zrJ1whLG2-IFGID-FjgN8oqNXCPsmZk_9j5Hf_2p3oXlg9cTN4 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 160aea9570904e87b498c61bb6171b1d Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-MigrationsAdminTest-313454353 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/160aea9570904e87b498c61bb6171b1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/160aea9570904e87b498c61bb6171b1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/160aea9570904e87b498c61bb6171b1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_160aea9570904e87b498c61bb6171b1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-MigrationsAdminTest-313454353 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 160aea9570904e87b498c61bb6171b1d Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-MigrationsAdminTest-313454353 Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-MigrationsAdminTest-313454353-project-admin Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 238bd4e17419450cb3850f505c67581d Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-MigrationsAdminTest-313454353-project-admin Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: exception: Flavor ab6df50d-4a54-4457-bb8c-ff5103aa650d could not be found. Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ab6df50d-4a54-4457-bb8c-ff5103aa650d'} Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ab6df50d-4a54-4457-bb8c-ff5103aa650d could not be found. Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor ab6df50d-4a54-4457-bb8c-ff5103aa650d could not be found. Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:33.759842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ab6df50d-4a54-4457-bb8c-ff5103aa650d could not be found. Oct 17 13:30:33.767480 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:30:33.770114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12c88190-709b-480a-a58e-d0fa54c49288 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Returning 404 to user: Flavor ab6df50d-4a54-4457-bb8c-ff5103aa650d could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:33.771054 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12c88190-709b-480a-a58e-d0fa54c49288 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/ab6df50d-4a54-4457-bb8c-ff5103aa650d" status: 404 len: 109 microversion: 2.1 time: 0.045645 Oct 17 13:30:33.785874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1704/3475] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:33 2022] DELETE /compute/v2.1/flavors/ab6df50d-4a54-4457-bb8c-ff5103aa650d => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:30:33.791099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:33.791722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:33.820031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:33.820555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:33.821419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:33.823246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:33.824653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:33.827462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:34.010386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:34.027683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee430667-8224-41b5-a63a-e04d8d3b5c84 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1272 microversion: 2.1 time: 0.249480 Oct 17 13:30:34.030021 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1705/3476] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:33 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:34.035787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a79671c-2765-48b4-a931-11059c47ffa9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd3dd30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:34.114053 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a79671c-2765-48b4-a931-11059c47ffa9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.081083 Oct 17 13:30:34.114677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1706/3477] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:34 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:34.128373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-833523978", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:34.171863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:34.197863 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5e59a25-c8eb-4fa1-bad7-aab4d2d577dc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 0.691766 Oct 17 13:30:34.199146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1772/3478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:33 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:34.232809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:30:34.517704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:34.518641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:34.527730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:34.530865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:34.535226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:34.540370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:34.541303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:34.541978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:34.971348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:34.987377 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a02b52b-ef97-4fdd-97a6-48461102bec3 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.467908 Oct 17 13:30:34.987948 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1773/3479] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:34 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:34.994200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-dc0734a5-c760-4ed3-a521-f8b0aec0f01a req-74529fa2-36b6-4635-bfbe-d0f821c6faa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73432491-5ba9-4fba-8d40-1100517eafca", "tag": "7f5af312-583e-4a52-a461-d811f642c9ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:35.027900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dc0734a5-c760-4ed3-a521-f8b0aec0f01a req-74529fa2-36b6-4635-bfbe-d0f821c6faa7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.028818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dc0734a5-c760-4ed3-a521-f8b0aec0f01a req-74529fa2-36b6-4635-bfbe-d0f821c6faa7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.031168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dc0734a5-c760-4ed3-a521-f8b0aec0f01a req-74529fa2-36b6-4635-bfbe-d0f821c6faa7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.049880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:35.050867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:35.051518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:35.052123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:35.052724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:35.066579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-dc0734a5-c760-4ed3-a521-f8b0aec0f01a req-74529fa2-36b6-4635-bfbe-d0f821c6faa7 service nova] Creating event network-changed:7f5af312-583e-4a52-a461-d811f642c9ce for instance 73432491-5ba9-4fba-8d40-1100517eafca on n-h2-854121-14 Oct 17 13:30:35.080086 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-dc0734a5-c760-4ed3-a521-f8b0aec0f01a req-74529fa2-36b6-4635-bfbe-d0f821c6faa7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089483 Oct 17 13:30:35.082136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.083333 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1774/3480] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:35.090907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.091853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.092888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.093631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.094889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.096297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:35.102031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:35.117016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.118344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.121408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.122811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.125820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.129099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.147575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:35.160061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Getting quotas for user fec0e15aae5c4bf996ee4b8a98a496e2 and project 72898d2193744efcb00118587dcf3bea. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:35.198685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:30:35.205438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:30:35.288418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ade02abe-9b8c-48ba-a0ab-a5c531fcce13 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169965 Oct 17 13:30:35.295947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1707/3481] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:30:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:30:35.301451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a6ffecd-c48c-4d70-98bd-18e660005bc1 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd2cee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:35.436748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a6ffecd-c48c-4d70-98bd-18e660005bc1 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.139390 Oct 17 13:30:35.438425 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1708/3482] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:35 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:35.448653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:35.453012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:35.465095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.470079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.470893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:35.471779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:35.472350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:35.474505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:36.055469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:36.077207 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-272efc8e-6d2a-4987-bcfe-786f32e8d575 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.990217 Oct 17 13:30:36.079348 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1775/3483] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:35 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:36.120881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b126f6d-7872-43b0-9dfc-e2d1798e83a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:36.137083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b126f6d-7872-43b0-9dfc-e2d1798e83a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:37.118388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:37.181571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b126f6d-7872-43b0-9dfc-e2d1798e83a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:37.186728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:37.197145 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b126f6d-7872-43b0-9dfc-e2d1798e83a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1212 microversion: 2.1 time: 1.088284 Oct 17 13:30:37.199059 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1776/3484] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:36 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1212 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:37.213288 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-973bcde3-4251-4590-9fe7-424e97ef5825 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1518 microversion: 2.1 time: 1.769816 Oct 17 13:30:37.215262 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1709/3485] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:35 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1518 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:37.219316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:37.225350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:37.247857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0a5ccdb-7f70-44e0-9047-91a47f25c242 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f7d280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:37.280869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:37.282775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:37.283256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:37.285172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:37.288321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:37.288759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:37.353436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0a5ccdb-7f70-44e0-9047-91a47f25c242 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.122888 Oct 17 13:30:37.354487 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1710/3486] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:37 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:37.369196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:37.370575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:37.391820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:37.392373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:37.392806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:37.393928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:37.394552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:37.395144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.123433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:38.173212 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7b92eea-131e-485c-a4b4-6bc32be5cce1 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.812458 Oct 17 13:30:38.173212 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1711/3487] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:37 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:38.224515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:38.225045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:38.236453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:38.236978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:38.237743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.239727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:38.240274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:38.240789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.315338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:38.346758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-34951a0a-1644-45da-b3f7-cb4f1c691e60 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 1.133991 Oct 17 13:30:38.348880 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1777/3488] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:37 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:38.371102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:38.372114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:38.388033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:38.389336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:38.390107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.392381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:38.393240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:38.393989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.536408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:38.573501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53536a85-f195-4e87-a925-dae11f924bbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1272 microversion: 2.1 time: 0.351556 Oct 17 13:30:38.576145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1712/3489] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:38 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1272 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:38.586075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:38.588267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:38.600409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:38.601399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:38.602006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.602753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:38.603379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:38.604008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:38.650940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9446e439-21cd-4d8b-867e-735d2e84004f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/ips" status: 200 len: 151 microversion: 2.20 time: 0.072923 Oct 17 13:30:38.652246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1713/3490] 10.222.0.65 () {60 vars in 1289 bytes} [Mon Oct 17 13:30:38 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:30:38.661084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-518c2a3d-bfc3-45eb-bac6-2161d93087d6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce02820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:38.750479 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-518c2a3d-bfc3-45eb-bac6-2161d93087d6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.096369 Oct 17 13:30:38.762837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1714/3491] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:38 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:39.061748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:39.075693 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcaeadef-7068-4d6a-8e17-33cec2694961 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1524 microversion: 2.1 time: 0.725647 Oct 17 13:30:39.076294 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1778/3492] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:38 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1524 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:39.210702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:39.213326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:39.233563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:39.237141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:39.239709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:39.240848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:39.241717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:39.242492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:39.371490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:39.373423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:39.396476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:39.397278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:39.398772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:39.400363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:39.401059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:39.404863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.214528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:40.228307 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01e59898-7218-4a64-8e57-e6939b3afa7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 1.022100 Oct 17 13:30:40.241213 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1715/3493] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:39 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:40.250329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:40.253851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:40.278497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.279000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.279443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.280161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.280618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.281049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.327411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:40.341665 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f53fd71-8a30-42c6-8183-f241bd39da25 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.973134 Oct 17 13:30:40.343399 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1779/3494] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:39 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:40.356448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a72618ae-9cc9-4e2a-bd6d-81e872b4ca9a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce865e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:40.459991 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a72618ae-9cc9-4e2a-bd6d-81e872b4ca9a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1453 microversion: 2.1 time: 0.113556 Oct 17 13:30:40.461860 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1780/3495] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:40 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:40.468285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:40.469443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:40.479431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.480202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.480895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.481849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.482543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.484017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.623604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:40.642454 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa498a56-3cb4-4b7c-b0aa-a4234d6755c5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1270 microversion: 2.1 time: 0.411572 Oct 17 13:30:40.644623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1716/3496] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:40 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1270 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:40.662530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3cfc86d2-38ac-4fe8-a8fb-af626b3f7fa4 req-29bf52e9-d396-4037-9995-3b12c838ea8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208b6878-95d7-40a3-9107-0c1f4882c463", "name": "network-vif-unplugged", "status": "completed", "tag": "4f157780-b51f-4f5f-ab5c-87c51cc051f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:40.693833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3cfc86d2-38ac-4fe8-a8fb-af626b3f7fa4 req-29bf52e9-d396-4037-9995-3b12c838ea8a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:40.696987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3cfc86d2-38ac-4fe8-a8fb-af626b3f7fa4 req-29bf52e9-d396-4037-9995-3b12c838ea8a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:40.699916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3cfc86d2-38ac-4fe8-a8fb-af626b3f7fa4 req-29bf52e9-d396-4037-9995-3b12c838ea8a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:40.751879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3cfc86d2-38ac-4fe8-a8fb-af626b3f7fa4 req-29bf52e9-d396-4037-9995-3b12c838ea8a service nova] Creating event network-vif-unplugged:4f157780-b51f-4f5f-ab5c-87c51cc051f3 for instance 208b6878-95d7-40a3-9107-0c1f4882c463 on n-h2-854121-14 Oct 17 13:30:40.774033 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3cfc86d2-38ac-4fe8-a8fb-af626b3f7fa4 req-29bf52e9-d396-4037-9995-3b12c838ea8a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121082 Oct 17 13:30:40.776831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1717/3497] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:41.098178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:41.117471 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40d9614b-8ce1-4c60-8542-3309b1ffdb93 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1524 microversion: 2.1 time: 0.653020 Oct 17 13:30:41.121451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1781/3498] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:40 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1524 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:41.258092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:41.260491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:41.287885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.288400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.289395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.290340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.291189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.291786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.370411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:41.372013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:41.417954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.419169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.419854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:41.424788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:41.428385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:41.431178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.204189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:42.211923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:42.222163 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-769ae998-fb42-4642-9d29-87586bc1c452 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.968863 Oct 17 13:30:42.229620 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41150ec6-42fb-4a02-8b0b-0d88e11ab48a tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.858144 Oct 17 13:30:42.229840 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1718/3499] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:41 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:42.241445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19525933-17d8-4280-b746-04e235a6c0b9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f94820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:42.244976 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1782/3500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:41 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:42.250435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:42.251067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:42.275334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.275334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.279167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.279871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.280356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.281095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.370808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19525933-17d8-4280-b746-04e235a6c0b9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1462 microversion: 2.1 time: 0.134392 Oct 17 13:30:42.377461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1719/3501] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:42 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1462 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:42.385069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ed7b946a-1b3b-4ebb-bcd8-43e9c0715559 req-bc20ee4e-5652-4a80-a1c9-7c848b91c70b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a1a25d-2a00-48bb-8f77-bc886d031c69", "tag": "13b6ddce-498e-4ce5-88df-21a5b8f1b33c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:42.417128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed7b946a-1b3b-4ebb-bcd8-43e9c0715559 req-bc20ee4e-5652-4a80-a1c9-7c848b91c70b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.418178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed7b946a-1b3b-4ebb-bcd8-43e9c0715559 req-bc20ee4e-5652-4a80-a1c9-7c848b91c70b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.419515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ed7b946a-1b3b-4ebb-bcd8-43e9c0715559 req-bc20ee4e-5652-4a80-a1c9-7c848b91c70b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.465487 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ed7b946a-1b3b-4ebb-bcd8-43e9c0715559 req-bc20ee4e-5652-4a80-a1c9-7c848b91c70b service nova] Creating event network-changed:13b6ddce-498e-4ce5-88df-21a5b8f1b33c for instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 on n-h2-854121-14 Oct 17 13:30:42.481195 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ed7b946a-1b3b-4ebb-bcd8-43e9c0715559 req-bc20ee4e-5652-4a80-a1c9-7c848b91c70b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100655 Oct 17 13:30:42.483281 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1720/3502] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:42.500811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:42.503702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:42.540391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.544512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.544962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.546211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.548973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.550675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.575371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:42.914659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:42.928778 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-645d6b5d-da15-431d-83af-6c543d96ac6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.682541 Oct 17 13:30:42.943203 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1783/3503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:42 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:42.964567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:42.967576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:42.983278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.985737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.986412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:42.991100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:42.991605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:42.992053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.034678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lazy-loading 'flavor' on Instance uuid 82e45827-89b8-402f-befe-a8cb5d7d1e7f {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:30:43.057093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:43.069623 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2dddad6a-628e-4467-b56f-bd3522717728 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1524 microversion: 2.1 time: 0.582021 Oct 17 13:30:43.070003 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1721/3504] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:42 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1524 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:43.077813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18bee373-e066-4db5-8454-bad0363090df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd3d040>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:43.178235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18bee373-e066-4db5-8454-bad0363090df tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 200 len: 1462 microversion: 2.1 time: 0.103425 Oct 17 13:30:43.180837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1722/3505] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:43 2022] GET /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:43.223542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:43.230134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:43.304444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:43.313075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:43.313714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.314721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:43.315583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:43.316397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.626330 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f6e1705-b5c2-4e65-8d5f-17b851860cc6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/action" status: 202 len: 0 microversion: 2.20 time: 0.682848 Oct 17 13:30:43.627884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1784/3506] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:30:42 2022] POST /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:43.643807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:43.645269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:43.669787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:43.670344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:43.675095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.676030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:43.676517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:43.682486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.692421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:43.797717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:43.806920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc15f21e-9b6e-4d56-8619-360f7157c422 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1467 microversion: 2.1 time: 0.615356 Oct 17 13:30:43.808100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1723/3507] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:43 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1467 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:43.825759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:43.827466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:43.839224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:43.840181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:43.840850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:43.842514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:43.843364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:43.844723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.057780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.082774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6259fd3-7848-4a97-9934-a69139b1e0e2 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.452114 Oct 17 13:30:44.084273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1785/3508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:43 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:44.098347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:44.099349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:44.108566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.110322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.111005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.113324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.114011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.115058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.136981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.149629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05711a08-5c04-4876-8617-67c186c415c3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.339984 Oct 17 13:30:44.151910 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1724/3509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:43 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:44.168787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f88f49d0-68f8-461f-a860-510e28566244 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd9e9d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:44.371486 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f88f49d0-68f8-461f-a860-510e28566244 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?changes-since=2022-10-17T13%3A28%3A01Z" status: 200 len: 1902 microversion: 2.1 time: 0.211269 Oct 17 13:30:44.371486 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1725/3510] 10.222.0.65 () {58 vars in 1199 bytes} [Mon Oct 17 13:30:44 2022] GET /compute/v2.1/images?changes-since=2022-10-17T13%3A28%3A01Z => generated 1902 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:44.371660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:44.372166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:44.395141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.396077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.396806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.397894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.398418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.398991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.466943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.482804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.485347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.487089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-515a9b0f-061b-4daf-a839-e92b481c701a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.401619 Oct 17 13:30:44.487792 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1786/3511] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:44 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:44.495823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:44.497083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:44.506965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.508242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.509087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.510229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.511591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.512303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.849405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:44.863732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-235f2565-6475-47d3-9775-bda5ed96ccba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.496739 Oct 17 13:30:44.866029 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1726/3512] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:44 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:44.877375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2dbb015e-69ec-490f-96dd-0ef5a3ab3c44 req-d5b6711f-ba11-4897-ad6d-a961fa4b84cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:44.911503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2dbb015e-69ec-490f-96dd-0ef5a3ab3c44 req-d5b6711f-ba11-4897-ad6d-a961fa4b84cd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:44.916446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2dbb015e-69ec-490f-96dd-0ef5a3ab3c44 req-d5b6711f-ba11-4897-ad6d-a961fa4b84cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:44.917237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2dbb015e-69ec-490f-96dd-0ef5a3ab3c44 req-d5b6711f-ba11-4897-ad6d-a961fa4b84cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:44.932556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2dbb015e-69ec-490f-96dd-0ef5a3ab3c44 req-d5b6711f-ba11-4897-ad6d-a961fa4b84cd service nova] Creating event network-changed:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h1-854121-14 Oct 17 13:30:44.939397 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2dbb015e-69ec-490f-96dd-0ef5a3ab3c44 req-d5b6711f-ba11-4897-ad6d-a961fa4b84cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072021 Oct 17 13:30:44.940136 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1727/3513] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:44.951649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-279472c7-cac5-4b9a-8249-748b5411a685 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f41a1f7d550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:44.992195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:45.004061 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c86d5e5c-32c8-43a6-9d51-c285034e9015 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1524 microversion: 2.1 time: 0.512463 Oct 17 13:30:45.004889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1787/3514] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:44 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1524 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:45.096546 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-279472c7-cac5-4b9a-8249-748b5411a685 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1739691663" status: 200 len: 485 microversion: 2.1 time: 0.151809 Oct 17 13:30:45.099926 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1728/3515] 10.222.0.65 () {58 vars in 1231 bytes} [Mon Oct 17 13:30:44 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1739691663 => generated 485 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:45.116320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1350cf41-abb1-4056-bcc2-4971c9d9f888 req-d5930682-f359-4688-a6e8-030899645c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208b6878-95d7-40a3-9107-0c1f4882c463", "name": "network-vif-plugged", "status": "completed", "tag": "4f157780-b51f-4f5f-ab5c-87c51cc051f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:45.124359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:45.136565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1350cf41-abb1-4056-bcc2-4971c9d9f888 req-d5930682-f359-4688-a6e8-030899645c29 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:45.138311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1350cf41-abb1-4056-bcc2-4971c9d9f888 req-d5930682-f359-4688-a6e8-030899645c29 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:45.139117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1350cf41-abb1-4056-bcc2-4971c9d9f888 req-d5930682-f359-4688-a6e8-030899645c29 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:45.159726 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1350cf41-abb1-4056-bcc2-4971c9d9f888 req-d5930682-f359-4688-a6e8-030899645c29 service nova] Creating event network-vif-plugged:4f157780-b51f-4f5f-ab5c-87c51cc051f3 for instance 208b6878-95d7-40a3-9107-0c1f4882c463 on n-h2-854121-14 Oct 17 13:30:45.166518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1350cf41-abb1-4056-bcc2-4971c9d9f888 req-d5930682-f359-4688-a6e8-030899645c29 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053937 Oct 17 13:30:45.167402 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1729/3516] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:45.177232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:45.181698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:45.186207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=30 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:45.196468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:45.196954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:45.203788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:45.204836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:45.213606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:45.214114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:45.303202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-311848573", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:45.377768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] validate_networks() for [('6899df72-89a0-45b2-b6ce-880aaf135cdc', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:30:45.891833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:45.900809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab522597-c7c0-48ee-a9df-606c772c89de tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.732024 Oct 17 13:30:45.913828 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1730/3517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:45 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:45.924217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8f99e01-32fb-49e3-8623-85eb2a456106 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419dc9a820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:46.036726 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8f99e01-32fb-49e3-8623-85eb2a456106 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?server=a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 957 microversion: 2.1 time: 0.121575 Oct 17 13:30:46.038092 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1731/3518] 10.222.0.65 () {58 vars in 1209 bytes} [Mon Oct 17 13:30:45 2022] GET /compute/v2.1/images?server=a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 957 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:46.043139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:46.045969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:46.055438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.056231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.057465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.058788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.059565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.060574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.419310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:46.430004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d82ba5d8-806f-40f0-bb53-6a4657068022 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.390523 Oct 17 13:30:46.430598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1732/3519] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:46 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:46.436519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:46.438533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:46.445516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.446517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.447226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.448357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.449135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.450014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.558636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:46.560030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:46.560796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:46.561483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:46.562159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:46.584524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=41 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:46.596579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.599872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.600603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.604030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.605446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.606293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.649606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:46.659252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Getting quotas for project fd9375f00d234e46abc756b0c482e73f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:46.660557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:46.662328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:46.663846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fcc8491a-8888-4d22-b8dd-7ce232635911 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.231085 Oct 17 13:30:46.677189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1733/3520] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:46 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:46.677414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Getting quotas for user 55a415731f7c4b389e33a1e15388358b and project fd9375f00d234e46abc756b0c482e73f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:46.684586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:46.684586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:46.693729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.694514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.695196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.696130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.696916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.697600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.710681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:30:46.716551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:30:46.812168 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26558c15-043d-4ed6-9476-007c923f26c2 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.805548 Oct 17 13:30:46.821842 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1788/3521] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:30:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:30:46.830166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:46.831028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:46.846087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.847518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.848761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:46.849893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:46.850525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:46.851312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.064026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:47.100654 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-43b78aba-2806-48dc-b97d-46fb0a6c25b0 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.433193 Oct 17 13:30:47.101915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1734/3522] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:46 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.106815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4dfe927-434c-4033-b9fb-067b5463a10e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd2cc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.120293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:47.129391 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e2fc300-d387-4f36-8130-8a65bf92c24f tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1524 microversion: 2.1 time: 0.305678 Oct 17 13:30:47.134663 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1789/3523] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:46 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1524 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.142035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e33cdb5a-06b0-4339-86b3-ba5b8011c8da tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.143284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e33cdb5a-06b0-4339-86b3-ba5b8011c8da tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.192553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4dfe927-434c-4033-b9fb-067b5463a10e tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fv2.1%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 485 microversion: 2.1 time: 0.089215 Oct 17 13:30:47.193079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1735/3524] 10.222.0.65 () {58 vars in 1317 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fv2.1%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 485 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:47.197826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.200390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.209209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.209711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.210152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.210864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.211336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.211927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.312721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e33cdb5a-06b0-4339-86b3-ba5b8011c8da tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:47.329904 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e33cdb5a-06b0-4339-86b3-ba5b8011c8da tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1213 microversion: 2.1 time: 0.193464 Oct 17 13:30:47.331510 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1790/3525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.449541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-269a8271-6cc6-4d35-addc-1a8b5bcf123a req-51e4db86-2a5f-43c7-9144-c9babd50a02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "name": "network-vif-unplugged", "status": "completed", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:47.466636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-269a8271-6cc6-4d35-addc-1a8b5bcf123a req-51e4db86-2a5f-43c7-9144-c9babd50a02e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.467694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-269a8271-6cc6-4d35-addc-1a8b5bcf123a req-51e4db86-2a5f-43c7-9144-c9babd50a02e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.473690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-269a8271-6cc6-4d35-addc-1a8b5bcf123a req-51e4db86-2a5f-43c7-9144-c9babd50a02e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.488215 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-269a8271-6cc6-4d35-addc-1a8b5bcf123a req-51e4db86-2a5f-43c7-9144-c9babd50a02e service nova] Creating event network-vif-unplugged:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:30:47.497824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-269a8271-6cc6-4d35-addc-1a8b5bcf123a req-51e4db86-2a5f-43c7-9144-c9babd50a02e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164242 Oct 17 13:30:47.503395 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1791/3526] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:47.511367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0733e1a6-af81-4ebc-a36e-d5ecefecadc1 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce55d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.574896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0733e1a6-af81-4ebc-a36e-d5ecefecadc1 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 485 microversion: 2.1 time: 0.068932 Oct 17 13:30:47.578821 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1792/3527] 10.222.0.65 () {58 vars in 1303 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 485 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:47.584168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.586859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.593435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.594221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.594826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.595701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.596315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.597225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.601700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:47.611006 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4636814-31af-4740-9297-5e5da2f03ae7 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.416067 Oct 17 13:30:47.612247 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1736/3528] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.618193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42c55ef5-9d86-4848-bcdf-5b29473f067a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce149d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.751476 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42c55ef5-9d86-4848-bcdf-5b29473f067a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.137955 Oct 17 13:30:47.752726 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1737/3529] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.757698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.758531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:47.768136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.768633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.769067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.770100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:47.770555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:47.770978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:47.889883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:47.898884 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3690ddb4-7e1e-4f22-b390-fa2225773a7e tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.318883 Oct 17 13:30:47.900496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1793/3530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:47.908254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a06b4e24-d0ab-4c4d-8107-05442bf421da tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce55d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:47.992720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a06b4e24-d0ab-4c4d-8107-05442bf421da tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.090798 Oct 17 13:30:47.993985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1794/3531] 10.222.0.65 () {58 vars in 1149 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:48.003120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:48.008083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:48.009534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90513626-6a34-4c78-8854-1ad90e0d0562 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce66310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.009666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:48.010757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3765a3e0-7590-423f-a5da-0eb43ef0adfd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.256815 Oct 17 13:30:48.011317 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1738/3532] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:47 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:48.072385 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90513626-6a34-4c78-8854-1ad90e0d0562 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.066065 Oct 17 13:30:48.073093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1795/3533] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:48.087069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56ae2dc1-0350-42e1-a126-e0868f62f5be tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd2c940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.124181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.125409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:48.142370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.143018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.144279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.145545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.147324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.148293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.223403 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-56ae2dc1-0350-42e1-a126-e0868f62f5be tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?changes-since=2022-10-17T13%3A27%3A53Z" status: 200 len: 6328 microversion: 2.1 time: 0.139963 Oct 17 13:30:48.224825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1739/3534] 10.222.0.65 () {58 vars in 1220 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-17T13%3A27%3A53Z => generated 6328 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:48.242699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.243822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:48.252993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.253857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.254407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.255232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.255787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.256474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.473964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:48.487058 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0bc90ff4-1747-4784-b3ba-f0959e3078a1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.366491 Oct 17 13:30:48.502435 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1796/3535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:48.502435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b1054eb-8372-48d9-a01a-94a045115e2b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce07820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.558741 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b1054eb-8372-48d9-a01a-94a045115e2b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1739691663" status: 200 len: 665 microversion: 2.1 time: 0.069560 Oct 17 13:30:48.559654 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1797/3536] 10.222.0.65 () {58 vars in 1252 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1739691663 => generated 665 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:48.565011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.565648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:48.575115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.575699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.576047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.576882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.577382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.578248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.705008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:48.715884 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a9e0f20-dc91-40fa-92f7-4ddce74dd6c9 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1524 microversion: 2.1 time: 0.488942 Oct 17 13:30:48.717461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1740/3537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1524 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:48.725754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88a8f6aa-d94a-43b0-8769-8e1c6fe65a2d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd5c670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.790850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:48.803132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00772bc3-2625-426b-8e68-36816273b258 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1217 microversion: 2.1 time: 0.242341 Oct 17 13:30:48.804039 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1798/3538] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:48.808683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.809325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:48.825669 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88a8f6aa-d94a-43b0-8769-8e1c6fe65a2d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fv2.1%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1465 microversion: 2.1 time: 0.105531 Oct 17 13:30:48.830206 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1741/3539] 10.222.0.65 () {58 vars in 1338 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fv2.1%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1465 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:48.832105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.832921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.833470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.834368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.834825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.835428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.844979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbacde94-1f61-4c5b-abb2-4f1eb0f040f9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce02280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.949514 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbacde94-1f61-4c5b-abb2-4f1eb0f040f9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1465 microversion: 2.1 time: 0.109499 Oct 17 13:30:48.964289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1742/3540] 10.222.0.65 () {58 vars in 1324 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.65%2Fcompute%2Fservers%2F3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1465 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:48.970236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:48.970890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:48.979316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.979934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.980438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:48.981395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:48.982004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:48.982499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:49.271196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:49.285046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7963831-beb8-4a89-89c8-f033d0813643 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.479654 Oct 17 13:30:49.302727 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1799/3541] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:49.309209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d97c384c-329c-4ad2-9667-7388560f6c3d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce1e940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:49.389808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:49.399761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1bafae6-1947-4540-a44f-3b544911f011 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.434303 Oct 17 13:30:49.424639 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1743/3542] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:48 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:49.430140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:49.431007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:49.438627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:49.439317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:49.440223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:49.441101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:49.441587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:49.442079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:49.477315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d97c384c-329c-4ad2-9667-7388560f6c3d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.172959 Oct 17 13:30:49.477926 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1800/3543] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Oct 17 13:30:49 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:49.498915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-465968d8-377d-4348-81b3-a44450a1a3aa tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce07670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:49.581373 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-465968d8-377d-4348-81b3-a44450a1a3aa tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.086566 Oct 17 13:30:49.583603 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1801/3544] 10.222.0.65 () {58 vars in 1170 bytes} [Mon Oct 17 13:30:49 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:49.589260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:49.590225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:49.592594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:49.604633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:49.605673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:49.606361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:49.607311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:49.607776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:49.608203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.089821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.103903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e2202a5-b130-4eb6-a8cf-3fcade345dba tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.518546 Oct 17 13:30:50.104759 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1802/3545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:49 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:50.110598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-39dd40d1-854f-43ec-938c-731d0fff367d req-e9221072-9244-43ed-80a6-6508d2f1c10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73432491-5ba9-4fba-8d40-1100517eafca", "name": "network-vif-plugged", "status": "completed", "tag": "7f5af312-583e-4a52-a461-d811f642c9ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:50.120773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-39dd40d1-854f-43ec-938c-731d0fff367d req-e9221072-9244-43ed-80a6-6508d2f1c10d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.121558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-39dd40d1-854f-43ec-938c-731d0fff367d req-e9221072-9244-43ed-80a6-6508d2f1c10d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.124583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-39dd40d1-854f-43ec-938c-731d0fff367d req-e9221072-9244-43ed-80a6-6508d2f1c10d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.126871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.152928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.161927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.163457 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4feead0d-6127-4996-b1ae-ba0248d4f15e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.737583 Oct 17 13:30:50.165852 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-39dd40d1-854f-43ec-938c-731d0fff367d req-e9221072-9244-43ed-80a6-6508d2f1c10d service nova] Creating event network-vif-plugged:7f5af312-583e-4a52-a461-d811f642c9ce for instance 73432491-5ba9-4fba-8d40-1100517eafca on n-h2-854121-14 Oct 17 13:30:50.168244 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1744/3546] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:49 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:50.182829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-482c9a02-1eaa-4dd7-95fb-24eebe9c278d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce02700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.186983 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-39dd40d1-854f-43ec-938c-731d0fff367d req-e9221072-9244-43ed-80a6-6508d2f1c10d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080824 Oct 17 13:30:50.191906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1803/3547] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:50.206964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.208145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:50.215827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.216680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.217310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.219401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.220246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.220845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.322055 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-482c9a02-1eaa-4dd7-95fb-24eebe9c278d tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/db51f7c1-415a-4ea9-94a7-afd34c3636cd" status: 200 len: 784 microversion: 2.1 time: 0.152269 Oct 17 13:30:50.345560 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1745/3548] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/images/db51f7c1-415a-4ea9-94a7-afd34c3636cd => generated 784 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:50.353493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.354119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:50.381600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.382331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.396211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.398947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.399822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.400657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.544508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.561667 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-363591b9-21a8-4157-92af-2a6cb45661ce tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1271 microversion: 2.1 time: 0.214234 Oct 17 13:30:50.564285 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1746/3549] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:50.572196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.573292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:50.583367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.584829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.585604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.587605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.589090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.589763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.720885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.730503 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7cec663b-5dfd-4467-9bad-ee6a5d95c205 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1509 microversion: 2.1 time: 0.534510 Oct 17 13:30:50.731322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1804/3550] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1509 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:50.747243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d234889-5958-4eef-b88a-ddc8180ddbe9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce863a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.783019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:50.795458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65bc4d94-bd5f-4f16-9cbc-67a6842f6617 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.229171 Oct 17 13:30:50.795978 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1747/3551] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:50.802575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.803465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:50.810530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.811133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.811758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.812666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.813363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.813790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.820682 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d234889-5958-4eef-b88a-ddc8180ddbe9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.086789 Oct 17 13:30:50.821593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1805/3552] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:50.826899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:50.827601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:50.835281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.835850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.836357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:50.837135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:50.837681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:50.838373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.029947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:51.032822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:51.039994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6dce63c1-999f-4914-92b7-f9cc355a32ee tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.240647 Oct 17 13:30:51.040719 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1748/3553] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:51.041852 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dbd8c895-30c4-4c03-aa88-a291a2e06fde tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 200 len: 1509 microversion: 2.1 time: 0.218556 Oct 17 13:30:51.042433 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1806/3554] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:50 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:51.047241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba9a5038-2a20-4511-807c-234ad1a02d5b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419cd3ddc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:51.068700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:51.069484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:51.077233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.078069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.078932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.079812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.080710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.080856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.108259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:51.208083 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92483ec4-eece-4bc6-914e-e1ce8c77d1b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "DELETE /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 204 len: 0 microversion: 2.1 time: 0.143515 Oct 17 13:30:51.212567 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1807/3555] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:51 2022] DELETE /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:30:51.219925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:51.220634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:51.228818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.229647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.230840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.231700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.232615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.233553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.459870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:51.470364 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d20cfce-a91b-4fac-9f8a-b9056845d9ff tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.255735 Oct 17 13:30:51.480589 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1808/3556] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:51 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:51.480589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:51.480589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:51.489402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.489402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.489402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.489402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.489402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.489402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.652328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:51.675576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:51.679754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:51.682819 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4e36920-948e-4baa-a207-13cfd0623047 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.209161 Oct 17 13:30:51.682819 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1809/3557] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:51 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:51.693734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-429081343", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "99a30118-d7c2-4414-85aa-d0c48dec24c1"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:51.753358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] validate_networks() for [('99a30118-d7c2-4414-85aa-d0c48dec24c1', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:30:51.843058 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba9a5038-2a20-4511-807c-234ad1a02d5b tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1" status: 204 len: 0 microversion: 2.1 time: 0.800667 Oct 17 13:30:51.844350 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1749/3558] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:51 2022] DELETE /compute/v2.1/images/1f0cabda-fd09-4cf8-a24c-e4e2f10c33a1 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:51.849533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:51.850426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:51.856750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.857600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.858249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.859680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:51.860362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:51.860996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:51.866793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:52.143841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:52.155464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f621128a-2792-4496-9224-a464b10821f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.309469 Oct 17 13:30:52.157884 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1750/3559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:51 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:52.166415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:52.167436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:52.174796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.175282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.175714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.176442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.176888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.177479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.404504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:30:52.404672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:30:52.405138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:30:52.405565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:30:52.406084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:30:52.416003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.416490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.416920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.417953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.418416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.418854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.427548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:52.447933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Getting quotas for project bf8d2529de0a43119965e8ededb97bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:30:52.455039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Getting quotas for user 17f16d27aa024ca091d45cbac8c00cbf and project bf8d2529de0a43119965e8ededb97bcf. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:30:52.469595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:30:52.471940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:30:52.529106 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65379e09-3327-48ff-af2a-12126ca25ebe tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.845027 Oct 17 13:30:52.530808 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1810/3560] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:30:52.536174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76ececfa-341b-4027-abe8-19ec2471926c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce660d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:52.560605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:52.572051 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42f71f30-edf9-4a01-a6c2-78cb56384acf tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1313 microversion: 2.1 time: 0.412513 Oct 17 13:30:52.573188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1751/3561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:52 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:52.579935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:52.580577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:52.588108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.589518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.590146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.591305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.591718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.595352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.790381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:52.799570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba297236-7562-4bee-984b-87b452b30331 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.225285 Oct 17 13:30:52.800720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1752/3562] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:52 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:52.816516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-57cfeeb1-8616-465b-9fad-84bb7a24e38e req-012e70e6-4872-40cc-8ef8-274565966001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "name": "network-vif-plugged", "status": "completed", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:52.829500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-57cfeeb1-8616-465b-9fad-84bb7a24e38e req-012e70e6-4872-40cc-8ef8-274565966001 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.830121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-57cfeeb1-8616-465b-9fad-84bb7a24e38e req-012e70e6-4872-40cc-8ef8-274565966001 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.830684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-57cfeeb1-8616-465b-9fad-84bb7a24e38e req-012e70e6-4872-40cc-8ef8-274565966001 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.845062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-57cfeeb1-8616-465b-9fad-84bb7a24e38e req-012e70e6-4872-40cc-8ef8-274565966001 service nova] Creating event network-vif-plugged:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h1-854121-14 Oct 17 13:30:52.854728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-57cfeeb1-8616-465b-9fad-84bb7a24e38e req-012e70e6-4872-40cc-8ef8-274565966001 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051636 Oct 17 13:30:52.855948 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1753/3563] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:52.962866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:52.963900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:52.972157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.972870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.973368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:52.974156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:52.974637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:52.975145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:53.174219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:53.185612 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f29305c-a340-49be-bcd6-e44c9144981e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.327980 Oct 17 13:30:53.186853 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1754/3564] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:52 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:53.192370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b1147ac-6685-42b3-8c23-e9e58ed72ce2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:53.193645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b1147ac-6685-42b3-8c23-e9e58ed72ce2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:53.206774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:53.223635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76ececfa-341b-4027-abe8-19ec2471926c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3" status: 204 len: 0 microversion: 2.1 time: 0.691179 Oct 17 13:30:53.224488 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1811/3565] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:52 2022] DELETE /compute/v2.1/images/6b9e8f2e-66b6-4215-ba16-d1cf8e1403d3 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:53.233288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:53.235318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:53.253538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:53.254285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:53.254891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:53.256338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:53.257747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:53.258933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:53.289713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b1147ac-6685-42b3-8c23-e9e58ed72ce2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:53.304651 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b1147ac-6685-42b3-8c23-e9e58ed72ce2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1217 microversion: 2.1 time: 0.115759 Oct 17 13:30:53.309726 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1755/3566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:53 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:53.321927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:53.322797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:53.339438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:53.342344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:53.342873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:53.344512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:53.345021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:53.345496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:53.512859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:53.526214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:53.528697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:53.532828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1af5ae7-afe8-4917-b7a7-401448d493ef tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.305139 Oct 17 13:30:53.534498 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1812/3567] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:53 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:53.549903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4caa2958-fc98-4995-baba-28e35251cc7c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce9eaf0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:53.600990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:53.621713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a97be7d-a73e-485a-882e-4bf5755f3428 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.310400 Oct 17 13:30:53.640201 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1756/3568] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:53 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:53.640201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:53.640201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:53.651841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:53.652362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:53.654097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:53.654897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:53.655372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:53.655813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.010182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:54.028085 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7de5756c-cecb-4ed1-89e1-6514e65234fa tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1498 microversion: 2.1 time: 0.403682 Oct 17 13:30:54.028843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1757/3569] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:53 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1498 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:54.035393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.036161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.042760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.043824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.044550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.045536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.047613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.048314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.268187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:54.276940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89231ef4-97dd-443a-b1d7-130e5e77cb9c tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.245936 Oct 17 13:30:54.277618 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1758/3570] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:54 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:54.285767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b038f0ac-61fc-4235-8bd8-94f79157072e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.304620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_groups [None req-b038f0ac-61fc-4235-8bd8-94f79157072e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Querying cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) for 1 instances {{(pid=120697) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:30:54.306062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b038f0ac-61fc-4235-8bd8-94f79157072e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.306742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b038f0ac-61fc-4235-8bd8-94f79157072e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.307622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b038f0ac-61fc-4235-8bd8-94f79157072e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.324997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4caa2958-fc98-4995-baba-28e35251cc7c tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7" status: 204 len: 0 microversion: 2.1 time: 0.788848 Oct 17 13:30:54.328654 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1813/3571] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:53 2022] DELETE /compute/v2.1/images/331587a8-b89b-4b5d-b63d-639eb9c1a2f7 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:54.332631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.333735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.351336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.353825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.354490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.356413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.357747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.358747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.420271 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b038f0ac-61fc-4235-8bd8-94f79157072e tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups/e74d6299-0966-46f6-af09-6a7812d18b23" status: 200 len: 222 microversion: 2.1 time: 0.140453 Oct 17 13:30:54.428474 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1759/3572] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:30:54 2022] GET /compute/v2.1/os-server-groups/e74d6299-0966-46f6-af09-6a7812d18b23 => generated 222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:54.433972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.434955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.442051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.446017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.446769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.447884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.448899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.449603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.586452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:54.605290 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-defe259e-448a-4e84-9efc-62cb4d7fcaf2 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1269 microversion: 2.1 time: 0.175076 Oct 17 13:30:54.606520 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1760/3573] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:54 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:54.613641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.614516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.622134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.623155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.623816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.624766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.626198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.626862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.691094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:54.693423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:54.702394 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38ff8b7c-53da-4e0a-bc48-a46edb92e120 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1312 microversion: 2.1 time: 0.374781 Oct 17 13:30:54.704440 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1814/3574] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:54 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1312 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:54.709932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.710846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.717514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.718417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.722001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.723154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.725335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.726083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.787076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:54.851669 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b963033e-f520-4976-8e2c-500de57bb8fb tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 204 len: 0 microversion: 2.1 time: 0.243286 Oct 17 13:30:54.852629 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1761/3575] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:54 2022] DELETE /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:54.859472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3e1fc2ec-438a-4e42-b46e-56ce9c975579 req-6b2f9db4-44be-4ae6-a0d1-57dd63d08540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "208b6878-95d7-40a3-9107-0c1f4882c463", "name": "network-vif-deleted", "tag": "4f157780-b51f-4f5f-ab5c-87c51cc051f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:54.873724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3e1fc2ec-438a-4e42-b46e-56ce9c975579 req-6b2f9db4-44be-4ae6-a0d1-57dd63d08540 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.874513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3e1fc2ec-438a-4e42-b46e-56ce9c975579 req-6b2f9db4-44be-4ae6-a0d1-57dd63d08540 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.875837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3e1fc2ec-438a-4e42-b46e-56ce9c975579 req-6b2f9db4-44be-4ae6-a0d1-57dd63d08540 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.904553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3e1fc2ec-438a-4e42-b46e-56ce9c975579 req-6b2f9db4-44be-4ae6-a0d1-57dd63d08540 service nova] Creating event network-vif-deleted:4f157780-b51f-4f5f-ab5c-87c51cc051f3 for instance 208b6878-95d7-40a3-9107-0c1f4882c463 on n-h2-854121-14 Oct 17 13:30:54.911115 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3e1fc2ec-438a-4e42-b46e-56ce9c975579 req-6b2f9db4-44be-4ae6-a0d1-57dd63d08540 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056363 Oct 17 13:30:54.912441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1762/3576] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:54.917649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.918826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.928306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.929526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.930502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.932101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.932770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.933418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.946810 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d6cb6cb-a9f7-45e1-8059-e118cce43e12 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 204 len: 0 microversion: 2.1 time: 0.240681 Oct 17 13:30:54.954242 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1815/3577] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:54 2022] DELETE /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:54.960955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:54.967047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:54.979464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.980284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.980700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:54.981509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:54.981998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:54.982491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.262718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:55.271701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:55.273196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:55.274479 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa0c3a62-3519-415c-83f2-e5995c2ecbf3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.360825 Oct 17 13:30:55.274929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1763/3578] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:54 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:55.279384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b13414c5-b6cc-46d2-a24f-f0b1899bd6b9 req-bd7d2d97-57e6-49b4-8964-9e1c755bdd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a644097-0001-4764-812e-210cc06b12a0", "tag": "fd196736-c92a-477c-8c68-b4161a19f8ab"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:55.282474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:55.295937 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0c7f71e0-8c49-4a3b-a7a1-e0b73240f004 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.339948 Oct 17 13:30:55.297535 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1816/3579] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:54 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:55.298938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b13414c5-b6cc-46d2-a24f-f0b1899bd6b9 req-bd7d2d97-57e6-49b4-8964-9e1c755bdd2b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.299790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b13414c5-b6cc-46d2-a24f-f0b1899bd6b9 req-bd7d2d97-57e6-49b4-8964-9e1c755bdd2b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.300405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b13414c5-b6cc-46d2-a24f-f0b1899bd6b9 req-bd7d2d97-57e6-49b4-8964-9e1c755bdd2b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.304107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:55.304913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:55.311213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.311915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.313327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.314046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.314499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.314918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.316523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b13414c5-b6cc-46d2-a24f-f0b1899bd6b9 req-bd7d2d97-57e6-49b4-8964-9e1c755bdd2b service nova] Creating event network-changed:fd196736-c92a-477c-8c68-b4161a19f8ab for instance 8a644097-0001-4764-812e-210cc06b12a0 on n-h2-854121-14 Oct 17 13:30:55.321891 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b13414c5-b6cc-46d2-a24f-f0b1899bd6b9 req-bd7d2d97-57e6-49b4-8964-9e1c755bdd2b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045706 Oct 17 13:30:55.322640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1764/3580] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:55.329265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a447bd86-4182-4e79-a581-ab9d7cd9471a req-acbe7ad5-97a1-47e5-aa98-22b98e178b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a1a25d-2a00-48bb-8f77-bc886d031c69", "name": "network-vif-plugged", "status": "completed", "tag": "13b6ddce-498e-4ce5-88df-21a5b8f1b33c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:55.338995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a447bd86-4182-4e79-a581-ab9d7cd9471a req-acbe7ad5-97a1-47e5-aa98-22b98e178b69 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.339606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a447bd86-4182-4e79-a581-ab9d7cd9471a req-acbe7ad5-97a1-47e5-aa98-22b98e178b69 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.340167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a447bd86-4182-4e79-a581-ab9d7cd9471a req-acbe7ad5-97a1-47e5-aa98-22b98e178b69 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.352514 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a447bd86-4182-4e79-a581-ab9d7cd9471a req-acbe7ad5-97a1-47e5-aa98-22b98e178b69 service nova] Creating event network-vif-plugged:13b6ddce-498e-4ce5-88df-21a5b8f1b33c for instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 on n-h2-854121-14 Oct 17 13:30:55.357453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a447bd86-4182-4e79-a581-ab9d7cd9471a req-acbe7ad5-97a1-47e5-aa98-22b98e178b69 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033101 Oct 17 13:30:55.358116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1765/3581] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:55.363698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:55.364409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:55.371243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.371724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.372166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.372898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.373531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.374060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.871722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:55.880173 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16a6ec3b-a989-4d78-8478-ab0013aa4071 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1474 microversion: 2.1 time: 0.581306 Oct 17 13:30:55.880759 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1817/3582] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:55 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1474 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:55.885271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:55.885851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:55.892393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.892885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.893360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.894255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.894711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.895153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.930287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:55.939404 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-09f29700-3aaf-4fb3-8af2-e31c23111672 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1504 microversion: 2.1 time: 0.580177 Oct 17 13:30:55.939996 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1766/3583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:55 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:55.944640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:55.945265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:55.954353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.954822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.955250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:55.955946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:55.956390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:55.956809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.054506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.063824 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f658eb1-2daf-4fd1-8524-b9871d48080d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1277 microversion: 2.1 time: 0.122701 Oct 17 13:30:56.064437 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1767/3584] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:55 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:56.081383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:56.082035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:56.088141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.088622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.089057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.089774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.090227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.090652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.151514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.159484 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b7867ac-5524-48ac-9c48-edb6e6d8ebed tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.277722 Oct 17 13:30:56.160151 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1818/3585] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:55 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:56.294298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.301784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:56.302800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:56.303596 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b82f4c1b-1519-4b00-9dcb-af864d641b64 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1461 microversion: 2.1 time: 0.238026 Oct 17 13:30:56.304188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1768/3586] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:56 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1461 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:56.310676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.316285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.317840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.318756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.319395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.319821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.324810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:56.325823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:56.339536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.340143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.340691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.341973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.342612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.343131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.349410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:56.759473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.774974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.792238 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b797d4d-22d3-440a-a77f-79fe830b02dc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.475251 Oct 17 13:30:56.794662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.795720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1769/3587] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:56 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:56.796264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:56.798516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80fb122a-caaa-41bb-a320-9bd15d333e99 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.502663 Oct 17 13:30:56.814434 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1819/3588] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:56 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:56.815161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:56.815161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:56.818853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.819593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.820196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.821074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.821791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.823710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.904561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:56.905999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:56.913074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.913597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.914213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:56.915124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:56.915574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:56.916162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.136971 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ab0a17b-7157-47d9-b045-0117489abe99 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1614 microversion: 2.1 time: 0.334428 Oct 17 13:30:57.142045 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1770/3589] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:56 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1614 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:57.153425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:57.156203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:57.171803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.173742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.174755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.176998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.178833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.179787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.231693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:57.240540 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c86187b4-5cef-4ec0-8f8b-3d56f6c1553a tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 200 len: 1474 microversion: 2.1 time: 0.339797 Oct 17 13:30:57.241716 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1820/3590] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:56 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:30:57.246726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:57.247540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:57.254323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.255034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.255677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.256560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.257218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.257907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.398020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:57.407607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07e5996b-7818-47ad-8b9e-4eac49ce653d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1275 microversion: 2.1 time: 0.164638 Oct 17 13:30:57.408203 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1821/3591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:57 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1275 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:57.415408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:57.416213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:57.423412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.424325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.424770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.425717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.426095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.426716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.458147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '238bd4e17419450cb3850f505c67581d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '160aea9570904e87b498c61bb6171b1d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:57.459507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] flavor_id is None. Assuming migration. {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 13:30:57.459947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 13:30:57.528552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:57.538561 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22208c42-f560-424d-850e-5b56960ef9d6 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1504 microversion: 2.1 time: 0.395105 Oct 17 13:30:57.539155 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1771/3592] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:57 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:57.562078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:57.563003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:57.570162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.570936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.571544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.572591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.573334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.573985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.608922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11511c03-a6c5-4f80-ba65-3ed59577ac60 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb/action" status: 202 len: 0 microversion: 2.1 time: 0.198664 Oct 17 13:30:57.620522 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1822/3593] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:30:57 2022] POST /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:30:57.626161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:57.627432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:57.639001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.640098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.641204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:57.647108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:57.647272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:57.647600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.160335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:58.177459 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-610360f9-d50a-4571-9943-c76451daba3d tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.621785 Oct 17 13:30:58.181511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:58.190244 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86fec900-815f-4fbc-9c6d-30a754943ced tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1470 microversion: 2.1 time: 0.568414 Oct 17 13:30:58.194540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1772/3594] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:57 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:58.202442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:58.203453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:58.210587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1823/3595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:57 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:58.211963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.212752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.213807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.214940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.215690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.216325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.219105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:58.219731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:58.242612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.244735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.245421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.246492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.247125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.254950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.714187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:58.725146 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-501cca5a-1617-4c9f-9949-ca52bd685a32 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.527129 Oct 17 13:30:58.745216 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1773/3596] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:58 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:58.745456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:58.753594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:58.758074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7612d133-c0fa-4a18-8d9a-41e8907b3e02 req-06f0a1e2-df8d-4487-904d-b9af0c4c8e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3be2a371-cdcd-4928-a92a-7c4b5118d776", "name": "network-vif-deleted", "tag": "57cc1827-dab3-48ea-9688-e790d4b193e9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:58.759057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:58.762294 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f31b387f-69d4-4c9a-94a5-3964c8423fe7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.549791 Oct 17 13:30:58.764343 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1824/3597] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:58 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:30:58.770367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7612d133-c0fa-4a18-8d9a-41e8907b3e02 req-06f0a1e2-df8d-4487-904d-b9af0c4c8e54 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.772319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7612d133-c0fa-4a18-8d9a-41e8907b3e02 req-06f0a1e2-df8d-4487-904d-b9af0c4c8e54 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.773572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7612d133-c0fa-4a18-8d9a-41e8907b3e02 req-06f0a1e2-df8d-4487-904d-b9af0c4c8e54 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.780575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:58.784067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: 3be2a371-cdcd-4928-a92a-7c4b5118d776] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:58.797903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7612d133-c0fa-4a18-8d9a-41e8907b3e02 req-06f0a1e2-df8d-4487-904d-b9af0c4c8e54 service nova] Creating event network-vif-deleted:57cc1827-dab3-48ea-9688-e790d4b193e9 for instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 on n-h1-854121-14 Oct 17 13:30:58.801358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.804072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.804766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.805549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.805947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7612d133-c0fa-4a18-8d9a-41e8907b3e02 req-06f0a1e2-df8d-4487-904d-b9af0c4c8e54 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062735 Oct 17 13:30:58.806421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.807096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.807878 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1774/3598] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:58.815606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:58.816499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:58.828224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.828994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.829641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.830601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.831457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.832106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.867490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] HTTP exception thrown: Instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 could not be found. Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Request method failure captured: Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 HTTP/1.1 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhYLqngW4iRStzzpP1GjbxePn3r-3aCuWL4cdSmeImf30lA-vAGTDftrxanK8GKFam3oxOmRakVCsTgfNtZJH109PYMIw7DYM0iwrR1pe0o4x5goM5C8hzKO4vVxA7Q4xg-ulCrrx4xwFbfQUU0mMlHkxAMYuKJ9AfIBKjrxipHAZ4 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a093da4643464296a663c7010d07dc36 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListImageFiltersTestJSON-413870884 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a093da4643464296a663c7010d07dc36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a093da4643464296a663c7010d07dc36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a093da4643464296a663c7010d07dc36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a093da4643464296a663c7010d07dc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListImageFiltersTestJSON-413870884 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a093da4643464296a663c7010d07dc36 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-413870884 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListImageFiltersTestJSON-413870884-project Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 7a795921a8c449459f1f4b02852af1a2 Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListImageFiltersTestJSON-413870884-project Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 could not be found. Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3be2a371-cdcd-4928-a92a-7c4b5118d776'} Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 could not be found. Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 could not be found. Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:30:58.871598 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 could not be found. Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Returning 404 to user: Instance 3be2a371-cdcd-4928-a92a-7c4b5118d776 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed1f0241-a406-4c5e-9ee6-820a76fc9313 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776" status: 404 len: 111 microversion: 2.1 time: 0.107814 Oct 17 13:30:58.876413 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1825/3599] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:58 2022] GET /compute/v2.1/servers/3be2a371-cdcd-4928-a92a-7c4b5118d776 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:30:58.879852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:58.880265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:58.891927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.893404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.893874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:58.895563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:58.895937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:58.898588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.058965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:59.067214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:30:59.074597 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a24967e1-a596-474d-8852-dd8a2d66716b tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1462 microversion: 2.1 time: 0.199222 Oct 17 13:30:59.079292 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1826/3600] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:58 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1462 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:59.102967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.103599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:59.119177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.120017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.120625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.121633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.122292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.123043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.158973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:30:59.282985 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2e4298a-dd6a-4c21-826c-e22cc46a1040 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 204 len: 0 microversion: 2.1 time: 0.199986 Oct 17 13:30:59.283601 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1827/3601] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:30:59 2022] DELETE /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:30:59.287296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:59.295509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.295917 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15933bc7-c4c1-48ae-ba2d-e809ed8a51d6 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 0.486628 Oct 17 13:30:59.296912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:59.297769 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1775/3602] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:58 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:59.303342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.303732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b3347a4f-d54e-477c-82b3-24bc7a428d3b req-7b160e5d-149a-4706-a062-30136efcc3af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73432491-5ba9-4fba-8d40-1100517eafca", "name": "network-vif-deleted", "tag": "7f5af312-583e-4a52-a461-d811f642c9ce"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:30:59.303993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.304198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.305012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.305604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.306040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.316622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b3347a4f-d54e-477c-82b3-24bc7a428d3b req-7b160e5d-149a-4706-a062-30136efcc3af service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.317693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b3347a4f-d54e-477c-82b3-24bc7a428d3b req-7b160e5d-149a-4706-a062-30136efcc3af service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.318325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b3347a4f-d54e-477c-82b3-24bc7a428d3b req-7b160e5d-149a-4706-a062-30136efcc3af service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.330954 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b3347a4f-d54e-477c-82b3-24bc7a428d3b req-7b160e5d-149a-4706-a062-30136efcc3af service nova] Creating event network-vif-deleted:7f5af312-583e-4a52-a461-d811f642c9ce for instance 73432491-5ba9-4fba-8d40-1100517eafca on n-h2-854121-14 Oct 17 13:30:59.336284 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b3347a4f-d54e-477c-82b3-24bc7a428d3b req-7b160e5d-149a-4706-a062-30136efcc3af service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036777 Oct 17 13:30:59.337496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1776/3603] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:30:59.344588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.345334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:59.352349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.352846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.353633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.354749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.355513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.356114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.506640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:59.515739 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24efeb7f-fd37-4fd8-aefe-333f0147654a tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1314 microversion: 2.1 time: 0.230957 Oct 17 13:30:59.529305 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1828/3604] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:59 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:59.529305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.529305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:59.533504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.535087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.535548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.536267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.536720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.537148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.539356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:59.548817 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e700d6cf-938a-4aba-b73b-44b57691ac6a tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1470 microversion: 2.1 time: 0.209860 Oct 17 13:30:59.553239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1777/3605] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:59 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:59.675231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:59.683393 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8986e9cd-b1e6-49e2-ae2d-62c9a1970bfe tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1473 microversion: 2.1 time: 0.165105 Oct 17 13:30:59.684174 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1829/3606] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:59 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1473 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:59.755742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.756563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:59.762980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.763574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.764080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.765884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.766426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.766931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.795018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:30:59.795658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:30:59.803623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.804111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.804543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.805268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:30:59.806807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:30:59.807240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:30:59.968148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:30:59.981511 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4201a007-bce5-4f4a-8aab-4fc1eee6c064 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.229287 Oct 17 13:30:59.982835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1778/3607] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:30:59 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:30:59.999545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:00.009623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:00.011138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:00.012470 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-410f9fde-60d0-4cce-b21b-5a0618375b2a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1743 microversion: 2.20 time: 0.221398 Oct 17 13:31:00.013368 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1830/3608] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:30:59 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:00.102877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:00.103550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:00.109810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.110609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.110996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.112009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.112558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.112969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.303578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:00.321410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:00.322021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:00.324153 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ef04cd4-8803-463f-81e7-1c6072c3c7ca tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1462 microversion: 2.1 time: 0.225101 Oct 17 13:31:00.326066 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1779/3609] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:00 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1462 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:00.330384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.330873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.331303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.331999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.332621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.333044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.541793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:00.542444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:00.550698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.551606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.552142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.552940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.553485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.553977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.767050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:00.777329 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78218f1a-fab3-42d3-ab1d-4c500cde0ec0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1464 microversion: 2.1 time: 0.239435 Oct 17 13:31:00.778116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1780/3610] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:00 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:00.784654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:00.785698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:00.793381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.794232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.795034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:00.795963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:00.797422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:00.798395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.076148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.084437 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cafa47f3-1540-4fca-bd8f-266ca20bd0fc tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 0.767552 Oct 17 13:31:01.085014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1831/3611] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:00 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:01.089900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.090699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:01.099260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.100136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.100745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.109881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.109881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.109881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.194647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.207883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebc4b20c-3dce-4ab5-9f55-45652f636214 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1470 microversion: 2.1 time: 0.428318 Oct 17 13:31:01.209783 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1781/3612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:00 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1470 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:01.323717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.333674 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d68fb6de-e82c-4a50-99e9-ef67c99e2579 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1473 microversion: 2.1 time: 0.247311 Oct 17 13:31:01.334839 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1832/3613] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:01.341047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1ea3b91d-5ba5-40f4-ae2d-37f6df532525 req-4d519bd8-ed85-4689-9acd-36de74b9fc45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49ab65db-ed26-4696-8e24-f7172f64bf8d", "tag": "844512d4-441a-479a-8e79-239e6419beb8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:01.354060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ea3b91d-5ba5-40f4-ae2d-37f6df532525 req-4d519bd8-ed85-4689-9acd-36de74b9fc45 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.355080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ea3b91d-5ba5-40f4-ae2d-37f6df532525 req-4d519bd8-ed85-4689-9acd-36de74b9fc45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.355685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1ea3b91d-5ba5-40f4-ae2d-37f6df532525 req-4d519bd8-ed85-4689-9acd-36de74b9fc45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.370581 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1ea3b91d-5ba5-40f4-ae2d-37f6df532525 req-4d519bd8-ed85-4689-9acd-36de74b9fc45 service nova] Creating event network-changed:844512d4-441a-479a-8e79-239e6419beb8 for instance 49ab65db-ed26-4696-8e24-f7172f64bf8d on n-h1-854121-14 Oct 17 13:31:01.377293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1ea3b91d-5ba5-40f4-ae2d-37f6df532525 req-4d519bd8-ed85-4689-9acd-36de74b9fc45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039746 Oct 17 13:31:01.378875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1833/3614] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:01.383519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Calling method '.version_select at 0x7f419ccbfb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.388110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.389037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:01.398459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.399155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.399765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.400828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.401012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.401724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.402455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.402700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.403205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.431598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.432367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.432913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.454290 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4781701d-ecea-4806-916d-4b1d5e532791 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] 10.222.0.65 "GET /compute/v2.1/os-simple-tenant-usage/507d0adda30f42ecbf339005b9bcfe90?start=2022-10-16T13%3A31%3A00.796001&end=2022-10-18T13%3A31%3A00.796001" status: 200 len: 696 microversion: 2.1 time: 0.243111 Oct 17 13:31:01.455797 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1782/3615] 10.222.0.65 () {58 vars in 1412 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/os-simple-tenant-usage/507d0adda30f42ecbf339005b9bcfe90?start=2022-10-16T13%3A31%3A00.796001&end=2022-10-18T13%3A31%3A00.796001 => generated 696 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:01.473842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.474462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:01.481979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.482469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.482905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.483616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.484118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.485124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.621116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.631142 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec48bc5b-e4c2-41e1-bf53-0bb2b50156ad tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.250233 Oct 17 13:31:01.632265 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1834/3616] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:01.637742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.638674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:01.647357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.648267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.648804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.649800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.650464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.651244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.664180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.673611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.675796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.677006 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-97c6f9e7-a614-4cca-85cf-46f376084a5e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1743 microversion: 2.20 time: 0.220030 Oct 17 13:31:01.677609 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1783/3617] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1743 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:01.682437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '.version_select at 0x7f419cce10d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.692919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.693723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.694345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.705687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.706177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.706705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.718337 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08620b70-d571-46e9-939b-1692b9427190 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/os-simple-tenant-usage/507d0adda30f42ecbf339005b9bcfe90?start=2022-10-16T13%3A31%3A00.796001&end=2022-10-18T13%3A31%3A00.796001" status: 200 len: 700 microversion: 2.1 time: 0.039355 Oct 17 13:31:01.719572 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1784/3618] 10.222.0.65 () {58 vars in 1412 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/os-simple-tenant-usage/507d0adda30f42ecbf339005b9bcfe90?start=2022-10-16T13%3A31%3A00.796001&end=2022-10-18T13%3A31%3A00.796001 => generated 700 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:01.733597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Calling method '.version_select at 0x7f419cc6f790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.742798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.743284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.743720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.746455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:01.758275 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6379ce2-16ba-4df0-905b-46b3de3370e9 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1298 microversion: 2.1 time: 0.124579 Oct 17 13:31:01.760201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.760702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.761117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.769911 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1835/3619] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1298 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:01.913329 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-deefde08-5d19-46a5-9a86-fa2aaaa9a628 tempest-TenantUsagesTestJSON-1169482175 tempest-TenantUsagesTestJSON-1169482175-project-admin] 10.222.0.65 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A31%3A00.796001&end=2022-10-18T13%3A31%3A00.796001&detailed=1" status: 200 len: 40413 microversion: 2.1 time: 0.183209 Oct 17 13:31:01.914444 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1785/3620] 10.222.0.65 () {58 vars in 1335 bytes} [Mon Oct 17 13:31:01 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-16T13%3A31%3A00.796001&end=2022-10-18T13%3A31%3A00.796001&detailed=1 => generated 40413 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:31:01.968177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:01.969259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:01.981377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.982349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.984409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:01.987338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:01.988140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:01.988623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.029658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:31:02.107837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.108767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:02.119306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.119912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.120446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.133208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.133499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.136023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.163649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:02.185737 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6b20d1e-ff5a-489d-8e1a-687260985627 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "DELETE /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 204 len: 0 microversion: 2.1 time: 0.219825 Oct 17 13:31:02.187932 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1836/3621] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:01 2022] DELETE /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:02.201770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.204486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:02.225534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.226338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.228531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.230578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.231232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.232769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.432722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:02.462268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=13 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:02.532361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:02.543451 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb20af90-61dd-49f8-a723-08c31226e82b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 0.439391 Oct 17 13:31:02.547583 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1786/3622] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:02.552764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:02.553089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.554002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:02.562064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.563326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.564007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.564945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.565641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.566417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.583155 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d5fb25f-acf7-4545-b07e-30fce9c3d5f0 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1470 microversion: 2.1 time: 0.389452 Oct 17 13:31:02.586471 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1837/3623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1470 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:02.591198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.591806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:02.600600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.601231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.601841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.603225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.603688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.604113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.838331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:02.842615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:02.854764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-895faf83-2b43-4531-b069-486bac84c05f tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1473 microversion: 2.1 time: 0.267146 Oct 17 13:31:02.855505 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b67fbd76-fb58-47f0-8655-f516bd2b96a2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1470 microversion: 2.1 time: 0.306896 Oct 17 13:31:02.856587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1838/3624] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1473 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:02.862561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8baafae7-94d5-41dd-8123-bf5835ad93b0 req-9025a32c-4805-4b91-8f6d-d9c6f8072689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "name": "network-vif-plugged", "status": "completed", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:02.869680 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1787/3625] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:02.873967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8baafae7-94d5-41dd-8123-bf5835ad93b0 req-9025a32c-4805-4b91-8f6d-d9c6f8072689 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.874879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8baafae7-94d5-41dd-8123-bf5835ad93b0 req-9025a32c-4805-4b91-8f6d-d9c6f8072689 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.875537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8baafae7-94d5-41dd-8123-bf5835ad93b0 req-9025a32c-4805-4b91-8f6d-d9c6f8072689 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.879685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.880609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:02.889894 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8baafae7-94d5-41dd-8123-bf5835ad93b0 req-9025a32c-4805-4b91-8f6d-d9c6f8072689 service nova] Creating event network-vif-plugged:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:31:02.896076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8baafae7-94d5-41dd-8123-bf5835ad93b0 req-9025a32c-4805-4b91-8f6d-d9c6f8072689 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038053 Oct 17 13:31:02.897717 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1839/3626] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:02.903443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:02.903777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.904662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.905539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.907266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:02.910864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.911977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.912540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.915584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.916320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.916922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:02.917829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:02.918440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:02.919020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.181510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:03.194807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:03.196290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:03.197638 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-166981ea-853d-4932-89d1-c6bc4746e88d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.298399 Oct 17 13:31:03.221376 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1840/3627] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:03.228847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:03.229669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:03.235992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:03.239774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.240281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.240719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.241478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.241943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.242373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.253693 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77a7f07c-9e7e-40bd-a6e2-190e3febc083 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.382465 Oct 17 13:31:03.256128 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1788/3628] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:02 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:03.267932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:03.295115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.295664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.296112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.296906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lazy-loading 'fault' on Instance uuid 73432491-5ba9-4fba-8d40-1100517eafca {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:31:03.367451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac4e032f9c2e4a7e9c521e79f2186b9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a104760f38d941fd8b603be9c644d784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:03.383498 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7923d3cf-4942-4666-ac13-d34ec5f41912 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 200 len: 1303 microversion: 2.1 time: 0.160872 Oct 17 13:31:03.397857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1841/3629] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:03 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:03.568837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:03.569650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:03.571565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:03.581876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.582362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.583065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.589952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.589952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.591076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.596719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:03.612432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:03.612432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:03.619874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.620846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.622063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:03.624386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:03.624386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:03.624386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.227914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:04.255247 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00789a5c-0863-40f1-92d2-41c1391b1249 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1470 microversion: 2.1 time: 0.652037 Oct 17 13:31:04.260194 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1842/3630] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:03 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1470 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:04.289548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:04.290527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:04.296707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:04.305721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:04.306780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:04.307400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.308733 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-594caa23-dd4e-4fa9-b847-72a8895a4483 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 0.744262 Oct 17 13:31:04.309429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:04.310087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:04.312577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.329198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1789/3631] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:03 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:04.344220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:04.345064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:04.351405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:04.352153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:04.352778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.353685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:04.354298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:04.354882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.905688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a795921a8c449459f1f4b02852af1a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a093da4643464296a663c7010d07dc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:04.925598 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-870a77b9-cb79-419b-9e7c-2132c5e1e358 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 200 len: 1431 microversion: 2.1 time: 0.640815 Oct 17 13:31:04.926668 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1843/3632] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:04 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 1431 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:04.932377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:04.938123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:04.945763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:04.957902 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-624dcb2f-b2b7-4bb0-a91e-3d36ec99dcd5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1470 microversion: 2.1 time: 0.635108 Oct 17 13:31:04.962068 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1790/3633] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:04 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1470 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:04.965008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:04.976984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:04.978052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:04.978754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.979957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:04.980535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:04.981077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:04.987165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:05.001644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.009914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.010772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.011745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.016802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.017817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.619533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:05.632099 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bc4eee5-b9a3-4ac2-acb0-a123731db4b3 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.668674 Oct 17 13:31:05.636564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1791/3634] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:04 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:05.651901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:05.652991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:05.669811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.670299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.672952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.673773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.674227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.674668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.707071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:05.710768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca HTTP/1.1 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '73432491-5ba9-4fba-8d40-1100517eafca'} Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:05.716358 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:05.726332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:05.729275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:05.731397 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85695f14-f543-41d2-b8b8-b73e5f3bb011 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 404 len: 111 microversion: 2.1 time: 0.091519 Oct 17 13:31:05.736015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1792/3635] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:05 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:05.743675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-135b37db-183a-4399-87b8-a32d7c449b81 req-67be1ee4-767b-4b97-8811-120c63313c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5fb28-2a85-4a7a-91b3-68f5d97fc401", "name": "network-vif-deleted", "tag": "711ec366-f4c2-40cf-92a8-2cad16dd2957"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:05.751968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:05.759787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:05.761373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-135b37db-183a-4399-87b8-a32d7c449b81 req-67be1ee4-767b-4b97-8811-120c63313c86 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.762101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-135b37db-183a-4399-87b8-a32d7c449b81 req-67be1ee4-767b-4b97-8811-120c63313c86 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.762779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-135b37db-183a-4399-87b8-a32d7c449b81 req-67be1ee4-767b-4b97-8811-120c63313c86 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.771715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcc53794-1ac5-4778-a7fe-967900718d62 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.843534 Oct 17 13:31:05.787800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-135b37db-183a-4399-87b8-a32d7c449b81 req-67be1ee4-767b-4b97-8811-120c63313c86 service nova] Creating event network-vif-deleted:711ec366-f4c2-40cf-92a8-2cad16dd2957 for instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 on n-h2-854121-14 Oct 17 13:31:05.790227 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1844/3636] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:04 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:05.796199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-135b37db-183a-4399-87b8-a32d7c449b81 req-67be1ee4-767b-4b97-8811-120c63313c86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055770 Oct 17 13:31:05.798135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-93ddb244-fd82-420e-9afa-62f072918954 req-44982966-dbe3-4bd9-87b1-cc1163d5d25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a644097-0001-4764-812e-210cc06b12a0", "name": "network-vif-plugged", "status": "completed", "tag": "fd196736-c92a-477c-8c68-b4161a19f8ab"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:05.801233 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1793/3637] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:05.814292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:05.815537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:05.820155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-93ddb244-fd82-420e-9afa-62f072918954 req-44982966-dbe3-4bd9-87b1-cc1163d5d25e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.820642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-93ddb244-fd82-420e-9afa-62f072918954 req-44982966-dbe3-4bd9-87b1-cc1163d5d25e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.821073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-93ddb244-fd82-420e-9afa-62f072918954 req-44982966-dbe3-4bd9-87b1-cc1163d5d25e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.824196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.825008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.826572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.827667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.828479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.829342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.848825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-93ddb244-fd82-420e-9afa-62f072918954 req-44982966-dbe3-4bd9-87b1-cc1163d5d25e service nova] Creating event network-vif-plugged:fd196736-c92a-477c-8c68-b4161a19f8ab for instance 8a644097-0001-4764-812e-210cc06b12a0 on n-h2-854121-14 Oct 17 13:31:05.861695 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-93ddb244-fd82-420e-9afa-62f072918954 req-44982966-dbe3-4bd9-87b1-cc1163d5d25e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070950 Oct 17 13:31:05.862685 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1845/3638] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:05.872102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:05.875902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:05.885218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.885688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.886132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:05.886879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:05.887315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:05.887740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.536253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:06.548600 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9bb9711-89ba-4559-afe8-3ae3180401d3 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1470 microversion: 2.1 time: 0.744494 Oct 17 13:31:06.550198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1794/3639] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:05 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1470 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:06.561444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86ab6db9-c52f-4145-9b73-dc2e8abd27d5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:06.576232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:06.586758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f5515a9-6ee9-4eaa-bd2b-74c768c3404a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 0.722783 Oct 17 13:31:06.588375 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1846/3640] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:05 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:06.595432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:06.596378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] [instance: a5c5fb28-2a85-4a7a-91b3-68f5d97fc401] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:06.604451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.605334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.605958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.606852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.607527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.608456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.656965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_groups [None req-86ab6db9-c52f-4145-9b73-dc2e8abd27d5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Querying cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) for 1 instances {{(pid=120697) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:31:06.659754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86ab6db9-c52f-4145-9b73-dc2e8abd27d5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.661647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86ab6db9-c52f-4145-9b73-dc2e8abd27d5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.662452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86ab6db9-c52f-4145-9b73-dc2e8abd27d5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.666490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] HTTP exception thrown: Instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 could not be found. Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Request method failure captured: Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 HTTP/1.1 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVhYLqngW4iRStzzpP1GjbxePn3r-3aCuWL4cdSmeImf30lA-vAGTDftrxanK8GKFam3oxOmRakVCsTgfNtZJH109PYMIw7DYM0iwrR1pe0o4x5goM5C8hzKO4vVxA7Q4xg-ulCrrx4xwFbfQUU0mMlHkxAMYuKJ9AfIBKjrxipHAZ4 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a093da4643464296a663c7010d07dc36 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ListImageFiltersTestJSON-413870884 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a093da4643464296a663c7010d07dc36"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a093da4643464296a663c7010d07dc36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a093da4643464296a663c7010d07dc36"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a093da4643464296a663c7010d07dc36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ListImageFiltersTestJSON-413870884 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a093da4643464296a663c7010d07dc36 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-413870884 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ListImageFiltersTestJSON-413870884-project Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 7a795921a8c449459f1f4b02852af1a2 Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ListImageFiltersTestJSON-413870884-project Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 could not be found. Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a5c5fb28-2a85-4a7a-91b3-68f5d97fc401'} Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 could not be found. Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 could not be found. Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:06.673281 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 could not be found. Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Returning 404 to user: Instance a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:06.680980 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f19df988-d880-41be-8ccd-de3ef40c6ec8 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401" status: 404 len: 111 microversion: 2.1 time: 0.086243 Oct 17 13:31:06.686567 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1847/3641] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:06 2022] GET /compute/v2.1/servers/a5c5fb28-2a85-4a7a-91b3-68f5d97fc401 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:06.692317 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-86ab6db9-c52f-4145-9b73-dc2e8abd27d5 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.138880 Oct 17 13:31:06.699224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1795/3642] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:31:06 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:06.709561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:06.710108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:06.736539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.737033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.737492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.738209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.738659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.739083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.814152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-71316d88-35f7-4f42-83e0-a355aafe8884 req-3cf83888-1072-4df1-b4c4-5f4bdbd212ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a1a25d-2a00-48bb-8f77-bc886d031c69", "name": "network-vif-deleted", "tag": "13b6ddce-498e-4ce5-88df-21a5b8f1b33c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:06.824873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-71316d88-35f7-4f42-83e0-a355aafe8884 req-3cf83888-1072-4df1-b4c4-5f4bdbd212ad service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.825404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-71316d88-35f7-4f42-83e0-a355aafe8884 req-3cf83888-1072-4df1-b4c4-5f4bdbd212ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.825841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-71316d88-35f7-4f42-83e0-a355aafe8884 req-3cf83888-1072-4df1-b4c4-5f4bdbd212ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.838824 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-71316d88-35f7-4f42-83e0-a355aafe8884 req-3cf83888-1072-4df1-b4c4-5f4bdbd212ad service nova] Creating event network-vif-deleted:13b6ddce-498e-4ce5-88df-21a5b8f1b33c for instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 on n-h2-854121-14 Oct 17 13:31:06.844914 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-71316d88-35f7-4f42-83e0-a355aafe8884 req-3cf83888-1072-4df1-b4c4-5f4bdbd212ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143663 Oct 17 13:31:06.845574 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1796/3643] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:06.852043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:06.852933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:06.859758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.860477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.861610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:06.862350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:06.862815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:06.863266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.046143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:07.060120 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a00420b7-346d-47ab-bc7b-80a51fadb9b5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1470 microversion: 2.1 time: 0.368463 Oct 17 13:31:07.063440 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1848/3644] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:06 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1470 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:07.070911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b3a0865-47a2-4762-92b1-ff60aa6879f6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce079d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.165332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:07.179426 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1745e6dd-2cec-4d9d-adb9-78be7fe64a57 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1313 microversion: 2.1 time: 0.331756 Oct 17 13:31:07.181077 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1797/3645] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:06 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:07.213642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-399d3529-6925-46f3-8804-ff8cb86f8971 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.234715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:07.236233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_groups [None req-399d3529-6925-46f3-8804-ff8cb86f8971 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Querying cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) for 1 instances {{(pid=120697) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:31:07.237182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-399d3529-6925-46f3-8804-ff8cb86f8971 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.238044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-399d3529-6925-46f3-8804-ff8cb86f8971 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.238797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-399d3529-6925-46f3-8804-ff8cb86f8971 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.254080 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-399d3529-6925-46f3-8804-ff8cb86f8971 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups/e74d6299-0966-46f6-af09-6a7812d18b23" status: 200 len: 184 microversion: 2.1 time: 0.067932 Oct 17 13:31:07.255326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1798/3646] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:31:07 2022] GET /compute/v2.1/os-server-groups/e74d6299-0966-46f6-af09-6a7812d18b23 => generated 184 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:07.260252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.260691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:07.268102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.268831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.269607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.270721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.272296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.276740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.487088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:07.509211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:07.511053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:07.513531 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4924cbf5-6afe-4993-9e56-39883a32060f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.256338 Oct 17 13:31:07.526842 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1799/3647] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:07 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:07.535807 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b3a0865-47a2-4762-92b1-ff60aa6879f6 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/images/73056d67-5e8c-4ef9-9678-1890fadec1f9" status: 204 len: 0 microversion: 2.1 time: 0.471174 Oct 17 13:31:07.536671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1849/3648] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:07 2022] DELETE /compute/v2.1/images/73056d67-5e8c-4ef9-9678-1890fadec1f9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:07.542674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.543407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:07.545300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-098ef63e-0711-4749-9125-3c84c4d9dff9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce86a60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.551044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.551775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.552373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.553277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.553889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.554475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.574451 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca HTTP/1.1 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '73432491-5ba9-4fba-8d40-1100517eafca'} Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:07.576397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.582092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.584189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:07.585969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e686224-7934-4b4a-b417-7fc714a6a736 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 404 len: 111 microversion: 2.1 time: 0.057778 Oct 17 13:31:07.590128 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1800/3649] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:07 2022] DELETE /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:07.605868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.606483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:07.631504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.632255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.632847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.633588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.634055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.634466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.691819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.692483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.692957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.693449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lazy-loading 'fault' on Instance uuid 20a1a25d-2a00-48bb-8f77-bc886d031c69 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:31:07.788271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e95e23a6e24fc6ada73b5fc532b472', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507d0adda30f42ecbf339005b9bcfe90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:07.798586 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f376e07-172b-4594-9188-2756632b8906 tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 200 len: 1304 microversion: 2.1 time: 0.207445 Oct 17 13:31:07.799468 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1801/3650] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:07 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 1304 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:07.805457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.809689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] [instance: 73432491-5ba9-4fba-8d40-1100517eafca] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:07.818354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.818354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.818639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.820113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.820755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.821071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.844217 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca HTTP/1.1 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '73432491-5ba9-4fba-8d40-1100517eafca'} Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:07.846478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. Oct 17 13:31:07.851898 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.854087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance 73432491-5ba9-4fba-8d40-1100517eafca could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:07.855613 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37328227-914e-489e-9923-fd4727562aba tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca" status: 404 len: 111 microversion: 2.1 time: 0.054820 Oct 17 13:31:07.856393 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1802/3651] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:07 2022] GET /compute/v2.1/servers/73432491-5ba9-4fba-8d40-1100517eafca => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:07.861782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.863279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:07.880538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.886792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.887565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.888222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.888756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.889217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:07.918217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-098ef63e-0711-4749-9125-3c84c4d9dff9 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/images/02acf753-a947-488c-a7f7-f94ec9d01639" status: 204 len: 0 microversion: 2.1 time: 0.377262 Oct 17 13:31:07.919394 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1850/3652] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:07 2022] DELETE /compute/v2.1/images/02acf753-a947-488c-a7f7-f94ec9d01639 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:07.925487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05676645-9460-4ddd-9e28-cc98d2565524 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:07.936290 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-05676645-9460-4ddd-9e28-cc98d2565524 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance group ba2d5edf-acab-43e3-9606-1999a6beb0f4 could not be found. Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05676645-9460-4ddd-9e28-cc98d2565524 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-server-groups/ba2d5edf-acab-43e3-9606-1999a6beb0f4 HTTP/1.1 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance group ba2d5edf-acab-43e3-9606-1999a6beb0f4 could not be found. Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ba2d5edf-acab-43e3-9606-1999a6beb0f4'} Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ba2d5edf-acab-43e3-9606-1999a6beb0f4 could not be found. Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ba2d5edf-acab-43e3-9606-1999a6beb0f4 could not be found. Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.950544 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:07.958453 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:07.958453 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:07.958453 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:07.958453 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:07.958453 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ba2d5edf-acab-43e3-9606-1999a6beb0f4 could not be found. Oct 17 13:31:07.958453 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:07.960242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05676645-9460-4ddd-9e28-cc98d2565524 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance group ba2d5edf-acab-43e3-9606-1999a6beb0f4 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:07.961382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05676645-9460-4ddd-9e28-cc98d2565524 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/ba2d5edf-acab-43e3-9606-1999a6beb0f4" status: 404 len: 117 microversion: 2.1 time: 0.040602 Oct 17 13:31:07.962173 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1851/3653] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:31:07 2022] DELETE /compute/v2.1/os-server-groups/ba2d5edf-acab-43e3-9606-1999a6beb0f4 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:07.967058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7048423f-dee5-4db7-b1f7-742094b4778c req-c6255a3c-e69b-4f5f-a0a7-522d93fc8e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ab65db-ed26-4696-8e24-f7172f64bf8d", "name": "network-vif-plugged", "status": "completed", "tag": "844512d4-441a-479a-8e79-239e6419beb8"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:07.980727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7048423f-dee5-4db7-b1f7-742094b4778c req-c6255a3c-e69b-4f5f-a0a7-522d93fc8e0c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:07.981620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7048423f-dee5-4db7-b1f7-742094b4778c req-c6255a3c-e69b-4f5f-a0a7-522d93fc8e0c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:07.982249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7048423f-dee5-4db7-b1f7-742094b4778c req-c6255a3c-e69b-4f5f-a0a7-522d93fc8e0c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.018140 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7048423f-dee5-4db7-b1f7-742094b4778c req-c6255a3c-e69b-4f5f-a0a7-522d93fc8e0c service nova] Creating event network-vif-plugged:844512d4-441a-479a-8e79-239e6419beb8 for instance 49ab65db-ed26-4696-8e24-f7172f64bf8d on n-h1-854121-14 Oct 17 13:31:08.024206 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7048423f-dee5-4db7-b1f7-742094b4778c req-c6255a3c-e69b-4f5f-a0a7-522d93fc8e0c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060672 Oct 17 13:31:08.025657 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1852/3654] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:08.035465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-247d1ff6-781f-4e46-9dbe-3d3ff597d783 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] Calling method '.version_select at 0x7f419ce07790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.216421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:08.227114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bac1d7a-8b89-48ba-86af-ec439befe7ad tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 0.369241 Oct 17 13:31:08.242480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1803/3655] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:07 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:08.252461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c45bb81-f21d-44bc-a692-ac9f53e052bb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.261091 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8c45bb81-f21d-44bc-a692-ac9f53e052bb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance group 2bd830ce-67b6-4d23-a4ce-82d3425fb459 could not be found. Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c45bb81-f21d-44bc-a692-ac9f53e052bb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-server-groups/2bd830ce-67b6-4d23-a4ce-82d3425fb459 HTTP/1.1 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance group 2bd830ce-67b6-4d23-a4ce-82d3425fb459 could not be found. Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2bd830ce-67b6-4d23-a4ce-82d3425fb459'} Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2bd830ce-67b6-4d23-a4ce-82d3425fb459 could not be found. Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2bd830ce-67b6-4d23-a4ce-82d3425fb459 could not be found. Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.263550 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2bd830ce-67b6-4d23-a4ce-82d3425fb459 could not be found. Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c45bb81-f21d-44bc-a692-ac9f53e052bb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance group 2bd830ce-67b6-4d23-a4ce-82d3425fb459 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c45bb81-f21d-44bc-a692-ac9f53e052bb tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/2bd830ce-67b6-4d23-a4ce-82d3425fb459" status: 404 len: 117 microversion: 2.1 time: 0.021915 Oct 17 13:31:08.272097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1804/3656] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:31:08 2022] DELETE /compute/v2.1/os-server-groups/2bd830ce-67b6-4d23-a4ce-82d3425fb459 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:08.274055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.274055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:08.281219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.281836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.282284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.283299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.283721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.284155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.474036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-247d1ff6-781f-4e46-9dbe-3d3ff597d783 tempest-ListImageFiltersTestJSON-413870884 tempest-ListImageFiltersTestJSON-413870884-project] 10.222.0.65 "DELETE /compute/v2.1/images/62b88a0a-a016-4d59-970c-173231efa354" status: 204 len: 0 microversion: 2.1 time: 0.446836 Oct 17 13:31:08.474801 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1853/3657] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:08 2022] DELETE /compute/v2.1/images/62b88a0a-a016-4d59-970c-173231efa354 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:08.482509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.486843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:08.497227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.500979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.501670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.502583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.507241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.508095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.527431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:08.537967 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-751d52f0-e1e0-4287-88e1-add71149dc23 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.269187 Oct 17 13:31:08.539081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1805/3658] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:08 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:08.553123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14f15871-deb8-403e-aea4-cb46f51a71ec tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.560596 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-14f15871-deb8-403e-aea4-cb46f51a71ec tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance group 5dbe51c7-299c-415e-b39d-2e949cbc51f5 could not be found. Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14f15871-deb8-403e-aea4-cb46f51a71ec tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-server-groups/5dbe51c7-299c-415e-b39d-2e949cbc51f5 HTTP/1.1 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance group 5dbe51c7-299c-415e-b39d-2e949cbc51f5 could not be found. Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5dbe51c7-299c-415e-b39d-2e949cbc51f5'} Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5dbe51c7-299c-415e-b39d-2e949cbc51f5 could not be found. Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5dbe51c7-299c-415e-b39d-2e949cbc51f5 could not be found. Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.570786 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5dbe51c7-299c-415e-b39d-2e949cbc51f5 could not be found. Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14f15871-deb8-403e-aea4-cb46f51a71ec tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance group 5dbe51c7-299c-415e-b39d-2e949cbc51f5 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-14f15871-deb8-403e-aea4-cb46f51a71ec tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/5dbe51c7-299c-415e-b39d-2e949cbc51f5" status: 404 len: 117 microversion: 2.1 time: 0.032535 Oct 17 13:31:08.576776 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1806/3659] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:31:08 2022] DELETE /compute/v2.1/os-server-groups/5dbe51c7-299c-415e-b39d-2e949cbc51f5 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:08.581282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.603571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:08.625249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.627133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.627598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.629286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.630440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.633609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.821690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:08.839303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0be1d945-ca7d-478f-8734-8bb2f5fd7d74 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1498 microversion: 2.1 time: 0.360347 Oct 17 13:31:08.840698 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1854/3660] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:08 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1498 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:08.855022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e40cd05-4d88-4e64-862f-c01b31a579da tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.871998 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-8e40cd05-4d88-4e64-862f-c01b31a579da tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] HTTP exception thrown: Instance group f757e97f-d62d-4577-94be-85f409e4ec9b could not be found. Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e40cd05-4d88-4e64-862f-c01b31a579da tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Request method failure captured: Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-server-groups/f757e97f-d62d-4577-94be-85f409e4ec9b HTTP/1.1 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVjpQ00y3-8p4Ps8vSjD9eu4f-WiFvOiO4j4Co2ljv-ICtRFy8SzXrl9zt4BUx3wKU5ayu1lt-wWxrbjVIbYcNHRmxa8A8U-OcqpigPomGTQH1B5aMJrDa94dw3736gDcvMkLLbjDS3GC0SV6Z0BeCsbhOdSLLD6X_EFZcPuAyrGJeo Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a104760f38d941fd8b603be9c644d784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a104760f38d941fd8b603be9c644d784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a104760f38d941fd8b603be9c644d784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a104760f38d941fd8b603be9c644d784 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerGroupTestJSON-1493357161 Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ac4e032f9c2e4a7e9c521e79f2186b9d Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerGroupTestJSON-1493357161-project Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance group f757e97f-d62d-4577-94be-85f409e4ec9b could not be found. Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f757e97f-d62d-4577-94be-85f409e4ec9b'} Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f757e97f-d62d-4577-94be-85f409e4ec9b could not be found. Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f757e97f-d62d-4577-94be-85f409e4ec9b could not be found. Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.875490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f757e97f-d62d-4577-94be-85f409e4ec9b could not be found. Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e40cd05-4d88-4e64-862f-c01b31a579da tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Returning 404 to user: Instance group f757e97f-d62d-4577-94be-85f409e4ec9b could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:08.880847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e40cd05-4d88-4e64-862f-c01b31a579da tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/f757e97f-d62d-4577-94be-85f409e4ec9b" status: 404 len: 117 microversion: 2.1 time: 0.036822 Oct 17 13:31:08.882526 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1855/3661] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:31:08 2022] DELETE /compute/v2.1/os-server-groups/f757e97f-d62d-4577-94be-85f409e4ec9b => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:08.894671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:08.902003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] [instance: 20a1a25d-2a00-48bb-8f77-bc886d031c69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:08.917719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.918640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.919728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.920615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.922009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.922154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:08.923276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.939854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:08.941356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:08.943560 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c5c1272-b967-43f1-8524-e38d7a316fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.367089 Oct 17 13:31:08.944930 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1807/3662] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:08 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:08.953024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:08.956528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:08.959663 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] HTTP exception thrown: Instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 could not be found. Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Request method failure captured: Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 HTTP/1.1 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVjuq7PF0eYLYVldDk-BwDNCiNYQNurGGWXfEPB4gptmGiJ6Uv4XKDW5E2s9KjFDnyZMMGQZY2TtBp6bY0rV8xStB8BO7ujujB_42Q1g72g5qOPQGBf6Zrfre94jKKcp4wRjciScX2q_0IJtS3-kNSF-yziOoaiHDpKUZu0h2wwP-Ek Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 507d0adda30f42ecbf339005b9bcfe90 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TenantUsagesTestJSON-582256527 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/507d0adda30f42ecbf339005b9bcfe90"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/507d0adda30f42ecbf339005b9bcfe90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/507d0adda30f42ecbf339005b9bcfe90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_507d0adda30f42ecbf339005b9bcfe90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TenantUsagesTestJSON-582256527 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 507d0adda30f42ecbf339005b9bcfe90 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TenantUsagesTestJSON-582256527 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TenantUsagesTestJSON-582256527-project Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 09e95e23a6e24fc6ada73b5fc532b472 Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TenantUsagesTestJSON-582256527-project Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 could not be found. Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '20a1a25d-2a00-48bb-8f77-bc886d031c69'} Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 could not be found. Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 could not be found. Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:08.962874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 could not be found. Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] Returning 404 to user: Instance 20a1a25d-2a00-48bb-8f77-bc886d031c69 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b80a9f35-5127-47a5-8821-12c368219cab tempest-TenantUsagesTestJSON-582256527 tempest-TenantUsagesTestJSON-582256527-project] 10.222.0.65 "GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69" status: 404 len: 111 microversion: 2.1 time: 0.081725 Oct 17 13:31:08.968781 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1856/3663] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:08 2022] GET /compute/v2.1/servers/20a1a25d-2a00-48bb-8f77-bc886d031c69 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:08.971412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.972076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.972924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.974299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:08.974981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:08.975569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:08.979173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbba12d7-f993-4cfa-bba3-0bff216021c4 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:09.014071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lazy-loading 'flavor' on Instance uuid 8a644097-0001-4764-812e-210cc06b12a0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:31:09.037189 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbba12d7-f993-4cfa-bba3-0bff216021c4 tempest-ServerGroupTestJSON-1493357161 tempest-ServerGroupTestJSON-1493357161-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/e74d6299-0966-46f6-af09-6a7812d18b23" status: 204 len: 0 microversion: 2.1 time: 0.067406 Oct 17 13:31:09.042088 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1857/3664] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:31:08 2022] DELETE /compute/v2.1/os-server-groups/e74d6299-0966-46f6-af09-6a7812d18b23 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:09.234550 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4aae8b23-1eb4-4667-bef7-66973e720d75 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "POST /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0/action" status: 200 len: 32 microversion: 2.1 time: 0.276157 Oct 17 13:31:09.235430 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1808/3665] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:31:08 2022] POST /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:31:09.248764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:09.249720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:09.256664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:09.257405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:09.260690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:09.261459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:09.262358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:09.264474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:09.265347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:09.266142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:09.281780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:09.282346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:09.282791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:09.283517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:09.283976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:09.284403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:10.714849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:10.729528 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1b8c872-8ba0-4b3a-a8ec-efe96a84c738 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 1.485240 Oct 17 13:31:10.730992 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1858/3666] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:09 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:10.745802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:10.748300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:10.765974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:10.774814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:10.780174 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-206af42a-e7a4-470a-86f7-688250ee0cc5 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1317 microversion: 2.1 time: 1.528069 Oct 17 13:31:10.780558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:10.781525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:10.783677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:10.800891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:10.803721 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1809/3667] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:09 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1317 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:10.805371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:10.811587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:10.812793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:10.836597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:10.837108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:10.841766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:10.842508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:10.846168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:10.846861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:10.912322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:11.565803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:11.582435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:11.588046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:11.591179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b3c84d7-b06f-4326-917f-782785d69ca8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.786365 Oct 17 13:31:11.594832 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1810/3668] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:10 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:11.605832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:11.622216 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88aa28ef-3967-42a5-a764-52b9ee02a5d5 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.888430 Oct 17 13:31:11.638435 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1859/3669] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:10 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:11.758723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:11.759917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:11.760279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:11.773572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:11.774997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:11.775678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:11.778194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:11.778843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:11.779446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:11.802652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Calling method '.version_select at 0x7f419cc29e50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:11.835071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:11.835562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:11.838802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:11.840631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:11.843102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:11.845876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:11.886920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-43b9aa08-8df2-4027-980f-41b124bbd304 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] 10.222.0.65 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.287123 Oct 17 13:31:11.887922 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1811/3670] 10.222.0.65 () {58 vars in 1122 bytes} [Mon Oct 17 13:31:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:11.901063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:11.901727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:11.912936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:11.913497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:11.914154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:11.915099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:11.916144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:11.916782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:12.496306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:12.519754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53e4f48e-6f9b-45f1-b226-98ffc244af40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.765116 Oct 17 13:31:12.520784 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1860/3671] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:11 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:12.530799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1909308833", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:12.670322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:12.672265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:31:12.686270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-466502c9-00c0-4df2-9504-2dab1fe2b718 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1507 microversion: 2.1 time: 0.793187 Oct 17 13:31:12.709428 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1812/3672] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:11 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1507 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:12.725614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:12.726502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:12.734493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:12.735429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:12.736762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:12.737712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:12.738359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:12.739643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:13.103260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:13.115796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:13.117120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:13.118619 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b6ffa96-3c5e-479f-b0ca-ec81efc66b1f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.407836 Oct 17 13:31:13.129568 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1813/3673] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:12 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:13.142058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:13.142950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:13.150763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:13.151812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:13.152255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:13.152973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:13.161834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:13.162386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:13.480594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Getting quotas for project eef6cba9841a4b6c8d1eabbef0e42d30. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:31:13.498213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:13.505573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Getting quotas for user 9c14fe8b4a67497a8c6fb0789bb07b5b and project eef6cba9841a4b6c8d1eabbef0e42d30. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:31:13.522681 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Request method failure captured: Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 1752 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkfB-qfYkLg911jVMaKJt64d6A9upalv4FOl9sUpC3XTNxASGf1-16nejfgMsZP_7HjV2qODBMNwYAFnIiEQyI2b7uBq8SzYq6wc5bbDlTOm0iXs3zXl-_Us_YHKUIfIibLU8ifQTbRwqJ5X4E-texODV3461SVvPP2JwIqq6ekci8 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: eef6cba9841a4b6c8d1eabbef0e42d30 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1439862898 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/eef6cba9841a4b6c8d1eabbef0e42d30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eef6cba9841a4b6c8d1eabbef0e42d30"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/eef6cba9841a4b6c8d1eabbef0e42d30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_eef6cba9841a4b6c8d1eabbef0e42d30"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1439862898 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: eef6cba9841a4b6c8d1eabbef0e42d30 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1439862898 Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9c14fe8b4a67497a8c6fb0789bb07b5b Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1909308833", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:13.526604 n-d-854121-14 devstack@n-api.service[120698]: exception: Maximum number of metadata items exceeds 128 Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1909308833', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:13.529073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 17 13:31:13.536376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:13.542414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:13.543378 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d591e892-666c-45de-8cd8-cf5868a67908 tempest-AbsoluteLimitsNegativeTestJSON-1439862898 tempest-AbsoluteLimitsNegativeTestJSON-1439862898-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.019973 Oct 17 13:31:13.544482 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1861/3674] 10.222.0.65 () {60 vars in 1148 bytes} [Mon Oct 17 13:31:12 2022] POST /compute/v2.1/servers => generated 87 bytes in 1023 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:31:13.554333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:13.556146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:13.564782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:13.565667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:13.566344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:13.567300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:13.567973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:13.568630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:13.573659 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-033ce276-1937-4eb0-b10e-37cca1cdc31f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.441415 Oct 17 13:31:13.574521 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1814/3675] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:13 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:13.588219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:13.597213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:13.622603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:13.623120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:13.623561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:13.631620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:13.633413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:13.634833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:14.365182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:14.413499 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b24381de-542f-4ddc-b62b-b2eddb26a655 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1507 microversion: 2.1 time: 0.863055 Oct 17 13:31:14.429978 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1862/3676] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:13 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1507 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:14.438871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:14.443172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:14.443797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:14.456527 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf5e1984-86a9-468e-8272-42027a487c44 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.878845 Oct 17 13:31:14.464705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:14.465276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:14.465759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:14.466759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:14.467229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:14.467657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:14.470203 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1815/3677] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:13 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:14.488777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:14.510723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:14.528226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:14.528734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:14.529186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:14.536780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:14.537296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:14.537938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:14.701996 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-781a37d6-b4c8-4693-a590-f4968aa86e91 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "PUT /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1079 microversion: 2.1 time: 0.229635 Oct 17 13:31:14.703789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1816/3678] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:31:14 2022] PUT /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1079 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:14.708921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:14.709840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:14.717446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:14.718530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:14.719330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:14.720439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:14.721144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:14.722047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:15.405465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:15.417133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:15.418941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:15.420346 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7fc7b202-5f44-4d43-a8bb-b00a80da3b87 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.989355 Oct 17 13:31:15.434117 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1863/3679] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:14 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:15.452044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:15.471668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:15.489939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:15.493127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:15.494121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:15.495059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:15.495730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:15.496399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:15.654582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:15.671786 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6fe6eda7-a155-466e-bfb8-555e079e0caa tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.965998 Oct 17 13:31:15.672950 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1817/3680] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:14 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:15.678781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:15.681742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:15.701000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:15.705602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:15.706309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:15.707269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:15.708290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:15.709855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.216674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:16.264128 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-190ac749-8654-4bc8-9ea5-49fead19379b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1505 microversion: 2.1 time: 0.822654 Oct 17 13:31:16.294003 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1864/3681] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:15 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:16.306495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:16.307119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:16.313727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:16.323674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e21b800-a355-45fb-931a-6874e72acc97 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.649399 Oct 17 13:31:16.328876 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1818/3682] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:15 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:16.331300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.332027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.334175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.335170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.338016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.338997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.452274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:16.453512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:16.466085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.468358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.469487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.470911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.471984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.473304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.820194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:16.826275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:16.837935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:16.839690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:16.840925 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea02b2dd-c02c-4fd9-921e-aa575776fa30 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.393069 Oct 17 13:31:16.841846 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1819/3683] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:16 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:31:16.842170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc97fb57-472c-42c7-a2b9-e3f14012fd5d tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1505 microversion: 2.1 time: 0.544705 Oct 17 13:31:16.845441 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1865/3684] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:16 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:16.857359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:16.857987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:16.891698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.891698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.892070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.896890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:16.899845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:16.903438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.904584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.905057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.912224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.917754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.918621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:16.923910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:16.925500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:16.929455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:17.064186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:17.097419 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e85ac9e-02c0-461d-b920-b304dc15afbd tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "PUT /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1081 microversion: 2.1 time: 0.212563 Oct 17 13:31:17.100776 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1866/3685] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:31:16 2022] PUT /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1081 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:17.122113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:17.122581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:17.139503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:17.153629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:17.154176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:17.154945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:17.155502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:17.156588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:17.684412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:17.698563 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7a89905-1f94-4520-9e10-2eeb07baa952 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.855605 Oct 17 13:31:17.699613 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1820/3686] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:16 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:17.706189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:17.717126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:17.725055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:17.725581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:17.726025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:17.732385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:17.733365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:17.733876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:17.886937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:17.903005 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-634fcef6-2018-4bb1-98f6-93c97af29d62 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1507 microversion: 2.1 time: 0.785999 Oct 17 13:31:17.909212 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1867/3687] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:17 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1507 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:17.917108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:17.918431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:17.926656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:17.927947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:17.932714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:17.933662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:17.934316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:17.934824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:18.675708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:18.695450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:18.705268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:18.708244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:18.710113 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d847c56-392a-4015-98b4-0fe75d1d6b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.799350 Oct 17 13:31:18.711012 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1868/3688] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:17 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:18.725753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:18.726655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:18.739679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:18.741566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0082998f-6369-4349-93ae-37c65464cc4c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 1.040791 Oct 17 13:31:18.749200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:18.749516 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1821/3689] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:17 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:18.750706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:18.764612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:18.764612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:18.766693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:18.767420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:18.768092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:18.775699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:18.776214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:18.776671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:18.777456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:18.777926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:18.778358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:19.500577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:19.510697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:19.522813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9e130b1-35d0-4904-9cfc-bbb7e367eeee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.769442 Oct 17 13:31:19.523458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1822/3690] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:18 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:19.541846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f96e6a0e-bb5a-4b75-9c44-daaa350f84b3 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1507 microversion: 2.1 time: 0.818028 Oct 17 13:31:19.543482 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1869/3691] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:18 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1507 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:19.569652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:19.570560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:19.578834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:19.579694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:19.580330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:19.581584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:19.582932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:19.583786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:19.664416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:31:19.860653 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e206c52c-8b86-4854-b308-be57ef644672 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "DELETE /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 204 len: 0 microversion: 2.1 time: 0.294816 Oct 17 13:31:19.861973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1870/3692] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:19 2022] DELETE /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:31:19.869458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:19.870682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:19.877533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:19.878476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:19.879101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:19.880170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:19.880892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:19.881584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:19.901333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-074f4836-12c9-4f41-8421-482a6327c21d tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-48785049", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:19.904752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-074f4836-12c9-4f41-8421-482a6327c21d tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] HTTP exception thrown: min_count must be <= max_count Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-074f4836-12c9-4f41-8421-482a6327c21d tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Request method failure captured: Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 182 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVkmrM3_5pkNHwjkLp1hH8ErdLA4aCp5tKGmt8KQV-KJYDWydI9wYcurc3ve1wwHb0uFj2IqNFnu6tCwIequR2gJpuVuEAskpqai2oCmcgwT9FAZCwMSCAeuxCyk6QeDhK1E1ndHFySdO5YSqCla26_4-d2nI9nyNDly9v89UbJxYWc Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a8e5426579a4101842cb8cad1193053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d111900fe0504043b2c3033965ebc2fa Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-48785049", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: exception: min_count must be <= max_count Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-48785049', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 17 13:31:19.908457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:19.914170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-074f4836-12c9-4f41-8421-482a6327c21d tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Returning 400 to user: min_count must be <= max_count {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:19.914170 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-074f4836-12c9-4f41-8421-482a6327c21d tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.367321 Oct 17 13:31:19.914170 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1823/3693] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:19 2022] POST /compute/v2.1/servers => generated 74 bytes in 368 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:31:19.948908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:19.949551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:20.005969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.006499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.006954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.007677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.008142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.008572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.347412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:20.376307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:20.384605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:20.386767 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ee085b02-c8a9-471d-b568-f0c139819835 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.523249 Oct 17 13:31:20.389447 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1871/3694] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:19 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:20.405898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:20.406407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:20.419342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.433144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.433913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.434638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.435099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.435533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.525735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:20.526879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:31:20.554818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b574837b-5f46-4557-a80e-37575beedc24 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.614889 Oct 17 13:31:20.557022 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1824/3695] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:19 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:20.584290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5823cfee-e666-4edb-aebc-17623b2bdaf3 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2140482019", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "max_count": 0}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5823cfee-e666-4edb-aebc-17623b2bdaf3 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Request method failure captured: Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 168 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVkmrM3_5pkNHwjkLp1hH8ErdLA4aCp5tKGmt8KQV-KJYDWydI9wYcurc3ve1wwHb0uFj2IqNFnu6tCwIequR2gJpuVuEAskpqai2oCmcgwT9FAZCwMSCAeuxCyk6QeDhK1E1ndHFySdO5YSqCla26_4-d2nI9nyNDly9v89UbJxYWc Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a8e5426579a4101842cb8cad1193053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: d111900fe0504043b2c3033965ebc2fa Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2140482019", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "max_count": 0}} Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2140482019', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'max_count': 0}}} Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 0 Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:31:20.607760 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:31:20.614197 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.619144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5823cfee-e666-4edb-aebc-17623b2bdaf3 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:20.622381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5823cfee-e666-4edb-aebc-17623b2bdaf3 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.061056 Oct 17 13:31:20.624002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1825/3696] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:20 2022] POST /compute/v2.1/servers => generated 130 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:31:20.648387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:20.652623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:20.682193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.682777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.683232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.684033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.684472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.716405 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.compute.api [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Instance is already in deleting state, ignoring this request Oct 17 13:31:20.717613 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-083069f4-7c9d-4a7c-866c-5e51f16f4122 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "DELETE /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 204 len: 0 microversion: 2.1 time: 0.324820 Oct 17 13:31:20.721116 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1872/3697] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:20 2022] DELETE /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:20.726606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.735761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a086f7fc-adcf-4d59-9e10-156394b65e99 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-390720371", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "max_count": 2.5}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a086f7fc-adcf-4d59-9e10-156394b65e99 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Request method failure captured: Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 169 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkmrM3_5pkNHwjkLp1hH8ErdLA4aCp5tKGmt8KQV-KJYDWydI9wYcurc3ve1wwHb0uFj2IqNFnu6tCwIequR2gJpuVuEAskpqai2oCmcgwT9FAZCwMSCAeuxCyk6QeDhK1E1ndHFySdO5YSqCla26_4-d2nI9nyNDly9v89UbJxYWc Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a8e5426579a4101842cb8cad1193053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d111900fe0504043b2c3033965ebc2fa Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-390720371", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "max_count": 2.5}} Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-390720371', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'max_count': 2.5}}} Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:31:20.746508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:31:20.753224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:20.758395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a086f7fc-adcf-4d59-9e10-156394b65e99 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:20.759753 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a086f7fc-adcf-4d59-9e10-156394b65e99 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.036944 Oct 17 13:31:20.761382 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1873/3698] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:20 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:31:20.769777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:20.771516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:20.787716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.790150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.790843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:20.791839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:20.792465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:20.793061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:21.603255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:21.642410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57a6c8e5-d336-400a-a790-483b7c80a131 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1513 microversion: 2.1 time: 0.879586 Oct 17 13:31:21.643028 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1874/3699] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:20 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1513 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:21.647925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57059196-fa47-4dbf-b19f-31940a942b9e tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1391232151", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 0}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57059196-fa47-4dbf-b19f-31940a942b9e tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Request method failure captured: Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 168 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkmrM3_5pkNHwjkLp1hH8ErdLA4aCp5tKGmt8KQV-KJYDWydI9wYcurc3ve1wwHb0uFj2IqNFnu6tCwIequR2gJpuVuEAskpqai2oCmcgwT9FAZCwMSCAeuxCyk6QeDhK1E1ndHFySdO5YSqCla26_4-d2nI9nyNDly9v89UbJxYWc Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a8e5426579a4101842cb8cad1193053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d111900fe0504043b2c3033965ebc2fa Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1391232151", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 0}} Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1391232151', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'min_count': 0}}} Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 0 Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:31:21.652878 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57059196-fa47-4dbf-b19f-31940a942b9e tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:21.659512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57059196-fa47-4dbf-b19f-31940a942b9e tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013704 Oct 17 13:31:21.675451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1875/3700] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:21 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:31:21.680434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:21.694128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:21.701980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:21.703185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:21.703936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:21.705693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:21.706391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:21.707032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:21.829152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:21.865356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:21.940883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:21.952965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9cc33b6-3c8e-41a6-8993-26ba0e939da2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 1.326458 Oct 17 13:31:21.959156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1826/3701] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:20 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:21.964782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:21.966187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:21.974840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:21.975654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:21.979107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:21.980167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:21.980868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:21.981555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:22.269676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:22.287920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:22.292160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:22.297773 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c40b5203-481d-4570-a184-17e56750df8f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.619708 Oct 17 13:31:22.303401 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1876/3702] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:21 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:22.321829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8045638-3bd3-402a-8531-21db464ef818 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1929839650", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 2.5}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8045638-3bd3-402a-8531-21db464ef818 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Request method failure captured: Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 170 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkmrM3_5pkNHwjkLp1hH8ErdLA4aCp5tKGmt8KQV-KJYDWydI9wYcurc3ve1wwHb0uFj2IqNFnu6tCwIequR2gJpuVuEAskpqai2oCmcgwT9FAZCwMSCAeuxCyk6QeDhK1E1ndHFySdO5YSqCla26_4-d2nI9nyNDly9v89UbJxYWc Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a8e5426579a4101842cb8cad1193053"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a8e5426579a4101842cb8cad1193053"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 9a8e5426579a4101842cb8cad1193053 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1413047692 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d111900fe0504043b2c3033965ebc2fa Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1413047692-project Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1929839650", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 2.5}} Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1929839650', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'min_count': 2.5}}} Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 2.5 Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:31:22.327884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8045638-3bd3-402a-8531-21db464ef818 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:22.332949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8045638-3bd3-402a-8531-21db464ef818 tempest-MultipleCreateNegativeTestJSON-1413047692 tempest-MultipleCreateNegativeTestJSON-1413047692-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.024655 Oct 17 13:31:22.339970 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1877/3703] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:31:22.381020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:22.390820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67b7233c-27d0-4a89-bcec-03035da9773f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.430330 Oct 17 13:31:22.401448 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1827/3704] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:21 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:22.671625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:22.672904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:22.715197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8f845332-213f-4e6a-9a6d-59967c03d2f4 req-10bea260-f35e-40dd-9c79-7c6083e1ad0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49ab65db-ed26-4696-8e24-f7172f64bf8d", "name": "network-vif-deleted", "tag": "844512d4-441a-479a-8e79-239e6419beb8"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:22.716154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:22.718469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:22.722746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:22.723994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:22.726499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:22.729675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:22.749641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f845332-213f-4e6a-9a6d-59967c03d2f4 req-10bea260-f35e-40dd-9c79-7c6083e1ad0b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:22.750180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f845332-213f-4e6a-9a6d-59967c03d2f4 req-10bea260-f35e-40dd-9c79-7c6083e1ad0b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:22.750626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f845332-213f-4e6a-9a6d-59967c03d2f4 req-10bea260-f35e-40dd-9c79-7c6083e1ad0b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:22.802952 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8f845332-213f-4e6a-9a6d-59967c03d2f4 req-10bea260-f35e-40dd-9c79-7c6083e1ad0b service nova] Creating event network-vif-deleted:844512d4-441a-479a-8e79-239e6419beb8 for instance 49ab65db-ed26-4696-8e24-f7172f64bf8d on n-h1-854121-14 Oct 17 13:31:22.840250 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8f845332-213f-4e6a-9a6d-59967c03d2f4 req-10bea260-f35e-40dd-9c79-7c6083e1ad0b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128747 Oct 17 13:31:22.841336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1828/3705] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:22.987737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:22.988506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:23.007967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:23.008291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:23.008735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:23.018459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:23.020750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:23.022089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:23.106596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:23.429810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f16d27aa024ca091d45cbac8c00cbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8d2529de0a43119965e8ededb97bcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:23.449596 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-723ba1a2-96a4-4b7d-88b8-2526836149c1 tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 200 len: 1471 microversion: 2.1 time: 0.781759 Oct 17 13:31:23.451643 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1878/3706] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:22 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 1471 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:23.464721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:23.466920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:23.482938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:23.485485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:23.485978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:23.490661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:23.492037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:23.492342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:23.532781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:23.553796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:23.561968 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-888cdfbb-7654-4019-b284-b6184c453c49 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.579219 Oct 17 13:31:23.565479 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1829/3707] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:22 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:23.590765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:23.597314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:23.616817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:23.622755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:23.624927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:23.626700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:23.628863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:23.630467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:23.964245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:23.975613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:23.977811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:23.979686 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-689df54b-98f9-406f-99ee-068ddaf7edf1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.526104 Oct 17 13:31:23.980833 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1879/3708] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:23 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:24.171825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:24.184953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fffaac2c-01aa-49c3-a415-32752ec26e35 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.618064 Oct 17 13:31:24.195086 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1830/3709] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:23 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:24.482526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:24.485862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 49ab65db-ed26-4696-8e24-f7172f64bf8d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:24.487863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:24.503545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.504221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.504865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.505626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.506080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.506503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.542463 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] HTTP exception thrown: Instance 49ab65db-ed26-4696-8e24-f7172f64bf8d could not be found. Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Request method failure captured: Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d HTTP/1.1 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTViBiKqzTq6L4vYpcc0uYYt_R-SFvmfgoSk8GMV9wKfqqdkSY1y_CQ0opM4Iq6yQ3OfdcMEYtr1Sc-pMMLgatdWt_T73JIjoqRjYMy60jI2It0U25GZJU1v-Idg0YaQpXdm8bwzvqrdSZOnCnZFrOMg59fE3MiKnznY_BVtg0VaOSOY Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 17f16d27aa024ca091d45cbac8c00cbf Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 49ab65db-ed26-4696-8e24-f7172f64bf8d could not be found. Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '49ab65db-ed26-4696-8e24-f7172f64bf8d'} Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49ab65db-ed26-4696-8e24-f7172f64bf8d could not be found. Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49ab65db-ed26-4696-8e24-f7172f64bf8d could not be found. Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.544032 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49ab65db-ed26-4696-8e24-f7172f64bf8d could not be found. Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Returning 404 to user: Instance 49ab65db-ed26-4696-8e24-f7172f64bf8d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0850c10-1be2-4744-91a9-4439ed2b9aba tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d" status: 404 len: 111 microversion: 2.1 time: 0.072857 Oct 17 13:31:24.552587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1880/3710] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:24 2022] GET /compute/v2.1/servers/49ab65db-ed26-4696-8e24-f7172f64bf8d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:24.561023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:24.563123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:24.571445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.572230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.572901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.573890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.574926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.575526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.586730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:24.587344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:24.598745 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] HTTP exception thrown: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Request method failure captured: Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 HTTP/1.1 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTViBiKqzTq6L4vYpcc0uYYt_R-SFvmfgoSk8GMV9wKfqqdkSY1y_CQ0opM4Iq6yQ3OfdcMEYtr1Sc-pMMLgatdWt_T73JIjoqRjYMy60jI2It0U25GZJU1v-Idg0YaQpXdm8bwzvqrdSZOnCnZFrOMg59fE3MiKnznY_BVtg0VaOSOY Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 17f16d27aa024ca091d45cbac8c00cbf Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '208b6878-95d7-40a3-9107-0c1f4882c463'} Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:24.600714 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.606054 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.606996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.609390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Returning 404 to user: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:24.612910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.613953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.614958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.615613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.616211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.622674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c7498b7-7b7c-432a-b539-4423b60f298a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "DELETE /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 404 len: 111 microversion: 2.1 time: 0.064376 Oct 17 13:31:24.623585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1831/3711] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:24 2022] DELETE /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:24.632486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:24.633101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 208b6878-95d7-40a3-9107-0c1f4882c463] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:24.658727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.659224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.659654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.666191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.666681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.667127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.690448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] HTTP exception thrown: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Request method failure captured: Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 HTTP/1.1 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTViBiKqzTq6L4vYpcc0uYYt_R-SFvmfgoSk8GMV9wKfqqdkSY1y_CQ0opM4Iq6yQ3OfdcMEYtr1Sc-pMMLgatdWt_T73JIjoqRjYMy60jI2It0U25GZJU1v-Idg0YaQpXdm8bwzvqrdSZOnCnZFrOMg59fE3MiKnznY_BVtg0VaOSOY Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 17f16d27aa024ca091d45cbac8c00cbf Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '208b6878-95d7-40a3-9107-0c1f4882c463'} Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.692738 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Returning 404 to user: Instance 208b6878-95d7-40a3-9107-0c1f4882c463 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:24.698178 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd8e1d88-f892-4415-861b-c7525afca14b tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463" status: 404 len: 111 microversion: 2.1 time: 0.068109 Oct 17 13:31:24.699546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1832/3712] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:24 2022] GET /compute/v2.1/servers/208b6878-95d7-40a3-9107-0c1f4882c463 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:24.716177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:24.717429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:24.730657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.733092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.736361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.736361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.739158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.741194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.782103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] HTTP exception thrown: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Request method failure captured: Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 HTTP/1.1 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTViBiKqzTq6L4vYpcc0uYYt_R-SFvmfgoSk8GMV9wKfqqdkSY1y_CQ0opM4Iq6yQ3OfdcMEYtr1Sc-pMMLgatdWt_T73JIjoqRjYMy60jI2It0U25GZJU1v-Idg0YaQpXdm8bwzvqrdSZOnCnZFrOMg59fE3MiKnznY_BVtg0VaOSOY Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 17f16d27aa024ca091d45cbac8c00cbf Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7bb93367-f14d-409d-8d88-134889651af4'} Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:24.789214 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.794347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.797717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Returning 404 to user: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:24.802847 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aaf2fc38-939d-4b45-b57a-6e31947f419a tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 404 len: 111 microversion: 2.1 time: 0.099249 Oct 17 13:31:24.803996 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1833/3713] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:31:24 2022] DELETE /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:31:24.814687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:24.816542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] [instance: 7bb93367-f14d-409d-8d88-134889651af4] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:24.832293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.834042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.835127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.837679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:24.838544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:24.840082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:24.882202 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] HTTP exception thrown: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Request method failure captured: Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 HTTP/1.1 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTViBiKqzTq6L4vYpcc0uYYt_R-SFvmfgoSk8GMV9wKfqqdkSY1y_CQ0opM4Iq6yQ3OfdcMEYtr1Sc-pMMLgatdWt_T73JIjoqRjYMy60jI2It0U25GZJU1v-Idg0YaQpXdm8bwzvqrdSZOnCnZFrOMg59fE3MiKnznY_BVtg0VaOSOY Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_bf8d2529de0a43119965e8ededb97bcf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: bf8d2529de0a43119965e8ededb97bcf Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1931747943 Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 17f16d27aa024ca091d45cbac8c00cbf Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-1931747943-project Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7bb93367-f14d-409d-8d88-134889651af4'} Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:31:24.886000 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:31:24.890766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] Returning 404 to user: Instance 7bb93367-f14d-409d-8d88-134889651af4 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:31:24.891549 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f18aae62-8671-44e4-a951-7fa3117b26da tempest-ServerDiskConfigTestJSON-1931747943 tempest-ServerDiskConfigTestJSON-1931747943-project] 10.222.0.65 "GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4" status: 404 len: 111 microversion: 2.1 time: 0.079665 Oct 17 13:31:24.892754 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1834/3714] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:24 2022] GET /compute/v2.1/servers/7bb93367-f14d-409d-8d88-134889651af4 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:31:25.011168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:25.012370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:25.025049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:25.026442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:25.028468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:25.030000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:25.031457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:25.032610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:25.143689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:25.151973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8575bbe7-1668-47d9-85e2-c359d0665145 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.570176 Oct 17 13:31:25.152565 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1881/3715] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:24 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:25.222777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:25.223597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:25.237231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:25.241565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:25.242739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:25.246794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:25.249604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:25.251971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:25.795763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:25.809004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:25.823320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:25.825340 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7467cd4-f621-4daf-b23f-80720b591478 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1738 microversion: 2.20 time: 0.818807 Oct 17 13:31:25.826932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1835/3716] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:25 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1738 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:31:25.855580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:25.864176 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cee522d7-7dcc-4927-a986-5d9c4020e64d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.648092 Oct 17 13:31:25.871782 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1882/3717] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:25 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:26.182239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:26.183069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:26.195078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:26.195583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:26.196033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:26.200358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:26.200862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:26.201372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:26.706411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:26.716488 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3897c90-2fac-4d0b-89e9-d2e537a8b7db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.539485 Oct 17 13:31:26.716771 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1836/3718] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:26 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:26.859138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:26.860363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:26.881644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:26.881900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:26.883239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:26.886355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:26.888885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:26.891177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:26.897435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:26.898062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:26.909822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:26.915509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:26.916394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:26.917512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:26.918214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:26.918957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:27.519653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:27.531241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:27.533945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:27.535598 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69eef207-2036-4cee-a15e-08d00f0376ab tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1720 microversion: 2.20 time: 0.681585 Oct 17 13:31:27.536305 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1883/3719] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:26 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1720 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:27.579451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:27.589440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcb924ac-bad8-4862-a20b-a22edf4c11e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.698014 Oct 17 13:31:27.602955 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1837/3720] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:26 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:27.742142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:27.744188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:27.780112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:27.786070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:27.789744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:27.792924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:27.793638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:27.797517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:27.848931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:28.429315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dcb979a2-507e-4b6e-b402-5a3ecec6738f req-5422c87c-4ea0-4bda-973e-f94d03ac1483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "name": "network-vif-unplugged", "status": "completed", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:28.455190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcb979a2-507e-4b6e-b402-5a3ecec6738f req-5422c87c-4ea0-4bda-973e-f94d03ac1483 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:28.455700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcb979a2-507e-4b6e-b402-5a3ecec6738f req-5422c87c-4ea0-4bda-973e-f94d03ac1483 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:28.458438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcb979a2-507e-4b6e-b402-5a3ecec6738f req-5422c87c-4ea0-4bda-973e-f94d03ac1483 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:28.492780 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dcb979a2-507e-4b6e-b402-5a3ecec6738f req-5422c87c-4ea0-4bda-973e-f94d03ac1483 service nova] Creating event network-vif-unplugged:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:31:28.502798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dcb979a2-507e-4b6e-b402-5a3ecec6738f req-5422c87c-4ea0-4bda-973e-f94d03ac1483 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077454 Oct 17 13:31:28.503781 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1838/3721] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:28.565391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:28.566355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:28.587811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:28.589552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:28.590970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:28.591744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:28.593795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:28.597128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:29.243303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:29.267697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fa7d1f6-c0c9-4eb7-8250-f5c118dc73b4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 1.529638 Oct 17 13:31:29.281567 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1884/3722] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:27 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:29.283487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:29.284425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:29.301551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:29.302497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:29.302948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:29.303672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:29.310221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:29.311040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:29.454318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:29.476672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:29.479013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:29.480751 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69f86985-1069-4f30-bcfc-0c94e8b5990b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1720 microversion: 2.20 time: 0.920151 Oct 17 13:31:29.481540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1839/3723] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:28 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1720 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:31:30.002720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1982993792", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "77a1bcce-2384-43aa-b7ca-1f670a6d0916"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:30.072604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:30.082681 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a0d55f0-231f-4a8a-88bf-a217a349f8ec tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.804374 Oct 17 13:31:30.083892 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1885/3724] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:29 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:30.117675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] validate_networks() for [('77a1bcce-2384-43aa-b7ca-1f670a6d0916', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:31:30.301782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:30.302461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:30.323321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:30.333501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:30.334899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:30.336041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:30.339357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:30.339918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:30.810963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:30.841491 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f179975-ba48-4c97-8400-cda42d1ac4a8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1475 microversion: 2.1 time: 0.546595 Oct 17 13:31:30.842300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1886/3725] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:30 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1475 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:30.864165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:30.870916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:30.889275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:30.895647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:30.897344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:30.898359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:30.903050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:30.906921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.225668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:31.245580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:31.252696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:31.255635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd24a6db-5a98-4a7d-8410-8634fc8b4666 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1723 microversion: 2.20 time: 0.411119 Oct 17 13:31:31.257854 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1887/3726] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:30 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:31.289989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:31.294432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:31.321034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:31.322679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:31.323364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.324634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:31.327583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:31.329048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.643394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:31.648683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:31:31.649902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:31:31.650647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:31:31.651290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:31:31.651917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:31:31.657673 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-34205a67-a71e-4c6d-8380-f2e2d7967af1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.397000 Oct 17 13:31:31.661974 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1888/3727] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:31 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:31.681428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:31.682382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:31.682946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.683943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:31.686243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:31.687660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.690134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc81c0c7-1ec4-4a12-8d69-a9a90481aedc"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:31.693951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:31.710343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:31.710839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:31.721336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.722376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:31.723019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:31.727310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:31.748078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Getting quotas for project 73df0b1b02ef4f4fb3e63199da76330e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:31:31.771136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Getting quotas for user ae4bb905a78641abb1f224d483016369 and project 73df0b1b02ef4f4fb3e63199da76330e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:31:31.826879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:31:31.838504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:31:31.946513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:32.028052 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25b8f094-dd13-4537-a2ea-dbb6bd0422c3 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.253332 Oct 17 13:31:32.032474 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1840/3728] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:31:32.057472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:32.060834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:32.094198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:32.095189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:32.096384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:32.140675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:32.141820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:32.142630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:32.329633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-acf10622-23ee-4dca-8a7f-fd2337ea28e8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.666164 Oct 17 13:31:32.331488 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1889/3729] 10.222.0.65 () {62 vars in 1364 bytes} [Mon Oct 17 13:31:31 2022] POST /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 188 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:31:32.344918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60981d96-0a82-406c-8875-11705ecfbc87 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:32.346311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60981d96-0a82-406c-8875-11705ecfbc87 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:33.397970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60981d96-0a82-406c-8875-11705ecfbc87 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:33.421661 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60981d96-0a82-406c-8875-11705ecfbc87 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1216 microversion: 2.1 time: 1.088390 Oct 17 13:31:33.422300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1890/3730] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:32 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1216 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:33.439872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:33.442842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:33.473355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:33.473858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:33.478610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:33.479388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:33.479865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:33.485717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:33.575456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:31:33.788263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bba2d763-1211-40d5-90db-3bc06d442873 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/action" status: 202 len: 0 microversion: 2.20 time: 0.361633 Oct 17 13:31:33.789763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1891/3731] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:31:33 2022] POST /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:31:33.801267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:33.803085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:33.824988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:33.826744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:33.829192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:33.832477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:33.833242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:33.833916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:34.101366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:34.128393 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72e1fd85-574b-49dd-8e1d-251b8edea023 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1474 microversion: 2.1 time: 2.093925 Oct 17 13:31:34.149465 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1841/3732] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:32 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1474 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:34.162021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:34.162667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:34.182376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:34.183089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:34.184301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:34.185063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:34.185584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:34.186211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:34.995713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:35.004357 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e147966b-a560-4074-9bd7-44560b455ead tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 1.213245 Oct 17 13:31:35.035262 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1892/3733] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:33 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:35.041871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:35.042854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:35.049558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.050416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.051119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.052069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.052755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.053455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.210778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:35.226400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:35.228334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:35.233100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b17b0a04-0a94-4fec-b2cd-e0973020f98a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1749 microversion: 2.20 time: 1.082375 Oct 17 13:31:35.234013 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1842/3734] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:34 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1749 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:35.253315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "name": "network-vif-unplugged", "status": "completed", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:35.270298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.270878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.272104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.307859 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] Creating event network-vif-unplugged:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h2-854121-14 Oct 17 13:31:35.320026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] Instance 49427967-1ba2-4e58-b832-1a9fb815cccb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:31:35.347502 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-caaaf015-14a0-4eba-8a96-4c4be456bebc req-32eac509-a3d9-4230-8235-38171c766c9b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108342 Oct 17 13:31:35.348239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1843/3735] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:35.348710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:35.358248 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-736fcb9d-5df4-487b-b87f-138c4d623427 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1274 microversion: 2.1 time: 0.321022 Oct 17 13:31:35.359020 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1893/3736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:35 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:35.383928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:35.384853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:35.397722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.405765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.406659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:35.407435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:35.407910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:35.408348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:36.043083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:36.045025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:36.081851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:36.083952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:36.084633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:36.086498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:36.088203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:36.090301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:36.507465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:36.517207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab170167-6242-4bec-9763-0014862d8eb4 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1474 microversion: 2.1 time: 1.167795 Oct 17 13:31:36.544987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1844/3737] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:35 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1474 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:36.551764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:36.552735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:36.571184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:36.572000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:36.572633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:36.573552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:36.574177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:36.574782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:37.728931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:37.751664 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-78c23306-a9da-447b-9ad4-3ac6876da909 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 1.713335 Oct 17 13:31:37.756582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1894/3738] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:36 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:37.778487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:37.782125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:37.800322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:37.802192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:37.803193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:37.804594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:37.807503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:37.808183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:37.970524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:37.988576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:37.992855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:38.009618 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed2e9acb-2f0e-4415-8cf1-1db6c258f11c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1751 microversion: 2.20 time: 1.462478 Oct 17 13:31:38.011791 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1845/3739] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:36 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1751 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:38.022135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:38.023617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:38.044748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:38.046072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:38.050770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:38.051759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:38.057486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:38.058220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:38.105935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:38.118262 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52509752-07fc-4342-ab5f-3c407e942547 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1274 microversion: 2.1 time: 0.358742 Oct 17 13:31:38.121289 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1895/3740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:37 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1274 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:38.413355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:38.431763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:38.432462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:38.433072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:38.457468 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] Creating event network-changed:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h2-854121-14 Oct 17 13:31:38.470820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] Instance 49427967-1ba2-4e58-b832-1a9fb815cccb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:31:38.487458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a6ef04a2-7b4f-429e-a10b-a0ab972b8ec2 req-0a21ba86-a418-46cb-86ad-032a46c7f333 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077806 Oct 17 13:31:38.489375 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1896/3741] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:31:38.784310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:38.788821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:38.805113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:38.810022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:38.810621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:38.811606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:38.812363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:38.812981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:39.325665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:39.342275 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dac569ad-640a-490d-a315-251b6ffb59bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1504 microversion: 2.1 time: 0.563022 Oct 17 13:31:39.344027 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1897/3742] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:38 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1504 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:39.348711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:39.349359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:39.375729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:39.376233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:39.376902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:39.377452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:39.377920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:39.378611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:39.434682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:40.170952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:40.180019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3fd84344-5b12-48f7-a472-aed30d933ac8 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1474 microversion: 2.1 time: 2.166930 Oct 17 13:31:40.183896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1846/3743] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:38 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1474 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:40.214214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:40.219703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:40.230958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:40.236185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:40.236887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:40.237841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:40.238565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:40.239951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:41.131260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:41.193015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:41.200762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:41.206003 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18594097-1de4-48dc-8028-e504250448e9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1751 microversion: 2.20 time: 1.860821 Oct 17 13:31:41.221575 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1898/3744] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:39 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1751 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:41.235329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:41.236202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:41.246277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:41.247179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:41.247849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:41.249629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:41.250548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:41.251857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:41.564285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:41.578028 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f5b8e079-073e-4b7c-8c06-6dd87a6e6c35 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 1.367532 Oct 17 13:31:41.578729 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1847/3745] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:40 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:41.669712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1053099764", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:41.730730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:41.793198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] validate_networks() for [('9b3755b0-7f64-42c1-9f1d-0e81d72fca74', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:31:41.813213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:42.850249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:42.874739 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73d99778-4658-4858-8a4e-fc3bd0605459 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1484 microversion: 2.1 time: 1.649390 Oct 17 13:31:42.878535 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1899/3746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:41 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1484 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:42.910270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:42.916740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:42.939359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:42.940282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:42.940967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:42.942694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:42.946296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:42.947092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:43.418393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:43.887709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:43.902006 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-650e4561-5e94-49e5-ba23-f89f9f3042fb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1474 microversion: 2.1 time: 1.018934 Oct 17 13:31:43.903951 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1900/3747] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:42 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1474 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:43.916306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:43.923024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:43.960108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:43.961687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:43.963368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:43.965033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:43.968179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:43.969726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:44.306849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:31:44.307355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:31:44.307952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:31:44.308553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:31:44.309107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:31:44.330774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:44.331451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:44.340385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:44.353600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:44.356699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:44.357171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:44.439724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Getting quotas for project c49f4649ae554c4aab924b013a5a2396. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:31:44.450420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Getting quotas for user f6b044c4828b4d408a07accf03e43c09 and project c49f4649ae554c4aab924b013a5a2396. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:31:44.482827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:44.496753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:44.504416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:31:44.506280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:31:44.507787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:44.512356 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff2b9fee-353c-4f67-a16b-7a4cbbd38d6b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1751 microversion: 2.20 time: 0.605785 Oct 17 13:31:44.525957 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1901/3748] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:43 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1751 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:44.525957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:44.525957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:44.548426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:44.552427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:44.553895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:44.556335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:44.558151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:44.564137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:44.627418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1927a5be-49c8-4248-a117-cb9dbb08d2af tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.047525 Oct 17 13:31:44.630552 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1848/3749] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:31:44.647104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-937953239", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:44.836224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] validate_networks() for [('6899df72-89a0-45b2-b6ce-880aaf135cdc', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:31:45.711921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:45.740400 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b13ddd9d-6167-4d01-88d3-1fdcc02bdcfe tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 1.220464 Oct 17 13:31:45.742558 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1902/3750] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:44 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:45.758575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:45.762600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:45.787417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:45.788420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:45.788565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:45.789230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:45.789681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:45.794152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:46.002368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:46.018009 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f11640d-4192-4045-92ab-7fac4d598898 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1228 microversion: 2.1 time: 0.270200 Oct 17 13:31:46.018625 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1903/3751] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:45 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1228 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:46.047363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:46.049887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:46.062499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:46.067323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:46.068112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:46.069084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:46.069831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:46.070492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.004972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:48.016078 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-685d4a67-12fe-4b36-be22-4c4f1441a653 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1472 microversion: 2.1 time: 1.977853 Oct 17 13:31:48.016991 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1904/3752] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:46 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1472 bytes in 1980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:48.028207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:48.029436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:48.043067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.044080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.044708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.045777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.046534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.047156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.541345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:31:48.542366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:31:48.543381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:31:48.544355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:31:48.545098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:31:48.570009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.572953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.573614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.574499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.576156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.579215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.622499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Getting quotas for project fd9375f00d234e46abc756b0c482e73f. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:31:48.641578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Getting quotas for user 55a415731f7c4b389e33a1e15388358b and project fd9375f00d234e46abc756b0c482e73f. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:31:48.648831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:48.667422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:48.669474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:48.670816 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d95662a-d004-4d2f-a77e-2cf8367c4619 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.652440 Oct 17 13:31:48.671728 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1905/3753] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:48 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:48.684120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0e7d9384-dddd-4493-856e-499192720d80 req-1f19dd11-8ce9-4807-b523-0a4f5c832ecd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16", "tag": "ad8c1300-4ec2-46a9-8a18-785c58995ecf"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:48.699402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:31:48.705366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:31:48.709058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0e7d9384-dddd-4493-856e-499192720d80 req-1f19dd11-8ce9-4807-b523-0a4f5c832ecd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.709617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0e7d9384-dddd-4493-856e-499192720d80 req-1f19dd11-8ce9-4807-b523-0a4f5c832ecd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.710051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0e7d9384-dddd-4493-856e-499192720d80 req-1f19dd11-8ce9-4807-b523-0a4f5c832ecd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.730765 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0e7d9384-dddd-4493-856e-499192720d80 req-1f19dd11-8ce9-4807-b523-0a4f5c832ecd service nova] Creating event network-changed:ad8c1300-4ec2-46a9-8a18-785c58995ecf for instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 on n-h2-854121-14 Oct 17 13:31:48.738113 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0e7d9384-dddd-4493-856e-499192720d80 req-1f19dd11-8ce9-4807-b523-0a4f5c832ecd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065064 Oct 17 13:31:48.739100 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1906/3754] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:48.745453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:48.746202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:48.753730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.754278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.754770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.755483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.755936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.756357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.821270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c63f5d16-70cc-4036-93ae-9e8275b80195 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.189302 Oct 17 13:31:48.827573 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1849/3755] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:31:48.832675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:48.833704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:48.841640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.842981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.843699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:48.844693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:48.845418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:48.846065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.007568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:49.022486 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40bcda1d-2479-4263-a729-a0e28038cb2b tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1282 microversion: 2.1 time: 0.190891 Oct 17 13:31:49.037780 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1850/3756] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:48 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1282 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:49.152903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:49.162900 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f5b3ed6-8ff1-41ee-8de6-37b0707bde8f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 0.422503 Oct 17 13:31:49.184886 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1907/3757] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:48 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:49.190971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7be4332e-78ad-4e5b-8bab-b8a0df92322d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:49.191824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7be4332e-78ad-4e5b-8bab-b8a0df92322d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:49.267047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-264437179", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:49.295031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7be4332e-78ad-4e5b-8bab-b8a0df92322d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:49.304081 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7be4332e-78ad-4e5b-8bab-b8a0df92322d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1213 microversion: 2.1 time: 0.117782 Oct 17 13:31:49.305134 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1908/3758] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:49 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:49.326911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:49.328316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:49.340957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.341686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.342365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.343366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.343984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.344981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.397474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] validate_networks() for [('01e22cfe-9ea1-4a12-896c-16adb1ecc196', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:31:49.622798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:49.634641 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9bcdc2e-0f9a-4695-a092-1855d8ae4cfe tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1469 microversion: 2.1 time: 0.315575 Oct 17 13:31:49.646000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1909/3759] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:49 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1469 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:49.658475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:49.658994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:49.665349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.666126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.666730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.667627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.668247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.668830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.840422 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1979a3bd-bdaf-44b8-b48f-a5176e6a7f01 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "POST /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb/action" status: 202 len: 0 microversion: 2.1 time: 0.185804 Oct 17 13:31:49.841551 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1910/3760] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:31:49 2022] POST /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:31:49.849015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:49.850540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:49.860947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.861701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.862611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:49.863741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:49.864665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:49.865753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.063772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:31:50.065984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:31:50.066343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:31:50.067462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:31:50.068069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:31:50.083087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.083798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.085244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.086217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.087147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.087768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.111799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Getting quotas for project 0b4b7fe8f2da4c379be512ea0d916676. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:31:50.118722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Getting quotas for user 275516fa54254d86940a372e51ef39f4 and project 0b4b7fe8f2da4c379be512ea0d916676. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:31:50.122646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.138032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:31:50.140867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:31:50.169753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.172562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.183378 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fc7012c-4b83-4866-b795-054e298c069e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.334992 Oct 17 13:31:50.184989 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1911/3761] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:49 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:50.196607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:50.197837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:50.209862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.210431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.211115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.211901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.212428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.212912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.228440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f756ae0f-9bdd-4f77-a73e-6aaf781a7a5a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202202 Oct 17 13:31:50.237391 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1851/3762] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:31:50.244234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:50.246276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:50.256841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.257772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.258749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.261319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.262256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.262956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.349912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:50.469904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.479246 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26d86f26-f1d6-4f54-a135-6d867c4a8def tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.290584 Oct 17 13:31:50.480545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1912/3763] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:50 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:50.504874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:50.505856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:50.515764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.516528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.517625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.518590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.519278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.520262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.618605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.632693 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f6ccf0e-8009-4628-bd5c-3f42344a1a14 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.393320 Oct 17 13:31:50.650812 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1852/3764] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:50 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:50.657321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89cba871-f956-47fa-8cbd-ebcfe20746f0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:50.658229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89cba871-f956-47fa-8cbd-ebcfe20746f0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:50.763864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89cba871-f956-47fa-8cbd-ebcfe20746f0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.775300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89cba871-f956-47fa-8cbd-ebcfe20746f0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1216 microversion: 2.1 time: 0.122807 Oct 17 13:31:50.782191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:50.791489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-833548f0-6600-414e-b39c-7a630968c8b9 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 0.308527 Oct 17 13:31:50.792261 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1853/3765] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:50 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:50.793078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1913/3766] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:50 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:50.810091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:50.813479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:50.828392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.828958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.829595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:50.831826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:50.833524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:50.834191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:51.211950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:51.212918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:51.223623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:51.224127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:51.224589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:51.234216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:51.234923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:51.235536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:51.273119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:51.284050 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5a3f784-b954-4da0-ab8f-71c6da211e04 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1217 microversion: 2.1 time: 0.490584 Oct 17 13:31:51.287623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1854/3767] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:50 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1217 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:51.450978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:51.464492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:51.476210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:51.479883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:51.482884 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc24ddab-0c54-4a9c-9a23-2e891abd4e8c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.274807 Oct 17 13:31:51.486216 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1914/3768] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:51 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:31:51.507137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:51.508080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:51.527829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:51.528947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:51.530201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:51.531332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:51.531989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:51.532586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:51.658982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:51.660350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:51.687121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:51.692375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:51.697968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:51.702928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:51.706266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:51.708302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.063277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:52.075975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98e008a2-e091-4aba-ba1f-e642f6cc128a tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.423618 Oct 17 13:31:52.080512 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1915/3769] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:51 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:31:52.097963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:52.102998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:52.115121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.115943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.119191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.129797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.132068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.132733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.347046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:52.363198 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-098b74b1-1e63-4146-ae46-3b1bf20a6898 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.860158 Oct 17 13:31:52.380084 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1855/3770] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:51 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:52.391690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:52.392549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:52.415026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.415718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.417092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.422027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.422931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.424956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.642133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:52.656355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32287e08-a08a-464b-9699-d3550994ab38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1220 microversion: 2.1 time: 0.574350 Oct 17 13:31:52.658312 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1916/3771] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:52 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1220 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:52.674467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "name": "network-vif-plugged", "status": "completed", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:52.707125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.709364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.713093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.748603 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] Creating event network-vif-plugged:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h2-854121-14 Oct 17 13:31:52.780794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] Instance 49427967-1ba2-4e58-b832-1a9fb815cccb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:31:52.816264 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8cb72e7c-3950-4b7d-88d9-ab421ac25d55 req-2edbdc54-27fd-45d7-a292-c1c616827504 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149402 Oct 17 13:31:52.819483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1917/3772] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:52.862562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:52.873984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:52.925330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.926389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.927104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:52.928117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:52.928788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:52.929559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.085759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:53.101388 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cd9133a-2044-48f9-8a6a-36d2bd80beca tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1265 microversion: 2.1 time: 0.278944 Oct 17 13:31:53.104261 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1918/3773] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:52 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:53.115303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:53.117877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:53.147301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.149452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.149866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.152319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.160599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.161178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.378419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:53.392542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6900a736-f9ef-445c-9b25-1b290e6ec39f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 1.027070 Oct 17 13:31:53.396206 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1856/3774] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:52 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:53.404669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:53.414419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:53.431180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.432061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.432961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.434799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.437556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.439297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.613242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:53.629764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:53.649924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:53.655800 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ab22332-dd79-4d48-8926-a395200f6630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.548077 Oct 17 13:31:53.656466 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1919/3775] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:53 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:53.686671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b6c0e583-36de-45d3-8d8e-58fb22f24679 req-014e10eb-d427-4053-b3ad-3fca58123c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7", "tag": "65e5d91a-6d5a-43e2-ba0d-f0f29b71561e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:53.741788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b6c0e583-36de-45d3-8d8e-58fb22f24679 req-014e10eb-d427-4053-b3ad-3fca58123c45 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.747565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b6c0e583-36de-45d3-8d8e-58fb22f24679 req-014e10eb-d427-4053-b3ad-3fca58123c45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.748146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b6c0e583-36de-45d3-8d8e-58fb22f24679 req-014e10eb-d427-4053-b3ad-3fca58123c45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.823565 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b6c0e583-36de-45d3-8d8e-58fb22f24679 req-014e10eb-d427-4053-b3ad-3fca58123c45 service nova] Creating event network-changed:65e5d91a-6d5a-43e2-ba0d-f0f29b71561e for instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 on n-h1-854121-14 Oct 17 13:31:53.854132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b6c0e583-36de-45d3-8d8e-58fb22f24679 req-014e10eb-d427-4053-b3ad-3fca58123c45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192542 Oct 17 13:31:53.854751 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1920/3776] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:53.899425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:53.905896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:53.927092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.955946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.956561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:53.957362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:53.968687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:53.968687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:54.268761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:54.277447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75acc513-6502-4795-aaaf-cb288417b720 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.879700 Oct 17 13:31:54.301569 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1857/3777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:53 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:54.318452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:54.319281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:54.342707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:54.349872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:54.350723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:54.353268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:54.357927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:54.361423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.381973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:55.398033 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-573eae82-4c3c-4959-bfab-3ce80f31c456 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1268 microversion: 2.1 time: 1.095036 Oct 17 13:31:55.424078 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1858/3778] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:54 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1268 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:55.437478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:55.438564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:55.451319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.457975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.458877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.459996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.460641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.461333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.876613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:55.902900 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ba052c1-2a5a-411c-9359-c5808805371e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 2.022141 Oct 17 13:31:55.904401 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1921/3779] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:53 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 2026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:55.918578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:55.922864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:55.940652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:55.945354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.952871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.954292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:55.959335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:55.960131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:55.963979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:56.094440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:56.112625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ecd3e2a-71b5-46ca-a468-a7bca3416903 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1271 microversion: 2.1 time: 0.687046 Oct 17 13:31:56.154088 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1859/3780] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:55 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1271 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:56.172642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:56.173368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:56.193371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:56.204781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:56.206020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:56.209714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:56.213404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:56.218225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.099884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:57.123865 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2b354fe-3a93-401f-9544-1f1d19f1c802 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 1.200937 Oct 17 13:31:57.125516 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1922/3781] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:55 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:57.130564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:57.134213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:57.149633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.151824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.152450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.162510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.163177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.163734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.317145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:57.340946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:57.347260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:57.348819 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5f5535c-e14d-4be5-b742-08d1140e1566 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 1.193613 Oct 17 13:31:57.350634 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1860/3782] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:56 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:57.368348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:57.369949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:57.386637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.387669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.390756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.393990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.394462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.395129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.787866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:57.804875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ec2a3ff-03f3-4215-83bd-d36571794877 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1274 microversion: 2.1 time: 0.450390 Oct 17 13:31:57.807727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1861/3783] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:57 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1274 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:57.825240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:57.838106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:57.845387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.845912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.846362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:57.847054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:57.847504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:57.847915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.236104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:58.261992 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3061ec8f-c8af-4337-9989-0fe456589e49 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 1.135107 Oct 17 13:31:58.265670 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1923/3784] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:57 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:58.270599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:58.271207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:58.299717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.300219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.300661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.301405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.301857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.302282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.491374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:58.508836 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eba35b37-5ce2-45ba-b6d8-db10212fe8cb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.694387 Oct 17 13:31:58.510064 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1862/3785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:57 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:58.516583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:58.517582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:58.526813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.529473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.530600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.535248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.536635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.537444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.769300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:58.784072 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5ad1f85-91c2-4c66-886d-6303dcb5b721 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.517242 Oct 17 13:31:58.784721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1924/3786] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:58 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:58.803907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:58.808490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:58.823821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.824626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.827144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:58.828131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:58.828784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:58.829427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.056434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.070464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e05787e1-c1ca-439b-9b2c-dbbaa6ef10bf tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 0.558676 Oct 17 13:31:59.074772 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1863/3787] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:58 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:59.089400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:59.095278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:59.116165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.118072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.120136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.122031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.125350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.125862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.216805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.233640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.250498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.252498 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-654cb709-501a-4378-a4e1-923e6ec74fad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.463244 Oct 17 13:31:59.264951 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1925/3788] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:31:58 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:31:59.296850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:59.305142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:59.329124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:31:59.330806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.332393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.333868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.335028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.335998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.337134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.358534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.370309 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1fbc378b-377f-4a7b-8df5-55880ecb6db4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1274 microversion: 2.1 time: 0.293988 Oct 17 13:31:59.371843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1864/3789] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:59 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1274 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:59.469824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a6cb0e4d-f230-476b-aa2b-0805f71499bc req-b4794148-eb69-4106-8ad4-56c46fe37df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16", "name": "network-vif-plugged", "status": "completed", "tag": "ad8c1300-4ec2-46a9-8a18-785c58995ecf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:31:59.490584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a6cb0e4d-f230-476b-aa2b-0805f71499bc req-b4794148-eb69-4106-8ad4-56c46fe37df8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.491380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a6cb0e4d-f230-476b-aa2b-0805f71499bc req-b4794148-eb69-4106-8ad4-56c46fe37df8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.491999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a6cb0e4d-f230-476b-aa2b-0805f71499bc req-b4794148-eb69-4106-8ad4-56c46fe37df8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.509550 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a6cb0e4d-f230-476b-aa2b-0805f71499bc req-b4794148-eb69-4106-8ad4-56c46fe37df8 service nova] Creating event network-vif-plugged:ad8c1300-4ec2-46a9-8a18-785c58995ecf for instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 on n-h2-854121-14 Oct 17 13:31:59.517780 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a6cb0e4d-f230-476b-aa2b-0805f71499bc req-b4794148-eb69-4106-8ad4-56c46fe37df8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052999 Oct 17 13:31:59.519896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1865/3790] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:31:59.540353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:59.555969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:59.584060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.589924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.591095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.591712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.593577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.594267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.594889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.595418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7784b2ac-aac3-4786-85da-dff03357ccd7 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.311407 Oct 17 13:31:59.615394 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1926/3791] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:59 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:59.786413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:31:59.797571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4cc6e00f-3f91-439a-a364-297aab87ef9f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.266468 Oct 17 13:31:59.799630 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1866/3792] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:59 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:31:59.821319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:31:59.822276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:31:59.832015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.832849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.833515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:31:59.834418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:31:59.835045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:31:59.835639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.106814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:00.122952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:00.132336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:00.133956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:00.138233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.142053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.142843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.143847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.144561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.144918 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a62355ce-ca6f-4232-b09a-81bf084248ac tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.325017 Oct 17 13:32:00.145536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.145664 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1927/3793] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:31:59 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:00.281699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:00.282386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:00.290923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.296557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.297630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.298422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.298906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.299513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.532369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:00.559068 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e2c0704-2076-4a74-8450-8f8fdc0e1cbb tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 0.455915 Oct 17 13:32:00.579598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1867/3794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:00 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:00.586559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:00.594150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:00.612997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:00.656206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.656766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.657183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.657965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.658364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.658794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.770439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=20 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:00.819879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:00.830254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b308c1d-4b5b-4ac6-bdfb-240f23cb8425 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1274 microversion: 2.1 time: 0.248435 Oct 17 13:32:00.842847 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1868/3795] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:00 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1274 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:00.853826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:00.856399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:00.867090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:00.871044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.874262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.875985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.879152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:00.879361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.882034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.882710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.884140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:00.886315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c8b2ed2-acfc-495a-a4b5-90c93b156ef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.609944 Oct 17 13:32:00.887448 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1928/3796] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:00 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:00.892393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:00.893274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:00.900024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.900923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.901648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:00.902627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:00.903319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:00.905219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:01.238616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:01.251787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6deaba8-4aab-4c78-9656-8462672a374f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.362852 Oct 17 13:32:01.252306 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1929/3797] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:00 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:01.275672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:01.277940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:01.303170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:01.303896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:01.307302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:01.308559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:01.312555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:01.314876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:01.330376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:01.344503 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-373221de-59b6-4f3c-80a4-1e14f7413600 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.494544 Oct 17 13:32:01.345823 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1869/3798] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:00 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:01.587033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:01.588585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:01.594345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:01.598999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:01.605477 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b79ba961-f734-4e50-9ad0-8b6306b62681 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.346740 Oct 17 13:32:01.605819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:01.621322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1930/3799] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:01 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:01.622597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:01.624212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:01.624959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:01.625665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:01.858538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:01.860121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:01.874813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:01.875024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:01.875614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:01.881465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:01.895019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:01.896165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:02.128334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:02.131168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:02.144926 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9115a64d-9008-462c-8d76-13aa8b769f03 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1316 microversion: 2.1 time: 0.561583 Oct 17 13:32:02.145189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1870/3800] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:01 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:02.173873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:02.174504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:02.191716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:02.192225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:02.192666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:02.193415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:02.193878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:02.194315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:02.360644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:02.390609 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18ead712-1f04-49ba-b26c-1366e219252a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.537023 Oct 17 13:32:02.398599 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1931/3801] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:01 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:02.416546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:02.419025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:02.433924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:02.437182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:02.437764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:02.439415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:02.461531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:02.462748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:02.524877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:03.348837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:03.358643 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95eeadfd-1cdb-4699-9ad2-eccc7c0eabdc tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.958596 Oct 17 13:32:03.359173 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1932/3802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:02 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:03.386743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:03.387513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:03.402482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:03.402982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:03.419725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:03.420725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:03.428896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:03.432990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:03.872841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:03.883143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:03.884617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:03.907337 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f202151-5601-43c0-8aee-95e6c715c5c5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 1.761012 Oct 17 13:32:03.909611 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1871/3803] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:02 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:03.924279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:03.939190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:03.952218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:03.961365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:03.963447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:03.965116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:03.967271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:03.985637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:04.006106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:04.023369 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f222ea69-a7d9-4648-a075-dad0588d5899 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.662006 Oct 17 13:32:04.026371 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1933/3804] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:03 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:04.048463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:04.053866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:04.073322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:04.075475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:04.077525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:04.081679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:04.082393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:04.084314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.148304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.166390 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-251ac783-c228-4734-90ad-911da080ad84 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 1.254726 Oct 17 13:32:05.181773 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1872/3805] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:03 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:05.188222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:05.189189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:05.195744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.197734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.198396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.203865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.204599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.205370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.233704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.242505 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1b8e176-a8e1-4053-8ee7-d508d64a5d28 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1503 microversion: 2.1 time: 1.214596 Oct 17 13:32:05.248501 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1934/3806] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:04 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1503 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:05.256288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:05.260412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:05.273871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.276168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.276793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.279090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.285838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.286589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.508739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.518607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37f311b2-94c3-451d-b73c-1404cfb3c455 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.335359 Oct 17 13:32:05.535706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1873/3807] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:05 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:05.541042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "name": "network-vif-unplugged", "status": "completed", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:05.552333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.553305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.553856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.569508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] Creating event network-vif-unplugged:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h1-854121-14 Oct 17 13:32:05.577392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] Instance 49427967-1ba2-4e58-b832-1a9fb815cccb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:32:05.590442 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-544491f0-4d28-4116-8961-4eb10cffe4d9 req-eb7b6afd-df8d-47c9-ba15-6b66b14b1a06 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052947 Oct 17 13:32:05.595730 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1874/3808] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:05.601878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:05.602947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:05.614514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.615445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.616137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.616879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.617370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.617800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.639799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.649680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86b7b1f7-9acc-4efb-ba99-35d5e24a9a4d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.399306 Oct 17 13:32:05.666332 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1935/3809] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:05 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:05.672933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:05.673915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:05.680722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.681268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.681714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.682424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.683066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.683709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.924541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.952110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.955995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.957953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e18b7f86-5617-4f83-b8b0-591dc822b2f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.360709 Oct 17 13:32:05.960177 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1875/3810] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:05 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:05.970654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:05.971945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:05.982771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:05.988072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.989635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.990200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.993764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:05.994675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:05.996761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:05.999787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-283aa1b7-ddde-45c0-bb30-f158f66c378f tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.331477 Oct 17 13:32:06.001226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1936/3811] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:05 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:06.040109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:06.137849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4161add1-0585-4b78-b5df-90b357d35a1a tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 204 len: 0 microversion: 2.1 time: 0.175677 Oct 17 13:32:06.139629 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1876/3812] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:05 2022] DELETE /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:06.150303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:06.151258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:06.158844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.159636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.160277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.161230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.161992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.162941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.192732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:06.193838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:06.205247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.205747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.206187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.206900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.207357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.207784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.427363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:06.448002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:06.461195 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68eb3c80-5a27-43b3-9b9f-fd8f310fae79 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1509 microversion: 2.1 time: 0.316299 Oct 17 13:32:06.462781 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1937/3813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:06 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:06.465263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fda1fceb-1e94-4b0a-ae3c-2d359aaaa1ee tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.276596 Oct 17 13:32:06.466300 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1877/3814] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:06 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:06.546076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:06.546696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:06.553242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.553738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.554397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.555101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.555770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.556385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.677133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:06.678325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:06.684604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.685205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.686311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.687281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.687943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.688560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.694969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:06.705090 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ed6da3e-9ce7-4cde-98bc-cf8f7eeb62ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.163512 Oct 17 13:32:06.716955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1938/3815] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:06 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:06.833113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:06.841142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8986d88c-d929-461a-a6b8-6c73a07ced12 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.167780 Oct 17 13:32:06.841739 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1878/3816] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:06 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:06.945490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-299f98e3-7e85-407d-8dd3-0bc4754fafc1 req-f545f4bb-7164-485d-8f2b-03297ed5af19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a489911d-3fd0-4184-8d2a-c8ceae209621", "tag": "64463c2d-7932-429c-831b-3c574b79973e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:06.955557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-299f98e3-7e85-407d-8dd3-0bc4754fafc1 req-f545f4bb-7164-485d-8f2b-03297ed5af19 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:06.956031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-299f98e3-7e85-407d-8dd3-0bc4754fafc1 req-f545f4bb-7164-485d-8f2b-03297ed5af19 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:06.956511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-299f98e3-7e85-407d-8dd3-0bc4754fafc1 req-f545f4bb-7164-485d-8f2b-03297ed5af19 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:06.967995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-299f98e3-7e85-407d-8dd3-0bc4754fafc1 req-f545f4bb-7164-485d-8f2b-03297ed5af19 service nova] Creating event network-changed:64463c2d-7932-429c-831b-3c574b79973e for instance a489911d-3fd0-4184-8d2a-c8ceae209621 on n-h2-854121-14 Oct 17 13:32:06.972984 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-299f98e3-7e85-407d-8dd3-0bc4754fafc1 req-f545f4bb-7164-485d-8f2b-03297ed5af19 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031288 Oct 17 13:32:06.973676 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1939/3817] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:06.985839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:06.986404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:07.002879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.003400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.004314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.005104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.005596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.006025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.035905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:07.037036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:07.044619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.045425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.046140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.047236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.047872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.048816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.232847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:07.243434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:07.245325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:07.246638 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88946680-e3e0-42ff-a7b2-a02a68c1c89d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.265395 Oct 17 13:32:07.247320 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1879/3818] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:06 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:07.274517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:07.282790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-135be705-7a28-4833-a5fe-399aba2c8716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.252908 Oct 17 13:32:07.283693 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1940/3819] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:07 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:07.505896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:07.513336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:07.515350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:07.516424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:07.546427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.547680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.549970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.550649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.554367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.555236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.555581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.557304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:07.558211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.558854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:07.559673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:07.562595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.211184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:08.225547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:08.238260 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-477e6101-9556-49c5-abc7-62427fc209f2 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1509 microversion: 2.1 time: 0.737549 Oct 17 13:32:08.240709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1880/3820] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:07 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1509 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:08.241920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2ff9ad8-9c5e-4cb0-95ca-7e3cf7a12e91 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.734100 Oct 17 13:32:08.247285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0e79181c-fa93-483e-841a-9a09864f75ad req-c441fec5-8c11-4c7d-b848-f94ebb5aa7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7", "name": "network-vif-plugged", "status": "completed", "tag": "65e5d91a-6d5a-43e2-ba0d-f0f29b71561e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:08.257652 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1941/3821] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:07 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:08.262405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0e79181c-fa93-483e-841a-9a09864f75ad req-c441fec5-8c11-4c7d-b848-f94ebb5aa7bb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.263218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0e79181c-fa93-483e-841a-9a09864f75ad req-c441fec5-8c11-4c7d-b848-f94ebb5aa7bb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.264728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0e79181c-fa93-483e-841a-9a09864f75ad req-c441fec5-8c11-4c7d-b848-f94ebb5aa7bb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.272365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:08.272999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:08.284004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.284269 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0e79181c-fa93-483e-841a-9a09864f75ad req-c441fec5-8c11-4c7d-b848-f94ebb5aa7bb service nova] Creating event network-vif-plugged:65e5d91a-6d5a-43e2-ba0d-f0f29b71561e for instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 on n-h1-854121-14 Oct 17 13:32:08.284851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.285409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.286418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.287198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.288573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.292382 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0e79181c-fa93-483e-841a-9a09864f75ad req-c441fec5-8c11-4c7d-b848-f94ebb5aa7bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050210 Oct 17 13:32:08.297531 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1881/3822] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:08.316879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:08.316879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:08.331590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.333513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.335592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.336542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.337835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.340542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.702681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:08.713924 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f014f719-4186-4042-9090-080795a7a206 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.454698 Oct 17 13:32:08.715599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:08.736933 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1942/3823] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:08 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:08.743721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:08.745076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:08.752485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.754860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.755533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.757411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.758100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.759387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.774215 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-43b4f7c2-11d1-45f3-b325-1a683d854633 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.474306 Oct 17 13:32:08.776982 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1882/3824] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:08 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:08.799745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:08.800615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:08.807042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.814120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.815111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:08.816432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:08.817056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:08.817687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.165816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:09.175714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:09.180040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:09.182901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:09.187298 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7ccbe067-bf5c-4fe5-ab5a-4a161aa56c38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.448411 Oct 17 13:32:09.187501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27f626f3-cc7b-4aeb-83f8-53950578efb8 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1324 microversion: 2.1 time: 0.408380 Oct 17 13:32:09.188053 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1883/3825] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:08 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:09.188902 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1943/3826] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:08 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:09.195823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c999d9-c3d1-435f-96f0-5505353369b8", "tag": "d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7"}, {"name": "network-changed", "server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:09.206700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-03a758c3-0feb-4c69-bfab-5f25ca19af67 req-dc536420-6c0d-4a94-b7f7-0035a97fed66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16", "name": "network-vif-deleted", "tag": "ad8c1300-4ec2-46a9-8a18-785c58995ecf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:09.226867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03a758c3-0feb-4c69-bfab-5f25ca19af67 req-dc536420-6c0d-4a94-b7f7-0035a97fed66 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.229919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03a758c3-0feb-4c69-bfab-5f25ca19af67 req-dc536420-6c0d-4a94-b7f7-0035a97fed66 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.230593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03a758c3-0feb-4c69-bfab-5f25ca19af67 req-dc536420-6c0d-4a94-b7f7-0035a97fed66 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.234759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.235592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.236273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.251469 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-03a758c3-0feb-4c69-bfab-5f25ca19af67 req-dc536420-6c0d-4a94-b7f7-0035a97fed66 service nova] Creating event network-vif-deleted:ad8c1300-4ec2-46a9-8a18-785c58995ecf for instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 on n-h2-854121-14 Oct 17 13:32:09.268188 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-03a758c3-0feb-4c69-bfab-5f25ca19af67 req-dc536420-6c0d-4a94-b7f7-0035a97fed66 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068905 Oct 17 13:32:09.270677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Creating event network-changed:d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7 for instance 54c999d9-c3d1-435f-96f0-5505353369b8 on n-h2-854121-14 Oct 17 13:32:09.271498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1884/3827] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:09.271940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Creating event network-changed:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h1-854121-14 Oct 17 13:32:09.279158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] Instance 49427967-1ba2-4e58-b832-1a9fb815cccb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 13:32:09.285208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:09.285942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:09.298694 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-330cc6f7-3613-4c13-af8d-5120990c9aa3 req-cba0b417-ee4d-4836-a429-1dcf5d2d1b3a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.108298 Oct 17 13:32:09.299926 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1944/3828] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:09.306533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.307432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.307912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:09.308092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.308792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.309135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:09.311800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.312298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.319809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.320543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.321788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.322511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.322967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.323941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.403325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.403828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.404272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.405795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lazy-loading 'fault' on Instance uuid 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:09.521903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:09.533260 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb39e295-27c7-47cc-a29e-6702dc0716ea tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1306 microversion: 2.1 time: 0.259888 Oct 17 13:32:09.547467 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1885/3829] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:09 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1306 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:09.659026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:09.667278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77796813-0117-4228-83b7-2fa246e0cd3c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.365632 Oct 17 13:32:09.668106 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1945/3830] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:09 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:09.744814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:09.745477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:09.758165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.759189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.759861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.760820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.761922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.763543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.799001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:09.800295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:09.808125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.813507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.814899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:09.815905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:09.819313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:09.820192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.222265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.232169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.233293 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-484efc86-2f28-438e-8bec-838b573b8a5c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.492072 Oct 17 13:32:10.249945 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1886/3831] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:09 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:10.250357 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48bef0da-dcc2-475b-8c1a-95adbdbc64ee tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.447286 Oct 17 13:32:10.250484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:10.250484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:10.254406 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1946/3832] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:09 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:10.259204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.260495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.261610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.262662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.263364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.264596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.268422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:10.269037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:10.270450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:10.275879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.276380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.276820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.277546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.278186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.278797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.624780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.634356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.641379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.644710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.645265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dfe23b3a-1e0b-4c0d-81d0-a6191671b396 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1520 microversion: 2.1 time: 0.404230 Oct 17 13:32:10.646052 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1f0c0e3-3af6-47df-8178-e728015dcacf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.390760 Oct 17 13:32:10.657907 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1887/3833] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:10 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:10.661718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1947/3834] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:10 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:10.677661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:10.677661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:10.686760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.687553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.688978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.689804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.690278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.690729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.734015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.734290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.734811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.735336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lazy-loading 'fault' on Instance uuid 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:10.757680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-817470930", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "378eb288-e26b-4005-b826-6dcacdd89bfd"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:10.807120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:10.820548 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3037759-7979-4b35-8342-cce8896e8be6 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1306 microversion: 2.1 time: 0.160662 Oct 17 13:32:10.823328 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1888/3835] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:10 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:10.837185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:10.837802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:10.850397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] validate_networks() for [('378eb288-e26b-4005-b826-6dcacdd89bfd', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:32:10.856447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.856986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.857522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:10.858734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:10.859189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:10.859828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.090980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:11.101328 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82f79a17-b24a-47c5-9c8e-ed4a7d505a71 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.276692 Oct 17 13:32:11.117138 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1889/3836] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:10 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:11.118712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec221678-7ac6-4903-a215-7ce484554cc3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1187051599", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec221678-7ac6-4903-a215-7ce484554cc3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 243 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1187051599", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1187051599', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '9b3755b0-7f64-42c1-9f1d-0e81d72fca74'}]}}} Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:11.124112 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec221678-7ac6-4903-a215-7ce484554cc3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:11.130067 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec221678-7ac6-4903-a215-7ce484554cc3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.015329 Oct 17 13:32:11.135191 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1890/3837] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:11 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:32:11.141121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e37902d9-bf8f-40c5-b061-b171be5914d3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:11.141711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e37902d9-bf8f-40c5-b061-b171be5914d3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: f18ad8d2-92c7-4aab-8dd0-593986ea8fa5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:11.149456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e37902d9-bf8f-40c5-b061-b171be5914d3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] HTTP exception thrown: Instance f18ad8d2-92c7-4aab-8dd0-593986ea8fa5 could not be found. Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e37902d9-bf8f-40c5-b061-b171be5914d3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/f18ad8d2-92c7-4aab-8dd0-593986ea8fa5/metadata HTTP/1.1 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance f18ad8d2-92c7-4aab-8dd0-593986ea8fa5 could not be found. Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': 'f18ad8d2-92c7-4aab-8dd0-593986ea8fa5'} Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f18ad8d2-92c7-4aab-8dd0-593986ea8fa5 could not be found. Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f18ad8d2-92c7-4aab-8dd0-593986ea8fa5 could not be found. Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.158881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.164754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:11.164754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:11.164754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f18ad8d2-92c7-4aab-8dd0-593986ea8fa5 could not be found. Oct 17 13:32:11.164754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.164754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e37902d9-bf8f-40c5-b061-b171be5914d3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 404 to user: Instance f18ad8d2-92c7-4aab-8dd0-593986ea8fa5 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:11.164754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e37902d9-bf8f-40c5-b061-b171be5914d3 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/f18ad8d2-92c7-4aab-8dd0-593986ea8fa5/metadata" status: 404 len: 111 microversion: 2.1 time: 0.025430 Oct 17 13:32:11.166069 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1891/3838] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:32:11 2022] GET /compute/v2.1/servers/f18ad8d2-92c7-4aab-8dd0-593986ea8fa5/metadata => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:11.248174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a8bf9a1-b994-4411-bc9f-772bb06133c1 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300687659", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a8bf9a1-b994-4411-bc9f-772bb06133c1 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 499 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1300687659", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1300687659', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b3755b0-7f64-42c1-9f1d-0e81d72fca74'}]}}} Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:32:11.253988 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.257500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.262554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a8bf9a1-b994-4411-bc9f-772bb06133c1 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:11.270556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a8bf9a1-b994-4411-bc9f-772bb06133c1 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.026608 Oct 17 13:32:11.272027 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1892/3839] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:11 2022] POST /compute/v2.1/servers => generated 687 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:32:11.282522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:11.283725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:11.293632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.294561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.295913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.298098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.299139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.300782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.558940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:11.573601 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c0701cc-5b7d-4f79-9839-51bf81fe4b89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.299989 Oct 17 13:32:11.593296 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1893/3840] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:11 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:11.600582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:11.601236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:11.601771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:32:11.602430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:32:11.603085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:32:11.603672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:32:11.604260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:32:11.612000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.612713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.613188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.614062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.614581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.615012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.618066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.618559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.618987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.622720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.623471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.624454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.646072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Getting quotas for project 2b4099ba46204f7a87a4c569cb91e156. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:11.653115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Getting quotas for user df19e5ec0ca14a2599a64cf93b76ada1 and project 2b4099ba46204f7a87a4c569cb91e156. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:11.680371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:32:11.682793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:32:11.747849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dcbb2020-f8f6-4139-aa0d-f1b2b87fe10a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.083969 Oct 17 13:32:11.749291 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1948/3841] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:32:11.754253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48dd6e4d-108f-40a0-9a64-c3fae3f43b3c tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-419527159", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48dd6e4d-108f-40a0-9a64-c3fae3f43b3c tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 499 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-419527159", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-419527159', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b3755b0-7f64-42c1-9f1d-0e81d72fca74'}]}}} Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:32:11.759293 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:11.762792 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:11.769478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48dd6e4d-108f-40a0-9a64-c3fae3f43b3c tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:11.770595 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48dd6e4d-108f-40a0-9a64-c3fae3f43b3c tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.020174 Oct 17 13:32:11.772272 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1949/3842] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:11 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:32:11.803205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:11.803900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:11.813284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.813894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.814974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.815894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:11.816321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:11.816816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:11.857913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:11.874336 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-faf0fec7-2464-4cf1-8309-e035a7f38359 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.278582 Oct 17 13:32:11.885208 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1894/3843] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:11 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:11.885208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eda00ccf-9bcc-4f12-8431-a1ecff31d54a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:11.885208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eda00ccf-9bcc-4f12-8431-a1ecff31d54a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:11.961412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eda00ccf-9bcc-4f12-8431-a1ecff31d54a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:11.970635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eda00ccf-9bcc-4f12-8431-a1ecff31d54a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:11.974909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eda00ccf-9bcc-4f12-8431-a1ecff31d54a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:11.976196 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eda00ccf-9bcc-4f12-8431-a1ecff31d54a tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1261 microversion: 2.26 time: 0.100215 Oct 17 13:32:11.995417 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1895/3844] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:11 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1261 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:12.011125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:12.012717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:12.034810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.036956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.038954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.040142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.042012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.043171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.075792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:12.089726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:12.091187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:12.093443 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22a56b44-d8fe-4e98-96f0-85b5599d2f7d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.319982 Oct 17 13:32:12.094210 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1950/3845] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:11 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:12.099486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c11f3bd4-e02a-4e59-9104-ca7982d1d538 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1754468337", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c11f3bd4-e02a-4e59-9104-ca7982d1d538 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 754 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1754468337", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1754468337', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b3755b0-7f64-42c1-9f1d-0e81d72fca74'}]}}} Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:32:12.109149 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:32:12.112369 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:32:12.115541 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.115541 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.116909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c11f3bd4-e02a-4e59-9104-ca7982d1d538 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:12.120532 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c11f3bd4-e02a-4e59-9104-ca7982d1d538 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.024770 Oct 17 13:32:12.121123 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1951/3846] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:12 2022] POST /compute/v2.1/servers => generated 1197 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 13:32:12.126705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.129343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:12.130232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:12.131177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.133741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.134383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lazy-loading 'fault' on Instance uuid 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:12.144975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.145700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.146289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.147176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.147785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.148357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.247681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4bb905a78641abb1f224d483016369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df0b1b02ef4f4fb3e63199da76330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:12.258963 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f4786d4-f0a1-4026-83a0-5a83bbe14d50 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 200 len: 1306 microversion: 2.1 time: 0.260810 Oct 17 13:32:12.262592 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1896/3847] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:11 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 1306 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:12.271265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ecc7a6e4-18af-4c6c-9444-0b29740159c0 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1165192180", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ecc7a6e4-18af-4c6c-9444-0b29740159c0 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 1266 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1165192180", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9b3755b0-7f64-42c1-9f1d-0e81d72fca74"}]}} Oct 17 13:32:12.277125 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1165192180', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9b3755b0-7f64-42c1-9f1d-0e81d72fca74'}]}}} Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.286142 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:32:12.287654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:32:12.290338 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 17 13:32:12.290338 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.290338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ecc7a6e4-18af-4c6c-9444-0b29740159c0 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:12.290338 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ecc7a6e4-18af-4c6c-9444-0b29740159c0 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.014960 Oct 17 13:32:12.290338 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1897/3848] 10.222.0.65 () {60 vars in 1148 bytes} [Mon Oct 17 13:32:12 2022] POST /compute/v2.1/servers => generated 2221 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 17 13:32:12.299928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b364f0df-2aa4-4eda-bf1f-d70276ab3608 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:12.300435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b364f0df-2aa4-4eda-bf1f-d70276ab3608 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: fbffae1c-1c63-42e1-bb99-23eebc611923] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:12.318018 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b364f0df-2aa4-4eda-bf1f-d70276ab3608 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] HTTP exception thrown: Instance fbffae1c-1c63-42e1-bb99-23eebc611923 could not be found. Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b364f0df-2aa4-4eda-bf1f-d70276ab3608 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/fbffae1c-1c63-42e1-bb99-23eebc611923/metadata/test2 HTTP/1.1 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance fbffae1c-1c63-42e1-bb99-23eebc611923 could not be found. Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': 'fbffae1c-1c63-42e1-bb99-23eebc611923', 'id': 'test2'} Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbffae1c-1c63-42e1-bb99-23eebc611923 could not be found. Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbffae1c-1c63-42e1-bb99-23eebc611923 could not be found. Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:12.319919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:12.325544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:12.325544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:12.325544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbffae1c-1c63-42e1-bb99-23eebc611923 could not be found. Oct 17 13:32:12.325544 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:12.328534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b364f0df-2aa4-4eda-bf1f-d70276ab3608 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 404 to user: Instance fbffae1c-1c63-42e1-bb99-23eebc611923 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:12.329898 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b364f0df-2aa4-4eda-bf1f-d70276ab3608 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/fbffae1c-1c63-42e1-bb99-23eebc611923/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.041788 Oct 17 13:32:12.341239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1898/3849] 10.222.0.65 () {58 vars in 1281 bytes} [Mon Oct 17 13:32:12 2022] GET /compute/v2.1/servers/fbffae1c-1c63-42e1-bb99-23eebc611923/metadata/test2 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:12.348117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:12.348641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:12.357343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.358367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.359229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.363829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.364574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.365042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.441540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:12.471420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:12.475340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:12.483588 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b65f85df-f1cf-4876-926e-9ce9a078c9f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.360996 Oct 17 13:32:12.484756 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1952/3850] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:12 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:12.599728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:12.600475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:12.624381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.624944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.630905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.633395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.635422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.637601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.722211 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d02f32e3-f8d8-4d45-9e8e-7cf2fe0e9716 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 204 len: 0 microversion: 2.1 time: 0.378314 Oct 17 13:32:12.725702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1899/3851] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:12 2022] DELETE /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:12.741499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:12.746148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:12.760791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.761320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.761859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.762624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:12.763088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:12.763521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:12.986746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.000198 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcb31908-db8b-4326-99d8-ca798576cb2a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.405262 Oct 17 13:32:13.000887 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1953/3852] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:12 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:13.012818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.015383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.029027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.033855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.034356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.035024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.035744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.036200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.036817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.039815 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-619be8ba-5272-4bb7-be40-eb54148e4358 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1526 microversion: 2.1 time: 0.309845 Oct 17 13:32:13.040989 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1900/3853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:12 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1526 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:13.057644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.058684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.069851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.070537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.071094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.071924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.072497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.073035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.213442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.228855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.231420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.233696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5307479c-c3af-4e36-a321-d4a4dfa5d4c8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1265 microversion: 2.26 time: 0.190522 Oct 17 13:32:13.234720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1901/3854] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:13 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:13.250696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.250696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.257720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.258138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.258801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.259708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.260351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.260785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.290028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.301415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-974427bc-a803-4556-859d-c66a74dd579c tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1468 microversion: 2.1 time: 0.296179 Oct 17 13:32:13.305530 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1954/3855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:13 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1468 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:13.314685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.316217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.328767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.329825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.330558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.331946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.333075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.339088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.361694 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 HTTP/1.1 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16'} Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.363605 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.370432 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.373347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.374506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b27ff6a7-3acb-476e-8b54-d021194e5235 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 404 len: 111 microversion: 2.1 time: 0.067428 Oct 17 13:32:13.375584 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1955/3856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:13 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:13.384366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-476049376", "metadata": {"image_type": "test"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:13.387010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.395041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.395548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.395995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.396713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.397196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.397717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.414471 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16/action HTTP/1.1 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 111 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-476049376", "metadata": {"image_type": "test"}}} Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-476049376', 'metadata': {'image_type': 'test'}}}} Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:32:13.416428 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.421945 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.423973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.424869 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-492040d6-badf-4f94-9e03-8b3e9a567316 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "POST /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16/action" status: 404 len: 111 microversion: 2.1 time: 0.045003 Oct 17 13:32:13.425507 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1956/3857] 10.222.0.65 () {60 vars in 1279 bytes} [Mon Oct 17 13:32:13 2022] POST /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:32:13.438328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a117e797-068d-4e45-85f0-a5a78443b473 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-83967589", "metadata": {"image_type": "test"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:13.441202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a117e797-068d-4e45-85f0-a5a78443b473 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Failed to fetch instance by id tempest-invalid-846622979 {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:32:13.441914 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a117e797-068d-4e45-85f0-a5a78443b473 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance tempest-invalid-846622979 could not be found. Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a117e797-068d-4e45-85f0-a5a78443b473 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/tempest-invalid-846622979/action HTTP/1.1 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 110 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-83967589", "metadata": {"image_type": "test"}}} Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance tempest-invalid-846622979 could not be found. Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'tempest-invalid-846622979', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-83967589', 'metadata': {'image_type': 'test'}}}} Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-846622979 could not be found. Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.443466 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-846622979 could not be found. Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-846622979 could not be found. Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a117e797-068d-4e45-85f0-a5a78443b473 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance tempest-invalid-846622979 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a117e797-068d-4e45-85f0-a5a78443b473 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "POST /compute/v2.1/servers/tempest-invalid-846622979/action" status: 404 len: 100 microversion: 2.1 time: 0.010861 Oct 17 13:32:13.455217 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1957/3858] 10.222.0.65 () {60 vars in 1246 bytes} [Mon Oct 17 13:32:13 2022] POST /compute/v2.1/servers/tempest-invalid-846622979/action => generated 100 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:13.457985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e03d1883-629b-4bb7-8d40-1f52a4390089 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1954391956"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:13.460222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e03d1883-629b-4bb7-8d40-1f52a4390089 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:32:13.460731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.461575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e03d1883-629b-4bb7-8d40-1f52a4390089 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e03d1883-629b-4bb7-8d40-1f52a4390089 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 57 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: {"createImage": {"name": "tempest-test-snap-1954391956"}} Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1954391956'}}} Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.464909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e03d1883-629b-4bb7-8d40-1f52a4390089 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e03d1883-629b-4bb7-8d40-1f52a4390089 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.012970 Oct 17 13:32:13.473520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1958/3859] 10.222.0.65 () {60 vars in 1275 bytes} [Mon Oct 17 13:32:13 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:13.478382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31d3b957-3981-462f-b086-806c9ff48174 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-907336385"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:13.479483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.480714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31d3b957-3981-462f-b086-806c9ff48174 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:32:13.481281 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-31d3b957-3981-462f-b086-806c9ff48174 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.481892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31d3b957-3981-462f-b086-806c9ff48174 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 56 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: {"createImage": {"name": "tempest-test-snap-907336385"}} Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-907336385'}}} Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.483389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31d3b957-3981-462f-b086-806c9ff48174 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.488670 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31d3b957-3981-462f-b086-806c9ff48174 tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010332 Oct 17 13:32:13.489501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b5536ae-afe4-4898-be11-79005acf987e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.250473 Oct 17 13:32:13.489501 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1902/3860] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:13 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:13.489694 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1959/3861] 10.222.0.65 () {60 vars in 1281 bytes} [Mon Oct 17 13:32:13 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:13.508617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.509527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.513126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.514325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.517439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.517931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.518369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.519412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.520574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.521187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.525129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.525945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.526683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.527851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.528616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.529476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.547830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 HTTP/1.1 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16'} Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.549964 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.555020 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.556968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.557943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c8028b9-6faa-489f-88d5-6a163c77e01e tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 404 len: 111 microversion: 2.1 time: 0.056665 Oct 17 13:32:13.558835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1903/3862] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:13 2022] DELETE /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:32:13.571672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:13.572299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] [instance: 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:13.579093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.579376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.579811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.580520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:13.581074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:13.581679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:13.602355 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] HTTP exception thrown: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Request method failure captured: Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 HTTP/1.1 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVkxaoUykbpzOpYL6Jjryc9f8JV5ZTTu_lUouOP0OMcYNI3n-hhYxGYtur0foD3-UeZYuUqBk4OGROFXISHF8eNCCfpAj8cToWnGU-P3wgwFEVmhaz63yLjhCaqSCjoI3EE2Ho5IJNwoMhiyo9hZLRMfCKiy8cqxcJCCGPKO4ZQ4OB8 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_73df0b1b02ef4f4fb3e63199da76330e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 73df0b1b02ef4f4fb3e63199da76330e Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-658973650 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: ae4bb905a78641abb1f224d483016369 Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ImagesNegativeTestJSON-658973650-project Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16'} Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:13.603651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] Returning 404 to user: Instance 5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18002b08-70e8-4f16-8e47-5eea7ce75a2f tempest-ImagesNegativeTestJSON-658973650 tempest-ImagesNegativeTestJSON-658973650-project] 10.222.0.65 "GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16" status: 404 len: 111 microversion: 2.1 time: 0.037518 Oct 17 13:32:13.611700 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1904/3863] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:13 2022] GET /compute/v2.1/servers/5cdbc5b1-7ace-4b33-b49b-6bb08d8e2b16 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:13.705689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:13.715893 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba400142-3f36-4b61-8fa8-cfd449de800f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.211079 Oct 17 13:32:13.718062 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1960/3864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:13 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:14.026179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:14.026721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:14.045610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.049741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.051346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.053987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.058510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.061990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.066634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:14.068713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:14.090781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.094254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.096407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.097478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.101128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.102501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.421956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.423887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.432863 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31e17e10-bcea-4a3f-aa94-dd5d781484ce tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1526 microversion: 2.1 time: 0.372425 Oct 17 13:32:14.434421 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1961/3865] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1526 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:14.434686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e84f28d6-c7a2-4942-8a72-cc91806a59a8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.413506 Oct 17 13:32:14.435277 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1905/3866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:14.440023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:14.440752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:14.447188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.447975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.448698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.449684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.450710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.451430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.463440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:14.465869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:14.481515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.482980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.484246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.485255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.485927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.487938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.560165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.572838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.575030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.577188 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91983fe7-fd9c-4f44-803e-c9f58fb103e4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1313 microversion: 2.26 time: 0.140462 Oct 17 13:32:14.578667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1962/3867] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:14.585283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:14.586697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:14.597508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.598424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.599106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.600386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.601135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.601825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.781853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.793095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c41f788-bf37-462b-87b8-bf4950344b82 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1461 microversion: 2.1 time: 0.356561 Oct 17 13:32:14.794391 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1906/3868] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1461 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:14.820132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:14.821237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:14.835281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.836196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.836528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.837199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.838157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:14.839318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:14.841651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:14.868033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.872214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:14.878783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c77e65c-bc08-4642-b091-c8a24b01acda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.298477 Oct 17 13:32:14.879763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1963/3869] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:15.084528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:15.084778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:15.085920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:15.097603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2271b95-bbd0-42d0-ade4-4ab5e2511aa9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.286871 Oct 17 13:32:15.098041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.098586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1907/3870] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:15.098717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.099383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.100312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.101885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.103069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.119078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ebdbbc69-0e96-4623-838a-c4154fe07155 req-69e6aa7c-67a6-40a0-b015-c98df129a1ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "name": "network-vif-plugged", "status": "completed", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:15.137943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ebdbbc69-0e96-4623-838a-c4154fe07155 req-69e6aa7c-67a6-40a0-b015-c98df129a1ce service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.139518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ebdbbc69-0e96-4623-838a-c4154fe07155 req-69e6aa7c-67a6-40a0-b015-c98df129a1ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.139656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ebdbbc69-0e96-4623-838a-c4154fe07155 req-69e6aa7c-67a6-40a0-b015-c98df129a1ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.160519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ebdbbc69-0e96-4623-838a-c4154fe07155 req-69e6aa7c-67a6-40a0-b015-c98df129a1ce service nova] Creating event network-vif-plugged:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h1-854121-14 Oct 17 13:32:15.169330 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ebdbbc69-0e96-4623-838a-c4154fe07155 req-69e6aa7c-67a6-40a0-b015-c98df129a1ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053750 Oct 17 13:32:15.172321 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1908/3871] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:15.282158 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87e6c28c-6e01-4341-9de1-7b7743a6a9a8 tempest-MigrationsAdminTest-313454353 tempest-MigrationsAdminTest-313454353-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1614 microversion: 2.1 time: 0.401216 Oct 17 13:32:15.282752 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1964/3872] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:14 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1614 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:15.314077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:15.314592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:15.321756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.322597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.323220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.324148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.325038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.325508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.345623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:15.361733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:15.450465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:15.459760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:15.461256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:15.469511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.474674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.475262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.477130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.478711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.480006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.485728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcf26445-96b4-4583-9a36-a024bd758f2e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "DELETE /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 204 len: 0 microversion: 2.1 time: 0.176383 Oct 17 13:32:15.486959 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1909/3873] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:15 2022] DELETE /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:15.507281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:15.511396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:15.522105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.522714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.523316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.527455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.528120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.528669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.741598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:15.760919 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f1b4334-66c0-4313-bc6b-2e3dc88c43e0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.303875 Oct 17 13:32:15.777948 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1965/3874] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:15 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:15.790017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:15.793291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:15.810313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.814668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.815648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.816907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.817725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.822340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.834647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:15.846627 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8033aa3e-3db8-431f-b45f-9184196a8345 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1526 microversion: 2.1 time: 0.352918 Oct 17 13:32:15.848430 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1910/3875] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:15 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1526 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:15.863022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:15.864130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:15.874490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.875632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.876390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:15.877387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:15.878032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:15.878636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.018340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.040629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.044522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.046778 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ff2652d-7c40-451b-a3d4-3c95698fb764 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1319 microversion: 2.26 time: 0.196988 Oct 17 13:32:16.069872 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1911/3876] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:15 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:16.098208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:16.099141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:16.110152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.110654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.111295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.112383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.113297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.113906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.564230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.578935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d94cedd-1961-461f-9bce-16a2053a4d6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1467 microversion: 2.1 time: 0.799145 Oct 17 13:32:16.582485 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1966/3877] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:15 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1467 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:16.594066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:16.596841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:16.604385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.605512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.605972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.606694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.607156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.608108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.615232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.644603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.646744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.648795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59a97203-16b4-4227-8f3e-d17aa241cc66 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.575415 Oct 17 13:32:16.650363 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1912/3878] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:16 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:16.786005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:16.786806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:16.800059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.803114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.804459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.806926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.807708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.813571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.815279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:16.826451 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af7f16ee-a38f-41ed-b1c6-551d26ec8bed tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.241505 Oct 17 13:32:16.827390 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1967/3879] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:16 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:16.871409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:16.872813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:16.881147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.882042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.882570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:16.883366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:16.884148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:16.884661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.065546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:17.077001 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54795ef3-aa2a-43d0-a1ea-f9a4a4b43ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.295774 Oct 17 13:32:17.083705 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1913/3880] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:16 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:17.099613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:17.100610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:17.117093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.120672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.121243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.122089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.122757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.123931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.164018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:17.174406 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0f99647-4485-43c5-97b4-c41702a8f042 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1526 microversion: 2.1 time: 0.307288 Oct 17 13:32:17.175595 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1968/3881] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:16 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1526 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:17.227292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f6eaa9b0-4479-4732-bb24-9ae7f681ac08 req-d9a1d602-e9c7-4e5e-8580-a9d8ad12173e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "name": "network-vif-plugged", "status": "completed", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:17.246718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f6eaa9b0-4479-4732-bb24-9ae7f681ac08 req-d9a1d602-e9c7-4e5e-8580-a9d8ad12173e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.247526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f6eaa9b0-4479-4732-bb24-9ae7f681ac08 req-d9a1d602-e9c7-4e5e-8580-a9d8ad12173e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.249477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f6eaa9b0-4479-4732-bb24-9ae7f681ac08 req-d9a1d602-e9c7-4e5e-8580-a9d8ad12173e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.258289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:17.270263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:17.270488 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f6eaa9b0-4479-4732-bb24-9ae7f681ac08 req-d9a1d602-e9c7-4e5e-8580-a9d8ad12173e service nova] Creating event network-vif-plugged:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:32:17.272119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:17.274329 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c905ccbd-28af-4537-aba8-bbab9cf48a7e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1319 microversion: 2.26 time: 0.178616 Oct 17 13:32:17.274920 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1914/3882] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:17 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:17.276843 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f6eaa9b0-4479-4732-bb24-9ae7f681ac08 req-d9a1d602-e9c7-4e5e-8580-a9d8ad12173e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062710 Oct 17 13:32:17.277871 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1969/3883] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:17.605891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:17.606518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:17.623526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.625060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.627015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.627950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.639482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.639942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.680787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:17.682125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:17.692518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:17.699066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.699907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.700534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.702085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:17.705930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:17.706614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:17.966821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:17.983270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ec5efc4-eeb8-43b6-be13-cd4e0ad5a179 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1467 microversion: 2.1 time: 0.380712 Oct 17 13:32:17.991762 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1915/3884] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:17 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:18.012040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-96d97823-58b3-43af-b5a9-220cd766cd42 req-0b0e9e13-49e3-4ed3-8cd6-bbaf87b63a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7", "name": "network-vif-deleted", "tag": "65e5d91a-6d5a-43e2-ba0d-f0f29b71561e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:18.044940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-96d97823-58b3-43af-b5a9-220cd766cd42 req-0b0e9e13-49e3-4ed3-8cd6-bbaf87b63a19 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.045717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-96d97823-58b3-43af-b5a9-220cd766cd42 req-0b0e9e13-49e3-4ed3-8cd6-bbaf87b63a19 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.046284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-96d97823-58b3-43af-b5a9-220cd766cd42 req-0b0e9e13-49e3-4ed3-8cd6-bbaf87b63a19 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.075249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-96d97823-58b3-43af-b5a9-220cd766cd42 req-0b0e9e13-49e3-4ed3-8cd6-bbaf87b63a19 service nova] Creating event network-vif-deleted:65e5d91a-6d5a-43e2-ba0d-f0f29b71561e for instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 on n-h1-854121-14 Oct 17 13:32:18.087023 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-96d97823-58b3-43af-b5a9-220cd766cd42 req-0b0e9e13-49e3-4ed3-8cd6-bbaf87b63a19 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093689 Oct 17 13:32:18.087313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.090953 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1916/3885] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:18.106766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.109431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.110456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:18.110772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:18.110916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0531ed06-3d01-429b-9a04-731d6b12c4fa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.434530 Oct 17 13:32:18.121327 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1970/3886] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:17 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:18.127094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:18.127934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:18.137635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.144405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.145068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.145744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.149949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.150758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.150916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.151827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.152487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.152939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.153265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.153478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.462213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.476790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1316c401-0781-49ac-8c20-a4f379c87d54 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.353470 Oct 17 13:32:18.479908 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1971/3887] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:18 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:18.480106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.496040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:18.497071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:18.502528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-832b9556-4d6e-4e59-9b9d-1fa5928c8438 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.408346 Oct 17 13:32:18.503376 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1917/3888] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:18 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:18.504389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.505179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.505866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.506850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.507591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.508245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.508371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:18.508883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:18.522298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.522607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.523349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.524483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.525147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.525786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.567233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:18.568050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:18.569131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:18.569799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lazy-loading 'fault' on Instance uuid b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:18.686810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b044c4828b4d408a07accf03e43c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c49f4649ae554c4aab924b013a5a2396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.695345 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b57bfe5-8fae-429e-9238-a02270bf9cb5 tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 200 len: 1314 microversion: 2.1 time: 0.213817 Oct 17 13:32:18.695934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1972/3889] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:18 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:18.729745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.749599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.751080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:18.752272 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e69e0bc8-2cad-40d4-b037-9a12a8f8fff3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1319 microversion: 2.26 time: 0.247878 Oct 17 13:32:18.752840 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1918/3890] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:18 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:19.014939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:19.015815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:19.028687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.029922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.030247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.030967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.035907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.036372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.137555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:19.138196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:19.145254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.145793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.146248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.147677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.148333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.152672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.305204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:19.326730 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84fc96f1-0744-4cc0-9454-a5e7222982a3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1467 microversion: 2.1 time: 0.315391 Oct 17 13:32:19.327642 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1973/3891] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:19 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1467 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:19.338223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fc7463c9-68bb-4c2e-88e6-b67b096702d7 req-05474206-1908-45d9-90ba-ae9a8f01eb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c999d9-c3d1-435f-96f0-5505353369b8", "name": "network-vif-plugged", "status": "completed", "tag": "d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:19.355784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc7463c9-68bb-4c2e-88e6-b67b096702d7 req-05474206-1908-45d9-90ba-ae9a8f01eb45 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.358142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc7463c9-68bb-4c2e-88e6-b67b096702d7 req-05474206-1908-45d9-90ba-ae9a8f01eb45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.358965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc7463c9-68bb-4c2e-88e6-b67b096702d7 req-05474206-1908-45d9-90ba-ae9a8f01eb45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.370302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:19.394187 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fc7463c9-68bb-4c2e-88e6-b67b096702d7 req-05474206-1908-45d9-90ba-ae9a8f01eb45 service nova] Creating event network-vif-plugged:d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7 for instance 54c999d9-c3d1-435f-96f0-5505353369b8 on n-h2-854121-14 Oct 17 13:32:19.407442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fc7463c9-68bb-4c2e-88e6-b67b096702d7 req-05474206-1908-45d9-90ba-ae9a8f01eb45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075750 Oct 17 13:32:19.408338 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1974/3892] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:19.427812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:19.445945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:19.449779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:19.454802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a898f40a-9872-4b9a-9a96-62652847c6d2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1807 microversion: 2.20 time: 0.321367 Oct 17 13:32:19.458744 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1919/3893] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:19 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:32:19.504807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:19.505561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:19.512476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.512988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.514002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.514742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.515209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.515643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.527921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:19.528603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:19.542709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.543218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.543669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:19.551341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:19.552796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:19.552796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.011965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.024240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5766dc4f-897c-46cd-8adf-f769311f2b78 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.500124 Oct 17 13:32:20.029902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.045395 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1920/3894] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:19 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:20.045395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:20.045395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] [instance: b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:20.059599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.060129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.061442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.062415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.062893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.063422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.064086 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ff3ec3a-7d79-4a53-b82a-a2971cb3373b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.563413 Oct 17 13:32:20.064949 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1975/3895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:19 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:20.081459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:20.082599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:20.083917 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] HTTP exception thrown: Instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 could not be found. Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Request method failure captured: Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 HTTP/1.1 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVk87QdAtkNdGMdvCMD3yTe_GGI3hBxz148rhz0nj_Oz4TzXKsqpP81RYF7iNDb7T4zSwsejds6OQbgLbMVe6fAZ-8p-9aJUL9z6NPLWfSyxei1wgqfnQxRh5pUKOhF5vaav7zoJbbV3DBbo094Uo5QHSQKm3KeXcJysUrKpiTDp4-s Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c49f4649ae554c4aab924b013a5a2396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c49f4649ae554c4aab924b013a5a2396 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-778992651 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f6b044c4828b4d408a07accf03e43c09 Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-778992651-project Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 could not be found. Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7'} Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 could not be found. Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 could not be found. Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:20.087327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 could not be found. Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] Returning 404 to user: Instance b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a599df2e-d8ec-49ab-956f-7cbbe7ecfcef tempest-ServerMetadataNegativeTestJSON-778992651 tempest-ServerMetadataNegativeTestJSON-778992651-project] 10.222.0.65 "GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7" status: 404 len: 111 microversion: 2.1 time: 0.057722 Oct 17 13:32:20.092040 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1921/3896] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:20 2022] GET /compute/v2.1/servers/b07d0f6e-1c3e-4e4e-bc0b-c5c7da668df7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:20.096796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.097360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.097910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.098731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.099301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.099836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.214765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.223535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.225397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.226852 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b79ed24-64db-445d-85b4-183d9d912748 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1319 microversion: 2.26 time: 0.160694 Oct 17 13:32:20.228151 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1976/3897] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:20 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:20.355508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:20.356777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:20.366189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.367592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.368443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.371055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.371731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.372487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.470498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.488698 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-605403fd-43f9-4768-afcc-19a80465eb4f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 200 len: 1425 microversion: 2.1 time: 0.138525 Oct 17 13:32:20.491224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:20.492176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:20.503290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.505568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.508458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1922/3898] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:20 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 1425 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:20.509489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.510561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.511270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.511998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.666872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b947caf6-7eb5-479f-b743-218540ae6a89 req-ab3e3cf1-c0fa-4951-a697-97beeed5477f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49427967-1ba2-4e58-b832-1a9fb815cccb", "name": "network-vif-deleted", "tag": "d05181d2-02ff-4944-9a1a-8c80f8896e94"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:20.707559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b947caf6-7eb5-479f-b743-218540ae6a89 req-ab3e3cf1-c0fa-4951-a697-97beeed5477f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:20.711479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b947caf6-7eb5-479f-b743-218540ae6a89 req-ab3e3cf1-c0fa-4951-a697-97beeed5477f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:20.711989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b947caf6-7eb5-479f-b743-218540ae6a89 req-ab3e3cf1-c0fa-4951-a697-97beeed5477f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:20.754821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b947caf6-7eb5-479f-b743-218540ae6a89 req-ab3e3cf1-c0fa-4951-a697-97beeed5477f service nova] Creating event network-vif-deleted:d05181d2-02ff-4944-9a1a-8c80f8896e94 for instance 49427967-1ba2-4e58-b832-1a9fb815cccb on n-h1-854121-14 Oct 17 13:32:20.769834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b947caf6-7eb5-479f-b743-218540ae6a89 req-ab3e3cf1-c0fa-4951-a697-97beeed5477f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111060 Oct 17 13:32:20.771196 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1923/3899] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:20.865611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.894827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.903485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:20.907504 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3bd1b403-f03f-4e68-a72d-3224b7a9678c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1794 microversion: 2.20 time: 0.420313 Oct 17 13:32:20.915152 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1977/3900] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:20 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1794 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:32:21.059126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:21.063348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:21.088247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:21.089643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:21.103225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.103745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.103963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.104205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.104947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.105444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.105879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.106974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.108311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.109802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.115537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.117898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.586238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:21.602474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:21.607781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4242372b-b3cb-4c2a-a920-024c97261b8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1316 microversion: 2.1 time: 0.523603 Oct 17 13:32:21.622061 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-584fe34f-0a75-4783-bae4-05c2ce24bd4f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.560731 Oct 17 13:32:21.625771 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1924/3901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:21 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:21.632743 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1978/3902] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:21 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:21.638235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:21.644141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:21.651687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:21.652776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 49427967-1ba2-4e58-b832-1a9fb815cccb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:21.659405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:21.662648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.662797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.663763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.664288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.664709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.665176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.665723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.667863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.668257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.672468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.673720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.673982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:21.677451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.697926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] HTTP exception thrown: Instance 49427967-1ba2-4e58-b832-1a9fb815cccb could not be found. Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Request method failure captured: Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb HTTP/1.1 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfc8x7MSPirURZsoYThRcWLpVtDE_-EUfN4KvpKmc6zcBhVtfcaxZgYlFNPHKL-jFptDulR07KoD0aZym9E40VptiQqN-lP0L7uf-DAdNE37tV0QL8dErxTzJrod_-QnMWlJ_lXE0Sn2l0ibfa4IUyS_MOij-Csa-wgIvCiicWjAjQ Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72898d2193744efcb00118587dcf3bea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72898d2193744efcb00118587dcf3bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fec0e15aae5c4bf996ee4b8a98a496e2 Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 49427967-1ba2-4e58-b832-1a9fb815cccb could not be found. Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '49427967-1ba2-4e58-b832-1a9fb815cccb'} Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49427967-1ba2-4e58-b832-1a9fb815cccb could not be found. Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49427967-1ba2-4e58-b832-1a9fb815cccb could not be found. Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:21.699750 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49427967-1ba2-4e58-b832-1a9fb815cccb could not be found. Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Returning 404 to user: Instance 49427967-1ba2-4e58-b832-1a9fb815cccb could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:21.706454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c94dabe8-028c-4317-9908-c5d6a1308418 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb" status: 404 len: 111 microversion: 2.1 time: 0.074063 Oct 17 13:32:21.708665 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1979/3903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:21 2022] GET /compute/v2.1/servers/49427967-1ba2-4e58-b832-1a9fb815cccb => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:21.720851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:21.721976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:21.740142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.740780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.741390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.742287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:21.742968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:21.743865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:21.814382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:21.968843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:21.978744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ee3ce59-6e08-440b-a63e-037d8a9c5cbb tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 204 len: 0 microversion: 2.1 time: 0.266726 Oct 17 13:32:21.979437 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1980/3904] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:21 2022] DELETE /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:21.986054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5683d2fd-3430-43b1-9f76-9f203ebf89f3 req-78864fec-131c-43b0-93d6-18757ebe305a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a489911d-3fd0-4184-8d2a-c8ceae209621", "name": "network-vif-plugged", "status": "completed", "tag": "64463c2d-7932-429c-831b-3c574b79973e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:22.013328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5683d2fd-3430-43b1-9f76-9f203ebf89f3 req-78864fec-131c-43b0-93d6-18757ebe305a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.014367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5683d2fd-3430-43b1-9f76-9f203ebf89f3 req-78864fec-131c-43b0-93d6-18757ebe305a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.014998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5683d2fd-3430-43b1-9f76-9f203ebf89f3 req-78864fec-131c-43b0-93d6-18757ebe305a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.035544 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5683d2fd-3430-43b1-9f76-9f203ebf89f3 req-78864fec-131c-43b0-93d6-18757ebe305a service nova] Creating event network-vif-plugged:64463c2d-7932-429c-831b-3c574b79973e for instance a489911d-3fd0-4184-8d2a-c8ceae209621 on n-h2-854121-14 Oct 17 13:32:22.042013 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5683d2fd-3430-43b1-9f76-9f203ebf89f3 req-78864fec-131c-43b0-93d6-18757ebe305a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060991 Oct 17 13:32:22.042958 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1981/3905] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:22.050314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:22.051251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:22.058643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:22.059632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.060845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.062730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.063084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.063564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.064002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.068728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:22.074787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:22.076715 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-416a22f3-f0c2-44b9-9af3-6a1551d6303c tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.448908 Oct 17 13:32:22.079707 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1925/3906] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:21 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:22.514431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:22.528065 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14f7712f-4cbd-4846-a4ff-ee0efd2c6513 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1534 microversion: 2.1 time: 0.482644 Oct 17 13:32:22.532268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1982/3907] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:22 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1534 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:22.637073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:22.642217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:22.642839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:22.645076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:22.668945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.676008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.676427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.678224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.679482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.680157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.680658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.683889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.684380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.685134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:22.685936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:22.686562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:22.745806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:23.211052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:23.226807 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cfd0ceb5-0663-445e-b3eb-1aa75cfa276a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.587794 Oct 17 13:32:23.227881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1983/3908] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:22 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:23.243744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:23.244806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:23.254680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:23.255178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:23.255624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:23.256340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:23.256816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:23.257248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:23.463639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:23.473963 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67f2e282-4b77-434c-a186-5d53466961ba tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.842371 Oct 17 13:32:23.478151 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1926/3909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:23.562501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:23.564389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:23.570993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:23.571783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:23.572487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:23.573464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:23.574138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:23.574778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:23.657202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:23.668677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:23.670433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:23.671868 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4dfea3d1-6f71-45e9-96a4-7c7e0b3d3dbe tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.442718 Oct 17 13:32:23.672639 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1984/3910] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:23 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:23.680926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-997823259", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:23.758159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] validate_networks() for [('01e22cfe-9ea1-4a12-896c-16adb1ecc196', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:32:24.447394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:24.460947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23096c8e-fe39-4eac-aac6-8d267a10893e tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 200 len: 1534 microversion: 2.1 time: 0.909502 Oct 17 13:32:24.469702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1927/3911] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:23 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 1534 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:24.491328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:24.493742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:24.510557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:24.514591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:24.515231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:24.516093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:24.519198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:24.519762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:25.273440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:25.282739 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1c23b7e-1ff2-4e48-aeb2-2544339ce518 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1313 microversion: 2.1 time: 0.808512 Oct 17 13:32:25.294005 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1928/3912] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:24 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1313 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:25.312684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:25.313394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:25.328862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:25.329855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:25.330374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:25.331724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:25.337931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:25.339074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:25.744383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:32:25.745130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:32:25.745590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:32:25.746017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:32:25.746618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:32:25.762811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:25.764283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:25.765104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:25.766101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:25.766724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:25.767346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:25.816703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Getting quotas for project 0b4b7fe8f2da4c379be512ea0d916676. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:25.831641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Getting quotas for user 275516fa54254d86940a372e51ef39f4 and project 0b4b7fe8f2da4c379be512ea0d916676. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:25.862693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:32:25.869444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:32:25.959400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:25.976991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:25.978529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:25.982036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb8c5393-192e-41b6-83c8-f6a8fe3f52c3 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.685067 Oct 17 13:32:25.990187 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1929/3913] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:25 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:25.998266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a9ba7eb0-92e7-4d24-8bfd-f665dd1b8011 req-1914c852-91dd-4c0b-804a-88e0b09b499b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2edf43-7210-4cac-b3ba-54a58f9675f0", "name": "network-vif-deleted", "tag": "44228f23-e124-4c5c-9e1a-922b57474642"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:26.014073 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eca591c6-30d5-4eb7-980c-27d33e91828d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.339131 Oct 17 13:32:26.014863 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1985/3914] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:32:26.032997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:26.035512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: 5b2edf43-7210-4cac-b3ba-54a58f9675f0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:26.038355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a9ba7eb0-92e7-4d24-8bfd-f665dd1b8011 req-1914c852-91dd-4c0b-804a-88e0b09b499b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:26.039485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a9ba7eb0-92e7-4d24-8bfd-f665dd1b8011 req-1914c852-91dd-4c0b-804a-88e0b09b499b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:26.040187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a9ba7eb0-92e7-4d24-8bfd-f665dd1b8011 req-1914c852-91dd-4c0b-804a-88e0b09b499b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:26.056698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:26.058978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:26.059441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:26.060463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:26.061705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:26.063279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:26.104477 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] HTTP exception thrown: Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 could not be found. Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Request method failure captured: Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 HTTP/1.1 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfc8x7MSPirURZsoYThRcWLpVtDE_-EUfN4KvpKmc6zcBhVtfcaxZgYlFNPHKL-jFptDulR07KoD0aZym9E40VptiQqN-lP0L7uf-DAdNE37tV0QL8dErxTzJrod_-QnMWlJ_lXE0Sn2l0ibfa4IUyS_MOij-Csa-wgIvCiicWjAjQ Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72898d2193744efcb00118587dcf3bea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72898d2193744efcb00118587dcf3bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fec0e15aae5c4bf996ee4b8a98a496e2 Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 could not be found. Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5b2edf43-7210-4cac-b3ba-54a58f9675f0'} Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 could not be found. Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 could not be found. Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:26.109455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 could not be found. Oct 17 13:32:26.116446 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:26.120129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Returning 404 to user: Instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:26.120346 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a9ba7eb0-92e7-4d24-8bfd-f665dd1b8011 req-1914c852-91dd-4c0b-804a-88e0b09b499b service nova] Creating event network-vif-deleted:44228f23-e124-4c5c-9e1a-922b57474642 for instance 5b2edf43-7210-4cac-b3ba-54a58f9675f0 on n-h1-854121-14 Oct 17 13:32:26.123650 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-248aeb55-542e-403f-ac61-cdc51c417bd2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0" status: 404 len: 111 microversion: 2.1 time: 0.104062 Oct 17 13:32:26.126085 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1986/3915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:26 2022] GET /compute/v2.1/servers/5b2edf43-7210-4cac-b3ba-54a58f9675f0 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:26.133642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a9ba7eb0-92e7-4d24-8bfd-f665dd1b8011 req-1914c852-91dd-4c0b-804a-88e0b09b499b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140229 Oct 17 13:32:26.140022 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1930/3916] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:26.140802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fb1c2f6-54a4-4c9e-8ac6-c858fbb7919d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:26.144934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2fb1c2f6-54a4-4c9e-8ac6-c858fbb7919d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:26.155181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0a457d8-b2a5-4100-8a35-514c12781f6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '.version_select at 0x7f419ce021f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:26.186896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e0a457d8-b2a5-4100-8a35-514c12781f6b tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166434864" status: 202 len: 0 microversion: 2.1 time: 0.045069 Oct 17 13:32:26.188377 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1931/3917] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166434864 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:32:26.292990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2fb1c2f6-54a4-4c9e-8ac6-c858fbb7919d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:26.300473 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fb1c2f6-54a4-4c9e-8ac6-c858fbb7919d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1216 microversion: 2.1 time: 0.169511 Oct 17 13:32:26.301065 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1987/3918] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:26 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1216 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:26.320566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:26.321849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:26.347729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:26.348459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:26.349027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:26.363139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:26.364256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:26.364829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.020960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:27.021684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:27.036008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.038361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.038901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.040432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.041082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.041925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.065270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:27.085374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b2f87c1-197c-4601-b5b1-8cc9df2fad40 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1499 microversion: 2.1 time: 0.767080 Oct 17 13:32:27.085990 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1932/3919] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:26 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1499 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:27.110170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:27.122543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:27.136131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.136634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.137080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.137825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.138285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.139259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.205289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lazy-loading 'flavor' on Instance uuid a489911d-3fd0-4184-8d2a-c8ceae209621 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:27.331628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-941cb341-ab8c-42d3-a7e2-6131cfd97e0c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "POST /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621/action" status: 200 len: 32 microversion: 2.1 time: 0.226267 Oct 17 13:32:27.332906 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1933/3920] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:32:27 2022] POST /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:32:27.343373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:27.344339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:27.359610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.359610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.359610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.360351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.361999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.363552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.844545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:27.860889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f375eacd-807e-4220-a827-893b38c3d49b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1268 microversion: 2.1 time: 0.520481 Oct 17 13:32:27.877723 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1934/3921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:27 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1268 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:27.884357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:27.887151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:27.895044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.895923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.896591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.897618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:27.898403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:27.899072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:27.900059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:27.914494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:27.916048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:27.917120 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-780b7349-de0b-4176-8d9a-5e01045d1bec tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.907543 Oct 17 13:32:27.926718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1988/3922] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:27 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:32:28.204141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f76aa597-96e9-49dd-b788-9bdaa92e7482 req-ba632f43-941d-4a36-9a2d-8ad517341675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c419683-7478-4bc8-90c2-c4513e975cfb", "tag": "95d14041-66ec-402b-bbf4-37a30aa3fdab"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:28.218981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f76aa597-96e9-49dd-b788-9bdaa92e7482 req-ba632f43-941d-4a36-9a2d-8ad517341675 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.219579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f76aa597-96e9-49dd-b788-9bdaa92e7482 req-ba632f43-941d-4a36-9a2d-8ad517341675 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.219942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f76aa597-96e9-49dd-b788-9bdaa92e7482 req-ba632f43-941d-4a36-9a2d-8ad517341675 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.275319 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f76aa597-96e9-49dd-b788-9bdaa92e7482 req-ba632f43-941d-4a36-9a2d-8ad517341675 service nova] Creating event network-changed:95d14041-66ec-402b-bbf4-37a30aa3fdab for instance 3c419683-7478-4bc8-90c2-c4513e975cfb on n-h1-854121-14 Oct 17 13:32:28.290049 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f76aa597-96e9-49dd-b788-9bdaa92e7482 req-ba632f43-941d-4a36-9a2d-8ad517341675 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088986 Oct 17 13:32:28.293747 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1989/3923] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:32:28.562372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:28.574452 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-24197922-ccdf-42dd-9683-cc90e22855bc tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.694055 Oct 17 13:32:28.586507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1935/3924] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:27 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:28.894339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:28.895825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:28.914402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.915354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.915685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.917277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.918268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.918900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.950565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:28.951250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:28.963329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.968589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.969587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:28.970648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:28.972581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:28.974874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.043294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.057390 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce141288-5b69-4df9-a6aa-d98376a06f4c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1274 microversion: 2.1 time: 0.172698 Oct 17 13:32:29.059150 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1990/3925] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:28 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:29.081140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:29.082287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:29.090949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.092052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.092634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.093762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.094415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.095211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.164586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:29.312540 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1a39545-08ff-433f-9a7b-f430dac828db tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 204 len: 0 microversion: 2.1 time: 0.250920 Oct 17 13:32:29.313290 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1991/3926] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:29 2022] DELETE /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:29.324503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:29.324693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.326767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:29.343070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.343729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.344149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.344628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.345216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.345910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.346391 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a77357f3-af73-422d-8e97-423d817ec6cd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.401483 Oct 17 13:32:29.347477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.348797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.365406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1936/3927] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:28 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:29.388799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:29.604936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:29.605609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:29.612745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.613933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.614553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.615471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:29.616099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:29.616988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:29.789742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.798888 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f9d42d6-4ff3-4f01-a2e4-e9482dc617c3 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1468 microversion: 2.1 time: 0.481149 Oct 17 13:32:29.810014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1992/3928] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:29 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1468 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:29.971442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:29.989384 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb0c1884-a638-4369-a1e8-d9c6b7f5fd7a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.385298 Oct 17 13:32:29.991017 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1937/3929] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:29 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:30.089760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:30.089760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:30.103834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.104801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.105278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:30.106017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.106485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.106918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:30.241220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:30.251225 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1dd11985-3a89-4153-b16e-d8ee836c5c77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1274 microversion: 2.1 time: 0.171969 Oct 17 13:32:30.252239 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1993/3930] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:30 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:30.391198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:30.392605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:30.399814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.400346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.401053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:30.402413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.403326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.404702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:30.836969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:30.837623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:30.849656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.858791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.860983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:30.863696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:30.866087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:30.866941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.084113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.097191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.101020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.102587 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cddb1bd0-8900-4a44-bacf-68e0728d0956 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.731002 Oct 17 13:32:31.103637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1938/3931] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:30 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:31.110269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:31.111253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:31.126710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.127242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.127737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.128720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.129197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.129948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.379809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.388381 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6e14e34-68fe-4c32-83c5-507dd06eaf6f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1468 microversion: 2.1 time: 0.555534 Oct 17 13:32:31.389635 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1994/3932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:30 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1468 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:31.394330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:31.395299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:31.403041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.404385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.405272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.406962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:31.408268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:31.408901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:31.526906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.537876 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa88faa3-2452-4a04-a521-5e7ba7d8a608 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.432165 Oct 17 13:32:31.551663 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1939/3933] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:31 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:31.744262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:31.758516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9542c01-adb6-44f5-aa96-6ec715713f2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 0.367712 Oct 17 13:32:31.759352 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1995/3934] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:31 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:32.133377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:32.134141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:32.150437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.153039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.155290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.158091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.158836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.159547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.415158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:32.415887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:32.431629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.432865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.434177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.438544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.441322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.443066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.586598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:32.603640 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c4c2963-ac80-46be-8028-56e3b3326d72 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 200 len: 1426 microversion: 2.1 time: 0.193302 Oct 17 13:32:32.604930 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1996/3935] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:32 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 1426 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:32.612299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fcac81bf-d4a1-4262-aaf6-33589c94b01b req-85f11f1d-0f42-4c4f-8594-ac52760f1985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29ceb46-cca5-44b5-9989-31ba3ab4e498", "name": "network-vif-deleted", "tag": "22ccbdc7-99a9-4a51-9b3f-008b303eded7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:32.626633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fcac81bf-d4a1-4262-aaf6-33589c94b01b req-85f11f1d-0f42-4c4f-8594-ac52760f1985 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.627415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fcac81bf-d4a1-4262-aaf6-33589c94b01b req-85f11f1d-0f42-4c4f-8594-ac52760f1985 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.628419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fcac81bf-d4a1-4262-aaf6-33589c94b01b req-85f11f1d-0f42-4c4f-8594-ac52760f1985 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.660188 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fcac81bf-d4a1-4262-aaf6-33589c94b01b req-85f11f1d-0f42-4c4f-8594-ac52760f1985 service nova] Creating event network-vif-deleted:22ccbdc7-99a9-4a51-9b3f-008b303eded7 for instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 on n-h2-854121-14 Oct 17 13:32:32.676921 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fcac81bf-d4a1-4262-aaf6-33589c94b01b req-85f11f1d-0f42-4c4f-8594-ac52760f1985 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070315 Oct 17 13:32:32.678020 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1997/3936] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:32.701354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:32.702076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:32.723748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.725576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.726374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:32.728175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:32.730021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:32.730697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.023489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:33.033864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:33.044891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:33.046995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52c432f5-2727-42b4-b167-8234dcee22dd tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.917877 Oct 17 13:32:33.051612 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1940/3937] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:32 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:33.076762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:33.081285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:33.094792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.096805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.098784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.100401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.104437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.108504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.231079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:33.244899 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0e703d6-7926-41b4-91ed-c793e25f01d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.565282 Oct 17 13:32:33.251370 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1998/3938] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:32 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:33.534912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:33.548758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9c2c4f5-86eb-4cd4-bcfd-6e31eb775de1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 0.494070 Oct 17 13:32:33.551764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1941/3939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:33 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:33.632795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:33.633488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: d29ceb46-cca5-44b5-9989-31ba3ab4e498] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:33.647620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.649780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.653220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.655123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.655981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.656814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.678910 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] HTTP exception thrown: Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 could not be found. Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Request method failure captured: Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 HTTP/1.1 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVfc8x7MSPirURZsoYThRcWLpVtDE_-EUfN4KvpKmc6zcBhVtfcaxZgYlFNPHKL-jFptDulR07KoD0aZym9E40VptiQqN-lP0L7uf-DAdNE37tV0QL8dErxTzJrod_-QnMWlJ_lXE0Sn2l0ibfa4IUyS_MOij-Csa-wgIvCiicWjAjQ Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72898d2193744efcb00118587dcf3bea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72898d2193744efcb00118587dcf3bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fec0e15aae5c4bf996ee4b8a98a496e2 Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 could not be found. Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'd29ceb46-cca5-44b5-9989-31ba3ab4e498'} Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 could not be found. Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 could not be found. Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:33.681863 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 could not be found. Oct 17 13:32:33.688562 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:32:33.690322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Returning 404 to user: Instance d29ceb46-cca5-44b5-9989-31ba3ab4e498 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:33.691511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5c5c9c4-7afe-435e-94bd-c85c06423ff2 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498" status: 404 len: 111 microversion: 2.1 time: 0.063202 Oct 17 13:32:33.695604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1999/3940] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:33 2022] GET /compute/v2.1/servers/d29ceb46-cca5-44b5-9989-31ba3ab4e498 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:33.705442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:33.705778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:33.716084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.717147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.719392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.720949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.721736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.723022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.774705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:33.783736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:33.914576 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7719ae47-bfbb-4c86-be8e-ba2235eedd63 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 204 len: 0 microversion: 2.1 time: 0.216690 Oct 17 13:32:33.915326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1942/3941] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:33 2022] DELETE /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:33.925613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:33.926237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:33.938123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.938630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.939518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:33.944432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:33.944930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:33.945405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:34.072929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a0e6de4f-8526-43e0-8533-f59fb7bed8ea req-0775fb9b-2027-4571-b097-a440f3292372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c419683-7478-4bc8-90c2-c4513e975cfb", "name": "network-vif-plugged", "status": "completed", "tag": "95d14041-66ec-402b-bbf4-37a30aa3fdab"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:34.106983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0e6de4f-8526-43e0-8533-f59fb7bed8ea req-0775fb9b-2027-4571-b097-a440f3292372 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:34.108515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0e6de4f-8526-43e0-8533-f59fb7bed8ea req-0775fb9b-2027-4571-b097-a440f3292372 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:34.109285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0e6de4f-8526-43e0-8533-f59fb7bed8ea req-0775fb9b-2027-4571-b097-a440f3292372 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:34.155585 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a0e6de4f-8526-43e0-8533-f59fb7bed8ea req-0775fb9b-2027-4571-b097-a440f3292372 service nova] Creating event network-vif-plugged:95d14041-66ec-402b-bbf4-37a30aa3fdab for instance 3c419683-7478-4bc8-90c2-c4513e975cfb on n-h1-854121-14 Oct 17 13:32:34.164236 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a0e6de4f-8526-43e0-8533-f59fb7bed8ea req-0775fb9b-2027-4571-b097-a440f3292372 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103617 Oct 17 13:32:34.165605 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1943/3942] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:34.174342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:34.175442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:34.182944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:34.184443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:34.185273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:34.186241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:34.203003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:34.203478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:34.491485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:34.506312 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af74af6c-47c7-44e2-8a17-341e6eb6fda7 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1469 microversion: 2.1 time: 0.586609 Oct 17 13:32:34.507019 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2000/3943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:33 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1469 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:34.518066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:34.518789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:34.525397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:34.526364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:34.527353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:34.528268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:34.529582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:34.530243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.161434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.174419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.175097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.177259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f39931dd-6b0d-4ae1-8e12-d4c2d04858e0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 1.008986 Oct 17 13:32:35.178562 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1944/3944] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:34 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:35.183918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:35.184782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:35.191395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.191883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.192322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.193105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.193489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.193915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.322910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.332504 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9e1cefb-fb1c-40ad-8ec6-3ff30b5748fa tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.823983 Oct 17 13:32:35.333286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2001/3945] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:34 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:35.338146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ac90a836-15a1-4464-a42a-0b4694a92aa5 req-2b42028f-0811-4bd4-8a69-4265e272e033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac32659d-2fef-4b01-a1f2-62a4478f719e", "tag": "edd15adf-dc7e-4d5a-b27d-b32cec4b8174"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:35.357131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ac90a836-15a1-4464-a42a-0b4694a92aa5 req-2b42028f-0811-4bd4-8a69-4265e272e033 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.357824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ac90a836-15a1-4464-a42a-0b4694a92aa5 req-2b42028f-0811-4bd4-8a69-4265e272e033 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.358265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ac90a836-15a1-4464-a42a-0b4694a92aa5 req-2b42028f-0811-4bd4-8a69-4265e272e033 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.377350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ac90a836-15a1-4464-a42a-0b4694a92aa5 req-2b42028f-0811-4bd4-8a69-4265e272e033 service nova] Creating event network-changed:edd15adf-dc7e-4d5a-b27d-b32cec4b8174 for instance ac32659d-2fef-4b01-a1f2-62a4478f719e on n-h1-854121-14 Oct 17 13:32:35.391008 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ac90a836-15a1-4464-a42a-0b4694a92aa5 req-2b42028f-0811-4bd4-8a69-4265e272e033 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054098 Oct 17 13:32:35.391697 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2002/3946] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:35.533645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:35.534383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:35.549755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.550280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.550726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.551618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:35.552202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:35.552718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:35.719537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.733983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c2d9f8d-3f42-4d18-9838-84bd897cb2ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 0.553807 Oct 17 13:32:35.735235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1945/3947] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:35 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:35.787977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:35.946793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:35.963897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0dca0eb4-45e4-466b-9a4b-df59e4070ba1 tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1469 microversion: 2.1 time: 0.435578 Oct 17 13:32:35.964583 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2003/3948] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:35 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1469 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:36.208209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:36.209282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:36.219598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.220715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.221417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.222529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.223224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.223996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.355939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:36.356619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:36.359119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:36.371383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.371718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.374742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.378433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.378940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.379431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.543304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:36.558340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:36.563400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:36.566069 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbd35f33-f0b5-40f1-9029-c8eaad458518 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1361 microversion: 2.26 time: 0.361537 Oct 17 13:32:36.567227 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1946/3949] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:36 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:36.764215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:36.765220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:36.780408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.781570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.784021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.787735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:36.788918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:36.789607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:36.811857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:36.826124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7cd8b9e-2d2b-4255-b859-52777098b405 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.473996 Oct 17 13:32:36.827057 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2004/3950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:36 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:36.994529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:36.995408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:37.008116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:37.009657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.010157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.015953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.016774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.018020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.018514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.153075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fec0e15aae5c4bf996ee4b8a98a496e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72898d2193744efcb00118587dcf3bea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:37.168453 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad4b1b9a-0597-49ac-a2bb-fa78a2118c9d tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 200 len: 1427 microversion: 2.1 time: 0.178124 Oct 17 13:32:37.174855 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2005/3951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:36 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 1427 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:37.185518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:37.194083 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c32bf507-c9f7-41ec-a504-68d016142d9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 0.436505 Oct 17 13:32:37.197533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1947/3952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:36 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:37.452435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-708f26ab-d8c3-4c4a-ac1b-8ab8eeb876a4 req-780ca2ea-eb0c-409e-b2e4-2389a5eeefc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc", "name": "network-vif-deleted", "tag": "c55759fd-0f88-4381-af27-9df75fc55a23"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:37.483057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-708f26ab-d8c3-4c4a-ac1b-8ab8eeb876a4 req-780ca2ea-eb0c-409e-b2e4-2389a5eeefc2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.486520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-708f26ab-d8c3-4c4a-ac1b-8ab8eeb876a4 req-780ca2ea-eb0c-409e-b2e4-2389a5eeefc2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.487496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-708f26ab-d8c3-4c4a-ac1b-8ab8eeb876a4 req-780ca2ea-eb0c-409e-b2e4-2389a5eeefc2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.526641 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-708f26ab-d8c3-4c4a-ac1b-8ab8eeb876a4 req-780ca2ea-eb0c-409e-b2e4-2389a5eeefc2 service nova] Creating event network-vif-deleted:c55759fd-0f88-4381-af27-9df75fc55a23 for instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc on n-h1-854121-14 Oct 17 13:32:37.566911 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-708f26ab-d8c3-4c4a-ac1b-8ab8eeb876a4 req-780ca2ea-eb0c-409e-b2e4-2389a5eeefc2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109349 Oct 17 13:32:37.569300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2006/3953] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:37.592290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:37.592877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:37.600274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.600695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.601139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.601901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.602359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.602781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.854129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:37.854842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:37.876279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.876780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.877255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:37.877974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:37.878427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:37.878849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:38.312415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:38.320901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:38.327030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:38.328372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a75b2a64-6b7a-43ca-ba50-b044b9b56724 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1544 microversion: 2.26 time: 0.740357 Oct 17 13:32:38.330542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1948/3954] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:37 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1544 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:38.346469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:38.347078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] [instance: dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:38.371276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:38.371781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:38.372227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:38.373516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:38.373977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:38.374409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:38.409829 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] HTTP exception thrown: Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc could not be found. Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Request method failure captured: Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc HTTP/1.1 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVfc8x7MSPirURZsoYThRcWLpVtDE_-EUfN4KvpKmc6zcBhVtfcaxZgYlFNPHKL-jFptDulR07KoD0aZym9E40VptiQqN-lP0L7uf-DAdNE37tV0QL8dErxTzJrod_-QnMWlJ_lXE0Sn2l0ibfa4IUyS_MOij-Csa-wgIvCiicWjAjQ Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/72898d2193744efcb00118587dcf3bea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/72898d2193744efcb00118587dcf3bea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_72898d2193744efcb00118587dcf3bea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 72898d2193744efcb00118587dcf3bea Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-MigrationsAdminTest-1744980249 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fec0e15aae5c4bf996ee4b8a98a496e2 Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-MigrationsAdminTest-1744980249-project Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc could not be found. Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc'} Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc could not be found. Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc could not be found. Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:38.411536 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc could not be found. Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] Returning 404 to user: Instance dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:38.418636 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-14ae4b36-e22f-4f22-a6af-5756e4e5946f tempest-MigrationsAdminTest-1744980249 tempest-MigrationsAdminTest-1744980249-project] 10.222.0.65 "GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc" status: 404 len: 111 microversion: 2.1 time: 0.081256 Oct 17 13:32:38.426194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1949/3955] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:38 2022] GET /compute/v2.1/servers/dc40eba3-aa99-4dc6-aa88-8e9a50e5cffc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:38.431190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:38.431816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:38.462186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:38.462684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:38.463181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:38.463827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:38.464603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:38.464770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.221319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:39.236627 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39cf1db0-b08f-408d-b765-95205d48c89c tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 1.387601 Oct 17 13:32:39.237437 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2007/3956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:37 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:39.263855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a1fed040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:39.313015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.313501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.313963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.314469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:39.335067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.335569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.336013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.336734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.344523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.345421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.412007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.417820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.418368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.464844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.466584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.467362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.507388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:39.518731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:39.536300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b200ce7-2ca2-49a8-a4da-e9caff373e78 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 1.107422 Oct 17 13:32:39.539056 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1950/3957] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:38 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:39.548417 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5c9e7b5-6ee3-443a-94da-e0e532768f71 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1178700933" status: 201 len: 0 microversion: 2.26 time: 0.302805 Oct 17 13:32:39.556940 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2008/3958] 10.222.0.65 () {62 vars in 1380 bytes} [Mon Oct 17 13:32:39 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1178700933 => generated 0 bytes in 319 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:32:39.570637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d2833db-1ae1-4626-8b5b-6c2ed6caf836 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419cdda940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:39.580471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d2833db-1ae1-4626-8b5b-6c2ed6caf836 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.581521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d2833db-1ae1-4626-8b5b-6c2ed6caf836 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.582474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d2833db-1ae1-4626-8b5b-6c2ed6caf836 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.616615 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d2833db-1ae1-4626-8b5b-6c2ed6caf836 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1178700933" status: 204 len: 0 microversion: 2.26 time: 0.053655 Oct 17 13:32:39.617318 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1951/3959] 10.222.0.65 () {60 vars in 1361 bytes} [Mon Oct 17 13:32:39 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1178700933 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:39.629674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a1fed550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:39.663018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.664247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.664876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.670161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:39.688082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.688840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.691016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.691801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.692292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.692759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.728607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.729106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.729611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.740356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:39.751261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:39.800722 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2eb1d608-1fd8-475a-a17b-ac23f7aeebf0 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.178344 Oct 17 13:32:39.807827 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2009/3960] 10.222.0.65 () {60 vars in 1295 bytes} [Mon Oct 17 13:32:39 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:39.814329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4f8b523-8190-4fa9-8c42-79e684bdfa20 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419dc0ac10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:39.846673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f8b523-8190-4fa9-8c42-79e684bdfa20 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.848047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f8b523-8190-4fa9-8c42-79e684bdfa20 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.849490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f8b523-8190-4fa9-8c42-79e684bdfa20 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.870870 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4f8b523-8190-4fa9-8c42-79e684bdfa20 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 200 len: 12 microversion: 2.26 time: 0.062009 Oct 17 13:32:39.877815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1952/3961] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:32:39 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 12 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:39.890297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a1ffcdc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:39.901505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.902439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.903102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.904410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:39.912826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.913719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.914507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:39.915780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:39.916506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:39.917128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.036569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.037758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.038981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.086987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.090869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.092774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.147700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:40.201010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b579d454-b383-4f63-b0b6-1def54256d9e tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-289425553" status: 201 len: 0 microversion: 2.26 time: 0.320509 Oct 17 13:32:40.205597 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2010/3962] 10.222.0.65 () {62 vars in 1377 bytes} [Mon Oct 17 13:32:39 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-289425553 => generated 0 bytes in 326 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 17 13:32:40.220356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1920b4-014d-4b5f-bce2-977761533a73 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419dafddc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:40.242756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1920b4-014d-4b5f-bce2-977761533a73 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.243668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1920b4-014d-4b5f-bce2-977761533a73 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.244293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1920b4-014d-4b5f-bce2-977761533a73 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.266445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:40.273258 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e1920b4-014d-4b5f-bce2-977761533a73 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 200 len: 35 microversion: 2.26 time: 0.062117 Oct 17 13:32:40.279490 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1953/3963] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:32:40 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 35 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:40.282719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:40.306000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419deff310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:40.308035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.310377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.315449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.318501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.319527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.320086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.325410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=97,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:40.336578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.337081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.345535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.346063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:40.362107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.362941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.364088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.370817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.371595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.373110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.423164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.427080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.428192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.492502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:40.519957 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c20fc9e3-c82f-4e49-8bcf-14a64e0517e5 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-289425553" status: 204 len: 0 microversion: 2.26 time: 0.233814 Oct 17 13:32:40.523829 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1954/3964] 10.222.0.65 () {60 vars in 1361 bytes} [Mon Oct 17 13:32:40 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-289425553 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:40.531595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-feb52ffc-bef9-4490-b779-5a5581e6e1ff tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419dafddc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:40.540114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb52ffc-bef9-4490-b779-5a5581e6e1ff tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.540616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb52ffc-bef9-4490-b779-5a5581e6e1ff tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.541060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-feb52ffc-bef9-4490-b779-5a5581e6e1ff tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.572521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-feb52ffc-bef9-4490-b779-5a5581e6e1ff tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 200 len: 12 microversion: 2.26 time: 0.044492 Oct 17 13:32:40.573258 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1955/3965] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:32:40 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 12 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:40.593742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:40.594418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:40.605502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.606315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.607563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.608559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:40.609222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:40.609844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:40.964906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:40.980744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53248279-75ea-4f1a-87f7-68e2e5f8e1e5 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.722617 Oct 17 13:32:40.983139 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2011/3966] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:40 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:40.999368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a20a5940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.019645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.020394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.022327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.023096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:41.043784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.048136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.048626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.049439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.049916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.050352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.111575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.112074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.112513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.137750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:41.180830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-928e2e2e-b38e-462b-b3f5-9fa1bfe0a597 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.195113 Oct 17 13:32:41.182120 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2012/3967] 10.222.0.65 () {60 vars in 1295 bytes} [Mon Oct 17 13:32:40 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:41.194152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a2083940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.212897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.219728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.222596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.228251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:41.250063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.250799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.251452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.252381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.253014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.253637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.315700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.324115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.324581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.345939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.350252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.350972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.406958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:41.439904 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3218812e-fdc6-48f4-b7f5-2c78ee2df795 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-144750612" status: 201 len: 0 microversion: 2.26 time: 0.250398 Oct 17 13:32:41.443868 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2013/3968] 10.222.0.65 () {62 vars in 1377 bytes} [Mon Oct 17 13:32:41 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-144750612 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 17 13:32:41.454439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a1f17a60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.479272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.482816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:41.483038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.483449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.483944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:41.494404 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-227bd7be-cd73-45f8-af6f-f82344802923 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 0.920058 Oct 17 13:32:41.510765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.513122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.514409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.515816 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1956/3969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:40 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:41.516492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.520454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.521112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.578216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.581067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.582744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.598218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.599080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.599698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.655966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:41.681339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07af4274-2856-45b5-95ac-748643a765e6 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1800049151" status: 201 len: 0 microversion: 2.26 time: 0.234165 Oct 17 13:32:41.694769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419deff0d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.700178 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2014/3970] 10.222.0.65 () {62 vars in 1380 bytes} [Mon Oct 17 13:32:41 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1800049151 => generated 0 bytes in 253 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:32:41.711558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.715783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.717126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.717671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:41.733324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.734172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.735602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.742138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.742961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.743634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.801013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.801540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.801980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.836721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:41.862683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27713fe2-8fdc-4a06-86fd-16d62dbbfbde tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.172709 Oct 17 13:32:41.863638 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1957/3971] 10.222.0.65 () {60 vars in 1295 bytes} [Mon Oct 17 13:32:41 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:41.874704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95010daf-d0c5-466e-ada9-683864f27ed4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a20a5310>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.896369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95010daf-d0c5-466e-ada9-683864f27ed4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.901152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95010daf-d0c5-466e-ada9-683864f27ed4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.902293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95010daf-d0c5-466e-ada9-683864f27ed4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.947443 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95010daf-d0c5-466e-ada9-683864f27ed4 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 200 len: 12 microversion: 2.26 time: 0.063290 Oct 17 13:32:41.960933 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2015/3972] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:32:41 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 12 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:41.965932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419d073550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:41.983364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:41.984217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:41.984853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:41.985556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:42.000213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.014029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.014590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:42.014974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.015355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:42.016111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.016865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.017509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.030305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.032578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.035210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.036061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.036545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.040322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.058101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.058599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.059041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.083635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:42.117715 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbe7901c-ce05-44fe-8d13-3892a5f19a15 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.156641 Oct 17 13:32:42.121890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1958/3973] 10.222.0.65 () {60 vars in 1295 bytes} [Mon Oct 17 13:32:41 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:42.135973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419ce16af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:42.147963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.148789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.149458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.150303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:42.161569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.162431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.163013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.164219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.165729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.166423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.207558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:42.217012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.218373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.219060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.231210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.232537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.233253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.275128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:42.305532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db0ca42a-dc27-4a3f-97f5-33aba2e22cf8 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1791338791" status: 201 len: 0 microversion: 2.26 time: 0.174988 Oct 17 13:32:42.311801 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1959/3974] 10.222.0.65 () {62 vars in 1380 bytes} [Mon Oct 17 13:32:42 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-1791338791 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 17 13:32:42.334223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fcfb955d-159a-4962-b915-cfa0db3954fa req-e0eb9482-31d7-48ba-8184-610cbabea5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac32659d-2fef-4b01-a1f2-62a4478f719e", "name": "network-vif-plugged", "status": "completed", "tag": "edd15adf-dc7e-4d5a-b27d-b32cec4b8174"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:42.352924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fcfb955d-159a-4962-b915-cfa0db3954fa req-e0eb9482-31d7-48ba-8184-610cbabea5ad service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.353764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fcfb955d-159a-4962-b915-cfa0db3954fa req-e0eb9482-31d7-48ba-8184-610cbabea5ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.354518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fcfb955d-159a-4962-b915-cfa0db3954fa req-e0eb9482-31d7-48ba-8184-610cbabea5ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.383532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fcfb955d-159a-4962-b915-cfa0db3954fa req-e0eb9482-31d7-48ba-8184-610cbabea5ad service nova] Creating event network-vif-plugged:edd15adf-dc7e-4d5a-b27d-b32cec4b8174 for instance ac32659d-2fef-4b01-a1f2-62a4478f719e on n-h1-854121-14 Oct 17 13:32:42.416184 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fcfb955d-159a-4962-b915-cfa0db3954fa req-e0eb9482-31d7-48ba-8184-610cbabea5ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101576 Oct 17 13:32:42.417625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1960/3975] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:42.427596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f41a20771f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:42.472010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.473439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.474083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.474941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:42.484289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.485061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.485850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.486966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.487597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.488230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.531000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.532455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.533104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.544559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.545407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.546051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.606207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:42.662988 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d037494f-b908-490c-a14a-7eef47992217 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-39902392" status: 201 len: 0 microversion: 2.26 time: 0.243121 Oct 17 13:32:42.664905 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1961/3976] 10.222.0.65 () {62 vars in 1374 bytes} [Mon Oct 17 13:32:42 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags/tempest-tag-39902392 => generated 0 bytes in 247 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Oct 17 13:32:42.671829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:42.672713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:42.681577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.682281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.683032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:42.683955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:42.684580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:42.686212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.250587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:43.263933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5a54248-4272-409c-9414-8b0213a3f6b9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 1.261094 Oct 17 13:32:43.266934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2016/3977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:42 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:43.280431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Action: 'update_all', calling method: .version_select at 0x7f41a2083700>, body: {"tags": ["tempest-tag-1820465710", "tempest-tag-76057071"]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:43.310505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.311006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.311427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.312042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:43.333593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.334434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.335152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.336100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.336759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.340738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.413148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.414562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.415363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.457261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:43.499212 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b89caa07-38f3-4bb8-b775-298ec68bdb19 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 200 len: 60 microversion: 2.26 time: 0.226768 Oct 17 13:32:43.501658 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2017/3978] 10.222.0.65 () {62 vars in 1312 bytes} [Mon Oct 17 13:32:43 2022] PUT /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 60 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:43.510359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d37ca3ff-6a10-4f24-8479-61f28813271b tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419ce07040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:43.521133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:43.543520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d37ca3ff-6a10-4f24-8479-61f28813271b tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.544900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d37ca3ff-6a10-4f24-8479-61f28813271b tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.546459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d37ca3ff-6a10-4f24-8479-61f28813271b tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.547514 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-945b6a07-9767-4597-81b8-2102d91457ae tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1316 microversion: 2.1 time: 0.876738 Oct 17 13:32:43.553585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1962/3979] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:42 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1316 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:43.557847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d37ca3ff-6a10-4f24-8479-61f28813271b tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 200 len: 60 microversion: 2.26 time: 0.051827 Oct 17 13:32:43.564863 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2018/3980] 10.222.0.65 () {60 vars in 1292 bytes} [Mon Oct 17 13:32:43 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 60 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:43.571825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '.version_select at 0x7f419ce160d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:43.600072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.601740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.604183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.604936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:43.663222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.673703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.674431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.675354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.677607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.678911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.723789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.727920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.729116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.761679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'flavor' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:43.807412 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d718a7c9-0997-41f4-91a5-f48a12c54b54 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.241590 Oct 17 13:32:43.814635 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1963/3981] 10.222.0.65 () {60 vars in 1295 bytes} [Mon Oct 17 13:32:43 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:43.821305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:43.822067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:43.837012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.838110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.838746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.839785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:43.841115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:43.841776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:43.886794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:43.939225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:44.111022 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2cfa702-e2f1-40b4-8da3-baff04f144e7 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 204 len: 0 microversion: 2.26 time: 0.294330 Oct 17 13:32:44.111979 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2019/3982] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:32:43 2022] DELETE /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:32:44.120367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:44.121397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:44.136001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.138559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.139232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.140143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.140772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.141541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.295214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:44.295989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:44.313400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.313900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.314345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.315189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.315652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.316081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.716905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:44.736408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:44.749538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:44.750818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23db9f7c-706a-4f89-9107-09316bd31acb tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1550 microversion: 2.26 time: 0.634709 Oct 17 13:32:44.755216 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1964/3983] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:44 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1550 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:44.761107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:44.786630 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9a3bb96-2ca0-4e41-86aa-4da0a6f20811 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.496049 Oct 17 13:32:44.808573 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2020/3984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:44 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:44.814904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:44.821437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:44.837124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.843438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.845869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:44.848915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:44.850175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:44.852299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.074459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1163038896", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:45.155319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:32:45.211879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:45.222877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1ef7a72-bfaa-4507-b5dd-566490ebcb86 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1504 microversion: 2.1 time: 0.411826 Oct 17 13:32:45.223470 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2021/3985] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:44 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:45.391678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae17420f-2404-4408-a00f-59c106791a48 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Action: 'create', calling method: .version_select at 0x7f41a1fed9d0>, body: {"keypair": {"name": "tempest-keypair-981682981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSZ5jlBP5ELc8YqsbxgA02tclOQlXyw0BBbr9xJqNJWGHK3gNzocsCgc921v0n3I2VHrbxB5hO4A9+r/4FlKHHKCJjO17yO06O+d7Imas1ZfklPB1p6F4EKJDVQOELXHg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:45.426105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ae17420f-2404-4408-a00f-59c106791a48 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Getting quotas for project 5ac9d028f08241b592759d7db49a0e23. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:45.441911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ae17420f-2404-4408-a00f-59c106791a48 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Getting quotas for user d4d87104d2614a47b3262082aa6f1496 and project 5ac9d028f08241b592759d7db49a0e23. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:45.495880 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae17420f-2404-4408-a00f-59c106791a48 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263381 Oct 17 13:32:45.498188 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2022/3986] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:32:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:45.509104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:45.518356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:45.532725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.533450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.534061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.534962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.538782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.541878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.564677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:32:45.565410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:32:45.565976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:32:45.566788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:32:45.567387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:32:45.580242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.581182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.581999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.582999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.583687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.584335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.607610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Getting quotas for project 5e2474d0067c4163a4bafc4fb6d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:45.616233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:32:45.623365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Getting quotas for user 1609ae0c03284de9ada5ec9a0ca651f0 and project 5e2474d0067c4163a4bafc4fb6d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:45.653421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:32:45.659298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:32:45.767133 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0c953b85-0915-45e4-839e-413685d98b34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 204 len: 0 microversion: 2.1 time: 0.266950 Oct 17 13:32:45.773058 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2023/3987] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:32:45 2022] DELETE /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:32:45.783681 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-04170808-a399-46e2-9a7e-7577187da976 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025072 Oct 17 13:32:45.787828 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1965/3988] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:32:45.800842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:45.804039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:45.822155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.822890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.823537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.824539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:45.825620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:45.828251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:45.902500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1065482136", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:46.022123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:46.028022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] validate_networks() for [('b08fd1b8-f823-4fc4-a1e5-d5b611838b68', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:32:46.037323 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cb2a530-d48b-436b-9c7b-24facf3d4142 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1510 microversion: 2.1 time: 0.244963 Oct 17 13:32:46.038137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1966/3989] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:45 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:46.051878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:46.052565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:46.069288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:46.069798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:46.070250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:46.070973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:46.077132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:46.080320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:46.371293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:46.393780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:46.399665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:46.400925 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01471ddd-8120-469b-84d4-6ed0c239ccaf tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1550 microversion: 2.26 time: 0.360943 Oct 17 13:32:46.401534 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1967/3990] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:46 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1550 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:46.422952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b0a1ba8-a775-4130-9621-c077fdb93b08 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:46.424041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b0a1ba8-a775-4130-9621-c077fdb93b08 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:46.681852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3b0a1ba8-a775-4130-9621-c077fdb93b08 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:46.693036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b0a1ba8-a775-4130-9621-c077fdb93b08 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1222 microversion: 2.1 time: 0.290423 Oct 17 13:32:46.693686 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1968/3991] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:46 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:46.708401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:46.709366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:46.733420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:46.733420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:46.734882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:46.738454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:46.738921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:46.740365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:47.698106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:32:47.699395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:32:47.700306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:32:47.702799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:32:47.703419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:32:47.748785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:47.749327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:47.750794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:47.752188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:47.755158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:47.759015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:47.819417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for project 6ed221c004a544c79cb496a7b24b831c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:47.837331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for user 9258316116624b7181a18659867bd13b and project 6ed221c004a544c79cb496a7b24b831c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:47.844631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:47.860154 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf58304a-c73e-453c-b92b-4e6c081f65d4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 1.161255 Oct 17 13:32:47.877190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1969/3992] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:46 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:47.877190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:47.877190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:47.877190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:47.877190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:47.877868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:47.882641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:47.883357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:47.883925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:47.888733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:32:47.891422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:32:48.003528 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6d8ede7-cc96-4c8d-bdb2-096f3c8b3568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.224990 Oct 17 13:32:48.004120 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2024/3993] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:32:48.014782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:48.015412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:48.031128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.031625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.032128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.039575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.040972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.041996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.148564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.149066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.149535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.156808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lazy-loading 'fault' on Instance uuid 3c419683-7478-4bc8-90c2-c4513e975cfb {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:48.187159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:48.202090 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c61efed8-9735-4275-87d1-74062fa9a418 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1510 microversion: 2.1 time: 0.339881 Oct 17 13:32:48.213385 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1970/3994] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:47 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:48.235504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-234309c8-e530-4a8b-9eba-344dba6cc108 req-2bcaaafe-a811-4893-8c0b-9b81ac81e727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c419683-7478-4bc8-90c2-c4513e975cfb", "name": "network-vif-deleted", "tag": "95d14041-66ec-402b-bbf4-37a30aa3fdab"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:48.288544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-234309c8-e530-4a8b-9eba-344dba6cc108 req-2bcaaafe-a811-4893-8c0b-9b81ac81e727 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.290725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-234309c8-e530-4a8b-9eba-344dba6cc108 req-2bcaaafe-a811-4893-8c0b-9b81ac81e727 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.291905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-234309c8-e530-4a8b-9eba-344dba6cc108 req-2bcaaafe-a811-4893-8c0b-9b81ac81e727 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.307127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:48.322594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:48.324459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df19e5ec0ca14a2599a64cf93b76ada1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b4099ba46204f7a87a4c569cb91e156', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:48.327117 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e080466d-5959-4849-be46-61760fa8e0f9 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 200 len: 1351 microversion: 2.26 time: 0.317996 Oct 17 13:32:48.330411 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2025/3995] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:48 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 1351 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:32:48.339575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:48.346183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:48.368841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.371388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.372975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.375338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.375859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.377421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.379296 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-234309c8-e530-4a8b-9eba-344dba6cc108 req-2bcaaafe-a811-4893-8c0b-9b81ac81e727 service nova] Creating event network-vif-deleted:95d14041-66ec-402b-bbf4-37a30aa3fdab for instance 3c419683-7478-4bc8-90c2-c4513e975cfb on n-h1-854121-14 Oct 17 13:32:48.391492 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-234309c8-e530-4a8b-9eba-344dba6cc108 req-2bcaaafe-a811-4893-8c0b-9b81ac81e727 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187506 Oct 17 13:32:48.410816 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1971/3996] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:48.423199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb1aa6e9-e576-4237-bcde-75010862dc68 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:48.428089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb1aa6e9-e576-4237-bcde-75010862dc68 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:48.505721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:48.518227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea3d29aa-d8b4-4b1c-b549-926143a00b19 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1280 microversion: 2.1 time: 0.186524 Oct 17 13:32:48.537855 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2026/3997] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:48 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:48.594156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb1aa6e9-e576-4237-bcde-75010862dc68 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:48.602499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb1aa6e9-e576-4237-bcde-75010862dc68 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1222 microversion: 2.1 time: 0.190065 Oct 17 13:32:48.602956 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1972/3998] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:48 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1222 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:48.716052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1339184888", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:48.848344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] validate_networks() for [('b08fd1b8-f823-4fc4-a1e5-d5b611838b68', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:32:48.886435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:48.887044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:48.917802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.918355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.921420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:48.922402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:48.923083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:48.928915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.568128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:49.580807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d637f04-c345-4fb1-ae2b-34fcfb08831e tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.698222 Oct 17 13:32:49.583014 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1973/3999] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:48 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:49.592617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:49.594208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:49.618609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.619328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.625505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.626636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.627137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.630435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.789588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:49.825197 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6b2a709-323b-4e1f-8941-b30973720e9d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 200 len: 1468 microversion: 2.1 time: 0.239253 Oct 17 13:32:49.828154 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1974/4000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:49 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:49.839339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:49.839985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] [instance: 3c419683-7478-4bc8-90c2-c4513e975cfb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:49.859158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.860083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.860844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.862086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.862784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.863394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.894021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] HTTP exception thrown: Instance 3c419683-7478-4bc8-90c2-c4513e975cfb could not be found. Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Request method failure captured: Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb HTTP/1.1 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlac8MDq32hrEOwfvIsPRbB6w_E-iq_2vbAdGBofGhK6k8hZ1aVP8-x-xRqei74DIetSqHQTv6_nkAspdVj6kCNaEn_GH69iGwHB_N2bVyY0aDh0aW07hYBDpuorNMU9-WvTVpoc-iXnLv1fhZ4ORoIZnIP07w6mM02i5U9VDOJIQ0 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.26 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2b4099ba46204f7a87a4c569cb91e156 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerTagsTestJSON-154825128 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2b4099ba46204f7a87a4c569cb91e156"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b4099ba46204f7a87a4c569cb91e156"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b4099ba46204f7a87a4c569cb91e156"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2b4099ba46204f7a87a4c569cb91e156"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerTagsTestJSON-154825128 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2b4099ba46204f7a87a4c569cb91e156 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerTagsTestJSON-154825128 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerTagsTestJSON-154825128-project Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: df19e5ec0ca14a2599a64cf93b76ada1 Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerTagsTestJSON-154825128-project Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 3c419683-7478-4bc8-90c2-c4513e975cfb could not be found. Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3c419683-7478-4bc8-90c2-c4513e975cfb'} Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c419683-7478-4bc8-90c2-c4513e975cfb could not be found. Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c419683-7478-4bc8-90c2-c4513e975cfb could not be found. Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:49.896644 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c419683-7478-4bc8-90c2-c4513e975cfb could not be found. Oct 17 13:32:49.902499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:49.904880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] Returning 404 to user: Instance 3c419683-7478-4bc8-90c2-c4513e975cfb could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:49.906537 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0cf1b06-ddcf-41c2-b171-d1f964f66834 tempest-ServerTagsTestJSON-154825128 tempest-ServerTagsTestJSON-154825128-project] 10.222.0.65 "GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb" status: 404 len: 111 microversion: 2.26 time: 0.076304 Oct 17 13:32:49.908118 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1975/4001] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:32:49 2022] GET /compute/v2.1/servers/3c419683-7478-4bc8-90c2-c4513e975cfb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:32:49.935363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:49.936210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:49.951203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.953401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.954091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.963947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:32:49.964542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:32:49.964839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:32:49.965603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:32:49.966138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:32:49.971250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.973012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.974390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.986509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:49.988662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.991617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.993676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:49.994665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:49.997851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:49.998817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.040846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:50.081614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for project 6ed221c004a544c79cb496a7b24b831c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:50.110147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:50.136574 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e44bb7a6-6237-4c2c-b01e-a842375a771d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1280 microversion: 2.1 time: 0.226675 Oct 17 13:32:50.138226 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1976/4002] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:49 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:50.140321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for user 9258316116624b7181a18659867bd13b and project 6ed221c004a544c79cb496a7b24b831c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:50.169024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:32:50.173273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:32:50.243885 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7e33ce0-f599-4c83-be5c-7131ebbc6c73 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.534325 Oct 17 13:32:50.245775 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2027/4003] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:32:50.262540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0cc52eb-3338-433b-8fc9-b23f3706db22 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:50.263508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0cc52eb-3338-433b-8fc9-b23f3706db22 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:50.609036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:50.610062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:50.623218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.625929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.627341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.628510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.629718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.630969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.660599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0cc52eb-3338-433b-8fc9-b23f3706db22 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:50.676797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0cc52eb-3338-433b-8fc9-b23f3706db22 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1222 microversion: 2.1 time: 0.419104 Oct 17 13:32:50.698499 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1977/4004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:50 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1222 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:50.704441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2001854f-84fb-48c5-b2c6-1fdef6e47b81 req-789152fa-1975-45c9-8bd7-412d807d12f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac32659d-2fef-4b01-a1f2-62a4478f719e", "name": "network-vif-deleted", "tag": "edd15adf-dc7e-4d5a-b27d-b32cec4b8174"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:50.741005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2001854f-84fb-48c5-b2c6-1fdef6e47b81 req-789152fa-1975-45c9-8bd7-412d807d12f1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.741561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2001854f-84fb-48c5-b2c6-1fdef6e47b81 req-789152fa-1975-45c9-8bd7-412d807d12f1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.744737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2001854f-84fb-48c5-b2c6-1fdef6e47b81 req-789152fa-1975-45c9-8bd7-412d807d12f1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.782357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2001854f-84fb-48c5-b2c6-1fdef6e47b81 req-789152fa-1975-45c9-8bd7-412d807d12f1 service nova] Creating event network-vif-deleted:edd15adf-dc7e-4d5a-b27d-b32cec4b8174 for instance ac32659d-2fef-4b01-a1f2-62a4478f719e on n-h1-854121-14 Oct 17 13:32:50.795621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2001854f-84fb-48c5-b2c6-1fdef6e47b81 req-789152fa-1975-45c9-8bd7-412d807d12f1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095005 Oct 17 13:32:50.797862 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1978/4005] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:50.857804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:50.858691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:50.868462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.869762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.884773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.889687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.891689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.893502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.946954 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e HTTP/1.1 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ac32659d-2fef-4b01-a1f2-62a4478f719e'} Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:50.948780 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:50.956355 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b404de1-046a-41bf-ae64-94771b905ff3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 404 len: 111 microversion: 2.1 time: 0.098732 Oct 17 13:32:50.957827 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1979/4006] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:50 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:32:50.968920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:50.973987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:50.991565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.993712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.994351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:50.995686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:50.996335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:50.996941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:51.489873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:51.519532 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d5d087f-17b2-4195-9955-27810761a7c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.916151 Oct 17 13:32:51.522929 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2028/4007] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:50 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:51.530110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:51.531000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:51.540100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:51.540898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:51.542056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:51.543005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:51.543671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:51.544801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:51.699904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:51.714177 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3cf62042-c72d-4307-8ed4-be0ff833700e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.749356 Oct 17 13:32:51.715137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1980/4008] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:50 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:51.721085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:51.722195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:51.734155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:51.744412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:51.750518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:51.754011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:51.754684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:51.757768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:52.035459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:52.054628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3f94537-d4ee-49ef-bb2a-582aea265af7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1274 microversion: 2.1 time: 0.336652 Oct 17 13:32:52.056226 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1981/4009] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:51 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1274 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:52.072783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:52.077445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6438b46-7b43-4be0-9b16-2517c789e63e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6438b46-7b43-4be0-9b16-2517c789e63e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 163 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": 12345, "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 12345 Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:32:52.085580 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 17 13:32:52.092328 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:52.093489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d7e7436-f1ad-4b89-b116-5e37e703f078 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.561273 Oct 17 13:32:52.097486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6438b46-7b43-4be0-9b16-2517c789e63e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:52.098652 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6438b46-7b43-4be0-9b16-2517c789e63e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.039964 Oct 17 13:32:52.099972 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1982/4010] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:52 2022] POST /compute/v2.1/servers => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:32:52.104060 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2029/4011] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:51 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:52.124389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:52.126502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:52.150073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:52.150864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:52.151559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:52.152499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:52.156152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:52.157014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:52.548947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:52.550286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:52.561211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:52.562021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:52.562666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:52.587710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:52.591991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:52.595316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:52.956263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:52.969952 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38df65f9-e2ba-4b0d-a68e-265fe789eca0 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.860447 Oct 17 13:32:52.992178 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1983/4012] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:52 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:52.998802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:53.000117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:53.007390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.008156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.008799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.009791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.010256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.010685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.300961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:53.336966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd59a8bb-34f4-483f-947f-bcdb129117c4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.791237 Oct 17 13:32:53.353768 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2030/4013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:52 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:32:53.361239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:53.362212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:53.376965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.379027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.379821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.381147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.381879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.400485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.855389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:53.871538 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32516500-fa75-4012-8fea-262327635378 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1280 microversion: 2.1 time: 0.515152 Oct 17 13:32:53.874123 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2031/4014] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:53 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1280 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:53.892078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:53.893081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:53.910492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.911288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.911723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.912839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.913098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.914571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.939987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:53.970111 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26fbe34a-0d4a-4fdc-a830-9f35d8309941 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.976326 Oct 17 13:32:53.970714 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1984/4015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:52 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:53.986296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:53.987118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:53.995377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.996018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.996598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:53.998157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:53.998699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:53.999197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.040002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-527f025b-1cc8-4a4b-909e-d46052390624 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments/bc81c0c7-1ec4-4a12-8d69-a9a90481aedc" status: 200 len: 194 microversion: 2.20 time: 0.067912 Oct 17 13:32:54.041179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1985/4016] 10.222.0.65 () {60 vars in 1454 bytes} [Mon Oct 17 13:32:53 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments/bc81c0c7-1ec4-4a12-8d69-a9a90481aedc => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:32:54.047248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-64942e0e-7ff1-4c1a-9f2c-8c7efd4f6265 req-c222dca0-a9f4-4706-859d-5172987172c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27", "tag": "bbc503ca-3c00-4abf-aaf8-1675bcfaaee2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:54.061359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-64942e0e-7ff1-4c1a-9f2c-8c7efd4f6265 req-c222dca0-a9f4-4706-859d-5172987172c8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.062021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-64942e0e-7ff1-4c1a-9f2c-8c7efd4f6265 req-c222dca0-a9f4-4706-859d-5172987172c8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.062563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-64942e0e-7ff1-4c1a-9f2c-8c7efd4f6265 req-c222dca0-a9f4-4706-859d-5172987172c8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.092716 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-64942e0e-7ff1-4c1a-9f2c-8c7efd4f6265 req-c222dca0-a9f4-4706-859d-5172987172c8 service nova] Creating event network-changed:bbc503ca-3c00-4abf-aaf8-1675bcfaaee2 for instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 on n-h2-854121-14 Oct 17 13:32:54.104385 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-64942e0e-7ff1-4c1a-9f2c-8c7efd4f6265 req-c222dca0-a9f4-4706-859d-5172987172c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060730 Oct 17 13:32:54.118415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1986/4017] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:54.208226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:54.209239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:54.216511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.217555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.218339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.220206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.220889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.221361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.395304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lazy-loading 'services' on Instance uuid 82e45827-89b8-402f-befe-a8cb5d7d1e7f {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:32:54.527328 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17c2072b-8bda-418c-a85b-f5867df39862 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments/bc81c0c7-1ec4-4a12-8d69-a9a90481aedc" status: 202 len: 0 microversion: 2.20 time: 0.323722 Oct 17 13:32:54.528462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1987/4018] 10.222.0.65 () {60 vars in 1457 bytes} [Mon Oct 17 13:32:54 2022] DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments/bc81c0c7-1ec4-4a12-8d69-a9a90481aedc => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:32:54.541222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:54.547899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:54.581235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.582562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.583910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.584804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.585420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.586074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.914737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:54.928219 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3476ee4d-5076-4ed9-b4ce-5b5e9d959a36 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 1.052440 Oct 17 13:32:54.929543 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2032/4019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:53 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:54.941810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:54.947953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:54.964834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.966492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.967193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:54.970325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:54.971039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:54.971596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:55.028768 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ece062e3-c473-4e78-adc2-85afd94041df tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.097687 Oct 17 13:32:55.029995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2033/4020] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:32:54 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:32:55.047339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:55.048249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:55.058084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:55.059028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:55.060255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:55.061809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:55.062546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:55.063151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:55.598144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:56.442643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:56.452513 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc652641-7563-4ba3-9f4a-daedbf23b22e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 1.421247 Oct 17 13:32:56.453125 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2034/4021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:55 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:56.482666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "73964e26-69dd-4b10-81b1-3b8d31c69ae6"}], "security_groups": [{"name": "tempest-securitygroup--1376606499"}], "key_name": "tempest-keypair-981682981", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:56.491758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:56.530481 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e9daceb-73ad-455b-ae70-af885700d90f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 1.996624 Oct 17 13:32:56.550818 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1988/4022] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:54 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:56.560041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:56.561575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:56.569817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:32:56.572174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:56.572975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:56.573662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:56.574955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:56.576522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:56.577205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:56.998909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] validate_networks() for [('73964e26-69dd-4b10-81b1-3b8d31c69ae6', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:32:57.374977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:57.383982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-13dfa51d-7c9a-4d82-bcbf-4d3a280c10b6 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.831679 Oct 17 13:32:57.394585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1989/4023] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:56 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:57.409765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:57.412504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:57.423617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.428618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.429461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:57.431333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.432057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.432738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:57.510908 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3340130-9f13-4981-811c-45afb4330800 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.114738 Oct 17 13:32:57.512267 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1990/4024] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:32:57 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:32:57.521153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-11bb23ff-c2db-4899-ba8d-4e38064f069b req-6a43b04b-8bfe-4d22-b746-1a66f1b9d3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebec799c-df30-4d3d-9947-9ab16c8365d0", "tag": "0622d030-b335-4225-b818-f277b4b0383e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:57.548313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-11bb23ff-c2db-4899-ba8d-4e38064f069b req-6a43b04b-8bfe-4d22-b746-1a66f1b9d3b7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.553509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-11bb23ff-c2db-4899-ba8d-4e38064f069b req-6a43b04b-8bfe-4d22-b746-1a66f1b9d3b7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.554654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-11bb23ff-c2db-4899-ba8d-4e38064f069b req-6a43b04b-8bfe-4d22-b746-1a66f1b9d3b7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:57.582271 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-11bb23ff-c2db-4899-ba8d-4e38064f069b req-6a43b04b-8bfe-4d22-b746-1a66f1b9d3b7 service nova] Creating event network-changed:0622d030-b335-4225-b818-f277b4b0383e for instance ebec799c-df30-4d3d-9947-9ab16c8365d0 on n-h1-854121-14 Oct 17 13:32:57.597002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-11bb23ff-c2db-4899-ba8d-4e38064f069b req-6a43b04b-8bfe-4d22-b746-1a66f1b9d3b7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082054 Oct 17 13:32:57.598372 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1991/4025] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:32:57.604261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc2b51ea-9868-4d05-9954-875f8488c26c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1646635407", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ee03ceda-0160-408b-b389-39019ea8fe40", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:32:57.745649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cc2b51ea-9868-4d05-9954-875f8488c26c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Block Device ee03ceda-0160-408b-b389-39019ea8fe40 is not bootable. Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc2b51ea-9868-4d05-9954-875f8488c26c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 358 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1646635407", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ee03ceda-0160-408b-b389-39019ea8fe40", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: exception: Block Device ee03ceda-0160-408b-b389-39019ea8fe40 is not bootable. Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1646635407', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ee03ceda-0160-408b-b389-39019ea8fe40'}], 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ee03ceda-0160-408b-b389-39019ea8fe40 is not bootable. Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:57.758747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ee03ceda-0160-408b-b389-39019ea8fe40 is not bootable. Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ee03ceda-0160-408b-b389-39019ea8fe40 is not bootable. Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc2b51ea-9868-4d05-9954-875f8488c26c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Block Device ee03ceda-0160-408b-b389-39019ea8fe40 is not bootable. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc2b51ea-9868-4d05-9954-875f8488c26c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.160686 Oct 17 13:32:57.764571 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1992/4026] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:57 2022] POST /compute/v2.1/servers => generated 110 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:32:57.772223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:57.776806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:57.798700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.799212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.802341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:57.803122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:57.803602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:57.804040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:58.156044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:58.173800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70b2c0f9-cb47-402a-a0a5-2ad2054747bf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.409324 Oct 17 13:32:58.174595 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1993/4027] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:57 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:58.202278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:58.202910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:58.223930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:58.224436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:58.224877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:58.225628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:58.226083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:58.226512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.124825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:32:59.125368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:32:59.125852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:32:59.126271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:32:59.126694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:32:59.142767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.143276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.143720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.144461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.144922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.145385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.204791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Getting quotas for project 5ac9d028f08241b592759d7db49a0e23. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:32:59.218569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Getting quotas for user d4d87104d2614a47b3262082aa6f1496 and project 5ac9d028f08241b592759d7db49a0e23. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:32:59.255235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:32:59.260442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:32:59.317217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:32:59.333232 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-badac681-da24-4a9a-8b0f-5caf4341de4d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 1.140072 Oct 17 13:32:59.334169 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1994/4028] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:58 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:32:59.339558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:59.340166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:59.362558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.363661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.364264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.365576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.369763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.370677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.408931 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9bc53396-52eb-4b7a-8165-c89dd8c36df1 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.949036 Oct 17 13:32:59.418102 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2035/4029] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:32:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 2959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:32:59.437987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:32:59.438630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:32:59.457364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.459110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.459574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.461624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:32:59.465346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:32:59.468996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:32:59.480820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:00.103803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:00.116036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8817dbe-ddfe-4d43-b672-b37512139295 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.780674 Oct 17 13:33:00.116596 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1995/4030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:59 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:00.129956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:00.141097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:00.150974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.151476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.155199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.156201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.156844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.159083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.175759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:00.194637 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-694cf0d1-9ad9-4c59-b540-9606d5fc2a64 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.779383 Oct 17 13:33:00.218508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2036/4031] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:32:59 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:00.234131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:00.237356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:00.252702 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c398515-4007-44ff-8701-c801d9198b48 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.135005 Oct 17 13:33:00.255576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1996/4032] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:33:00 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:00.263692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d82695c-27df-4049-8506-ca7bb5917af7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:00.268962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.270077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d82695c-27df-4049-8506-ca7bb5917af7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:00.271253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.272004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.275162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.275935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.278000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.515261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d82695c-27df-4049-8506-ca7bb5917af7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:00.532223 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d82695c-27df-4049-8506-ca7bb5917af7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1225 microversion: 2.1 time: 0.275490 Oct 17 13:33:00.553595 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1997/4033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:00 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1225 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:00.562852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f595c1f4-0a6f-4072-a2a6-a97c4e48aa4f req-0ce22f78-8fed-4362-9946-e46f5d366e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b4c131-aeca-40af-9e61-6014c8c16f02", "tag": "7b809b30-e58d-4a82-a66f-2fde13274130"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:00.587695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f595c1f4-0a6f-4072-a2a6-a97c4e48aa4f req-0ce22f78-8fed-4362-9946-e46f5d366e13 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.588191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f595c1f4-0a6f-4072-a2a6-a97c4e48aa4f req-0ce22f78-8fed-4362-9946-e46f5d366e13 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.588619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f595c1f4-0a6f-4072-a2a6-a97c4e48aa4f req-0ce22f78-8fed-4362-9946-e46f5d366e13 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.626434 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f595c1f4-0a6f-4072-a2a6-a97c4e48aa4f req-0ce22f78-8fed-4362-9946-e46f5d366e13 service nova] Creating event network-changed:7b809b30-e58d-4a82-a66f-2fde13274130 for instance e5b4c131-aeca-40af-9e61-6014c8c16f02 on n-h1-854121-14 Oct 17 13:33:00.644346 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f595c1f4-0a6f-4072-a2a6-a97c4e48aa4f req-0ce22f78-8fed-4362-9946-e46f5d366e13 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089351 Oct 17 13:33:00.645257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1998/4034] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:00.657812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:00.661057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:00.679539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.695567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.696561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.701754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:00.702631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:00.703341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:00.735028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:01.088934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:01.098630 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d470f071-572e-4a19-b793-bb9c21e7c494 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.878933 Oct 17 13:33:01.105366 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2037/4035] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:00 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:01.116112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:01.118857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:01.133147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:01.141804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:01.142506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.143510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:01.144198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:01.144874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.179148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:01.188225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0dd3ec0-c211-41e4-9d51-1c6c73c47612 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.541529 Oct 17 13:33:01.195478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1999/4036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:00 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:01.227840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:01.228696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:01.248352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:01.249397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:01.252071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.253153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:01.256741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:01.257503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.910151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:01.921951 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48eef669-7a4b-4662-9e0f-327a6e87c4cb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.814973 Oct 17 13:33:01.922981 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2038/4037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:01 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:01.930673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:01.934727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:01.945279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:01.946185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:01.946974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.948080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:01.948926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:01.949870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:01.973800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:01.991311 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e22a8f9-703c-4773-a21e-73fdb7f68af1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.765487 Oct 17 13:33:01.992693 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2000/4038] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:01 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:01.999688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-259b6ac5-b414-4aeb-bf5a-37217eb44075 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075342 Oct 17 13:33:02.013727 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2039/4039] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:33:01 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:02.018783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:02.023155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:02.041559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.046725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.047524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.048533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.050990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.052164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.127308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:02.127940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:02.142153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.142671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.143123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.148514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.152585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.155875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.381005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:02.400456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6933f22-4b2e-4de6-b03f-27492c66a3db tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1283 microversion: 2.1 time: 0.406346 Oct 17 13:33:02.401489 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2001/4040] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:01 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1283 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:02.506984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:02.521895 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c943158-4c2a-4392-bc46-75b0c7f63fa8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.400529 Oct 17 13:33:02.522513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2040/4041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:02 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:02.914273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8edf8d1a-4b0b-431c-8034-baffafa15d52 req-560ef0ea-6032-4626-87d9-fc1a68e03d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec799c-df30-4d3d-9947-9ab16c8365d0", "name": "network-vif-plugged", "status": "completed", "tag": "0622d030-b335-4225-b818-f277b4b0383e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:02.938058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8edf8d1a-4b0b-431c-8034-baffafa15d52 req-560ef0ea-6032-4626-87d9-fc1a68e03d8c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.948249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8edf8d1a-4b0b-431c-8034-baffafa15d52 req-560ef0ea-6032-4626-87d9-fc1a68e03d8c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.949127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8edf8d1a-4b0b-431c-8034-baffafa15d52 req-560ef0ea-6032-4626-87d9-fc1a68e03d8c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.952230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:02.952918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:02.964972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8edf8d1a-4b0b-431c-8034-baffafa15d52 req-560ef0ea-6032-4626-87d9-fc1a68e03d8c service nova] Creating event network-vif-plugged:0622d030-b335-4225-b818-f277b4b0383e for instance ebec799c-df30-4d3d-9947-9ab16c8365d0 on n-h1-854121-14 Oct 17 13:33:02.965802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.966559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.971023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.972999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:02.973532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:02.973981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:02.984719 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8edf8d1a-4b0b-431c-8034-baffafa15d52 req-560ef0ea-6032-4626-87d9-fc1a68e03d8c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073982 Oct 17 13:33:02.986264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2002/4042] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:03.012732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:03.015444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:03.035448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.035940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.036451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.037282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.038045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.038680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.159467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77f87777-55b6-448a-a966-bd07c7ec43a8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148326 Oct 17 13:33:03.160628 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2003/4043] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:33:03 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:03.168819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:03.170266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:03.181763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.182269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.183663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.184310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.184854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.185558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.707076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:03.728445 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d998dc33-cd18-428f-9d6b-d36e5bb778e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.566456 Oct 17 13:33:03.741860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2004/4044] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:03 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:03.759979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:03.769009 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f3056bed-04c3-4df5-8c20-432141655f2f tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.821972 Oct 17 13:33:03.773114 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2041/4045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:02 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:03.773495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:03.774838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:03.785389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:03.788201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:03.791733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.792444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.795297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.796243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.798735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.799362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.806505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.807285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.807909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.808817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:03.810027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:03.810642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:03.972268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:03.986327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf6d3617-ce7e-4f9f-be58-f1b590e204c4 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1283 microversion: 2.1 time: 0.240257 Oct 17 13:33:03.993311 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2005/4046] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:03 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1283 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:04.000491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcf179ae-1e81-4e66-867a-18daf93bcf71 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-174490500", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "destination_type": "local"}, {"source_type": "volume", "uuid": "b5e76472-dee7-4ef8-8ea9-f958dd7a7a16", "destination_type": "invalid"}], "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcf179ae-1e81-4e66-867a-18daf93bcf71 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 494 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-174490500", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "destination_type": "local"}, {"source_type": "volume", "uuid": "b5e76472-dee7-4ef8-8ea9-f958dd7a7a16", "destination_type": "invalid"}], "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-174490500', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'b5e76472-dee7-4ef8-8ea9-f958dd7a7a16', 'destination_type': 'invalid'}], 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:04.006577 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcf179ae-1e81-4e66-867a-18daf93bcf71 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:04.011558 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcf179ae-1e81-4e66-867a-18daf93bcf71 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013691 Oct 17 13:33:04.013946 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2006/4047] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:03 2022] POST /compute/v2.1/servers => generated 155 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:04.018126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.018753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:04.027061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.027863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.030300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.031785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.034814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.036046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.178309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:04.188310 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7ef4110-712d-4fe3-b27d-33c913e1c04c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.412185 Oct 17 13:33:04.202427 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2042/4048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:03 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:04.210929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.213735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:04.221688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.222586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.223474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.224495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.225232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.225930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.267243 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3aecf89f-d1bc-47d2-bf5b-f65186b7ba27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063213 Oct 17 13:33:04.274329 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2043/4049] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:33:04 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:04.382122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.382995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:04.393516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.394432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.395273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.396311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.397005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.397805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.433597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:04.438212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:33:04.445528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea379314-9930-4287-8f4c-c9a1eb50d0e4 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.431178 Oct 17 13:33:04.446860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2007/4050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:04 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:04.480022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.482995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:04.499499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.500846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.501610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.503438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.504975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.505681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.552063 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01e6303d-552a-44cd-88be-280b43431d55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 204 len: 0 microversion: 2.20 time: 0.173480 Oct 17 13:33:04.554335 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2044/4051] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:33:04 2022] DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:33:04.570346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.571758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:04.582457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.582944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.583579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.584642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:04.585365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:04.586069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:04.911713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:04.942176 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6689cc7-d226-47f7-8814-e706d979230d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.470531 Oct 17 13:33:04.943356 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2008/4052] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:04 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:04.956182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:04.957102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.004980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.008996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.010096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.014951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.015907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.018092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.073478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.105114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.105114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.105114 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-701c188c-e87d-4a23-8429-2b58ffb533ad tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.535987 Oct 17 13:33:05.105114 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2045/4053] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:04 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:05.107442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:05.108283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.140971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.144514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.145038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.145820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.149449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.150571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.411769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.421262 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e4245df-1542-404f-ac89-fa67f86be20f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.474004 Oct 17 13:33:05.422925 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2009/4054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:04 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:05.428759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:05.429895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.438250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.445663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.446209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.448067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.448666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.449266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.548192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.584362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a50420e-a650-49e1-b889-5b44feda2764 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1485 microversion: 2.1 time: 0.469258 Oct 17 13:33:05.587300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2046/4055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:05 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1485 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:05.607523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-427121ca-be24-480b-b6c4-6719e4d5f8c7 req-04b9aa6d-1c8e-49d7-a628-e559095e253f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27", "name": "network-vif-plugged", "status": "completed", "tag": "bbc503ca-3c00-4abf-aaf8-1675bcfaaee2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:05.647310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-427121ca-be24-480b-b6c4-6719e4d5f8c7 req-04b9aa6d-1c8e-49d7-a628-e559095e253f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.648020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-427121ca-be24-480b-b6c4-6719e4d5f8c7 req-04b9aa6d-1c8e-49d7-a628-e559095e253f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.648910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-427121ca-be24-480b-b6c4-6719e4d5f8c7 req-04b9aa6d-1c8e-49d7-a628-e559095e253f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.669790 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-427121ca-be24-480b-b6c4-6719e4d5f8c7 req-04b9aa6d-1c8e-49d7-a628-e559095e253f service nova] Creating event network-vif-plugged:bbc503ca-3c00-4abf-aaf8-1675bcfaaee2 for instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 on n-h2-854121-14 Oct 17 13:33:05.677500 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-427121ca-be24-480b-b6c4-6719e4d5f8c7 req-04b9aa6d-1c8e-49d7-a628-e559095e253f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084677 Oct 17 13:33:05.680171 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2047/4056] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:05.690707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7040c59b-4b83-4bce-9192-667ebb56c843 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1546801559", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7040c59b-4b83-4bce-9192-667ebb56c843 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 492 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1546801559", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1546801559', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.705768 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7040c59b-4b83-4bce-9192-667ebb56c843 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:05.710754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7040c59b-4b83-4bce-9192-667ebb56c843 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023659 Oct 17 13:33:05.715802 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2048/4057] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:05 2022] POST /compute/v2.1/servers => generated 624 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:05.717113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:05.717113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.724767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.725308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.725745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.726729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.727355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.727954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.857445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:05.873298 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc63b280-a098-45e8-9401-737e3d4addef tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.444096 Oct 17 13:33:05.874671 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2010/4058] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:05 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:05.879659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:05.880199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:05.901052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.903153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.903876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:05.906604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:05.908809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:05.909475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.116579 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7516df4-6f5d-4b5f-8664-34559c4bdc63 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "POST /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621/action" status: 202 len: 0 microversion: 2.1 time: 0.239181 Oct 17 13:33:06.117870 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2011/4059] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:05 2022] POST /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:06.135577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:06.137585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:06.159771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.164346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.165769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.166544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.167020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.168236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.315434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.327824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0ca483c-aa80-4edc-9a6b-6ee98a0e093a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.615033 Oct 17 13:33:06.330291 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2049/4060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:05 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:06.336783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:06.338045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:06.347270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.348184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.348649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.349449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.350211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.350939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.400116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.410521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-442cb4be-9e8c-4ecd-9c5f-a0d83c5f8d47 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.285173 Oct 17 13:33:06.426439 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2012/4061] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:06 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:06.445432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:06.446834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:06.453862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.454577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.455282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.457045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.458034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.458634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.649607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.661382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-04fec11f-0a97-48d6-9a8b-ab09400b2cc8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1493 microversion: 2.1 time: 0.329701 Oct 17 13:33:06.670719 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2050/4062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:06 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1493 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:06.676431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:06.677226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:06.687232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.695935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.701948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.702796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.703701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.704306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.704877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.707403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.712575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:06.714335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a29a79c9-e7eb-4fff-9a06-46e1426cb0be tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.286388 Oct 17 13:33:06.715626 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2013/4063] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:06 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:06.721677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:06.722608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:06.730284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.731065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.733089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.734631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:06.735460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:06.736210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:06.996021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.000603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.008023 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-549517e4-612b-48b4-a724-9452ef33ef41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.335938 Oct 17 13:33:07.009104 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d585ceaf-7d46-4c86-a1dd-f6aee9ea0375 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.292156 Oct 17 13:33:07.009723 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2014/4064] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:06 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.011782 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2051/4065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:06 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.014806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.015565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.022844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.023488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.024060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.024940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.025559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.026138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.147543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07d0a7ec-c6c7-429b-a121-50cd9c6121be tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07d0a7ec-c6c7-429b-a121-50cd9c6121be tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 416 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.151952 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:07.155456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07d0a7ec-c6c7-429b-a121-50cd9c6121be tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:07.161542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07d0a7ec-c6c7-429b-a121-50cd9c6121be tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012149 Oct 17 13:33:07.166094 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2052/4066] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:07 2022] POST /compute/v2.1/servers => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:33:07.173254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.173996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.181987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.182593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.183125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.183950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.185352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.186215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.201070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.215231 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff9ddd74-18db-445a-bc5b-588c23fcb6e5 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.204281 Oct 17 13:33:07.229184 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2015/4067] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.358605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.363186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:07.370144 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c0063b1-2381-41f6-a041-f24dd1674ce1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.201237 Oct 17 13:33:07.371988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1459342352", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:07.376958 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2053/4068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.385312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.386257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.396494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.397288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.397829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.398804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.399422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.400194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.432277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:07.432828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:07.433479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:07.434013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:07.434674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:07.444557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.445558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.446379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.447365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.448563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.449084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.471118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Getting quotas for project b282ca0053594b0ea5ffe757a695b245. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:07.477520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Getting quotas for user f6d73e11d11f4ee5a1620602e4cc3ca8 and project b282ca0053594b0ea5ffe757a695b245. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:07.490973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:07.493963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:07.551665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.560511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96554197-4147-4783-b96f-12859783a589 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.181654 Oct 17 13:33:07.561667 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-47609f26-d7dc-4b0e-b86a-91b65ce1d641 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.337737 Oct 17 13:33:07.568456 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2016/4070] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:33:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 339 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:33:07.570050 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2054/4070] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.577495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4eec91d-bbd7-486a-9d53-065f13c1e2b5 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.578329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b4eec91d-bbd7-486a-9d53-065f13c1e2b5 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.584429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.585222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.592965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.593643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.594243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.595375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.597414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.597973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.629853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:07.659032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4eec91d-bbd7-486a-9d53-065f13c1e2b5 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.666772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=23 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:07.671966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4eec91d-bbd7-486a-9d53-065f13c1e2b5 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.673522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4eec91d-bbd7-486a-9d53-065f13c1e2b5 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.674783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4eec91d-bbd7-486a-9d53-065f13c1e2b5 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1278 microversion: 2.57 time: 0.103447 Oct 17 13:33:07.675402 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2055/4071] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:07.697786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.698694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.706013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.706782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.707334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.708134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.708720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.709278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.883462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.897974 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed1f3469-5bff-4e05-9e15-83e1b1017ca6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.334229 Oct 17 13:33:07.898576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2017/4072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.899633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:07.904399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-33a79165-93e8-4e00-a786-76adf84089a6 req-01fd4ed0-6379-4b42-aed1-3e7cf231c9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b4c131-aeca-40af-9e61-6014c8c16f02", "name": "network-vif-plugged", "status": "completed", "tag": "7b809b30-e58d-4a82-a66f-2fde13274130"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:07.927628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-33a79165-93e8-4e00-a786-76adf84089a6 req-01fd4ed0-6379-4b42-aed1-3e7cf231c9d1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.928116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-33a79165-93e8-4e00-a786-76adf84089a6 req-01fd4ed0-6379-4b42-aed1-3e7cf231c9d1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.928550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-33a79165-93e8-4e00-a786-76adf84089a6 req-01fd4ed0-6379-4b42-aed1-3e7cf231c9d1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.948483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-33a79165-93e8-4e00-a786-76adf84089a6 req-01fd4ed0-6379-4b42-aed1-3e7cf231c9d1 service nova] Creating event network-vif-plugged:7b809b30-e58d-4a82-a66f-2fde13274130 for instance e5b4c131-aeca-40af-9e61-6014c8c16f02 on n-h1-854121-14 Oct 17 13:33:07.954694 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-33a79165-93e8-4e00-a786-76adf84089a6 req-01fd4ed0-6379-4b42-aed1-3e7cf231c9d1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054926 Oct 17 13:33:07.955468 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2018/4073] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:07.959427 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02db73d9-900c-473f-ad0e-648cff149022 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1493 microversion: 2.1 time: 0.263676 Oct 17 13:33:07.960257 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2056/4074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1493 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:07.961639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:07.963172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:07.983991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.984754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.985365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:07.986255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:07.986887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:07.987463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.023717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e6ae550-ed40-4cfd-85f8-33a4d7f5fd3f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-476417084", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": -1, "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:08.041531 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-8e6ae550-ed40-4cfd-85f8-33a4d7f5fd3f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Flavor -1 could not be found. Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e6ae550-ed40-4cfd-85f8-33a4d7f5fd3f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 205 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-476417084", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": -1, "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor -1 could not be found. Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-476417084', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': -1, 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:08.046198 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 17 13:33:08.049367 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:08.053370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e6ae550-ed40-4cfd-85f8-33a4d7f5fd3f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:08.055326 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e6ae550-ed40-4cfd-85f8-33a4d7f5fd3f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.035938 Oct 17 13:33:08.056221 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2057/4075] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:08 2022] POST /compute/v2.1/servers => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:33:08.068648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:08.070339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:08.100848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.101857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.102544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.103636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.104290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.104953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.633747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:08.645190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:08.652929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:08.659939 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eaa7be68-21d3-4d8c-8b82-e8397b843ddf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1722 microversion: 2.20 time: 0.703116 Oct 17 13:33:08.660549 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2019/4076] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:07 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1722 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:08.678250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:08.681144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:08.690746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.691349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.691865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.692667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.693228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.693736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.720707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:08.732887 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ff13064-8471-4c5d-8401-b619786549ce tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1322 microversion: 2.1 time: 0.670038 Oct 17 13:33:08.733865 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2058/4077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:08 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:08.774803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:08.777107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:08.789653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.790311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.790844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.791648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.792374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.792957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.935342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:08.946076 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26e0d383-1106-4d42-b557-603ed88fbe42 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.271689 Oct 17 13:33:08.947303 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2020/4078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:08 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:08.952982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:08.953788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:08.969631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.970505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.971023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:08.972359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:08.973042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:08.973853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.024341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.033320 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eff861b4-4fd7-41a8-b8ba-149d37345c65 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.282537 Oct 17 13:33:09.038412 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2059/4079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:08 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:09.043574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:09.050780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:09.065570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.069005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.069942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.070850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.072836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.076772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.181476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:09.191779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.208273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.211282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.218529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.225067 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a022a909-76ce-4f05-9184-6301613c8a3e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1330 microversion: 2.57 time: 0.174232 Oct 17 13:33:09.231837 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2060/4080] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:09 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1330 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:09.234783 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aced75f6-777f-4c97-87c2-52e0cf79edf0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1322 microversion: 2.1 time: 0.281291 Oct 17 13:33:09.236435 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2021/4081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:08 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:09.241473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:09.242202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:09.250103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:09.251240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:09.254269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.255132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.255722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.256565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.257213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.257784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.265288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.271861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.273742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.275607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.276475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.279436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.738978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.751968 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eada8969-ff77-4a21-b41e-e71a5fdd36e0 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1493 microversion: 2.1 time: 0.510369 Oct 17 13:33:09.764045 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2022/4082] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:09 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1493 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:09.770150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:09.771037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:09.779704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.780790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.781655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.782636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.783365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.784215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.835254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:09.849068 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1fad49b-160d-4fea-a5ff-8b8204619c08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.611894 Oct 17 13:33:09.853598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2061/4083] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:09 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:09.884869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ea8b455b-a562-4cc2-9a62-f8fe65cc8add req-4d91cb8a-d312-4c77-abe6-8d59e70cfd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0c25bf-82d1-4082-b623-f7981dafbeb9", "tag": "d0e59ee1-ded3-4689-ba9b-c211523cd227"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:09.914347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:09.917040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea8b455b-a562-4cc2-9a62-f8fe65cc8add req-4d91cb8a-d312-4c77-abe6-8d59e70cfd75 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.917708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea8b455b-a562-4cc2-9a62-f8fe65cc8add req-4d91cb8a-d312-4c77-abe6-8d59e70cfd75 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.918291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea8b455b-a562-4cc2-9a62-f8fe65cc8add req-4d91cb8a-d312-4c77-abe6-8d59e70cfd75 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.953123 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ea8b455b-a562-4cc2-9a62-f8fe65cc8add req-4d91cb8a-d312-4c77-abe6-8d59e70cfd75 service nova] Creating event network-changed:d0e59ee1-ded3-4689-ba9b-c211523cd227 for instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 on n-h1-854121-14 Oct 17 13:33:09.959035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ea8b455b-a562-4cc2-9a62-f8fe65cc8add req-4d91cb8a-d312-4c77-abe6-8d59e70cfd75 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103878 Oct 17 13:33:09.959669 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2062/4084] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:09.971281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:09.972112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:09.979070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.979569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.980064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:09.981059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:09.982259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:09.983145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.064815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.076491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.085409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.088955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd4b66ad-e89b-44b7-82cd-eac575399a19 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1655 microversion: 2.20 time: 0.323390 Oct 17 13:33:10.090004 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2023/4085] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:09 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1655 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:10.095475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e4765a2-3c38-422a-a298-1880e2707ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-106050035", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e4765a2-3c38-422a-a298-1880e2707ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 172 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-106050035", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-106050035', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi -1 Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:10.099949 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 17 13:33:10.103812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.105768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e4765a2-3c38-422a-a298-1880e2707ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:10.106833 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e4765a2-3c38-422a-a298-1880e2707ee6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.015188 Oct 17 13:33:10.107892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2024/4086] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:10 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:10.115451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.116578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.125330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.125839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.126288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.127921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.128400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.129003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.341458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.350661 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7bfb975f-5888-43ac-a0df-5dd07a26ba71 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1472 microversion: 2.1 time: 0.389704 Oct 17 13:33:10.365186 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2063/4087] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:09 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:10.365186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.365186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.365186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.365567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.366033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.366941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.367402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.367993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.406035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.416136 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fea68a2-a6bb-4e2a-8f19-2af470857048 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.305939 Oct 17 13:33:10.417450 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2025/4088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:10.424055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.424897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.432407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.433204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.433837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.435602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.436461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.437084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.541071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.551762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.553490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.554905 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46d4a39d-d911-4edd-bab1-416b0358fe58 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1336 microversion: 2.57 time: 0.136250 Oct 17 13:33:10.555623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2026/4089] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1336 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:10.560429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.562408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.579087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.579594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.580550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.580895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.581366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.581801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.656513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.665003 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6fc3b981-42e7-456b-8e1a-2f8cc2e8fd8d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.312332 Oct 17 13:33:10.677344 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2064/4090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:10.854834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:10.869023 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b0d3333-8d17-4b6c-bb7d-3802ef26e313 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1515 microversion: 2.1 time: 0.312033 Oct 17 13:33:10.876597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2027/4091] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1515 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:10.887501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a9bc4b3-2d96-41c4-9172-ca9bdf51a59e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:10.888970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a9bc4b3-2d96-41c4-9172-ca9bdf51a59e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] [instance: 7457df49-9fb5-4638-b8d6-459c9a51270c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.896031 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4a9bc4b3-2d96-41c4-9172-ca9bdf51a59e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] HTTP exception thrown: Instance 7457df49-9fb5-4638-b8d6-459c9a51270c could not be found. Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a9bc4b3-2d96-41c4-9172-ca9bdf51a59e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Request method failure captured: Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/7457df49-9fb5-4638-b8d6-459c9a51270c/action HTTP/1.1 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 15 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl8zbcWYhTC3cBv4aCEfYQOXtBClAMZEapU0yWH_IPzc2PXfXKvunCgq9Uy9Zzls4Oz5zRrxkyCk7_xl_v1ulBkTVNOaEVhGhXpi09131XOQC7A_yia4jURIpYbrE91qw7p2VsHpQUGzuDss0qWlaQHAVXq5m33mX9b_SfUxlUf1o0 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4d78453bf59b4024be74aa36660aae3e Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: {"migrate": {}} Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 7457df49-9fb5-4638-b8d6-459c9a51270c could not be found. Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '7457df49-9fb5-4638-b8d6-459c9a51270c', 'body': {'migrate': {}}} Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7457df49-9fb5-4638-b8d6-459c9a51270c could not be found. Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7457df49-9fb5-4638-b8d6-459c9a51270c could not be found. Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.898001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:10.901928 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:10.901928 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:10.901928 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:10.901928 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:10.901928 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7457df49-9fb5-4638-b8d6-459c9a51270c could not be found. Oct 17 13:33:10.901928 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:10.904175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.905087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.913800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.914508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.915256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.916291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a9bc4b3-2d96-41c4-9172-ca9bdf51a59e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Returning 404 to user: Instance 7457df49-9fb5-4638-b8d6-459c9a51270c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:10.916816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.917639 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a9bc4b3-2d96-41c4-9172-ca9bdf51a59e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/7457df49-9fb5-4638-b8d6-459c9a51270c/action" status: 404 len: 111 microversion: 2.1 time: 0.250327 Oct 17 13:33:10.917957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.918542 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2065/4092] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:10 2022] POST /compute/v2.1/servers/7457df49-9fb5-4638-b8d6-459c9a51270c/action => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:10.930604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:10.930604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:10.933820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.942602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.946442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.948030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:10.948923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:10.954268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:10.957424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.246637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:11.260569 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b0a07c6-d911-4602-9b8f-bb758e58c77d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.368427 Oct 17 13:33:11.261203 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2028/4093] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:11.271930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:11.284158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:11.292771 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ab0fba9-3355-4050-a9a3-4402dd4ff8e9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1493 microversion: 2.1 time: 0.372457 Oct 17 13:33:11.294979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:11.295651 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2066/4094] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:10 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1493 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:11.312262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-473725787", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:11.328962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.332113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.332543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.338722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.339295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.339753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.404881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'flavor' on Instance uuid e5b4c131-aeca-40af-9e61-6014c8c16f02 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:11.405464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:11.542906 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19422f5b-1969-457a-8348-1a2e67371fa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action" status: 200 len: 32 microversion: 2.1 time: 0.278772 Oct 17 13:33:11.548125 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2029/4095] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:11 2022] POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:11.553045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:11.553794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:11.561542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.562036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.562484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.563229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.563691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.564123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.662128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.662738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.663198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.663668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lazy-loading 'fault' on Instance uuid 82e45827-89b8-402f-befe-a8cb5d7d1e7f {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:11.759959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:11.773770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:11.777867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:11.784371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd5e3bc4-2953-4e62-98d8-d4f3d0f2621a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 200 len: 1371 microversion: 2.20 time: 0.238517 Oct 17 13:33:11.785262 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2030/4096] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:11 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:11.819316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3671cee4-9e9d-41a4-85e0-2dc1a73f76bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1954021411", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:11.830232 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3671cee4-9e9d-41a4-85e0-2dc1a73f76bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3671cee4-9e9d-41a4-85e0-2dc1a73f76bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 216 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1954021411", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1954021411', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:11.832423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 17 13:33:11.835335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:11.838880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3671cee4-9e9d-41a4-85e0-2dc1a73f76bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:11.839962 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3671cee4-9e9d-41a4-85e0-2dc1a73f76bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.033097 Oct 17 13:33:11.841047 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2031/4097] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:11 2022] POST /compute/v2.1/servers => generated 123 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:11.852372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:11.853624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:11.862968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.864250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.864922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:11.865896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:11.866807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:11.867442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.007197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:12.008860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:12.009383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:12.009960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:12.010515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:12.026883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.027790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.028512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.029997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.030814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.031276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.052138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.062138 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8fd89c56-3da5-429c-a243-0292419918f2 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.215978 Oct 17 13:33:12.063143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2032/4098] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:11 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:12.069336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Getting quotas for project 5e2474d0067c4163a4bafc4fb6d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:12.074281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.074615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.081467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:12.083044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.083607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.084130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.084924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.086038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.086038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.087957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Getting quotas for user 1609ae0c03284de9ada5ec9a0ca651f0 and project 5e2474d0067c4163a4bafc4fb6d63cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:12.105621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:12.108864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:12.160377 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f90a9cdc-e961-45a8-9c76-3596dccca698 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863215 Oct 17 13:33:12.161145 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2067/4099] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:33:12.166383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.168156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.178058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.178552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.179190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.180181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.180423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.180852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.280810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.294416 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d87cc8c-e1d5-4c8d-a785-9da51093e56c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.229915 Oct 17 13:33:12.305243 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2033/4100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:12.310724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.311573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.318273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.318773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.319219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.319935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.320419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.325623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.339683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.368912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:12.378736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.381881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.383945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dab9093b-9952-4446-963f-6dc318315b05 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1336 microversion: 2.57 time: 0.221396 Oct 17 13:33:12.384920 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2068/4101] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1336 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:12.390992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e94ba4a3-5205-4548-9e46-ad02def5b6ad req-57588771-d9ac-451c-942a-782b49c0c28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e45827-89b8-402f-befe-a8cb5d7d1e7f", "name": "network-vif-deleted", "tag": "13ee2d57-56de-4573-8cfc-df1dd3b6017e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:12.423912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e94ba4a3-5205-4548-9e46-ad02def5b6ad req-57588771-d9ac-451c-942a-782b49c0c28d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.426626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e94ba4a3-5205-4548-9e46-ad02def5b6ad req-57588771-d9ac-451c-942a-782b49c0c28d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.427343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e94ba4a3-5205-4548-9e46-ad02def5b6ad req-57588771-d9ac-451c-942a-782b49c0c28d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.479103 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e94ba4a3-5205-4548-9e46-ad02def5b6ad req-57588771-d9ac-451c-942a-782b49c0c28d service nova] Creating event network-vif-deleted:13ee2d57-56de-4573-8cfc-df1dd3b6017e for instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f on n-h1-854121-14 Oct 17 13:33:12.498428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e94ba4a3-5205-4548-9e46-ad02def5b6ad req-57588771-d9ac-451c-942a-782b49c0c28d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108733 Oct 17 13:33:12.499245 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2069/4102] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:12.520196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0229e082-fbab-4b44-abb4-cd27a46da46a tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.520944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0229e082-fbab-4b44-abb4-cd27a46da46a tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.618469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.627613 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c445be9-32c7-4d86-a5ca-0ce249bc005b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.331018 Oct 17 13:33:12.641813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0229e082-fbab-4b44-abb4-cd27a46da46a tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.642556 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2034/4103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:12.649806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.650714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.664525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.664816 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0229e082-fbab-4b44-abb4-cd27a46da46a tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1221 microversion: 2.1 time: 0.162059 Oct 17 13:33:12.665058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.665609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.666337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.666801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.667233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.673572 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2070/4104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:12.678773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.679667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.688855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.689601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.690251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.691165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.692070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.692733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.947275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:12.959300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-710887ff-e3f4-466f-8e88-e3a61a6dd6a1 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1499 microversion: 2.1 time: 0.321017 Oct 17 13:33:12.959809 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2035/4105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1499 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:12.975105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:12.979436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:12.990770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.991590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.992069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:12.992854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:12.993352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:12.993924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.003384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:13.012443 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] HTTP exception thrown: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Request method failure captured: Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f HTTP/1.1 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjCBw7h_P3mKvp4spFDrMI71PuzaggJm7GSLgDW4OXVahCJakLHyMKheEuK3bYu4Of_GU7waQid8nNtGlg89P4cITe9Ji_mH72LxbO8bYB_8prp9zWqR53l9o_25u1wlslgJ7JBvnLDZgPiI2fr-rdjJwJCdS3QqJ7lMeB6snj86xY Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fa21bb7cfd2244a3ba5f0d3bdc41e437 Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '82e45827-89b8-402f-befe-a8cb5d7d1e7f'} Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.014367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Returning 404 to user: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-285767e4-9831-4f04-b0ea-24e4633d0db2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 404 len: 111 microversion: 2.20 time: 0.050197 Oct 17 13:33:13.021051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2036/4106] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:13.022854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.022854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:13.025798 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3dfa163-fd43-430c-95c6-2e6a53b91af6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.350323 Oct 17 13:33:13.029028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.029614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.031063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.031063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.031403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.031644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.037441 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2071/4107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:12 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:13.042764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65c732c4-f52f-463a-9749-b519903d9937 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '.version_select at 0x7f419e2e25e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.073284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:33:13.081230 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65c732c4-f52f-463a-9749-b519903d9937 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692010821" status: 204 len: 0 microversion: 2.20 time: 0.041345 Oct 17 13:33:13.082255 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2072/4108] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:33:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1692010821 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:33:13.109816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.110883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:13.124169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.134083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.134805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.138346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.140346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.145674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.200598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-014da871-4d47-40bd-84e0-cf4eabaa213a tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 204 len: 0 microversion: 2.1 time: 0.181085 Oct 17 13:33:13.201340 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2037/4109] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:13 2022] DELETE /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:33:13.208907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b3a534b-ae88-4630-ab84-bbe3b691424e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2054119003", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-key-68571190", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:13.270340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-3b3a534b-ae88-4630-ab84-bbe3b691424e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] validate_networks() for [('01e22cfe-9ea1-4a12-896c-16adb1ecc196', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:13.422189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:13.431764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4eef8cff-dbe9-41e9-bae4-2d30cb6fa819 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.347117 Oct 17 13:33:13.432568 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2073/4110] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:13 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:13.445642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.446288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:13.454838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.455332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.455943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.457008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.457642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.458203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.787225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3b3a534b-ae88-4630-ab84-bbe3b691424e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Invalid key_name provided. Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b3a534b-ae88-4630-ab84-bbe3b691424e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 245 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2054119003", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-key-68571190", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid key_name provided. Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2054119003', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'key_name': 'tempest-key-68571190', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-68571190 not found for user 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:13.790346 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 17 13:33:13.793364 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:13.798147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b3a534b-ae88-4630-ab84-bbe3b691424e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid key_name provided. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:13.799755 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b3a534b-ae88-4630-ab84-bbe3b691424e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.597256 Oct 17 13:33:13.801193 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2038/4111] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:13 2022] POST /compute/v2.1/servers => generated 70 bytes in 599 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 17 13:33:13.808419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.809250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:13.816571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:13.825917 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a4b2dd6-f572-44c6-aaa9-28b641afc59d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.391403 Oct 17 13:33:13.830782 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2074/4112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:13 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:13.842472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.842472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.842472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.842472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.842472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.842472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.847470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:13.851436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:13.861417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.863024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.863673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.865304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:13.867409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:13.868017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:13.993013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.015086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.021858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.023190 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-400aac37-1d7a-45f6-a0da-678b27989130 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1357 microversion: 2.57 time: 0.190727 Oct 17 13:33:14.023785 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2075/4113] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:13 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:14.035721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:14.036392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.052969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.053740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.054544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.055521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.056378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.057042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.143153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.151633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-944cae82-6852-4538-bf79-a707b9da9f89 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1217 microversion: 2.1 time: 0.126750 Oct 17 13:33:14.152550 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2076/4114] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:14 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1217 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:14.157817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:14.159460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.169303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.170154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.170497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.171222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.171672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.172154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.191804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.193906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:14.206603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0e63c4f-02e6-45d8-8fc5-d889e5b93a8c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.403968 Oct 17 13:33:14.207878 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2039/4115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:13 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:14.213365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:14.217498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.228781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.229655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.230326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.231848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.232430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.232870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.335071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:14.335298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:14.335789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:14.336328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:14.336757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:14.420180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.427615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.428694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.429175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.430322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.430710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.431151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.447776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.457410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cfd63c0d-f72b-41e4-adb2-4a0d1bfe747a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.303543 Oct 17 13:33:14.465955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2077/4116] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:14 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:14.465955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:14.465955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.467258 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2b0979d-704e-450f-b731-46ae81b714fe tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "POST /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784/action" status: 202 len: 1138 microversion: 2.57 time: 0.258009 Oct 17 13:33:14.481102 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2040/4117] 10.222.0.65 () {62 vars in 1320 bytes} [Mon Oct 17 13:33:14 2022] POST /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784/action => generated 1138 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:33:14.481854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.481854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.481854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.481854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.481854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.482210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.491823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c9bb090-f3ce-443d-87a0-a058dd08a562 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'create', calling method: .version_select at 0x7f41a2068dc0>, body: {"keypair": {"name": "tempest-keypair-1784670233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUnXLL35JhZ2AFEjM/afz3ODNl6BuAU/t+YMe/PBJkbomz4v0sa2NKUT4KIc7B9LiY/neZ+6BZ3gzESzWBkwMX79yWrZG0Eoh7eKVIOlyep0xvjrjE8aPC29YshftCtnQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:14.518419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=21 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:14.523626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4c9bb090-f3ce-443d-87a0-a058dd08a562 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for project f1c551f3219d4f78a100f1c60213c87a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:14.533278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4c9bb090-f3ce-443d-87a0-a058dd08a562 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for user fa21bb7cfd2244a3ba5f0d3bdc41e437 and project f1c551f3219d4f78a100f1c60213c87a. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:14.567806 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c9bb090-f3ce-443d-87a0-a058dd08a562 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.089602 Oct 17 13:33:14.568551 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2041/4118] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:33:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:33:14.574319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:14.575222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.583916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.585096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.585693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.586712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.587298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.587887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.948297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:14.957968 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97f50d6e-36c7-4794-aaa5-9a28b570918d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.498047 Oct 17 13:33:14.958562 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2078/4119] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:14 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:14.963531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:14.964187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:14.977365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.977850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.978450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:14.979171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:14.979594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:14.980097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.001844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.010878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27f36612-b2d4-4459-b63b-63f27afcb4a9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.441056 Oct 17 13:33:15.019835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2042/4120] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:14 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:15.019835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:15.019835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:15.023528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.024356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.024602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.025509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.025960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.026463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.110354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.119078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.120937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.122818 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-03fbbac0-74e7-418a-a279-26ff6a755881 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.163094 Oct 17 13:33:15.123415 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2079/4121] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:14 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:15.128367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29d77e44-3fac-4288-bf2e-23da8a07c240 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1311343637", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:15.365264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-29d77e44-3fac-4288-bf2e-23da8a07c240 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Neutron security group does_not_exist not found {{(pid=120698) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 17 13:33:15.366134 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-29d77e44-3fac-4288-bf2e-23da8a07c240 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29d77e44-3fac-4288-bf2e-23da8a07c240 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 258 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1311343637", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1311343637', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 17 13:33:15.379335 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 17 13:33:15.382570 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:15.391773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29d77e44-3fac-4288-bf2e-23da8a07c240 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:15.393261 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29d77e44-3fac-4288-bf2e-23da8a07c240 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.268616 Oct 17 13:33:15.394913 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2080/4122] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:15 2022] POST /compute/v2.1/servers => generated 106 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:15.404936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:15.410502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:15.426906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.427905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.428921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.429737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.430797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.431718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.462805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.476806 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-729f458f-8fe1-4800-a6a7-ae65e7f1d1f4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.464200 Oct 17 13:33:15.490046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2043/4123] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:15 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:15.496247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:15.497628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:15.504786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.505357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.506059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.506833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.507301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.507789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.878813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:15.887724 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e6509fe-c989-4f51-b68b-693419db86bd tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1217 microversion: 2.1 time: 0.490480 Oct 17 13:33:15.896582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2081/4124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:15 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1217 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:15.904983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:15.906216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:15.913403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.914054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.915037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:15.915224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:15.915880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:15.916304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.081477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.093223 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0feb0bc2-30dc-4c7a-9baf-c3e527eff5af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.601737 Oct 17 13:33:16.094155 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2044/4125] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:15 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:16.099514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:16.100441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:16.108562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.110086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.110891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.112010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.112881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.113521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.205421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.222455 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b5bc3596-9bb5-4cd9-af5d-522f7788ff17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.324623 Oct 17 13:33:16.223608 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2082/4126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:15 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:16.228434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:16.231139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:16.246421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.246990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.251848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.252825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.253505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.254095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.363330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.373092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.374642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.376250 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f31a90ca-15b1-4dc5-90b6-0dcd447198df tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.151442 Oct 17 13:33:16.377192 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2083/4127] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:16 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:16.381848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:16.382538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:16.384457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.390779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.391744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.392044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.393085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.393941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.394559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.408592 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a316407b-24d1-41e6-a890-4a2e63bae9af tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.312707 Oct 17 13:33:16.410157 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2045/4128] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:16 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:16.512742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:16.513403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:16.525431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.525967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.526413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.527140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.527580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.529851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.722202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.737905 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c1589749-271a-4ea5-b8b2-dcd6c0b14163 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.359815 Oct 17 13:33:16.738733 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2084/4129] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:16 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:16.745839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1170759913", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce425253-e80d-4938-9ad9-d53e5569ddc3"}], "security_groups": [{"name": "tempest-securitygroup--566168009"}], "key_name": "tempest-keypair-1784670233", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:16.894647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:16.907748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-519143d8-49c3-4531-9419-f04014b999f8 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 200 len: 1505 microversion: 2.1 time: 0.398913 Oct 17 13:33:16.908675 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2046/4130] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:16 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:16.914548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92fc272a-81c8-40ae-b581-179c98ed0044 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:16.915488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92fc272a-81c8-40ae-b581-179c98ed0044 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: d053da65-0a5a-4df0-8609-e30ec105be0f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:16.930950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-92fc272a-81c8-40ae-b581-179c98ed0044 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance d053da65-0a5a-4df0-8609-e30ec105be0f could not be found. Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92fc272a-81c8-40ae-b581-179c98ed0044 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/d053da65-0a5a-4df0-8609-e30ec105be0f HTTP/1.1 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d053da65-0a5a-4df0-8609-e30ec105be0f could not be found. Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd053da65-0a5a-4df0-8609-e30ec105be0f'} Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d053da65-0a5a-4df0-8609-e30ec105be0f could not be found. Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d053da65-0a5a-4df0-8609-e30ec105be0f could not be found. Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:16.932548 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d053da65-0a5a-4df0-8609-e30ec105be0f could not be found. Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92fc272a-81c8-40ae-b581-179c98ed0044 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance d053da65-0a5a-4df0-8609-e30ec105be0f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92fc272a-81c8-40ae-b581-179c98ed0044 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d053da65-0a5a-4df0-8609-e30ec105be0f" status: 404 len: 111 microversion: 2.1 time: 0.023803 Oct 17 13:33:16.937583 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2047/4131] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:16 2022] DELETE /compute/v2.1/servers/d053da65-0a5a-4df0-8609-e30ec105be0f => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:16.944298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b347c56a-9770-4f71-898d-d5f142ffe904 req-b253c047-e1ab-433e-85f3-630a6be2f527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0c25bf-82d1-4082-b623-f7981dafbeb9", "name": "network-vif-plugged", "status": "completed", "tag": "d0e59ee1-ded3-4689-ba9b-c211523cd227"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:16.956666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b347c56a-9770-4f71-898d-d5f142ffe904 req-b253c047-e1ab-433e-85f3-630a6be2f527 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:16.957149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b347c56a-9770-4f71-898d-d5f142ffe904 req-b253c047-e1ab-433e-85f3-630a6be2f527 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:16.957615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b347c56a-9770-4f71-898d-d5f142ffe904 req-b253c047-e1ab-433e-85f3-630a6be2f527 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:16.982370 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b347c56a-9770-4f71-898d-d5f142ffe904 req-b253c047-e1ab-433e-85f3-630a6be2f527 service nova] Creating event network-vif-plugged:d0e59ee1-ded3-4689-ba9b-c211523cd227 for instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 on n-h1-854121-14 Oct 17 13:33:16.993712 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b347c56a-9770-4f71-898d-d5f142ffe904 req-b253c047-e1ab-433e-85f3-630a6be2f527 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051013 Oct 17 13:33:16.997748 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2048/4132] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:17.004751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:17.005935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:17.007606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] validate_networks() for [('ce425253-e80d-4938-9ad9-d53e5569ddc3', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:17.016272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.017022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.018366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:17.019575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.020183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.021511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:17.184747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:17.193397 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7096b292-ddb0-493e-aee3-195b73cc2aa1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1273 microversion: 2.1 time: 0.194298 Oct 17 13:33:17.205635 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2049/4133] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:16 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:17.214831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:17.215716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:17.222370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.223136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.223837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:17.224745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.225415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.226011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:17.461133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:17.623054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:17.632572 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8589a429-7765-460e-a7ff-4799098a6b81 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.425502 Oct 17 13:33:17.633767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2050/4134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:17 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:17.641255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:17.643518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:17.650784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.651662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.652599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:17.654214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:17.654875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:17.662055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.071335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:18.082372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:18.090181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:18.090696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:18.091177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:18.091586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:18.091997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:18.099421 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af2c979e-c424-4760-8013-c6dbcee6926b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.463898 Oct 17 13:33:18.101900 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2051/4135] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:17 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:18.108737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:18.109379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:18.115103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.115462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.115931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.116668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.117077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.117689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.132783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.133319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.133760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.134473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.134911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.141361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.161991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for project f1c551f3219d4f78a100f1c60213c87a. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:18.177137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Getting quotas for user fa21bb7cfd2244a3ba5f0d3bdc41e437 and project f1c551f3219d4f78a100f1c60213c87a. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:18.195919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:18.201891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:18.228363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:18.238986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:18.240855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:18.242267 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f1ca7b5-3ea4-468b-aaf4-5d97d7c8070d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.137981 Oct 17 13:33:18.243271 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2052/4136] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:18 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:18.261598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:18.262574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:18.269375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.270126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.270705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.271599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.272192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.272759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.273623 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cbe763a-5cae-4dca-8263-1285f6715ca9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.533601 Oct 17 13:33:18.274788 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2085/4137] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:33:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:33:18.284439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:18.285192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:18.294737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.295787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.296660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.298237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.298932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.299509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.924430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:18.936846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0748251-17b4-44d9-85f8-9008ad3491ec tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.659652 Oct 17 13:33:18.958354 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2086/4138] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:18 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:18.964208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-419d01e4-6678-4874-abed-176e41e00651 req-d48c65a9-fd70-48d0-bad8-2e370a8ab5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a489911d-3fd0-4184-8d2a-c8ceae209621", "name": "network-vif-deleted", "tag": "64463c2d-7932-429c-831b-3c574b79973e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:18.979901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-419d01e4-6678-4874-abed-176e41e00651 req-d48c65a9-fd70-48d0-bad8-2e370a8ab5ad service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:18.980856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-419d01e4-6678-4874-abed-176e41e00651 req-d48c65a9-fd70-48d0-bad8-2e370a8ab5ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:18.982682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-419d01e4-6678-4874-abed-176e41e00651 req-d48c65a9-fd70-48d0-bad8-2e370a8ab5ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:18.998142 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-419d01e4-6678-4874-abed-176e41e00651 req-d48c65a9-fd70-48d0-bad8-2e370a8ab5ad service nova] Creating event network-vif-deleted:64463c2d-7932-429c-831b-3c574b79973e for instance a489911d-3fd0-4184-8d2a-c8ceae209621 on n-h2-854121-14 Oct 17 13:33:19.006512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-419d01e4-6678-4874-abed-176e41e00651 req-d48c65a9-fd70-48d0-bad8-2e370a8ab5ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046677 Oct 17 13:33:19.007759 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2087/4139] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:19.017118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.018116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: a489911d-3fd0-4184-8d2a-c8ceae209621] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.026937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.027585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.028950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.035205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.039869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.045652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.046943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca0ffde9-be02-40c9-8235-bb8f2c8f3d6d tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1351 microversion: 2.1 time: 0.802417 Oct 17 13:33:19.047765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.052472 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2053/4140] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:18 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1351 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:19.059943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.063368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.078586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.081439 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] HTTP exception thrown: Instance a489911d-3fd0-4184-8d2a-c8ceae209621 could not be found. Oct 17 13:33:19.082277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.082957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.083914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.085914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Request method failure captured: Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 HTTP/1.1 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVkEtqWvslvd6yv-JaNzl9XUVHCaoJVzXshHgOcUbiLB528j_N8CP9EASPxUwv2RizRNnFWZNvV30_dtO0HFEzHY-yS1RF8Qd54dhedeA-RanWghv1a4K-yFYtBV_tuBJk2KJCeXz2qs7AvB2yvwq732XmdcNvPqzPl9Je0e4DcBNO4 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: fd9375f00d234e46abc756b0c482e73f Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueTestJSON-1947191547 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueTestJSON-1947191547 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: fd9375f00d234e46abc756b0c482e73f Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueTestJSON-1947191547 Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueTestJSON-1947191547-project Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 55a415731f7c4b389e33a1e15388358b Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueTestJSON-1947191547-project Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance a489911d-3fd0-4184-8d2a-c8ceae209621 could not be found. Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a489911d-3fd0-4184-8d2a-c8ceae209621'} Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a489911d-3fd0-4184-8d2a-c8ceae209621 could not be found. Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a489911d-3fd0-4184-8d2a-c8ceae209621 could not be found. Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:19.087915 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a489911d-3fd0-4184-8d2a-c8ceae209621 could not be found. Oct 17 13:33:19.092125 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.094002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.097513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Returning 404 to user: Instance a489911d-3fd0-4184-8d2a-c8ceae209621 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:19.100664 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-814f5a11-2ddf-4e08-9162-c8f7506927eb tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621" status: 404 len: 111 microversion: 2.1 time: 0.091407 Oct 17 13:33:19.104322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2088/4141] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/a489911d-3fd0-4184-8d2a-c8ceae209621 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:19.117400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.118526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.133407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.136651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.138614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.141368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.142041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.143142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.292505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.302585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.304781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.306170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3ffa589-ef64-462f-9297-a103aee55ec8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1286 microversion: 2.20 time: 0.200635 Oct 17 13:33:19.307494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2089/4142] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:19.312538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b108b441-a1fa-408a-bffd-6c19029e445e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.313323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b108b441-a1fa-408a-bffd-6c19029e445e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:33:19.314038 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b108b441-a1fa-408a-bffd-6c19029e445e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b108b441-a1fa-408a-bffd-6c19029e445e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 9223372036854775808 could not be found. Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '9223372036854775808'} Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:19.315587 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b108b441-a1fa-408a-bffd-6c19029e445e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:19.320073 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b108b441-a1fa-408a-bffd-6c19029e445e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008296 Oct 17 13:33:19.321306 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2090/4143] 10.222.0.65 () {58 vars in 1188 bytes} [Mon Oct 17 13:33:19 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:19.327419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.328309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.335985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.336715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.337498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.338653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.352906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.354667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.419614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.420743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:33:19.442534 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d3806bf-12ce-4bc7-b469-19f82e9d0bba tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.388536 Oct 17 13:33:19.444318 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2054/4144] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:19.456899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.459324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.474321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.479496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.480484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.481625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.482613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.483334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.607182 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f213f921-f91c-4bb0-bc49-b934a48471c9 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 204 len: 0 microversion: 2.1 time: 0.283200 Oct 17 13:33:19.610000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2091/4145] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:19 2022] DELETE /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:33:19.618656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.619797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.628078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.629036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.629826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.630884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.631694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.632324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.757544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.787750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.805341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:19.807128 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f80a7d0e-8b64-4d9f-b72a-c945ce2b0a3c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.195574 Oct 17 13:33:19.808628 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2092/4146] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:19.815306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:19.816147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:19.822434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:19.824302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.824911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.828635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:19.839807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:19.844109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:19.847616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.052756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.071467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1388f56b-8244-4b34-846e-56351b01e928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.623938 Oct 17 13:33:20.088459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2055/4147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.088459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.088897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.107054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.107682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.108138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.108977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.109669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.110112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.353967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.363595 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ffa79046-e55b-42f5-9aac-a29b1aa71e96 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.552838 Oct 17 13:33:20.364412 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2093/4148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:19 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.369936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.371044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.386332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.387227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.387955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.389999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.390804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.391344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.410070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.423784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5beca620-784c-403b-8d79-5a0f3361a93d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1490 microversion: 2.1 time: 0.348578 Oct 17 13:33:20.436897 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2056/4149] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1490 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.436897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.436897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.443184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.443677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.444117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.445361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.445474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.446109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.561627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.571187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.572692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.573930 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c04d53dd-cbde-457e-b76b-883099e1ed20 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1334 microversion: 2.20 time: 0.147897 Oct 17 13:33:20.585187 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2057/4150] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1334 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:20.585187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.585187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.585964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.586594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.587089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.595210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.595210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.595210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.719686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.728157 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1464f421-7df8-4fed-b654-b7448c1ba15a tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1541 microversion: 2.1 time: 0.362517 Oct 17 13:33:20.741592 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2094/4151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1541 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.741592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.741592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.750930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.751430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.751871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.752957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.753035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.753458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.803166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:20.811391 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f565f437-e3ef-4187-82f3-45497e6c0916 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.235861 Oct 17 13:33:20.813211 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2058/4152] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:20.817285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:20.817785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:20.824158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.825195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.825622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:20.827347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:20.827347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:20.827347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.269282 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba7321d2-dba4-4f8c-b535-304dc1d32d35 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.455632 Oct 17 13:33:21.271568 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2059/4153] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9/os-interface => generated 284 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:21.284827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.286874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:21.300616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.303731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.305037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.305923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.307189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.307866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.308546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.320302 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d909f8f-1167-4f1c-959b-b529813736bf tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.585778 Oct 17 13:33:21.338526 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2095/4154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:20 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:21.343903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d93318d-44dc-44e2-99bf-fd1d636d8c41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.345291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d93318d-44dc-44e2-99bf-fd1d636d8c41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Failed to fetch instance by id -1 {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:33:21.345960 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3d93318d-44dc-44e2-99bf-fd1d636d8c41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance -1 could not be found. Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d93318d-44dc-44e2-99bf-fd1d636d8c41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance -1 could not be found. Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '-1'} Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:21.348553 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:21.352868 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:21.352868 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:21.352868 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 17 13:33:21.352868 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:21.354673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d93318d-44dc-44e2-99bf-fd1d636d8c41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:21.357036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d93318d-44dc-44e2-99bf-fd1d636d8c41 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.017180 Oct 17 13:33:21.358451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2096/4155] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:33:21 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:21.367004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1e670275-3775-41fc-b036-b0306ddf3cbc req-61ad23db-9f15-42d7-add6-1b5b6aa151c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6499be2a-ba66-45d8-a113-8097b13135dd", "tag": "0962a682-a069-4b8d-9ea9-64aa037d8435"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:21.379581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e670275-3775-41fc-b036-b0306ddf3cbc req-61ad23db-9f15-42d7-add6-1b5b6aa151c7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.380072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e670275-3775-41fc-b036-b0306ddf3cbc req-61ad23db-9f15-42d7-add6-1b5b6aa151c7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.380681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e670275-3775-41fc-b036-b0306ddf3cbc req-61ad23db-9f15-42d7-add6-1b5b6aa151c7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.389438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.392861 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1e670275-3775-41fc-b036-b0306ddf3cbc req-61ad23db-9f15-42d7-add6-1b5b6aa151c7 service nova] Creating event network-changed:0962a682-a069-4b8d-9ea9-64aa037d8435 for instance 6499be2a-ba66-45d8-a113-8097b13135dd on n-h2-854121-14 Oct 17 13:33:21.399910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.400366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1e670275-3775-41fc-b036-b0306ddf3cbc req-61ad23db-9f15-42d7-add6-1b5b6aa151c7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039792 Oct 17 13:33:21.402153 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2097/4156] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:21.402786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.404358 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fff9d727-44b5-40b1-b118-1ca8d1aac0ff tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.131444 Oct 17 13:33:21.405218 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2060/4157] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:21 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:21.410893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.412191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:21.419717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.420369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.420958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.421870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.422601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.423240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.423827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.424676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:21.439638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.440228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.442127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.442127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.442328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.442614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.451677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:21.647455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.660518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4544830-f148-4c39-81a9-c378bb42ac48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.253866 Oct 17 13:33:21.661121 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2061/4158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:21 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:21.665732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.668976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:21.676923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.677531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.684645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.685682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.686172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.686615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.715010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.725300 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-888773e1-2702-4774-9870-7d26b8a70e4f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.321380 Oct 17 13:33:21.726726 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2098/4159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:21 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:21.735931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.738825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:21.748728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.750204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.750890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.752241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.752886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.753514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.848576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.860789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.869813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.871544 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e98fe557-a9d0-4b61-af8f-8b36ff3f1f04 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1334 microversion: 2.20 time: 0.143348 Oct 17 13:33:21.872922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2099/4160] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:21 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:21.878522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:21.879178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:21.889098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.889098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.900665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.906485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:21.907043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:21.907500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:21.933613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:21.958370 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4ef134f-ecb8-4a2c-a83c-6253c905ed15 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1490 microversion: 2.1 time: 0.296143 Oct 17 13:33:21.978478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2062/4161] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:21 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1490 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:22.077857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.087737 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2628b5ea-4e97-4d69-9e2e-bf3a781247ad tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.212959 Oct 17 13:33:22.088687 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2100/4162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:21 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:22.111213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1b86b9f-4d83-435d-8e11-df40a935a5e5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:22.112062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1b86b9f-4d83-435d-8e11-df40a935a5e5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 576fe16f-41bf-4730-a83d-6477178b0120] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.119327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f1b86b9f-4d83-435d-8e11-df40a935a5e5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 576fe16f-41bf-4730-a83d-6477178b0120 could not be found. Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1b86b9f-4d83-435d-8e11-df40a935a5e5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/576fe16f-41bf-4730-a83d-6477178b0120/action HTTP/1.1 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 19 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: {"forceDelete": {}} Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 576fe16f-41bf-4730-a83d-6477178b0120 could not be found. Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '576fe16f-41bf-4730-a83d-6477178b0120', 'body': {'forceDelete': {}}} Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576fe16f-41bf-4730-a83d-6477178b0120 could not be found. Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576fe16f-41bf-4730-a83d-6477178b0120 could not be found. Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:22.127884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:22.131895 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:22.131895 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:22.131895 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576fe16f-41bf-4730-a83d-6477178b0120 could not be found. Oct 17 13:33:22.131895 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.131895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1b86b9f-4d83-435d-8e11-df40a935a5e5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 576fe16f-41bf-4730-a83d-6477178b0120 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:22.133084 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1b86b9f-4d83-435d-8e11-df40a935a5e5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/576fe16f-41bf-4730-a83d-6477178b0120/action" status: 404 len: 111 microversion: 2.1 time: 0.026213 Oct 17 13:33:22.133896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2063/4163] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:22 2022] POST /compute/v2.1/servers/576fe16f-41bf-4730-a83d-6477178b0120/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:33:22.144011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:22.145305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.153468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.155398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.155517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.156448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.156927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.157413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.344968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:22.345528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.349029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.365884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.366580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.366961 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b048f4d-7db6-438f-a80b-3565819e5266 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.221337 Oct 17 13:33:22.367700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.367948 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2101/4164] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:22.368862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.369363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.370094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.395405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:22.398100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.408035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.410103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.412693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.413953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.415204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.415922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.624485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.634964 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a491cec-cf0b-42e5-96c3-ffc4efb3ea6b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.294780 Oct 17 13:33:22.635660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2064/4165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:22 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:22.641414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.645887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:22.646858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.651007 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0952139c-f738-4193-b0c8-2fadf78cbc85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.261960 Oct 17 13:33:22.651939 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2102/4166] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:22.663063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.663603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.664055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.664861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.665295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.665688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.688553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08ff6627-1ae7-4c27-9dce-fa0655283a77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:22.691569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08ff6627-1ae7-4c27-9dce-fa0655283a77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 8963b47d-4883-494a-85ab-7b93d9496451] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.713635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-08ff6627-1ae7-4c27-9dce-fa0655283a77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 8963b47d-4883-494a-85ab-7b93d9496451 could not be found. Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08ff6627-1ae7-4c27-9dce-fa0655283a77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/8963b47d-4883-494a-85ab-7b93d9496451/action HTTP/1.1 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 39 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: {"os-getConsoleOutput": {"length": 10}} Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8963b47d-4883-494a-85ab-7b93d9496451 could not be found. Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8963b47d-4883-494a-85ab-7b93d9496451', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8963b47d-4883-494a-85ab-7b93d9496451 could not be found. Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8963b47d-4883-494a-85ab-7b93d9496451 could not be found. Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.735378 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8963b47d-4883-494a-85ab-7b93d9496451 could not be found. Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08ff6627-1ae7-4c27-9dce-fa0655283a77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 8963b47d-4883-494a-85ab-7b93d9496451 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08ff6627-1ae7-4c27-9dce-fa0655283a77 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/8963b47d-4883-494a-85ab-7b93d9496451/action" status: 404 len: 111 microversion: 2.1 time: 0.060654 Oct 17 13:33:22.738857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2103/4167] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:22 2022] POST /compute/v2.1/servers/8963b47d-4883-494a-85ab-7b93d9496451/action => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:22.753030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:22.754085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.764674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.765577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.766266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.767334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.768083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.768733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.783892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.801235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.802799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:22.814711 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49f86d94-2544-43c4-9642-514eae313b4f tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.174719 Oct 17 13:33:22.815808 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2065/4168] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:22 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:22.820617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:22.821252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:22.827795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.828397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.829016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:22.829767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:22.830284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:22.830776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.221146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.229518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b105ba43-90c0-47df-8b03-7cc31ab66212 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.412628 Oct 17 13:33:23.240354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2066/4169] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:22 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:23.253420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:23.255684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:23.272072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.272775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.273442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.274326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.275088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.275664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.369760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.380009 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4a779e9-87b3-49ce-aec1-eefba9ab8907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.639937 Oct 17 13:33:23.381387 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2104/4170] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:23.387990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:23.389322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:23.390696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.399189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.399986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.400606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.401486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.401899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.402530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.404058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.404278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.405886 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f184d56a-7acc-466f-803f-318ccd08e728 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1352 microversion: 2.20 time: 0.164321 Oct 17 13:33:23.406661 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2067/4171] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:23 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1352 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:23.412517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:23.413654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:23.422238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.423077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.423764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.424723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.425854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.426520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.727570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.733383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:23.738667 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7cf93d76-fd72-4564-aa89-d6dafef4646c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.330579 Oct 17 13:33:23.739600 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2068/4172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:23 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:23.745799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19c3fd6b-d45d-4cb5-834f-d8fdf1624189 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1490 microversion: 2.1 time: 0.362776 Oct 17 13:33:23.747509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:23.748138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:23.748487 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2105/4173] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:23 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1490 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:23.760476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.760975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.761447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.762765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.763635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.764325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.766184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbe82b64-e5ff-459e-9a75-16b430f4e907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:23.767213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbe82b64-e5ff-459e-9a75-16b430f4e907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: fdd281c5-542c-412f-8639-6a16ccb6bbd4] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:23.773403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-cbe82b64-e5ff-459e-9a75-16b430f4e907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance fdd281c5-542c-412f-8639-6a16ccb6bbd4 could not be found. Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbe82b64-e5ff-459e-9a75-16b430f4e907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/fdd281c5-542c-412f-8639-6a16ccb6bbd4 HTTP/1.1 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance fdd281c5-542c-412f-8639-6a16ccb6bbd4 could not be found. Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'fdd281c5-542c-412f-8639-6a16ccb6bbd4'} Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd281c5-542c-412f-8639-6a16ccb6bbd4 could not be found. Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd281c5-542c-412f-8639-6a16ccb6bbd4 could not be found. Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:23.774941 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd281c5-542c-412f-8639-6a16ccb6bbd4 could not be found. Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbe82b64-e5ff-459e-9a75-16b430f4e907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance fdd281c5-542c-412f-8639-6a16ccb6bbd4 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbe82b64-e5ff-459e-9a75-16b430f4e907 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/fdd281c5-542c-412f-8639-6a16ccb6bbd4" status: 404 len: 111 microversion: 2.1 time: 0.018036 Oct 17 13:33:23.778418 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2106/4174] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:23 2022] GET /compute/v2.1/servers/fdd281c5-542c-412f-8639-6a16ccb6bbd4 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:23.786122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:23.786822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:23.795371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.795974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.796484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:23.797295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:23.798068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:23.798617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.075160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.080426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:24.090864 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb4624b3-773e-4e5f-bfc5-6b43560525e4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.350115 Oct 17 13:33:24.091100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.095863 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2069/4175] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:23 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:24.113631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:24.114498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:24.121076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.122164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.122615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.123466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.123928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.124355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.125602 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2124a54a-02d3-4b21-b727-66360b9b13df tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.342478 Oct 17 13:33:24.127290 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2107/4176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:23 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:24.158375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:24.160679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:24.175357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.176184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.179407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.181346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.183131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.183817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.280067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.294440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.302232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.304216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd389991-ee20-4ab1-987f-cd7002fe4462 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.206286 Oct 17 13:33:24.305295 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2070/4177] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:24 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:24.311702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b0b44cd1-b0bb-460f-bbd3-579a36e1e7ed req-ab090719-aca3-4348-9e61-b7463d52e90b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0c25bf-82d1-4082-b623-f7981dafbeb9", "tag": "d0e59ee1-ded3-4689-ba9b-c211523cd227"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:24.323007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b0b44cd1-b0bb-460f-bbd3-579a36e1e7ed req-ab090719-aca3-4348-9e61-b7463d52e90b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.323932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b0b44cd1-b0bb-460f-bbd3-579a36e1e7ed req-ab090719-aca3-4348-9e61-b7463d52e90b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.324511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b0b44cd1-b0bb-460f-bbd3-579a36e1e7ed req-ab090719-aca3-4348-9e61-b7463d52e90b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.343940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b0b44cd1-b0bb-460f-bbd3-579a36e1e7ed req-ab090719-aca3-4348-9e61-b7463d52e90b service nova] Creating event network-changed:d0e59ee1-ded3-4689-ba9b-c211523cd227 for instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 on n-h1-854121-14 Oct 17 13:33:24.349857 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b0b44cd1-b0bb-460f-bbd3-579a36e1e7ed req-ab090719-aca3-4348-9e61-b7463d52e90b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043261 Oct 17 13:33:24.351150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2071/4178] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:24.357931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:24.358857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:24.368705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:24.371276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.372738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.373408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.374281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.374873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.375440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.547582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:24.583424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.599387 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17c9f822-950e-4a00-9e8e-d486abfbc677 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.445793 Oct 17 13:33:24.600493 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2108/4179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:24 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:24.611446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:24.612222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:24.641362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.641565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.643117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.643895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.647067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.647558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.767685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.781597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.790115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.795261 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f3af164-244b-47c6-b780-a1c99f166697 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.442611 Oct 17 13:33:24.797332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.798476 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2072/4180] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:24 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:24.800990 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de04e5a8-9ba4-4542-8456-29b279254e79 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1340 microversion: 2.20 time: 0.199320 Oct 17 13:33:24.804707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df63ef14-c4d2-41a9-aacf-664cc9f523c8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1665602923", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:24.818501 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2109/4181] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:24 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1340 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:24.830655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:24.831782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:24.838174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.838928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.839773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.841453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.842276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.842864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df63ef14-c4d2-41a9-aacf-664cc9f523c8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 238 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1665602923", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1665602923', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.862694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df63ef14-c4d2-41a9-aacf-664cc9f523c8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df63ef14-c4d2-41a9-aacf-664cc9f523c8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.064685 Oct 17 13:33:24.866341 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2073/4182] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:24 2022] POST /compute/v2.1/servers => generated 139 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:24.885287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:24.886381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:24.906845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.907713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.908368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.909385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:24.910060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:24.912959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:24.958212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:24.971477 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db7fb717-8a9e-4110-a5de-fdf0e03c6df6 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1448 microversion: 2.1 time: 0.151596 Oct 17 13:33:24.975156 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2110/4183] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:24 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:25.122044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:25.123736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:25.133469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.134241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.134840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.135905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.136776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.137977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.323754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:25.352418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8753e7f0-b656-429c-93a2-ed3224adbbe3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.483167 Oct 17 13:33:25.353657 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2074/4184] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:24 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:25.385254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:25.386459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:25.395356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.396084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.396700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.397662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.398268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.398842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.512014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:25.523634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:25.531799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:25.536509 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-86f591e3-0287-4de5-a8db-5029533a73ea tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.180674 Oct 17 13:33:25.538015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2075/4185] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:25 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:25.549584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:25.550361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:25.565212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.565865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.566424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.567277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.573679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.574325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.613050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:25.618668 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7a7c5c3-16fe-4bf7-ac31-7bcd837f0bde tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.502665 Oct 17 13:33:25.625385 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2111/4186] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:25 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:25.813585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:25.825289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:25.826380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:25.842450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.843074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed8c485e-f91f-4bb2-9650-9ca97d431e65 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.298690 Oct 17 13:33:25.843906 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2076/4187] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:25 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:25.846011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.846483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.847407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.847869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.848297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.857666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:25.858563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:25.880666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.881212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.881799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:25.882537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:25.882999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:25.883431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.136776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.146625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.148421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.150262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.152204 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-736b4622-156d-45da-bbb6-14064b7bc5f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.306612 Oct 17 13:33:26.165691 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2077/4188] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:25 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:26.168867 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f412caaa-7e8a-4251-b2e5-8fd735822c64 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.347040 Oct 17 13:33:26.170168 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2112/4189] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:25 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:26.176341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abdc10f8-23be-47e5-bc03-4c32951dcdac tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545792110", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:26.176628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.177545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abdc10f8-23be-47e5-bc03-4c32951dcdac tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 234 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-545792110", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-545792110', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.181681 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 17 13:33:26.186255 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.187850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.187850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.188114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.188688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.189569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.189766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abdc10f8-23be-47e5-bc03-4c32951dcdac tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:26.190005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.191610 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-abdc10f8-23be-47e5-bc03-4c32951dcdac tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.024211 Oct 17 13:33:26.192917 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2078/4190] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:26 2022] POST /compute/v2.1/servers => generated 133 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:26.201618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.202483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.211076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.211572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.212007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.213603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.214604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.215124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.234705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.235135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.235580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.236849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lazy-loading 'fault' on Instance uuid 8a644097-0001-4764-812e-210cc06b12a0 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:26.316900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.326157 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61c91fa8-1243-4d4b-82e8-ecec46b52ade tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1303 microversion: 2.1 time: 0.154719 Oct 17 13:33:26.327430 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2113/4191] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:26.411214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.428013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-53fb4154-bc04-4284-9053-39d8df03d60f req-802efc5c-723c-482b-99b1-8039929224c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a644097-0001-4764-812e-210cc06b12a0", "name": "network-vif-deleted", "tag": "fd196736-c92a-477c-8c68-b4161a19f8ab"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:26.438743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9d56e14-d210-48b5-8d39-baaa11ed15d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.240468 Oct 17 13:33:26.439487 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2079/4192] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:26.443662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-53fb4154-bc04-4284-9053-39d8df03d60f req-802efc5c-723c-482b-99b1-8039929224c5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.444143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-53fb4154-bc04-4284-9053-39d8df03d60f req-802efc5c-723c-482b-99b1-8039929224c5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.444815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-53fb4154-bc04-4284-9053-39d8df03d60f req-802efc5c-723c-482b-99b1-8039929224c5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.463355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-53fb4154-bc04-4284-9053-39d8df03d60f req-802efc5c-723c-482b-99b1-8039929224c5 service nova] Creating event network-vif-deleted:fd196736-c92a-477c-8c68-b4161a19f8ab for instance 8a644097-0001-4764-812e-210cc06b12a0 on n-h2-854121-14 Oct 17 13:33:26.464332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.464970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.472875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.473777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.474549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.475365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.476127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.476644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.476865 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-53fb4154-bc04-4284-9053-39d8df03d60f req-802efc5c-723c-482b-99b1-8039929224c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054321 Oct 17 13:33:26.477955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2114/4193] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:26.565318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.566029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.572580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.573084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.573545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.574245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.574892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.575380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.657130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.667500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.671689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.673616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.674825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e97da0df-9d42-4109-b487-f670a68ea0a0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.114609 Oct 17 13:33:26.675719 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2115/4194] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:26.680275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.680872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.685122 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77386986-7899-4a95-be16-475d5815b576 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.224329 Oct 17 13:33:26.686776 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2080/4195] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:26.686951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.687455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.687895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.688605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.689054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.689505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.711738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21ae2926-1d5a-4bb5-a31a-4ece2159d8d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:26.712546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21ae2926-1d5a-4bb5-a31a-4ece2159d8d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 306f0437-e711-40ae-9317-b80a0d9a551f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.718947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-21ae2926-1d5a-4bb5-a31a-4ece2159d8d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 306f0437-e711-40ae-9317-b80a0d9a551f could not be found. Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21ae2926-1d5a-4bb5-a31a-4ece2159d8d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/306f0437-e711-40ae-9317-b80a0d9a551f/action HTTP/1.1 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 13 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: {"pause": {}} Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 306f0437-e711-40ae-9317-b80a0d9a551f could not be found. Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '306f0437-e711-40ae-9317-b80a0d9a551f', 'body': {'pause': {}}} Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306f0437-e711-40ae-9317-b80a0d9a551f could not be found. Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306f0437-e711-40ae-9317-b80a0d9a551f could not be found. Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:26.730186 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:26.733733 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:26.733733 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:26.733733 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306f0437-e711-40ae-9317-b80a0d9a551f could not be found. Oct 17 13:33:26.733733 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:26.735827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21ae2926-1d5a-4bb5-a31a-4ece2159d8d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 306f0437-e711-40ae-9317-b80a0d9a551f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:26.736709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21ae2926-1d5a-4bb5-a31a-4ece2159d8d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/306f0437-e711-40ae-9317-b80a0d9a551f/action" status: 404 len: 111 microversion: 2.1 time: 0.029049 Oct 17 13:33:26.738225 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2081/4196] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:26 2022] POST /compute/v2.1/servers/306f0437-e711-40ae-9317-b80a0d9a551f/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:33:26.750426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.752468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.760099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.760943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.761661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.764202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.765189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.766544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.882274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.894244 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35380302-b0dd-4eaf-9fdb-262b3e316602 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.217368 Oct 17 13:33:26.894920 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2116/4197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:26.945099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:26.955817 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e0c97b1-0f54-4b17-be82-fe49d85d8363 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.210566 Oct 17 13:33:26.956404 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2082/4198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:26.979841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:26.981014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:26.987877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.988503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.989031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.989837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:26.990357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:26.990877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:26.995245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:27.138038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.146017 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69535aed-ffa4-4e65-aaa1-df06a171d0fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.170334 Oct 17 13:33:27.146839 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2117/4199] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:26 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:27.180043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:27.180633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.180743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:27.181267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.192722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.193249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.193690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.193857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.194418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.194506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.194794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.194887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.195243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.195510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.196170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.196784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.280999 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b46608eb-9ec7-455f-8a8e-e05c6aa88e18 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 202 len: 0 microversion: 2.1 time: 0.113598 Oct 17 13:33:27.285207 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2083/4200] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:27 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:27.292634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:27.293587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.301036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.301611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.302112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.302888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.303404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.303839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.527471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.536649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.538447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.539749 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96f46dd3-bb66-4769-873f-33a15d28ba2b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.363115 Oct 17 13:33:27.540729 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2118/4201] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:27.546080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:27.546785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.553486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.554228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.554751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.555537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.556105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.556607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.588325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.599880 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-005e742a-ea4d-4a18-a6aa-175c960c273d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.313332 Oct 17 13:33:27.600675 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2084/4202] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:27.605589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:27.607085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.613385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.614097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.614544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.615409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.616026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.616562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.673854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.674488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.674789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.675252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lazy-loading 'fault' on Instance uuid 8a644097-0001-4764-812e-210cc06b12a0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:27.790106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a415731f7c4b389e33a1e15388358b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd9375f00d234e46abc756b0c482e73f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.804024 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb769933-a24c-475e-b88e-2dda15f582e4 tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 200 len: 1303 microversion: 2.1 time: 0.202101 Oct 17 13:33:27.804622 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2085/4203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 1303 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:27.810245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:27.811155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.823726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.824331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.824806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.826088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.826621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.827250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.876062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.887077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8f86caf-38a3-4bab-b970-94e7c30af8d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1510 microversion: 2.1 time: 0.345104 Oct 17 13:33:27.888643 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2119/4204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1510 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:27.920523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:27.921178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:27.936637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.937147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.937620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.938564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:27.939041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:27.940580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:27.963376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.979032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.983775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:27.985302 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd53cd73-3da6-4502-94ce-6427cb2a093e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.179416 Oct 17 13:33:27.989497 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2086/4205] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:28.137786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.187018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=15 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:28.344923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:28.355078 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bed3cc13-0437-4317-b601-88c9b5e10a69 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.440071 Oct 17 13:33:28.356372 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2120/4206] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:27 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:28.568418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:28.569985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:28.577686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.578421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.579057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.580215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.580911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.581584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.630884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:28.631683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:28.650792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.651585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.652044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.653798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:28.654502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:28.654941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:28.990815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.001189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.003219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.003920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31dce129-fbd5-4816-9b07-6a7987b6926b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.440675 Oct 17 13:33:29.011421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2087/4207] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:28 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:29.020131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:29.021895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] [instance: 8a644097-0001-4764-812e-210cc06b12a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:29.030146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.030975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.032245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.033964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.036059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.036547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.039305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.052137 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ede19218-d407-44e3-adca-c4685c40dc65 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.424854 Oct 17 13:33:29.060256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] HTTP exception thrown: Instance 8a644097-0001-4764-812e-210cc06b12a0 could not be found. Oct 17 13:33:29.061581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2121/4208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:28 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Request method failure captured: Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 HTTP/1.1 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVkEtqWvslvd6yv-JaNzl9XUVHCaoJVzXshHgOcUbiLB528j_N8CP9EASPxUwv2RizRNnFWZNvV30_dtO0HFEzHY-yS1RF8Qd54dhedeA-RanWghv1a4K-yFYtBV_tuBJk2KJCeXz2qs7AvB2yvwq732XmdcNvPqzPl9Je0e4DcBNO4 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: fd9375f00d234e46abc756b0c482e73f Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueTestJSON-1947191547 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_fd9375f00d234e46abc756b0c482e73f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueTestJSON-1947191547 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: fd9375f00d234e46abc756b0c482e73f Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueTestJSON-1947191547 Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerRescueTestJSON-1947191547-project Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 55a415731f7c4b389e33a1e15388358b Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueTestJSON-1947191547-project Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 8a644097-0001-4764-812e-210cc06b12a0 could not be found. Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '8a644097-0001-4764-812e-210cc06b12a0'} Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a644097-0001-4764-812e-210cc06b12a0 could not be found. Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a644097-0001-4764-812e-210cc06b12a0 could not be found. Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:29.074195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a644097-0001-4764-812e-210cc06b12a0 could not be found. Oct 17 13:33:29.079523 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:29.079940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:29.079940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:29.083039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.083538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.083982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.084698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.085189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.085622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.089946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] Returning 404 to user: Instance 8a644097-0001-4764-812e-210cc06b12a0 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:29.090926 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0aa1a39b-b280-4a0f-acb0-a3aa77b7307d tempest-ServerRescueTestJSON-1947191547 tempest-ServerRescueTestJSON-1947191547-project] 10.222.0.65 "GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0" status: 404 len: 111 microversion: 2.1 time: 0.077071 Oct 17 13:33:29.091507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2088/4209] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:29 2022] GET /compute/v2.1/servers/8a644097-0001-4764-812e-210cc06b12a0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:29.096577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:29.097550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:29.116065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.116919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.117630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.118601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.119141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.119645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.145529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:29.247342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.260146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.263838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.265911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dad250bf-3675-4aa3-928c-5e3c116631bd tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.173007 Oct 17 13:33:29.266766 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2089/4210] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:29 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:29.381630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:29.382417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:29.389831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.390441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.390956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.391772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:29.392341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:29.393002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:29.959715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:29.975110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5966c48-cea0-4fca-9c55-b1c72997e00e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1490 microversion: 2.1 time: 0.912322 Oct 17 13:33:29.975977 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2122/4211] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:29 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1490 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:30.003552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.004092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:30.014062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.014454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.014943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.016413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.017095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.017688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.056512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:30.073905 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'pause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state paused Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 13 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: {"pause": {}} Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'pause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state paused Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'pause': {}}} Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state paused. Cannot pause while the instance is in this state. Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state paused Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:30.077188 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state paused Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'pause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state paused {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f071686-3316-42ca-9e9b-c49f65aa8c46 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 143 microversion: 2.1 time: 0.079959 Oct 17 13:33:30.081129 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2123/4212] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:29 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 143 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:30.086607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.087498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:30.095006 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb486153-76b1-435a-bcfc-353729d090e2 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.718246 Oct 17 13:33:30.095786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.096733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.097351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.098235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.098846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.099538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.119179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2090/4213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:29 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:30.131181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.132029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:30.155948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.161479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.162376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.163657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.166014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.170097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.714532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:30.747611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:30.751439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:30.765652 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce3fe004-3123-41f4-9830-ff9e7c852dd0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.682528 Oct 17 13:33:30.794848 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2124/4214] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:30.809336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:30.811274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.812110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:30.825384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.826021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.828471 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78ec6805-1458-4798-8260-9093de94fa49 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.706923 Oct 17 13:33:30.829117 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2091/4215] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:30.829943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.830989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.837345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.837805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.841326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-255a66af-d757-49a0-8d42-a017508e2aec req-4d80ce73-9b2b-464a-830d-1d1d2a53513f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:30.865926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-255a66af-d757-49a0-8d42-a017508e2aec req-4d80ce73-9b2b-464a-830d-1d1d2a53513f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.866688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-255a66af-d757-49a0-8d42-a017508e2aec req-4d80ce73-9b2b-464a-830d-1d1d2a53513f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.867228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-255a66af-d757-49a0-8d42-a017508e2aec req-4d80ce73-9b2b-464a-830d-1d1d2a53513f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.895808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-255a66af-d757-49a0-8d42-a017508e2aec req-4d80ce73-9b2b-464a-830d-1d1d2a53513f service nova] Creating event network-changed:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:33:30.908528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-255a66af-d757-49a0-8d42-a017508e2aec req-4d80ce73-9b2b-464a-830d-1d1d2a53513f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074410 Oct 17 13:33:30.909469 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2092/4216] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:30.915194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:30.920910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:30.932073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.933417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.934574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.935864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:30.938083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:30.938586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:30.971488 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7c5e4f9-bc08-4ac8-82ae-4382377e8dc2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 202 len: 0 microversion: 2.1 time: 0.166500 Oct 17 13:33:30.973564 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2125/4217] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:30 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:31.005053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.006686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:31.034160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.035489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.036343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.037766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.038868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.039513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.084459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.104510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.107218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.108583 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a64bafc-8bd3-444e-a09d-b60f2e59c094 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.197856 Oct 17 13:33:31.110158 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2093/4218] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:31.128212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.129132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:31.138654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.139512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.140192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.141219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.141851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.143047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.482697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.493057 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1df2e3fa-aaba-405c-ae76-714c560ae414 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1497 microversion: 2.1 time: 0.506416 Oct 17 13:33:31.510057 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2126/4219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:30 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1497 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:31.584147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:31.594452 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a04856b-471c-4c6a-8b19-3eba82984992 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.470438 Oct 17 13:33:31.595157 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2094/4220] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:31 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:31.820595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.821350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:31.829486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.829920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.830657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.831080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.831538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.831962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.864711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:31.864711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:31.880877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.881415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.881871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:31.882607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:31.883070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:31.883737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.200846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.226225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.236231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.237736 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad3df7f9-24c5-42bd-b79e-9c10cf479fb7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.422076 Oct 17 13:33:32.253913 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2127/4221] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:31 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:32.263518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-62225a5d-519a-4d4b-95da-817a72285592 req-966931bc-26a1-42f2-bf11-4c6401b5e2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6499be2a-ba66-45d8-a113-8097b13135dd", "name": "network-vif-plugged", "status": "completed", "tag": "0962a682-a069-4b8d-9ea9-64aa037d8435"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:32.281975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-62225a5d-519a-4d4b-95da-817a72285592 req-966931bc-26a1-42f2-bf11-4c6401b5e2f7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.282468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-62225a5d-519a-4d4b-95da-817a72285592 req-966931bc-26a1-42f2-bf11-4c6401b5e2f7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.283142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-62225a5d-519a-4d4b-95da-817a72285592 req-966931bc-26a1-42f2-bf11-4c6401b5e2f7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.303338 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-62225a5d-519a-4d4b-95da-817a72285592 req-966931bc-26a1-42f2-bf11-4c6401b5e2f7 service nova] Creating event network-vif-plugged:0962a682-a069-4b8d-9ea9-64aa037d8435 for instance 6499be2a-ba66-45d8-a113-8097b13135dd on n-h2-854121-14 Oct 17 13:33:32.309814 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-62225a5d-519a-4d4b-95da-817a72285592 req-966931bc-26a1-42f2-bf11-4c6401b5e2f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054181 Oct 17 13:33:32.311884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2128/4222] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:32.321597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:32.322771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:32.326635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.338346 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e7b27ca-5f2a-4534-9f6e-401454646af9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.483748 Oct 17 13:33:32.353277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.353277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.353277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.353277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.353277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.353277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.354589 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2095/4223] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:31 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:32.483667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.501071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.503965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.506139 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76ce114d-7cee-4f50-8e3a-edb6237b38a6 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.192329 Oct 17 13:33:32.507644 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2129/4224] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:32 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:32.520989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:32.521663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:32.531688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.532199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.532709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.533499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.534137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.534873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.628800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:32.628800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:32.640917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.641452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.641897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.642621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.643077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.643502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.875416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:32.884315 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30c75aea-9ce6-4539-ad17-2bf6cc557345 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.368126 Oct 17 13:33:32.910156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2096/4225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:32 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:32.917728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:32.918931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:32.926131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.927044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.927711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:32.928754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:32.929515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:32.930325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.064030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.077845 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3dd16b2d-5223-47cd-85c5-d086ed12023f tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.459054 Oct 17 13:33:33.084585 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2130/4226] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:32 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:33.224270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.242418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dab3a999-76f5-44b8-89bc-ca30672b4e33 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.330169 Oct 17 13:33:33.243618 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2097/4227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:32 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:33.269398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:33.272201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:33.273421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:33.274274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:33.281023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.281866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.282481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.283426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.284036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.284899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.285649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.286218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.286775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.287936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.288609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.289305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.302533 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e/action HTTP/1.1 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 28 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: {"reboot": {"type": "SOFT"}} Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ac32659d-2fef-4b01-a1f2-62a4478f719e', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:33.304524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:33.308679 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:33.311075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:33.312371 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8d8a6e2-7f4e-4b77-872c-47a0428da439 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e/action" status: 404 len: 111 microversion: 2.1 time: 0.049590 Oct 17 13:33:33.316992 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2131/4228] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:33 2022] POST /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:33.322638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:33.323489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:33.331141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.332177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.332772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.333684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.334293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.334873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.617878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.622513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.628043 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b9b8305-2058-4aec-a80b-91400571140e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.309664 Oct 17 13:33:33.628745 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2132/4229] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:33 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:33.635534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:33.636282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:33.643187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.643894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.644827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.645520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.645761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.646804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.655051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.657130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.658992 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e25bf85a-b419-44d9-8154-3be5c100f305 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.390312 Oct 17 13:33:33.673745 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2098/4230] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:33 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:33.693387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:33.694431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:33.704869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.705745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.706464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.707597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.708350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.709328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.841130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.852406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.854025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.855512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5133fa52-b042-4bba-afa7-4e91e94cb892 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.180264 Oct 17 13:33:33.856565 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2099/4231] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:33 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:33.861606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:33.862615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:33.870206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.871048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.872392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.873350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:33.874996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:33.875628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:33.944484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:33.956550 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24e4fa89-6ed6-4887-a02c-2927a7afa8e8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.326631 Oct 17 13:33:33.957989 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2133/4232] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:33 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:34.060977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:34.070246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1bd32064-1989-4771-a619-379468d92b6f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.212044 Oct 17 13:33:34.070821 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2100/4233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:33 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:34.096083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a96ad245-10a6-48b3-8a9a-f5ee1fc89781 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:34.099118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a96ad245-10a6-48b3-8a9a-f5ee1fc89781 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: c772a0d8-9933-4536-8b52-c6adeede6196] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:34.106070 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a96ad245-10a6-48b3-8a9a-f5ee1fc89781 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance c772a0d8-9933-4536-8b52-c6adeede6196 could not be found. Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a96ad245-10a6-48b3-8a9a-f5ee1fc89781 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/c772a0d8-9933-4536-8b52-c6adeede6196/action HTTP/1.1 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 28 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: {"reboot": {"type": "SOFT"}} Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance c772a0d8-9933-4536-8b52-c6adeede6196 could not be found. Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'c772a0d8-9933-4536-8b52-c6adeede6196', 'body': {'reboot': {'type': 'SOFT'}}} Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c772a0d8-9933-4536-8b52-c6adeede6196 could not be found. Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c772a0d8-9933-4536-8b52-c6adeede6196 could not be found. Oct 17 13:33:34.108490 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c772a0d8-9933-4536-8b52-c6adeede6196 could not be found. Oct 17 13:33:34.111816 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:34.112280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a96ad245-10a6-48b3-8a9a-f5ee1fc89781 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance c772a0d8-9933-4536-8b52-c6adeede6196 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:34.113147 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a96ad245-10a6-48b3-8a9a-f5ee1fc89781 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/c772a0d8-9933-4536-8b52-c6adeede6196/action" status: 404 len: 111 microversion: 2.1 time: 0.021413 Oct 17 13:33:34.117243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2134/4234] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:34 2022] POST /compute/v2.1/servers/c772a0d8-9933-4536-8b52-c6adeede6196/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:34.123127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.124083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:34.130928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.131798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.132511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.133775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.134521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.135170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.137933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.139424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:34.151952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.152358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.152833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.153962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.154420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.154850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.187802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:34.447433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:34.455616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:34.458934 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-efce3269-d31f-4b83-903a-0ceb4606b0c1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.344376 Oct 17 13:33:34.459540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2101/4235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:34.466119 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-911088f6-1509-4275-9744-ce96dd3c0859 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.344346 Oct 17 13:33:34.466699 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2135/4236] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:34.493076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.493737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:34.501566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.502068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.502514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.503226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.503687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.504116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.706297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:34.706929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:34.716268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.716772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.719918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:34.719918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:34.719918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:34.719918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.328754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.338166 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1439a3f8-ea87-45fb-8d21-99d965d74f25 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.849037 Oct 17 13:33:35.339269 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2102/4237] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:35.344928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.345761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:35.352123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.352799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.353415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.354303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.354917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.355501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.509175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.510133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.516993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.518714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.520008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3f5acb6-302f-4759-88c7-603719544ba7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.179656 Oct 17 13:33:35.520678 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2103/4238] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:35.523073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.524545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.526045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.526744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:35.530761 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-750021eb-9f5e-46ca-9e5d-0763ecfb03f8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.828304 Oct 17 13:33:35.533093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2136/4239] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:34 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:35.547594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:35.553217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:35.558424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.563722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.564065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.564647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.565045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.565767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.566061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.566430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.567134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.567460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.568302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.569261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.587983 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e/action HTTP/1.1 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 65 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ac32659d-2fef-4b01-a1f2-62a4478f719e', 'body': {'rebuild': {'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd'}}} Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:33:35.589886 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:33:35.594480 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:35.596552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:35.597805 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3dd3cd74-d7b3-4a45-94c4-7af882ce6025 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e/action" status: 404 len: 111 microversion: 2.1 time: 0.059044 Oct 17 13:33:35.604232 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2137/4240] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:35 2022] POST /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e/action => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:35.625963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:35.626756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:35.633420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.634175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.634836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.635744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:35.636418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:35.637659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:35.985725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.990772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:35.994263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbdce279-3fa7-41d7-bdd6-7ee409a068cb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.472317 Oct 17 13:33:35.996606 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2104/4241] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.007294 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d37f487-31de-454b-b545-76f399248e50 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1321 microversion: 2.1 time: 0.401795 Oct 17 13:33:36.007897 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2138/4242] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:35 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.017401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.019133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.035427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.035932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.036489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.037869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.038344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.038775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.417899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:36.444062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0be4ed1e-8a43-4104-a0b1-b05d4a0157fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.423154 Oct 17 13:33:36.455768 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2105/4243] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.472655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.473368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.490254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.490746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.491177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.492061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.492508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.493075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.549891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.552297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.563090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.563819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.564398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.565716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.566307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.566870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.717512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:36.727505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:36.737950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:36.739787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:36.741718 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5014e54-51ab-4cc7-a23f-8cd2b1c3444a tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.197075 Oct 17 13:33:36.755015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2106/4244] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:33:36.761711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.763772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.771632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.772423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.773813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.774762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.775409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.776025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.847524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:36.859408 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9768d5a2-9b2d-4b61-8de3-a0851f4be333 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.390654 Oct 17 13:33:36.860333 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2139/4245] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:36.892321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc885101-5f63-4bf1-9d0f-22adf7718741 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:36.895289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc885101-5f63-4bf1-9d0f-22adf7718741 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 796ae270-6153-44b0-a857-0265a420bd29] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.904155 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fc885101-5f63-4bf1-9d0f-22adf7718741 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 796ae270-6153-44b0-a857-0265a420bd29 could not be found. Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc885101-5f63-4bf1-9d0f-22adf7718741 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/796ae270-6153-44b0-a857-0265a420bd29/action HTTP/1.1 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 65 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 796ae270-6153-44b0-a857-0265a420bd29 could not be found. Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '796ae270-6153-44b0-a857-0265a420bd29', 'body': {'rebuild': {'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd'}}} Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796ae270-6153-44b0-a857-0265a420bd29 could not be found. Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 17 13:33:36.906209 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796ae270-6153-44b0-a857-0265a420bd29 could not be found. Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796ae270-6153-44b0-a857-0265a420bd29 could not be found. Oct 17 13:33:36.909651 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:36.912038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc885101-5f63-4bf1-9d0f-22adf7718741 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 796ae270-6153-44b0-a857-0265a420bd29 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:36.913445 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc885101-5f63-4bf1-9d0f-22adf7718741 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/796ae270-6153-44b0-a857-0265a420bd29/action" status: 404 len: 111 microversion: 2.1 time: 0.025433 Oct 17 13:33:36.918934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2140/4246] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:36 2022] POST /compute/v2.1/servers/796ae270-6153-44b0-a857-0265a420bd29/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:36.925080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:36.926981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:36.936060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.936861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.937532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:36.938464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:36.939108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:36.939909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.295520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.312039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.313804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.315186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b8ab70fd-e073-488d-bf78-5f40c16821db tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.558882 Oct 17 13:33:37.316324 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2107/4247] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:37.321133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.322205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:37.327015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.330791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.332095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.332966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.338062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52470c30-d5d8-4ddb-8381-1be441895f9f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.417715 Oct 17 13:33:37.338489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.338982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.339426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.339844 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2141/4248] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:36 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.345195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.346363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:37.351948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.352435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.353054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.353793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.354249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.354676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.667208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.680477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0072daca-afac-48af-9cec-457e91ed20f7 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.362901 Oct 17 13:33:37.681077 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2108/4249] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.694223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.696378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:37.706789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.707671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.708273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.708977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.709687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.710259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.720523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.729296 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-943d7ff6-28ef-45ac-93d8-c5eadcb63a41 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1471 microversion: 2.1 time: 0.387907 Oct 17 13:33:37.742291 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2142/4250] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.755722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:37.756580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:37.762516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:37.764346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.765065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.765805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.768676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.769557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.770280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.803071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lazy-loading 'flavor' on Instance uuid 6499be2a-ba66-45d8-a113-8097b13135dd {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:37.904167 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c89018dc-b08f-4bb7-b1ee-5a884f025c94 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd/action" status: 202 len: 0 microversion: 2.1 time: 0.153760 Oct 17 13:33:37.909192 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2143/4251] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:37 2022] POST /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:37.931201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.932298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:37.940489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:37.942197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.943054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.943660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.944547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.945096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.945990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.952436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40625e76-26a6-4802-90fa-da068a02d362 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.264709 Oct 17 13:33:37.953202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2109/4252] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:37.958518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:37.959554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:37.966881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.967802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.968494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:37.969446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:37.970196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:37.970880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.030459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.042705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.045853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.048156 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91ed3aff-2a99-4e61-8a38-f29d291f29d0 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.128334 Oct 17 13:33:38.058970 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2144/4253] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:38.071302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b30b5ffe-c111-491a-be13-b6d678c3ffd5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:38.072124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b30b5ffe-c111-491a-be13-b6d678c3ffd5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 18aaad53-d7ba-4468-9e5b-89f7e8c944b1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.079438 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b30b5ffe-c111-491a-be13-b6d678c3ffd5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 18aaad53-d7ba-4468-9e5b-89f7e8c944b1 could not be found. Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b30b5ffe-c111-491a-be13-b6d678c3ffd5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/18aaad53-d7ba-4468-9e5b-89f7e8c944b1/action HTTP/1.1 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 15 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: {"restore": {}} Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 18aaad53-d7ba-4468-9e5b-89f7e8c944b1 could not be found. Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '18aaad53-d7ba-4468-9e5b-89f7e8c944b1', 'body': {'restore': {}}} Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18aaad53-d7ba-4468-9e5b-89f7e8c944b1 could not be found. Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18aaad53-d7ba-4468-9e5b-89f7e8c944b1 could not be found. Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:38.081590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:38.085314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:38.085314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:38.085314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18aaad53-d7ba-4468-9e5b-89f7e8c944b1 could not be found. Oct 17 13:33:38.085314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.087062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b30b5ffe-c111-491a-be13-b6d678c3ffd5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 18aaad53-d7ba-4468-9e5b-89f7e8c944b1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:38.088136 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b30b5ffe-c111-491a-be13-b6d678c3ffd5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/18aaad53-d7ba-4468-9e5b-89f7e8c944b1/action" status: 404 len: 111 microversion: 2.1 time: 0.025514 Oct 17 13:33:38.089520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2145/4254] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:38 2022] POST /compute/v2.1/servers/18aaad53-d7ba-4468-9e5b-89f7e8c944b1/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:38.099132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:38.100152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.111012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.112259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.112904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.113866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.114515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.115374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.317777 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-418a4fd6-1a25-436d-9215-900856397452 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1632 microversion: 2.1 time: 0.362022 Oct 17 13:33:38.321778 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2110/4255] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:37 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1632 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:38.337310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a72b4541-1e76-4ac7-bd96-600809611eb0 req-468f12e1-54c4-4cdb-9676-f80ce4cdd80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "name": "network-vif-plugged", "status": "completed", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:38.343157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.352050 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-538035de-aa70-41c0-958c-f8a22f72c467 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.257370 Oct 17 13:33:38.353843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2146/4256] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:38 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:38.367080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:38.368301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.375609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.376475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.377130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.378300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.378911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.379488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.380324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a72b4541-1e76-4ac7-bd96-600809611eb0 req-468f12e1-54c4-4cdb-9676-f80ce4cdd80a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.380805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a72b4541-1e76-4ac7-bd96-600809611eb0 req-468f12e1-54c4-4cdb-9676-f80ce4cdd80a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.381969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a72b4541-1e76-4ac7-bd96-600809611eb0 req-468f12e1-54c4-4cdb-9676-f80ce4cdd80a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.395902 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a72b4541-1e76-4ac7-bd96-600809611eb0 req-468f12e1-54c4-4cdb-9676-f80ce4cdd80a service nova] Creating event network-vif-plugged:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:33:38.401101 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a72b4541-1e76-4ac7-bd96-600809611eb0 req-468f12e1-54c4-4cdb-9676-f80ce4cdd80a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077098 Oct 17 13:33:38.402058 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2111/4257] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:38.412119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:38.412830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.420772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.421298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.421743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.422450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.422907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.423456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.782934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.799636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.801925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.803854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93e19519-27f0-4811-8857-715b5f6a8f31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.448676 Oct 17 13:33:38.805188 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2147/4258] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:38 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:38.810341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:38.811039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.817206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.817965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.818636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.819582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.820246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.820888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.872605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:38.881926 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f145cfd-3bc0-48a8-8716-e3eaa0362f9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.478332 Oct 17 13:33:38.897193 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2112/4259] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:38 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:38.906581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:38.907387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.914366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.915262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.915902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.916814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.917453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.918045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.945829 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'restore' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 15 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: {"restore": {}} Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'restore' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'restore': {}}} Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state active. Cannot restore while the instance is in this state. Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:38.947605 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:38.952743 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:38.952743 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:38.952743 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:38.952743 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:38.952743 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:38.968020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'restore' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:38.968959 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e4265a5-4747-4946-803e-8fe5652d02e3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 145 microversion: 2.1 time: 0.067502 Oct 17 13:33:38.978287 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2113/4260] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:38 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 145 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:33:38.985512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:38.986462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:38.994229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.994874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.995386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:38.996989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:38.999007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:38.999602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.129193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:39.142586 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-273e97ff-7336-44a7-bf27-5f018252656d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.335865 Oct 17 13:33:39.143492 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2148/4261] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:38 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:39.148415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:39.149357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:39.156278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.157012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.157686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.158610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.159307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.160010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.255757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:39.263066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:39.268265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:39.270311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:39.271639 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0a394cb-5ce3-4fe5-a90f-ebb035fadd39 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.126947 Oct 17 13:33:39.273392 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8fc59e69-575d-468b-9c99-f11f4b6e6df5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.293352 Oct 17 13:33:39.274441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2114/4262] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:38 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:39.282298 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2149/4263] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:39 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:39.310487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:39.311111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:39.318335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.318930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.319553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.320340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.320874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.321404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.352732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:39.353592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:39.362878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.366856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.367254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:39.368196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:39.369314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:39.370438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.110360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:40.118796 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bfa39799-f26d-42a5-844b-d3bc2f3a6dff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.813554 Oct 17 13:33:40.119462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2115/4264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:39 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:40.134649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:40.134649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:40.143039 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c34c10d7-7775-49fd-a1f3-478df5eaae54 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1615 microversion: 2.1 time: 0.796513 Oct 17 13:33:40.143233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.144333 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2150/4265] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:39 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1615 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:40.147561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.148070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.148836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.149369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.152309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.171417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92c17820-d40a-43cf-8f11-ab51f7ccf070 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:40.171955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92c17820-d40a-43cf-8f11-ab51f7ccf070 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 7cd736a4-e1fb-480a-a82d-30437176d930] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:40.184166 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-92c17820-d40a-43cf-8f11-ab51f7ccf070 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 7cd736a4-e1fb-480a-a82d-30437176d930 could not be found. Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92c17820-d40a-43cf-8f11-ab51f7ccf070 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/7cd736a4-e1fb-480a-a82d-30437176d930/action HTTP/1.1 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 14 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: {"resume": {}} Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 7cd736a4-e1fb-480a-a82d-30437176d930 could not be found. Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '7cd736a4-e1fb-480a-a82d-30437176d930', 'body': {'resume': {}}} Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cd736a4-e1fb-480a-a82d-30437176d930 could not be found. Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cd736a4-e1fb-480a-a82d-30437176d930 could not be found. Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:40.193780 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:40.197314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:40.197314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:40.197314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cd736a4-e1fb-480a-a82d-30437176d930 could not be found. Oct 17 13:33:40.197314 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.201483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92c17820-d40a-43cf-8f11-ab51f7ccf070 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 7cd736a4-e1fb-480a-a82d-30437176d930 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:40.203907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92c17820-d40a-43cf-8f11-ab51f7ccf070 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/7cd736a4-e1fb-480a-a82d-30437176d930/action" status: 404 len: 111 microversion: 2.1 time: 0.059115 Oct 17 13:33:40.204847 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2151/4266] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:40 2022] POST /compute/v2.1/servers/7cd736a4-e1fb-480a-a82d-30437176d930/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:40.213386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:40.214193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:40.224886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.225443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.225885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.227882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.228349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.228777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.680529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:40.695907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:40.700190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:40.701689 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-edd408d4-2413-4531-a7cb-0050332fe88b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1407 microversion: 2.20 time: 0.581266 Oct 17 13:33:40.705441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2116/4267] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:40 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:40.715703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:40.722660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:40.734955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:40.750298 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ce9369e-fa09-468d-80b9-78f1c1bf3a1b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.544178 Oct 17 13:33:40.751149 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2152/4268] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:40 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:40.754570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.759427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.760246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.761355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.763190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.765249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.769741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:40.770425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:40.781776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.783394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.783854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.787553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:40.788053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:40.788596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:40.986990 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6499be2a-ba66-45d8-a113-8097b13135dd while it is in vm_state suspended Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Request method failure captured: Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd/action HTTP/1.1 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 15 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl8zbcWYhTC3cBv4aCEfYQOXtBClAMZEapU0yWH_IPzc2PXfXKvunCgq9Uy9Zzls4Oz5zRrxkyCk7_xl_v1ulBkTVNOaEVhGhXpi09131XOQC7A_yia4jURIpYbrE91qw7p2VsHpQUGzuDss0qWlaQHAVXq5m33mX9b_SfUxlUf1o0 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4d78453bf59b4024be74aa36660aae3e Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: {"migrate": {}} Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'migrate' instance 6499be2a-ba66-45d8-a113-8097b13135dd while it is in vm_state suspended Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '6499be2a-ba66-45d8-a113-8097b13135dd', 'body': {'migrate': {}}} Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6499be2a-ba66-45d8-a113-8097b13135dd in vm_state suspended. Cannot resize while the instance is in this state. Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:40.989704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6499be2a-ba66-45d8-a113-8097b13135dd while it is in vm_state suspended Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6499be2a-ba66-45d8-a113-8097b13135dd while it is in vm_state suspended Oct 17 13:33:40.993242 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:40.996915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Returning 409 to user: Cannot 'migrate' instance 6499be2a-ba66-45d8-a113-8097b13135dd while it is in vm_state suspended {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:40.998080 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40223d9f-cf3d-4c31-bc3e-8eb1dd07a7d0 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd/action" status: 409 len: 148 microversion: 2.1 time: 0.290301 Oct 17 13:33:40.999437 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2117/4269] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:40 2022] POST /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd/action => generated 148 bytes in 292 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:41.011389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:41.012853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:41.019650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.020360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.021070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.021942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.022557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.023131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.118126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:41.138028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:41.142093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:41.145199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d2ca2e6-6cf4-4390-a41b-1dad2dca3e34 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.144285 Oct 17 13:33:41.152940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:41.157844 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2118/4270] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:40 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:41.162740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c27c029a-173d-43f2-b20d-4850a8855a8e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c27c029a-173d-43f2-b20d-4850a8855a8e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Request method failure captured: Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27/action HTTP/1.1 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 39 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl8zbcWYhTC3cBv4aCEfYQOXtBClAMZEapU0yWH_IPzc2PXfXKvunCgq9Uy9Zzls4Oz5zRrxkyCk7_xl_v1ulBkTVNOaEVhGhXpi09131XOQC7A_yia4jURIpYbrE91qw7p2VsHpQUGzuDss0qWlaQHAVXq5m33mX9b_SfUxlUf1o0 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4d78453bf59b4024be74aa36660aae3e Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: {"os-resetState": {"state": "invalid"}} Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'invalid' Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:41.166387 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c27c029a-173d-43f2-b20d-4850a8855a8e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:41.171018 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c27c029a-173d-43f2-b20d-4850a8855a8e tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27/action" status: 400 len: 144 microversion: 2.1 time: 0.008925 Oct 17 13:33:41.173799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02bf23b3-8566-4d8e-bbd2-7298743cfc2d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.413882 Oct 17 13:33:41.175017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2153/4271] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:40 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:41.177835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2119/4272] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:41 2022] POST /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27/action => generated 144 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:41.190520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f865f2dd-191b-4b1c-8238-4fc4c154f258 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f865f2dd-191b-4b1c-8238-4fc4c154f258 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Request method failure captured: Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27/action HTTP/1.1 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 31 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl8zbcWYhTC3cBv4aCEfYQOXtBClAMZEapU0yWH_IPzc2PXfXKvunCgq9Uy9Zzls4Oz5zRrxkyCk7_xl_v1ulBkTVNOaEVhGhXpi09131XOQC7A_yia4jURIpYbrE91qw7p2VsHpQUGzuDss0qWlaQHAVXq5m33mX9b_SfUxlUf1o0 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4d78453bf59b4024be74aa36660aae3e Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: {"os-resetState": {"state": 1}} Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27', 'body': {'os-resetState': {'state': 1}}} Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi 1 Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:33:41.196498 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 17 13:33:41.200461 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.208310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:41.208481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f865f2dd-191b-4b1c-8238-4fc4c154f258 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:41.210042 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f865f2dd-191b-4b1c-8238-4fc4c154f258 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27/action" status: 400 len: 120 microversion: 2.1 time: 0.027892 Oct 17 13:33:41.210413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:41.211871 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2154/4273] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:41 2022] POST /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27/action => generated 120 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:41.218303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.219830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.223232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.224380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.225277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.225964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.236104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c03ff689-c0d0-459a-9b83-af9372e73898 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:41.239712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c03ff689-c0d0-459a-9b83-af9372e73898 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Failed to fetch instance by id 999 {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 17 13:33:41.240336 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c03ff689-c0d0-459a-9b83-af9372e73898 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c03ff689-c0d0-459a-9b83-af9372e73898 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Request method failure captured: Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 37 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl8zbcWYhTC3cBv4aCEfYQOXtBClAMZEapU0yWH_IPzc2PXfXKvunCgq9Uy9Zzls4Oz5zRrxkyCk7_xl_v1ulBkTVNOaEVhGhXpi09131XOQC7A_yia4jURIpYbrE91qw7p2VsHpQUGzuDss0qWlaQHAVXq5m33mX9b_SfUxlUf1o0 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Role: reader,member,admin Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: reader,member,admin Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1135223669ab4bdb9b6f93e8b92e9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1135223669ab4bdb9b6f93e8b92e9f15 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-481883228 Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4d78453bf59b4024be74aa36660aae3e Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-481883228-project-admin Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: {"os-resetState": {"state": "error"}} Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 999 could not be found. Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:41.247503 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:41.251457 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:41.251457 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 17 13:33:41.251457 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:41.251457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c03ff689-c0d0-459a-9b83-af9372e73898 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:41.251457 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c03ff689-c0d0-459a-9b83-af9372e73898 tempest-ServersAdminNegativeTestJSON-481883228 tempest-ServersAdminNegativeTestJSON-481883228-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.022996 Oct 17 13:33:41.251741 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2155/4274] 10.222.0.65 () {60 vars in 1179 bytes} [Mon Oct 17 13:33:41 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:41.272841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:41.273834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:41.286647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.288001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.288636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.289557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.290843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.291783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.297733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:41.335287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:33:41.489334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55fd7656-1494-421e-9df0-570d9b7e3c7e tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 204 len: 0 microversion: 2.1 time: 0.232876 Oct 17 13:33:41.490239 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2156/4275] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:41 2022] DELETE /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:33:41.502590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:41.503666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:41.511416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.512776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.513419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.514270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.514859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.515722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.706802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:41.737771 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e96c8778-7b07-4c09-a74c-c2ebe08622fd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.538287 Oct 17 13:33:41.754562 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2120/4276] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:41 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:41.754562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:41.754562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:41.769666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.771077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.771964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.775610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.776360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.777224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.917098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:41.958292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d3fd02b-51f5-48f4-8430-ec13b2b6b348 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1468 microversion: 2.1 time: 0.462558 Oct 17 13:33:41.976362 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2157/4277] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:41 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1468 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:41.984081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:41.984884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:41.992059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.992796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.993406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:41.994299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:41.994906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:41.995528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.023778 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'resume' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 14 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: {"resume": {}} Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'resume' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'resume': {}}} Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state active. Cannot resume while the instance is in this state. Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:42.025747 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:33:42.030512 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:42.033031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'resume' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:42.034130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9314c3c-491b-48b9-b936-fa69a0710ee5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 144 microversion: 2.1 time: 0.056313 Oct 17 13:33:42.035237 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2158/4278] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:41 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 144 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:42.040702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.041953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.050424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.052351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.053227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.055456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.057926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.059677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.126091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.140316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.141928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.143263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcc73576-e472-4b74-87ab-c20494794ab2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1599 microversion: 2.20 time: 0.400336 Oct 17 13:33:42.146419 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2121/4279] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:41 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1599 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:42.151817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.153406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.163422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.164256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.165046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.166243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.167033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.167637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.508854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.517736 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f26e28c1-5c47-48ab-a31f-cb9bff76fb61 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.481163 Oct 17 13:33:42.518513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2159/4280] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:42.538482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.538978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.546636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.547128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.547579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.548264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.548725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.549176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.573082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.586624 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6d34269-8edf-400d-841d-0937759f2bf2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.438702 Oct 17 13:33:42.588171 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2122/4281] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:42.595989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.597582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.610184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.610975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.611599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.612772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.614409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.615028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.678731 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc77cb8e-f91f-4c30-80c1-5cd8d41e0fd8 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.144265 Oct 17 13:33:42.679330 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2160/4282] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:33:42.684591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.694707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.703542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.704147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.709199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.709199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:42.709199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:42.709199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:42.780605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.789852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.795188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.798013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5eb1b15f-08bd-46a2-9c6c-7d022a0b3770 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.208316 Oct 17 13:33:42.809784 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2123/4283] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:42.937480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:42.947119 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd1f4613-1672-4bac-956b-0510878209ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.266587 Oct 17 13:33:42.969887 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2161/4284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:42.984126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:42.984755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:42.990298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:43.000112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.000618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.001072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.001873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.002338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.002775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.150250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-074cf9ec-7152-422b-9ad3-76687f69f2f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-074cf9ec-7152-422b-9ad3-76687f69f2f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 160 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": "", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "01e22cfe-9ea1-4a12-896c-16adb1ecc196"}]}} Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'server': {'name': '', 'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd', 'flavorRef': '452', 'networks': [{'uuid': '01e22cfe-9ea1-4a12-896c-16adb1ecc196'}]}}} Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi '' Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:33:43.154803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-074cf9ec-7152-422b-9ad3-76687f69f2f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-074cf9ec-7152-422b-9ad3-76687f69f2f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009990 Oct 17 13:33:43.158817 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2162/4285] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:43 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:33:43.164771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:43.165610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:43.174889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.175771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.176317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.177112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.177665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.178164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.364726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:43.382861 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-863f59ff-5204-48ed-9592-4248111404e7 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1468 microversion: 2.1 time: 0.403480 Oct 17 13:33:43.406116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2124/4286] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:42 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:43.492833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:43.543346 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8006ba8-d1d5-449d-b381-89bee7017b30 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.381482 Oct 17 13:33:43.544157 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2163/4287] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:43 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:43.546819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:43.547473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:43.556908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.558967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.560785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.565962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.567884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.570736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.571613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:43.572449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:43.581005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.581855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.582575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:43.583433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:43.584751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:43.585389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.490702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:44.499585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:44.503914 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-13e9afd1-db4b-4cb0-9392-b7b2c67f3f93 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.962008 Oct 17 13:33:44.519083 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2125/4288] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:43 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:44.529023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:44.531576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.532764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:44.540071 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c114c96c-eb15-4634-b192-5665a55e5955 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.972818 Oct 17 13:33:44.540677 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2164/4289] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:43 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:44.553464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.553720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:44.554786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.555443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.555993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.562349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.562629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.563187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.568810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.569336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.573996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.574918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.575396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.575813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.784708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:44.800256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:44.807975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:44.810114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e5c1ecde-757b-4d5b-a1a9-d4aff10b3908 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.285020 Oct 17 13:33:44.811253 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2126/4290] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:44.831692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b48ce10e-7e13-4dc5-b962-41c4daa0dce2 req-9dca8064-76e8-44ad-b9b1-1ba66b2e59eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:44.857209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b48ce10e-7e13-4dc5-b962-41c4daa0dce2 req-9dca8064-76e8-44ad-b9b1-1ba66b2e59eb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.858718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b48ce10e-7e13-4dc5-b962-41c4daa0dce2 req-9dca8064-76e8-44ad-b9b1-1ba66b2e59eb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.859337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b48ce10e-7e13-4dc5-b962-41c4daa0dce2 req-9dca8064-76e8-44ad-b9b1-1ba66b2e59eb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.901141 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b48ce10e-7e13-4dc5-b962-41c4daa0dce2 req-9dca8064-76e8-44ad-b9b1-1ba66b2e59eb service nova] Creating event network-changed:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:33:44.909051 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b48ce10e-7e13-4dc5-b962-41c4daa0dce2 req-9dca8064-76e8-44ad-b9b1-1ba66b2e59eb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094654 Oct 17 13:33:44.909051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2127/4291] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:44.913890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32a92610-1d28-4d20-8415-3e40f2ca3783 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:44.914520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-32a92610-1d28-4d20-8415-3e40f2ca3783 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: a6350ba8-5eb5-4a96-a63e-ae33614faaed] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:44.932399 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-32a92610-1d28-4d20-8415-3e40f2ca3783 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance a6350ba8-5eb5-4a96-a63e-ae33614faaed could not be found. Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32a92610-1d28-4d20-8415-3e40f2ca3783 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/a6350ba8-5eb5-4a96-a63e-ae33614faaed/action HTTP/1.1 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 14 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: {"shelve": {}} Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance a6350ba8-5eb5-4a96-a63e-ae33614faaed could not be found. Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a6350ba8-5eb5-4a96-a63e-ae33614faaed', 'body': {'shelve': {}}} Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6350ba8-5eb5-4a96-a63e-ae33614faaed could not be found. Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6350ba8-5eb5-4a96-a63e-ae33614faaed could not be found. Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:44.936856 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:44.941308 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:44.941308 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:44.941308 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6350ba8-5eb5-4a96-a63e-ae33614faaed could not be found. Oct 17 13:33:44.941308 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:44.941308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32a92610-1d28-4d20-8415-3e40f2ca3783 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance a6350ba8-5eb5-4a96-a63e-ae33614faaed could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:44.941308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32a92610-1d28-4d20-8415-3e40f2ca3783 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/a6350ba8-5eb5-4a96-a63e-ae33614faaed/action" status: 404 len: 111 microversion: 2.1 time: 0.029303 Oct 17 13:33:44.942293 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2128/4292] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:44 2022] POST /compute/v2.1/servers/a6350ba8-5eb5-4a96-a63e-ae33614faaed/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:44.956562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:44.957205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:44.971215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.971728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.972182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:44.972908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:44.973435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:44.973871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:45.165606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:45.174941 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6728150f-acb6-40df-bc55-93ca96a3f8e0 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1468 microversion: 2.1 time: 0.630949 Oct 17 13:33:45.181342 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2165/4293] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1468 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:45.476783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:45.497253 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8034591b-0e8f-4316-94b4-9d8af8658b6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.543585 Oct 17 13:33:45.498415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2129/4294] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:44 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:45.525414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:45.530507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:45.531143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:45.533741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:45.548580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:45.549088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:45.549572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:45.550305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:45.550774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:45.551210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:45.554742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:45.555246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:45.555691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:45.556408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:45.556871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:45.557345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.216892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:46.227255 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9b1eab5-fe30-47a3-ab14-8f23d338f4b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.705770 Oct 17 13:33:46.234293 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2166/4295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:45 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:46.244772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:46.250557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:46.266261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.267101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.267737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.269391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.270339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.271008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.339630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:46.367122 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e85452fe-ae17-4cae-8469-72425254e63e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.837927 Oct 17 13:33:46.369590 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2130/4296] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:45 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:46.395409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-427092fe-763a-4116-aa7d-6a42352bc221 req-66c875b1-b87a-4f18-9eb0-16a7ac6b4a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6499be2a-ba66-45d8-a113-8097b13135dd", "name": "network-vif-deleted", "tag": "0962a682-a069-4b8d-9ea9-64aa037d8435"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:46.418682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-427092fe-763a-4116-aa7d-6a42352bc221 req-66c875b1-b87a-4f18-9eb0-16a7ac6b4a03 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.419379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-427092fe-763a-4116-aa7d-6a42352bc221 req-66c875b1-b87a-4f18-9eb0-16a7ac6b4a03 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.420431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-427092fe-763a-4116-aa7d-6a42352bc221 req-66c875b1-b87a-4f18-9eb0-16a7ac6b4a03 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.454257 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-427092fe-763a-4116-aa7d-6a42352bc221 req-66c875b1-b87a-4f18-9eb0-16a7ac6b4a03 service nova] Creating event network-vif-deleted:0962a682-a069-4b8d-9ea9-64aa037d8435 for instance 6499be2a-ba66-45d8-a113-8097b13135dd on n-h2-854121-14 Oct 17 13:33:46.459083 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-427092fe-763a-4116-aa7d-6a42352bc221 req-66c875b1-b87a-4f18-9eb0-16a7ac6b4a03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082650 Oct 17 13:33:46.460458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2131/4297] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:46.482448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:46.487425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:46.489549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:46.497475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.499163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.499777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.500692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.503604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.504236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.506542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:46.521225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:46.522768 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd17e28b-371a-4686-b8d2-b30417a4c0c3 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1366 microversion: 2.57 time: 0.287223 Oct 17 13:33:46.537190 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2167/4298] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:46 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:46.537190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:46.537190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:46.537190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.547820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.548346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.549096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.549938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.550419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.587567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lazy-loading 'flavor' on Instance uuid 54c999d9-c3d1-435f-96f0-5505353369b8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:46.601632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.602133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.602576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.603039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lazy-loading 'fault' on Instance uuid 6499be2a-ba66-45d8-a113-8097b13135dd {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:46.667832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:46.684137 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-845ce54f-9fbc-4917-a99b-610e6bd659a1 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 200 len: 1311 microversion: 2.1 time: 0.222188 Oct 17 13:33:46.684752 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2132/4299] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:46 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:46.873364 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4f04568-18ad-4496-a3ca-09bc0098025d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 202 len: 0 microversion: 2.1 time: 0.348085 Oct 17 13:33:46.878460 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2168/4300] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:46 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:33:46.889479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:46.891650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:46.906377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.908102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.908565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:46.909345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:46.909809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:46.920623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.241391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:47.251210 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67c1dc02-813e-4f5e-a942-e251d21c2995 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.369317 Oct 17 13:33:47.252056 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2133/4301] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:46 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:47.395477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:47.396184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:47.404106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.404604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.405049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.405807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.407580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.408183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.554333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:47.555630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:47.564670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.565279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.565801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.566713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.567355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.568186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.671623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:47.684594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:47.686496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:47.688256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73163344-7158-4c7f-8b58-b0d36d4a576c tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1372 microversion: 2.57 time: 0.138029 Oct 17 13:33:47.689557 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2134/4302] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:47 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1372 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:33:47.713897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:47.715899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 6499be2a-ba66-45d8-a113-8097b13135dd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:47.719522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:47.724881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.725796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.726363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.727291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.727856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.728465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.733055 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cec194cc-86f3-4b3a-8868-d74a321444af tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.342210 Oct 17 13:33:47.733698 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2169/4303] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:47 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:47.746388 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] HTTP exception thrown: Instance 6499be2a-ba66-45d8-a113-8097b13135dd could not be found. Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Request method failure captured: Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd HTTP/1.1 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl6GXYjlFVC0zXvcqIZz4d6KcV_ozdsRVYexXFS7atIgIoSxcZhZzdgjtxn3VVFrL7OUcKIhyEfwS7Zpmom013-KvIVcxOMuYYWtfhvbL4bQqKm27ua4p3NYn3j-AM2gKpGrTMb2IQozq6rpsGXl307TsFAGqEc-eQXyFMLcfS6S0A Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 5e2474d0067c4163a4bafc4fb6d63cd8 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1152558100 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1152558100 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 5e2474d0067c4163a4bafc4fb6d63cd8 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1152558100 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdminNegativeTestJSON-1152558100-project Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 1609ae0c03284de9ada5ec9a0ca651f0 Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1152558100-project Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 6499be2a-ba66-45d8-a113-8097b13135dd could not be found. Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '6499be2a-ba66-45d8-a113-8097b13135dd'} Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6499be2a-ba66-45d8-a113-8097b13135dd could not be found. Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6499be2a-ba66-45d8-a113-8097b13135dd could not be found. Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:47.750110 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6499be2a-ba66-45d8-a113-8097b13135dd could not be found. Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Returning 404 to user: Instance 6499be2a-ba66-45d8-a113-8097b13135dd could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f39facee-fd59-4a39-b0ed-8bc5c5591337 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd" status: 404 len: 111 microversion: 2.1 time: 0.041218 Oct 17 13:33:47.754252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2135/4304] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:47 2022] GET /compute/v2.1/servers/6499be2a-ba66-45d8-a113-8097b13135dd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:33:47.769048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:47.769662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:47.778832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.779379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.779867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.780861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:47.781355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:47.781787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:47.826262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:33:47.836125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:48.008999 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96394785-a32d-411a-9989-f3e723390c7b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 204 len: 0 microversion: 2.1 time: 0.245141 Oct 17 13:33:48.010107 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2170/4305] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:33:47 2022] DELETE /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:33:48.019298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:48.020997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:48.028174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.029461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.029931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.030656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.031712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.032156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.269885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:48.276297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:48.277037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:48.280288 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-257a022c-5bb7-4a69-b07d-4268578aff1d tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1478 microversion: 2.1 time: 0.264008 Oct 17 13:33:48.282672 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2136/4306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:48 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1478 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:48.295753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.296682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.301619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.302633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.303270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.303964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.472645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:48.483479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c34a1a1e-b034-4111-b9f7-a97f34727848 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.211987 Oct 17 13:33:48.484809 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2171/4307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:48 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:48.497741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-296718576", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:48.559345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:48.719220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:48.719856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:48.727841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.727841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.728613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.729818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.731791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.732387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.889077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:48.906528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:48.908583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:48.910215 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae791914-f247-41e6-9e55-73c65a78bacb tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1372 microversion: 2.57 time: 0.198284 Oct 17 13:33:48.911332 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2172/4308] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:48 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:33:48.918773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:48.919790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:48.926689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.927529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.928179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:48.929115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:48.929863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:48.930517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.180406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:49.192758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cc11af6-97cf-49f1-8ff0-8ef8efc7b928 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1521 microversion: 2.1 time: 0.279619 Oct 17 13:33:49.207142 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2173/4309] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:48 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:49.221874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:49.222689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:49.223408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:49.224017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:49.224924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:49.239129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.239885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.240405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.241439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.241957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.242491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.264870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:49.271120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:49.286269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:49.289285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:49.311060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:49.311948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:49.318811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.319690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.320346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.321313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.321966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.322625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.370500 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-163a61cf-b640-4fa8-8e84-259fa12238fe tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071690 Oct 17 13:33:49.372454 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2137/4310] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:33:49.384961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c184c458-717e-4ddb-9d40-e0fb0fa1dd98 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:49.385660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c184c458-717e-4ddb-9d40-e0fb0fa1dd98 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:49.501143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c184c458-717e-4ddb-9d40-e0fb0fa1dd98 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:49.514230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c184c458-717e-4ddb-9d40-e0fb0fa1dd98 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1192 microversion: 2.1 time: 0.132234 Oct 17 13:33:49.526720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2138/4311] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:49 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1192 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:49.532579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:49.541144 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79647525-ee67-4f6c-9d60-f5d1202bff52 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1478 microversion: 2.1 time: 0.235782 Oct 17 13:33:49.542247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2174/4312] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:49 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:49.548638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:49.549439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:49.557555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.558056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.558559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.559537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.560138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.560431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.744096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:49.760077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28aa5780-49be-4851-be06-a1c75ae7b982 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.227142 Oct 17 13:33:49.762697 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2139/4313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:49 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:49.946864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:49.950705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:49.976071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.976974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.977702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:49.978805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:49.980455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:49.981689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.191507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.202187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.207886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.209125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb64fea4-3979-4b7f-b9c7-19eeb5bdb51d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1372 microversion: 2.57 time: 0.274054 Oct 17 13:33:50.209724 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2175/4314] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:49 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:50.227773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:50.228610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:50.263612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.264531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.266182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.266958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.267443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.271203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.531437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.541028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:50.541884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:50.558955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b77f2961-e685-4998-b41d-7cb411f3ef1c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1501 microversion: 2.1 time: 0.335973 Oct 17 13:33:50.561025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.562459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.562853 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2140/4315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:50 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1501 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:50.565115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.565879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.566342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.566770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.573039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:50.573808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:50.599385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.600251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.600938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.601974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.602627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.604130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.732452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.742607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d546ed2-897d-4b7f-b4a1-2278ddc5e3c4 tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1436 microversion: 2.1 time: 0.178109 Oct 17 13:33:50.743724 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2141/4316] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:50 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1436 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:50.750125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:50.752165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:50.766246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.766805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.767437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.768352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.769082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.769722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.830155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:50.843475 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cf8b918-9729-40f4-ad49-c9586a4219e6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1244 microversion: 2.1 time: 0.303950 Oct 17 13:33:50.846264 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2176/4317] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:50 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1244 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:50.870128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:50.870764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:50.906152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.906657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.908350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:50.909145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:50.912726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:50.913314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.206571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:51.229970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc1d1cac-2cab-495a-bbb0-b7a2c6659d32 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1516 microversion: 2.1 time: 0.472606 Oct 17 13:33:51.231241 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2142/4318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:50 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1516 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:51.254227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a7f83158-0818-46e1-be72-2316a7fa9b37 req-e3514bbc-5ddb-4747-97ea-3df95a4a8e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27", "name": "network-vif-deleted", "tag": "bbc503ca-3c00-4abf-aaf8-1675bcfaaee2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:51.265712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a7f83158-0818-46e1-be72-2316a7fa9b37 req-e3514bbc-5ddb-4747-97ea-3df95a4a8e76 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.266478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a7f83158-0818-46e1-be72-2316a7fa9b37 req-e3514bbc-5ddb-4747-97ea-3df95a4a8e76 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.267074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a7f83158-0818-46e1-be72-2316a7fa9b37 req-e3514bbc-5ddb-4747-97ea-3df95a4a8e76 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.271712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:51.282199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58706677-d3c8-4add-a72f-9b21ab8c628f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.434566 Oct 17 13:33:51.282424 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a7f83158-0818-46e1-be72-2316a7fa9b37 req-e3514bbc-5ddb-4747-97ea-3df95a4a8e76 service nova] Creating event network-vif-deleted:bbc503ca-3c00-4abf-aaf8-1675bcfaaee2 for instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 on n-h2-854121-14 Oct 17 13:33:51.288618 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a7f83158-0818-46e1-be72-2316a7fa9b37 req-e3514bbc-5ddb-4747-97ea-3df95a4a8e76 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041078 Oct 17 13:33:51.289929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2143/4319] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:51.299076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:51.300513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.303896 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2177/4320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:50 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:51.309548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.309777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45052cf7-44bf-42cb-9dc0-910c816396ff tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:51.310850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.311524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.312169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45052cf7-44bf-42cb-9dc0-910c816396ff tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: fa3f7717-d2e3-446a-870e-4f9565d45ad5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.312691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.313483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.314189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.318163 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-45052cf7-44bf-42cb-9dc0-910c816396ff tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Instance fa3f7717-d2e3-446a-870e-4f9565d45ad5 could not be found. Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45052cf7-44bf-42cb-9dc0-910c816396ff tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/fa3f7717-d2e3-446a-870e-4f9565d45ad5/action HTTP/1.1 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 14 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: {"rescue": {}} Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance fa3f7717-d2e3-446a-870e-4f9565d45ad5 could not be found. Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'fa3f7717-d2e3-446a-870e-4f9565d45ad5', 'body': {'rescue': {}}} Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3f7717-d2e3-446a-870e-4f9565d45ad5 could not be found. Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3f7717-d2e3-446a-870e-4f9565d45ad5 could not be found. Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:51.321423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:51.326636 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:51.326636 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:51.326636 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:51.326636 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:51.326636 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3f7717-d2e3-446a-870e-4f9565d45ad5 could not be found. Oct 17 13:33:51.326636 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:51.327972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45052cf7-44bf-42cb-9dc0-910c816396ff tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 404 to user: Instance fa3f7717-d2e3-446a-870e-4f9565d45ad5 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:51.329037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45052cf7-44bf-42cb-9dc0-910c816396ff tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/fa3f7717-d2e3-446a-870e-4f9565d45ad5/action" status: 404 len: 111 microversion: 2.1 time: 0.024090 Oct 17 13:33:51.330153 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2178/4321] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:51 2022] POST /compute/v2.1/servers/fa3f7717-d2e3-446a-870e-4f9565d45ad5/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:51.339410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:51.340058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.348006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.348493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.349122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.349842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.350647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.351288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.416452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:51.437946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:51.454194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:51.455813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8dd0e8c2-88c0-4838-8a7e-cbc0d0b29a0d tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1357 microversion: 2.57 time: 0.164411 Oct 17 13:33:51.460575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97b72da6-b402-4399-a039-26e306d36b43 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action" status: 202 len: 0 microversion: 2.1 time: 0.123168 Oct 17 13:33:51.464111 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2179/4322] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:51 2022] POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:51.471887 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2144/4323] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:51 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:51.474734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:51.475454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.493544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.494181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.495353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.497262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.497790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.498438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.502701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:51.505288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.531823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.532449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.534171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.536241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.536732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.551247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.644455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:33:51.760241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:51.824658 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8363fc9d-3e11-4b9c-b641-5cda07821820 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "DELETE /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 204 len: 0 microversion: 2.57 time: 0.332223 Oct 17 13:33:51.829078 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2145/4324] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:33:51 2022] DELETE /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:33:51.836457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:51.837762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:51.863102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.870031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.873850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.878852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.879820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.880459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.933399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:51.938669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:51.939935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:51.940655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lazy-loading 'fault' on Instance uuid 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:52.230573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1609ae0c03284de9ada5ec9a0ca651f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2474d0067c4163a4bafc4fb6d63cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.255308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-04534c6c-1e72-4db1-ba6f-abbb0560bd5c tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 200 len: 1312 microversion: 2.1 time: 0.424382 Oct 17 13:33:52.257977 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2146/4325] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:51 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 1312 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:52.274033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:52.276825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:52.298035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:52.304939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:52.305562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.307213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:52.307961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:52.308495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.378066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.388348 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29fb7db5-f658-4b24-b028-080bf274afe8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1521 microversion: 2.1 time: 0.922026 Oct 17 13:33:52.389057 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2180/4326] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:51 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:52.396111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:52.397363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.399829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:52.407876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.409432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.410620 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e571c4c8-c6f5-4472-a115-baeabe29d15e tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1363 microversion: 2.57 time: 0.150929 Oct 17 13:33:52.410945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:52.411554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:52.412017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.412857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:52.413499 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2147/4327] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:52 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:52.413620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:52.413761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.425269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:52.425903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:52.433235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:52.434265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:52.435021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.436384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:52.436384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:52.436666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:52.490886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.501097 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f518b13f-eadf-4743-a870-2fabd770b6bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1250 microversion: 2.1 time: 0.110915 Oct 17 13:33:52.502030 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2181/4328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:52 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1250 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:52.590017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:52.604453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e5a1034-b217-403c-be94-e0aa5e0ac3cf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.190108 Oct 17 13:33:52.606240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2148/4329] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:52 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:53.283726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:53.284389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] [instance: 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:53.295020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.295505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.295963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.296670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.297128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.297581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.353567 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] HTTP exception thrown: Instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 could not be found. Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Request method failure captured: Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 HTTP/1.1 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl6GXYjlFVC0zXvcqIZz4d6KcV_ozdsRVYexXFS7atIgIoSxcZhZzdgjtxn3VVFrL7OUcKIhyEfwS7Zpmom013-KvIVcxOMuYYWtfhvbL4bQqKm27ua4p3NYn3j-AM2gKpGrTMb2IQozq6rpsGXl307TsFAGqEc-eQXyFMLcfS6S0A Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 5e2474d0067c4163a4bafc4fb6d63cd8 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1152558100 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5e2474d0067c4163a4bafc4fb6d63cd8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1152558100 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 5e2474d0067c4163a4bafc4fb6d63cd8 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1152558100 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersAdminNegativeTestJSON-1152558100-project Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1609ae0c03284de9ada5ec9a0ca651f0 Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1152558100-project Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 could not be found. Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27'} Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 could not be found. Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 could not be found. Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:53.356438 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 could not be found. Oct 17 13:33:53.360530 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:53.364888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] Returning 404 to user: Instance 3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:53.365795 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5af32e1-9c01-4423-bcab-d083143a200b tempest-ServersAdminNegativeTestJSON-1152558100 tempest-ServersAdminNegativeTestJSON-1152558100-project] 10.222.0.65 "GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27" status: 404 len: 111 microversion: 2.1 time: 0.086203 Oct 17 13:33:53.371866 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2182/4330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:53 2022] GET /compute/v2.1/servers/3b8b6a0c-6f11-457a-a9ff-5b9e26a3bb27 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:33:53.415860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:53.417199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:53.426740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.427564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.428312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.429029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.429766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.430349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.441032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:53.442731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:53.452263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.455981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.458514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.459756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.462607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.463203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.636906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:53.648839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:53.657844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d73e11d11f4ee5a1620602e4cc3ca8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b282ca0053594b0ea5ffe757a695b245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:53.659784 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5dcdaa57-9d79-4260-923c-dcab06dce81b tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 200 len: 1363 microversion: 2.57 time: 0.222425 Oct 17 13:33:53.663180 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2183/4331] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:53 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:33:53.668964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:53.676182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:53.690937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.691607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.692230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.701495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.702177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.702661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.905252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:53.922503 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa84df1b-0b44-4c18-af06-bbe8dc026db2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1501 microversion: 2.1 time: 0.511612 Oct 17 13:33:53.922923 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2149/4332] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:53 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1501 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:53.928264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:53.928928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:53.935756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.936281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.936726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:53.937461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:53.938415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:53.938415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.102245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:54.113239 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32866e41-d0c0-4fa0-bba9-c2e2c633f6f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.447627 Oct 17 13:33:54.114345 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2184/4333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:53 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:54.119564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:54.124523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:54.131359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.132215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.133284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.134506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.135498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.136147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.164607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'flavor' on Instance uuid ebec799c-df30-4d3d-9947-9ab16c8365d0 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:54.181185 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Cannot 'rescue' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state paused Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action HTTP/1.1 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 14 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: {"rescue": {}} Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'rescue' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state paused Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ebec799c-df30-4d3d-9947-9ab16c8365d0', 'body': {'rescue': {}}} Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 in vm_state paused. Cannot rescue while the instance is in this state. Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state paused Oct 17 13:33:54.184157 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state paused Oct 17 13:33:54.187608 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.195157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 409 to user: Cannot 'rescue' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state paused {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:54.196072 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-99651bae-87c9-48b9-81b2-dc12d206e087 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action" status: 409 len: 144 microversion: 2.1 time: 0.080294 Oct 17 13:33:54.196684 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2185/4334] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:54 2022] POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action => generated 144 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:33:54.205896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:54.206434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:54.218566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.219564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.220219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.222273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.223022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.223694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.246815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:54.250275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:54.263699 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f905e762-8271-47dc-a9c6-faecf4604302 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.335411 Oct 17 13:33:54.264438 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2150/4335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:53 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:54.345697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5da9fef1-57ed-4fb9-963c-02bf565291d2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action" status: 202 len: 0 microversion: 2.1 time: 0.143732 Oct 17 13:33:54.365455 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2186/4336] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:54 2022] POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:33:54.372990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:54.373894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:54.394023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.395561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.397608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.398893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.400123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.401810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.670552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:54.691882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:54.692600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] [instance: 407c0bc0-b707-435f-8e30-07939cbf7784] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:54.698274 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db6d5e19-8825-4cc8-8818-c6431f26a0c6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1508 microversion: 2.1 time: 0.329544 Oct 17 13:33:54.700959 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2151/4337] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:54 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:54.719510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.720051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.724676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.725375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:54.725832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:54.726264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:54.743231 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] HTTP exception thrown: Instance 407c0bc0-b707-435f-8e30-07939cbf7784 could not be found. Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Request method failure captured: Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 HTTP/1.1 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVmSnhmzGA87E8u9_NJKBGNpdKOoXCc6ER_ycUf4t52ABEv7XnMIKoikxeajWMNPeEOlB1GoUpsn0ptH-7MJqBNzophZy_wVeD-pHhCbDMSD4jyGYiI5UKjzm_D0RGm9HIc6qI5W448sqJDQoUN6aN4HopmXi1UiZ6TxBRFfugRXkhs Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.57 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: b282ca0053594b0ea5ffe757a695b245 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerShowV257Test-836536599 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b282ca0053594b0ea5ffe757a695b245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b282ca0053594b0ea5ffe757a695b245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b282ca0053594b0ea5ffe757a695b245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b282ca0053594b0ea5ffe757a695b245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerShowV257Test-836536599 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: b282ca0053594b0ea5ffe757a695b245 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerShowV257Test-836536599 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerShowV257Test-836536599-project Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f6d73e11d11f4ee5a1620602e4cc3ca8 Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerShowV257Test-836536599-project Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 407c0bc0-b707-435f-8e30-07939cbf7784 could not be found. Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '407c0bc0-b707-435f-8e30-07939cbf7784'} Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 407c0bc0-b707-435f-8e30-07939cbf7784 could not be found. Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 407c0bc0-b707-435f-8e30-07939cbf7784 could not be found. Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:33:54.744909 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 407c0bc0-b707-435f-8e30-07939cbf7784 could not be found. Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] Returning 404 to user: Instance 407c0bc0-b707-435f-8e30-07939cbf7784 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:33:54.752269 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9ab3240-3ea0-42fe-82a2-0fa6837c75b7 tempest-ServerShowV257Test-836536599 tempest-ServerShowV257Test-836536599-project] 10.222.0.65 "GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784" status: 404 len: 111 microversion: 2.57 time: 0.060134 Oct 17 13:33:54.763732 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2187/4338] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:33:54 2022] GET /compute/v2.1/servers/407c0bc0-b707-435f-8e30-07939cbf7784 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:33:55.090729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b7724c20-d989-4158-a86d-99438f057c28 req-fc205262-39fc-4df0-b713-89938b97972c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f789d693-646c-483d-9ae4-fe5988d5c4c3", "tag": "90ab39cc-bbab-4ab6-a004-eae44b430694"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:55.117764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7724c20-d989-4158-a86d-99438f057c28 req-fc205262-39fc-4df0-b713-89938b97972c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.118654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7724c20-d989-4158-a86d-99438f057c28 req-fc205262-39fc-4df0-b713-89938b97972c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.119391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7724c20-d989-4158-a86d-99438f057c28 req-fc205262-39fc-4df0-b713-89938b97972c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:55.135469 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b7724c20-d989-4158-a86d-99438f057c28 req-fc205262-39fc-4df0-b713-89938b97972c service nova] Creating event network-changed:90ab39cc-bbab-4ab6-a004-eae44b430694 for instance f789d693-646c-483d-9ae4-fe5988d5c4c3 on n-h2-854121-14 Oct 17 13:33:55.144189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.145385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:55.169448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.172235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b7724c20-d989-4158-a86d-99438f057c28 req-fc205262-39fc-4df0-b713-89938b97972c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092281 Oct 17 13:33:55.173794 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2152/4339] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:55.178399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.179217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:55.180197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.180925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.191191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:55.289760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.290587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:55.309544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.312629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.315675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:55.316752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.317444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.318066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:55.587012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:55.595450 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae89c71b-2d24-419f-83e2-9a7992f1ffa5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.458149 Oct 17 13:33:55.596027 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2188/4340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:55.733862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:55.735411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:55.736003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:55.745490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.745694 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fdb20d0-08d2-4091-b93a-9a5593794ba1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.461370 Oct 17 13:33:55.746789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2153/4341] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:55.747434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.747875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:55.748625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:55.749080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:55.749605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.099682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:56.113969 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a05d29de-aac7-4f41-89f4-8d995c72dc9a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1516 microversion: 2.1 time: 0.391805 Oct 17 13:33:56.114764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2189/4342] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:55 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1516 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:56.623676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:56.624671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:56.647978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.651349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.651828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.653661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.654133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.654573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.772956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:56.777574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:56.786108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:56.810533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.813610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.814782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:56.815840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:56.816496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:56.817217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:57.088057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:57.098062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-369685af-6f6d-444d-9f1c-536fa0178ec9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.479703 Oct 17 13:33:57.099182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2154/4343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:56 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:57.123856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:57.133135 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b7e2c69-cfc9-4c2c-aaf0-9f8db5a7e3bd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.365201 Oct 17 13:33:57.134444 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2190/4344] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:56 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:33:58.107951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-207e2533-99a3-4b40-8b29-af776797be4c tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Action: 'create', calling method: .version_select at 0x7f419cd2f1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1064119004"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.124839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-227352610", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:58.185303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:33:58.422516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:33:58.422949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:33:58.423448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:33:58.423807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:33:58.424244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:33:58.434847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.435436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.435876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.436694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.437150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.437605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.471359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:33:58.483310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:33:58.512155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:33:58.514816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:33:58.530379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:33:58.539777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-207e2533-99a3-4b40-8b29-af776797be4c tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.506731 Oct 17 13:33:58.540748 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2191/4345] 10.222.0.65 () {60 vars in 1155 bytes} [Mon Oct 17 13:33:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 510 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 17 13:33:58.546925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.547991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:58.560762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.561756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.561871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.562635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.563351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.563963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.586990 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-397eb280-16ab-44c4-85d0-13e39f4e76f7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837519 Oct 17 13:33:58.593404 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2155/4346] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:33:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:33:58.601441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:58.602548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:58.619290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.620090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.620751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.622282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:58.622935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:58.623696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:58.956548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:58.969839 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88817dd4-460b-4834-8c97-77e3787a3fe7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.427538 Oct 17 13:33:58.970530 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2192/4347] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:58.975287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6fa6ed20-5550-4a26-99d5-cf6e8c2ecddd tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419cd33b80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:59.036869 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6fa6ed20-5550-4a26-99d5-cf6e8c2ecddd tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 200 len: 345 microversion: 2.1 time: 0.065082 Oct 17 13:33:59.037660 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2193/4348] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:33:59.042337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15baed27-01f4-4ec6-bd0d-f686151c6794 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:59.043146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15baed27-01f4-4ec6-bd0d-f686151c6794 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:59.151375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15baed27-01f4-4ec6-bd0d-f686151c6794 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:59.157041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:59.165607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-478a0c47-fe02-4ada-a509-49d60341fc34 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.570721 Oct 17 13:33:59.167862 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15baed27-01f4-4ec6-bd0d-f686151c6794 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1216 microversion: 2.1 time: 0.128962 Oct 17 13:33:59.181622 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2194/4349] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:59 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1216 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:59.182523 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2156/4350] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:58 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:33:59.189373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:33:59.191830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:59.206077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:59.206275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:59.206788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:59.207500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:59.207955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:59.208383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:59.254897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'flavor' on Instance uuid ebec799c-df30-4d3d-9947-9ab16c8365d0 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:33:59.453015 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48ba71ed-0b81-441c-9364-33d22a392bdd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action" status: 200 len: 32 microversion: 2.1 time: 0.249123 Oct 17 13:33:59.455262 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2195/4351] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:33:59 2022] POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action => generated 32 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:33:59.465004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:33:59.466009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:33:59.475814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:59.479713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:59.481040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:59.482238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:33:59.482927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:33:59.485517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:33:59.877740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:33:59.886245 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d09a933-6038-4ee8-a8ca-36a07d1fc217 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.425593 Oct 17 13:33:59.908942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2157/4352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:59 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:00.002971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.002971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:00.015740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.016239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.016700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.018009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.018976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.029397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.055457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-245ccda0-56c4-40f8-998c-2646329bf252 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f41a21040d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.223562 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-245ccda0-56c4-40f8-998c-2646329bf252 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 200 len: 346 microversion: 2.1 time: 0.174916 Oct 17 13:34:00.226148 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2158/4353] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:34:00 2022] GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:00.233834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.234747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:00.245997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.247326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.247920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.248820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.249480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.250977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.295999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:00.306134 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db1a7141-bbca-45f3-8cd5-00a69fed558a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.311071 Oct 17 13:34:00.307252 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2196/4354] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:33:59 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:00.312459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.313370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:00.320619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.321389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.322066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.322985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.323654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.324499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.453556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:00.469332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61bbe262-83e2-47a8-bade-c4ca2b9f2bd3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1268 microversion: 2.1 time: 0.239770 Oct 17 13:34:00.471908 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2159/4355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:00 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1268 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:00.486837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f12151e-9521-4c88-a5c7-edcf9ceb0e5c tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Action: 'create', calling method: .version_select at 0x7f41a21048b0>, body: {"snapshot": {"volume_id": "e9ddc834-3949-465b-84c6-d9161f811855", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-733602542"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:00.565941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:00.594193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96bb9d9f-7b39-4c8a-8d60-4004f31a195f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.285659 Oct 17 13:34:00.595699 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2197/4356] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:00 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:00.892484 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f12151e-9521-4c88-a5c7-edcf9ceb0e5c tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.416998 Oct 17 13:34:00.893540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2160/4357] 10.222.0.65 () {60 vars in 1162 bytes} [Mon Oct 17 13:34:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:00.905459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edef5e33-3da9-459c-b984-c0e7d7cd2249 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419cd333a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.916414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:00.920353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:00.939707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.940205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.940699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:00.944540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:00.945234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:00.945937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.055410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edef5e33-3da9-459c-b984-c0e7d7cd2249 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 200 len: 286 microversion: 2.1 time: 0.154722 Oct 17 13:34:01.056313 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2198/4358] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:00 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:01.078568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fbd6ea76-84b2-4f32-9eea-7dbcb92e599a tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419cd2f5e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.154431 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fbd6ea76-84b2-4f32-9eea-7dbcb92e599a tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.082006 Oct 17 13:34:01.156048 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2199/4359] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:01.171867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6675c20b-aa80-4bf2-9b86-2db30d49ea3b tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419dd905e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.208174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:01.223899 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96a839c6-4fa8-476b-ab89-aaabec69fd3d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.312900 Oct 17 13:34:01.238304 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2161/4360] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:00 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:01.244750 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6675c20b-aa80-4bf2-9b86-2db30d49ea3b tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 200 len: 286 microversion: 2.1 time: 0.081039 Oct 17 13:34:01.245395 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2200/4361] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:01.363516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.365812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:01.376056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.376854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.377573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.378500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.380532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.381153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.500314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.501655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:01.516961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.525987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.529597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.530510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.532866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.533549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.662104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:01.676906 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dda72099-2fdb-4262-9bed-097ab7a225f1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.327165 Oct 17 13:34:01.686670 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2162/4362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:01.703838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.707383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:01.718662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.719174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.719654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.720605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.721309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.721928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.750440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:01.762303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-afa340e8-e9d3-4ecf-a851-b2c9c4b6679e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1274 microversion: 2.1 time: 0.270302 Oct 17 13:34:01.777681 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2201/4363] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1274 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:01.785935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.786127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:01.786556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:01.796290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.797054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.797794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.798646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.799276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.800013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.883571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:01.947670 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a937b811-60ca-4726-be2e-6bc62d6a02e6 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 204 len: 0 microversion: 2.1 time: 0.259116 Oct 17 13:34:01.948523 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2163/4364] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:01 2022] DELETE /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:01.959707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:01.962817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:01.970003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.972045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.972045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:01.972045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:01.972045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:01.973122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.085849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:02.108179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-562964ae-4118-4ea1-b3a8-18a42f980e6a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.324960 Oct 17 13:34:02.109406 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2202/4365] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:02.255025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:02.255639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:02.262638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:02.267967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.269712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.272337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.273318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.274480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.276795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.302179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7b1ea74-7afc-437f-a0bc-05d1019b649c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1664 microversion: 2.1 time: 0.346672 Oct 17 13:34:02.302812 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2164/4366] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:01 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1664 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:02.308037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-883c123c-3681-4734-ad84-c8908b11c249 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419dc1d310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:02.400277 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-883c123c-3681-4734-ad84-c8908b11c249 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 200 len: 286 microversion: 2.1 time: 0.096354 Oct 17 13:34:02.400986 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2165/4367] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:02 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:02.486757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dcfa8ec1-2ef4-44b4-8411-50dd58a667f0 req-fc91c655-d710-42eb-b4a3-72413bbd0af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f789d693-646c-483d-9ae4-fe5988d5c4c3", "name": "network-vif-plugged", "status": "completed", "tag": "90ab39cc-bbab-4ab6-a004-eae44b430694"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:02.520598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcfa8ec1-2ef4-44b4-8411-50dd58a667f0 req-fc91c655-d710-42eb-b4a3-72413bbd0af0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.522673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcfa8ec1-2ef4-44b4-8411-50dd58a667f0 req-fc91c655-d710-42eb-b4a3-72413bbd0af0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.526121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dcfa8ec1-2ef4-44b4-8411-50dd58a667f0 req-fc91c655-d710-42eb-b4a3-72413bbd0af0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.530654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:02.541359 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3b322ba-eb13-4003-98bb-de1d5939ed74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.294132 Oct 17 13:34:02.546839 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2203/4368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:02 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:02.555483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dcfa8ec1-2ef4-44b4-8411-50dd58a667f0 req-fc91c655-d710-42eb-b4a3-72413bbd0af0 service nova] Creating event network-vif-plugged:90ab39cc-bbab-4ab6-a004-eae44b430694 for instance f789d693-646c-483d-9ae4-fe5988d5c4c3 on n-h2-854121-14 Oct 17 13:34:02.563594 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dcfa8ec1-2ef4-44b4-8411-50dd58a667f0 req-fc91c655-d710-42eb-b4a3-72413bbd0af0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089721 Oct 17 13:34:02.565868 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2166/4369] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:02.702384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:02.704622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:02.711832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.712541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.713124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.714370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.716206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.717190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.794200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:02.794966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:02.810901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.811900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.812785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:02.813760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:02.814223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:02.814797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.058139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:03.067442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c668d5ea-4ef3-4e0a-aeeb-2eac87a3c9d8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.369184 Oct 17 13:34:03.077894 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2204/4370] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:02 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:03.096154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:03.105015 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ec90d16-b878-4b0c-be49-099d52d2a49e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.318355 Oct 17 13:34:03.105931 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2167/4371] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:02 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:03.135254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.135996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:03.151030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.151449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.151906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.152956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.153495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.153922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.309597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:03.318338 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4aa311a2-9fe9-4539-b95d-68a9d3abc0f8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.187054 Oct 17 13:34:03.318928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2205/4372] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:03 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:03.329448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.331471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:03.339045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.339752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.340365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.341366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.342010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.342449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.418446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0323301-6287-425c-a049-3206dc9f18dd tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419dd905e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.458609 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0323301-6287-425c-a049-3206dc9f18dd tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 200 len: 287 microversion: 2.1 time: 0.048218 Oct 17 13:34:03.460155 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2206/4373] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:03 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:03.470392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87c7e9dc-3583-484d-9e28-36d76b536842 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419cd2ba60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.504004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:03.513858 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddf02eba-3872-49b2-b36b-03fa5e4fdbc7 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1664 microversion: 2.1 time: 0.190387 Oct 17 13:34:03.527251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2168/4374] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:03 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:03.557398 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87c7e9dc-3583-484d-9e28-36d76b536842 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 202 len: 0 microversion: 2.1 time: 0.090635 Oct 17 13:34:03.559931 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2207/4375] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Oct 17 13:34:03 2022] DELETE /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:34:03.571733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.572394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:03.579223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d08e998-4b5d-4662-b8f9-7ee9f64bbb89 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419d121af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:03.591587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.592330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.592933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.593936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:03.595497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:03.595942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:03.647988 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d08e998-4b5d-4662-b8f9-7ee9f64bbb89 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 200 len: 286 microversion: 2.1 time: 0.083510 Oct 17 13:34:03.648577 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2169/4376] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:03 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:03.823485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:03.828134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:03.834266 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6bc29010-ec58-47cb-a761-eeaec48b7921 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.266333 Oct 17 13:34:03.835403 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2208/4377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:03 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.094794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.096119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.106414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.107299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.107968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.108963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.109877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.110962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.131470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.133004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.149585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.151749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.153836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.158673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.159516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.160190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.322976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.335395 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a06f476e-62ba-4b2d-939d-ab38c9719484 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1292 microversion: 2.1 time: 0.246046 Oct 17 13:34:04.352150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2170/4378] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1292 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.357815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.358442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.366590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.367092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.367547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.368264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.368724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.369191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.437664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.448465 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8dccd442-0f1b-4bc7-8f6b-4901aef6b60f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.323637 Oct 17 13:34:04.449783 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2209/4379] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:04.540601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.541136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.541996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.556467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b2eeb35-4cb8-4fab-9717-c1e6f4d7ee8f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.202881 Oct 17 13:34:04.560493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.561644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.562707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.563645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.565647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.566851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.574101 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2171/4380] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.660518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6138dba3-3f9b-4be1-bfb7-c8f8fd581827 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419dae7ee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.704251 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6138dba3-3f9b-4be1-bfb7-c8f8fd581827 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 200 len: 286 microversion: 2.1 time: 0.047468 Oct 17 13:34:04.705182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2172/4381] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:04.731576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-61ec7a72-33eb-469a-9c6a-71c32cb19d67 req-d4e7f0d3-5323-4be3-bc0e-3b6b223fa9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509d327d-d2cb-4993-9f10-b5550138a4d7", "tag": "f49487c7-680d-46f2-9563-3549e8d4f532"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:04.734248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:04.743061 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a36f9ad-fbb6-4471-9f96-5f76126a887b tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1664 microversion: 2.1 time: 0.206680 Oct 17 13:34:04.743995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2210/4382] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1664 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:04.770447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-61ec7a72-33eb-469a-9c6a-71c32cb19d67 req-d4e7f0d3-5323-4be3-bc0e-3b6b223fa9de service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.770939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-61ec7a72-33eb-469a-9c6a-71c32cb19d67 req-d4e7f0d3-5323-4be3-bc0e-3b6b223fa9de service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.771383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-61ec7a72-33eb-469a-9c6a-71c32cb19d67 req-d4e7f0d3-5323-4be3-bc0e-3b6b223fa9de service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.785197 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-61ec7a72-33eb-469a-9c6a-71c32cb19d67 req-d4e7f0d3-5323-4be3-bc0e-3b6b223fa9de service nova] Creating event network-changed:f49487c7-680d-46f2-9563-3549e8d4f532 for instance 509d327d-d2cb-4993-9f10-b5550138a4d7 on n-h1-854121-14 Oct 17 13:34:04.790696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-61ec7a72-33eb-469a-9c6a-71c32cb19d67 req-d4e7f0d3-5323-4be3-bc0e-3b6b223fa9de service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067665 Oct 17 13:34:04.791256 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2173/4383] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:04.863169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:04.863353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:04.879387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.881746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.882216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:04.882955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:04.883490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:04.883929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.097766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:05.110507 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d7fd511-783c-4788-bdc6-d351adca842b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.250334 Oct 17 13:34:05.111224 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2211/4384] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:04 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:05.361087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.361879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.404302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.404807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.405402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.406132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.406614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.407111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.474744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.475808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.495483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.499481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.501613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.503230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.520266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.522011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.792218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:05.809420 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a76290a-0925-4625-8845-12e956940a58 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1474 microversion: 2.1 time: 0.452467 Oct 17 13:34:05.810041 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2174/4385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1474 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:05.816267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.820415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.832277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:05.834552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.835227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.835811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.836659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.837360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.837929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.859315 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5527bab-b72f-4b16-90a9-05e9dc3109a3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.390729 Oct 17 13:34:05.871073 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2212/4386] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:05.880291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdced293-4fb1-4e79-aabb-32d9ca2e63b5 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419dd3f550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.924926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-bdced293-4fb1-4e79-aabb-32d9ca2e63b5 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] HTTP exception thrown: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdced293-4fb1-4e79-aabb-32d9ca2e63b5 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Request method failure captured: Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 HTTP/1.1 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVnFEoPxhPTsNf-sAP0DgzdDo3NdQCgw_4486kzp6PqrHj9IQxFXj1YjC-CF6DsevYQuNGVzNCQSMV2VmeJPN0ib4JQYZKx8xa6CZSF-6vmueS_wSB16wSDN1CHvuzzE3M8LLxy4ZLNT5Y7FqS8H3TQNtiZJIfJhv5JsbiktFckOWhs Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: e9278de82f774ef6b89c05ce93ab3e62 Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: exception: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e7c50fee-f46b-4f09-b7ea-eb8c202e0521'} Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. (HTTP 404) (Request-ID: req-f7ff8184-e984-4f85-934a-37ae7af41fcf) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:34:05.938331 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. Oct 17 13:34:05.942321 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:05.946138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdced293-4fb1-4e79-aabb-32d9ca2e63b5 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Returning 404 to user: Snapshot e7c50fee-f46b-4f09-b7ea-eb8c202e0521 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:05.947171 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bdced293-4fb1-4e79-aabb-32d9ca2e63b5 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521" status: 404 len: 111 microversion: 2.1 time: 0.079915 Oct 17 13:34:05.947886 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2213/4387] 10.222.0.65 () {58 vars in 1251 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/os-snapshots/e7c50fee-f46b-4f09-b7ea-eb8c202e0521 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:05.953569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:05.954424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:05.965137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.966195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.966785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:05.968224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:05.968834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:05.969432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.043397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.046419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.048625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.050431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lazy-loading 'fault' on Instance uuid 4f0c25bf-82d1-4082-b623-f7981dafbeb9 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:06.119263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:06.124653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d87104d2614a47b3262082aa6f1496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ac9d028f08241b592759d7db49a0e23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:06.131462 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe9498a0-aedf-4e46-b07d-5306cf3c3a9b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1532 microversion: 2.1 time: 0.320062 Oct 17 13:34:06.135696 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2175/4388] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1532 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:06.142707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0ce278a-82e0-4a37-a439-accd148229ff tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419e15c670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.152249 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa4e7059-b13e-41da-8c38-b00097714e36 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 200 len: 1315 microversion: 2.1 time: 0.186090 Oct 17 13:34:06.152987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2214/4389] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:05 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:06.172899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1361009520", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:06.231807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0ce278a-82e0-4a37-a439-accd148229ff tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 202 len: 0 microversion: 2.1 time: 0.094174 Oct 17 13:34:06.236189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2176/4390] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:34:06 2022] DELETE /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:06.246763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.247414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:06.251514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:06.263080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.265896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.267206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.269957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.270628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.272705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.478933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:06.494406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e927791d-5535-426f-b319-b2732a3d19f9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.255777 Oct 17 13:34:06.495476 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2177/4391] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:06.506277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4308d0e-31b2-47e3-a87d-3383f5f4363d tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419db4b700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.698830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4308d0e-31b2-47e3-a87d-3383f5f4363d tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 200 len: 345 microversion: 2.1 time: 0.196987 Oct 17 13:34:06.699420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2178/4392] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:06.886081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:06.886760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:06.903048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.908416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.908973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:06.909823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:06.910311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:06.910748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.453979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:07.454458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:07.454933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:07.455444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:07.455900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:07.476652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.480406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.482026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.485045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.486324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.489972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.551783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:07.568857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:07.622578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:07.625410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 17c139b1-9522-4e1a-b39b-cc44299559c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:07.736350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:07.749825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4cac67f2-fe9b-408d-8941-754ee99759df tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595803 Oct 17 13:34:07.750835 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b06ac9a-c7d4-45e6-98c9-8a5357c1fb0e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.864065 Oct 17 13:34:07.766273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2215/4393] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:07.767655 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2179/4394] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:06 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:07.784572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4cfbd459-d0e4-4f23-b0e2-2a4683b7246d req-11fd0204-4039-4b54-87e4-d7892c21c824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0c25bf-82d1-4082-b623-f7981dafbeb9", "name": "network-vif-deleted", "tag": "d0e59ee1-ded3-4689-ba9b-c211523cd227"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:07.790935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:07.791900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:07.802071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4cfbd459-d0e4-4f23-b0e2-2a4683b7246d req-11fd0204-4039-4b54-87e4-d7892c21c824 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.802871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4cfbd459-d0e4-4f23-b0e2-2a4683b7246d req-11fd0204-4039-4b54-87e4-d7892c21c824 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.803709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4cfbd459-d0e4-4f23-b0e2-2a4683b7246d req-11fd0204-4039-4b54-87e4-d7892c21c824 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.818925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.819428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.819867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.820577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.821025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.821479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.830506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4cfbd459-d0e4-4f23-b0e2-2a4683b7246d req-11fd0204-4039-4b54-87e4-d7892c21c824 service nova] Creating event network-vif-deleted:d0e59ee1-ded3-4689-ba9b-c211523cd227 for instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 on n-h1-854121-14 Oct 17 13:34:07.842430 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4cfbd459-d0e4-4f23-b0e2-2a4683b7246d req-11fd0204-4039-4b54-87e4-d7892c21c824 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073926 Oct 17 13:34:07.844534 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2216/4395] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:07.856522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:07.862230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] [instance: 4f0c25bf-82d1-4082-b623-f7981dafbeb9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:07.878840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.880588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.881299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.883462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.884179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.886934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.924197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] HTTP exception thrown: Instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 could not be found. Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Request method failure captured: Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 HTTP/1.1 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl85DyJhyDBeGDLDACsrMbvrZDTySdsSTErxTLfZHc_FwQn1DtPGT35ElxT2AH6CbtNISwEQMGAlcKHa0oG_DtsMJrDYSEuaRDPNE9TBZZvRTvNZUx7jDlwG4tlUS7afAbpW39T4e-0VLDn2jQw6t8j0VEadkSkknjmdaUqs9sxfc4 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 5ac9d028f08241b592759d7db49a0e23 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestFqdnHostnames-1288600218 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5ac9d028f08241b592759d7db49a0e23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5ac9d028f08241b592759d7db49a0e23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5ac9d028f08241b592759d7db49a0e23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5ac9d028f08241b592759d7db49a0e23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestFqdnHostnames-1288600218 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 5ac9d028f08241b592759d7db49a0e23 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1288600218 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestFqdnHostnames-1288600218-project Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: d4d87104d2614a47b3262082aa6f1496 Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestFqdnHostnames-1288600218-project Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 could not be found. Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '4f0c25bf-82d1-4082-b623-f7981dafbeb9'} Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 could not be found. Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 could not be found. Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:07.927056 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 could not be found. Oct 17 13:34:07.931429 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:07.932638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Returning 404 to user: Instance 4f0c25bf-82d1-4082-b623-f7981dafbeb9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:07.934342 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-260b6bad-10c9-4b35-bbbc-789d0bd1ff2c tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9" status: 404 len: 111 microversion: 2.1 time: 0.088269 Oct 17 13:34:07.936096 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2217/4396] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:07 2022] GET /compute/v2.1/servers/4f0c25bf-82d1-4082-b623-f7981dafbeb9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:07.942039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:07.942954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:07.972200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.973067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.974498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:07.975432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:07.976365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:07.976923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.166625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:08.184683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90545194-93d5-49d9-b356-c9733918336a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1532 microversion: 2.1 time: 0.415844 Oct 17 13:34:08.186245 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2180/4397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:07 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1532 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:08.191499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f87aaa2-9c25-41e0-8665-9f5f07c42f77 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f41a21040d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.243163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:08.258831 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d20ad75-e6fd-4bae-82e0-2d6538dc5232 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.320433 Oct 17 13:34:08.282080 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2218/4398] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:07 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:08.288737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef9ea76d-beec-4030-8092-82c44653b2ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.289332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef9ea76d-beec-4030-8092-82c44653b2ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 17c139b1-9522-4e1a-b39b-cc44299559c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:08.296291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f87aaa2-9c25-41e0-8665-9f5f07c42f77 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 200 len: 345 microversion: 2.1 time: 0.108667 Oct 17 13:34:08.297219 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2181/4399] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:34:08 2022] GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:08.302252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d23fe72-cdb7-4ae1-9337-9b0fcc298117 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] Calling method '.version_select at 0x7f419d121550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.340679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef9ea76d-beec-4030-8092-82c44653b2ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 17c139b1-9522-4e1a-b39b-cc44299559c9] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:08.354832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d23fe72-cdb7-4ae1-9337-9b0fcc298117 tempest-ServersTestFqdnHostnames-1288600218 tempest-ServersTestFqdnHostnames-1288600218-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-981682981" status: 202 len: 0 microversion: 2.1 time: 0.056101 Oct 17 13:34:08.357263 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2182/4400] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-981682981 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:08.783684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.785049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:08.816132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:08.825527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=14 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:08.828781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.830033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.831886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.838465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.839238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.840871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.879976 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.scheduler.client.report [None req-ef9ea76d-beec-4030-8092-82c44653b2ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Deleted allocations for instance 17c139b1-9522-4e1a-b39b-cc44299559c9 Oct 17 13:34:08.909125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef9ea76d-beec-4030-8092-82c44653b2ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9" status: 204 len: 0 microversion: 2.1 time: 0.624999 Oct 17 13:34:08.910256 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2219/4401] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:08 2022] DELETE /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:08.918431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:08.920871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 17c139b1-9522-4e1a-b39b-cc44299559c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:08.953458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.954117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.956492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.957396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:08.961258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:08.963625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:08.997644 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 HTTP/1.1 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '17c139b1-9522-4e1a-b39b-cc44299559c9'} Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.000176 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:09.004814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:09.004814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:09.004814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:09.004814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:09.004814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:34:09.004814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:09.006884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:09.013985 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d2f0f80-587c-431d-96d3-9e657eb6c81a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9" status: 404 len: 111 microversion: 2.1 time: 0.093741 Oct 17 13:34:09.013985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2220/4402] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:08 2022] GET /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:34:09.094572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-924847924", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:09.192444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:09.205628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:09.217570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6caf4ff9-4ff0-4474-b7b4-0b4e8898b219 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.438305 Oct 17 13:34:09.238448 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2183/4403] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:08 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:09.249989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:09.250787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:09.260137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.260854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.263452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.264525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.265137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.265911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.721991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:09.784284 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f8a8b0b-e4b5-4096-93a7-44b6a00c551f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1532 microversion: 2.1 time: 0.540884 Oct 17 13:34:09.805447 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2184/4404] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:09 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1532 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:09.818127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:09.819007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:09.832835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.833632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.834308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:09.835213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:09.835925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:09.841724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.209647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:10.210202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:10.210648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:10.211125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:10.211817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:10.230754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.235017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.236411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.241578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.242921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.244181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.298319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:10.318709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:10.328772 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b895bee3-6096-430e-80a3-8af7b7cd2d74 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.522135 Oct 17 13:34:10.329022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:10.334282 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2185/4405] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:09 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:10.348809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8c92739-29d7-4d8d-8f78-a5dc1a3b3578 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f41a21665e0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.360843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:10.366636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:10.408792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-d8c92739-29d7-4d8d-8f78-a5dc1a3b3578 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] HTTP exception thrown: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8c92739-29d7-4d8d-8f78-a5dc1a3b3578 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Request method failure captured: Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 HTTP/1.1 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVnFEoPxhPTsNf-sAP0DgzdDo3NdQCgw_4486kzp6PqrHj9IQxFXj1YjC-CF6DsevYQuNGVzNCQSMV2VmeJPN0ib4JQYZKx8xa6CZSF-6vmueS_wSB16wSDN1CHvuzzE3M8LLxy4ZLNT5Y7FqS8H3TQNtiZJIfJhv5JsbiktFckOWhs Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e9278de82f774ef6b89c05ce93ab3e62 Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: exception: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e9ddc834-3949-465b-84c6-d9161f811855'} Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. (HTTP 404) (Request-ID: req-4c113e41-8784-4157-95aa-0246da8426c0) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:34:10.411124 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8c92739-29d7-4d8d-8f78-a5dc1a3b3578 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Returning 404 to user: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:10.414739 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8c92739-29d7-4d8d-8f78-a5dc1a3b3578 tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 404 len: 109 microversion: 2.1 time: 0.077269 Oct 17 13:34:10.421576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2186/4406] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:10.429571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a8562115-e22a-4be5-aeef-8789ec4699c8 req-097d8a5b-a7ba-4459-bb00-80cd8657766f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509d327d-d2cb-4993-9f10-b5550138a4d7", "name": "network-vif-plugged", "status": "completed", "tag": "f49487c7-680d-46f2-9563-3549e8d4f532"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:10.463534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a8562115-e22a-4be5-aeef-8789ec4699c8 req-097d8a5b-a7ba-4459-bb00-80cd8657766f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.464438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a8562115-e22a-4be5-aeef-8789ec4699c8 req-097d8a5b-a7ba-4459-bb00-80cd8657766f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.465524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a8562115-e22a-4be5-aeef-8789ec4699c8 req-097d8a5b-a7ba-4459-bb00-80cd8657766f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.484855 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f6b4c58-7c26-431a-986e-065b76be1ec2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394582 Oct 17 13:34:10.489649 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2221/4407] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:10.506628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.507265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:10.510090 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a8562115-e22a-4be5-aeef-8789ec4699c8 req-097d8a5b-a7ba-4459-bb00-80cd8657766f service nova] Creating event network-vif-plugged:f49487c7-680d-46f2-9563-3549e8d4f532 for instance 509d327d-d2cb-4993-9f10-b5550138a4d7 on n-h1-854121-14 Oct 17 13:34:10.523357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a8562115-e22a-4be5-aeef-8789ec4699c8 req-097d8a5b-a7ba-4459-bb00-80cd8657766f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107032 Oct 17 13:34:10.527265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.528775 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2187/4408] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:10.533036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.552620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.554863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.560097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.560799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.562863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8c0956f-1740-461b-a882-661adeadd31e tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419dc9ab80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.652521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e8c0956f-1740-461b-a882-661adeadd31e tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] HTTP exception thrown: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8c0956f-1740-461b-a882-661adeadd31e tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Request method failure captured: Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 HTTP/1.1 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVnFEoPxhPTsNf-sAP0DgzdDo3NdQCgw_4486kzp6PqrHj9IQxFXj1YjC-CF6DsevYQuNGVzNCQSMV2VmeJPN0ib4JQYZKx8xa6CZSF-6vmueS_wSB16wSDN1CHvuzzE3M8LLxy4ZLNT5Y7FqS8H3TQNtiZJIfJhv5JsbiktFckOWhs Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e9278de82f774ef6b89c05ce93ab3e62 Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: exception: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e9ddc834-3949-465b-84c6-d9161f811855'} Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. (HTTP 404) (Request-ID: req-2911b49b-601e-4e3e-a069-f2bc32879dd5) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:34:10.654668 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8c0956f-1740-461b-a882-661adeadd31e tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Returning 404 to user: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8c0956f-1740-461b-a882-661adeadd31e tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 404 len: 109 microversion: 2.1 time: 0.123774 Oct 17 13:34:10.660586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2188/4409] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:34:10 2022] DELETE /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:10.666507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7fcfb59-e763-43b3-9cad-343cb849cc3a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.667325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7fcfb59-e763-43b3-9cad-343cb849cc3a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:10.836689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7fcfb59-e763-43b3-9cad-343cb849cc3a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:10.852661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7fcfb59-e763-43b3-9cad-343cb849cc3a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1220 microversion: 2.1 time: 0.194050 Oct 17 13:34:10.853692 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2189/4410] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:10.863730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3441bc25-e4e3-4160-9647-3423741aafca tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Calling method '.version_select at 0x7f419cb4ab80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.878450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:10.903245 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ea70d11-474b-4a2c-8966-89e459fe3ba6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.412300 Oct 17 13:34:10.908761 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2222/4411] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:10.921687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3441bc25-e4e3-4160-9647-3423741aafca tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] HTTP exception thrown: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.923400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:10.924164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3441bc25-e4e3-4160-9647-3423741aafca tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Request method failure captured: Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 HTTP/1.1 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVnFEoPxhPTsNf-sAP0DgzdDo3NdQCgw_4486kzp6PqrHj9IQxFXj1YjC-CF6DsevYQuNGVzNCQSMV2VmeJPN0ib4JQYZKx8xa6CZSF-6vmueS_wSB16wSDN1CHvuzzE3M8LLxy4ZLNT5Y7FqS8H3TQNtiZJIfJhv5JsbiktFckOWhs Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f0b7002860b94033b28f2ae3e715dd65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f0b7002860b94033b28f2ae3e715dd65 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-68820448 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e9278de82f774ef6b89c05ce93ab3e62 Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-68820448-project Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: exception: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e9ddc834-3949-465b-84c6-d9161f811855'} Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. (HTTP 404) (Request-ID: req-a67d25ed-ea98-44a7-a77f-2fdd06c0e7d5) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:34:10.929643 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. Oct 17 13:34:10.933720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:10.935848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3441bc25-e4e3-4160-9647-3423741aafca tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] Returning 404 to user: Volume e9ddc834-3949-465b-84c6-d9161f811855 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:10.935848 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3441bc25-e4e3-4160-9647-3423741aafca tempest-VolumesSnapshotsTestJSON-68820448 tempest-VolumesSnapshotsTestJSON-68820448-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855" status: 404 len: 109 microversion: 2.1 time: 0.080419 Oct 17 13:34:10.940392 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2190/4412] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/os-volumes/e9ddc834-3949-465b-84c6-d9161f811855 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:34:10.951960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.952531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.952975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:10.955075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:10.956117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:10.959186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.321708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:11.333974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c68362c6-93f3-4165-8467-64a77e3fc8ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1532 microversion: 2.1 time: 0.423311 Oct 17 13:34:11.334628 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2223/4413] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:10 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1532 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:11.360796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.362241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:11.378752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.379453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.380065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.380996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.381625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.385770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.638494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:11.650890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7acf0b87-8e82-46d9-a2a1-7faad3bb0b20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.293110 Oct 17 13:34:11.652430 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2191/4414] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:11 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:11.879865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.881342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:11.895632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.896388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.904605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.905629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.906227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.906683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.935137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:11.935765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:11.947623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.948132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.949127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:11.949892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:11.950477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:11.950914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.030030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:12.046550 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2eb8782-ef9f-4a2e-b666-238a3ef703e8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1216 microversion: 2.1 time: 0.164783 Oct 17 13:34:12.047487 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2224/4415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:11 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:12.313714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:12.324023 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbe79ce6-ee1f-4602-9e81-fdb1bffb2c28 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1316 microversion: 2.1 time: 0.392959 Oct 17 13:34:12.328519 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2192/4416] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:11 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1316 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:12.360898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.361571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:12.364587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:12.385646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.386232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.386967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.387861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.395925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.396414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.617800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f66e92f2-63d0-48f1-a418-de2db7dfe86c req-61bfb109-064a-411e-b82a-57e3e33ddab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c999d9-c3d1-435f-96f0-5505353369b8", "name": "network-vif-plugged", "status": "completed", "tag": "d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:12.655266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f66e92f2-63d0-48f1-a418-de2db7dfe86c req-61bfb109-064a-411e-b82a-57e3e33ddab2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.655778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f66e92f2-63d0-48f1-a418-de2db7dfe86c req-61bfb109-064a-411e-b82a-57e3e33ddab2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.657373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f66e92f2-63d0-48f1-a418-de2db7dfe86c req-61bfb109-064a-411e-b82a-57e3e33ddab2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.690669 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f66e92f2-63d0-48f1-a418-de2db7dfe86c req-61bfb109-064a-411e-b82a-57e3e33ddab2 service nova] Creating event network-vif-plugged:d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7 for instance 54c999d9-c3d1-435f-96f0-5505353369b8 on n-h2-854121-14 Oct 17 13:34:12.703958 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f66e92f2-63d0-48f1-a418-de2db7dfe86c req-61bfb109-064a-411e-b82a-57e3e33ddab2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090671 Oct 17 13:34:12.706034 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2193/4417] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:12.728242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:12.734246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:12.750405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.750913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.751353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.752158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:12.753295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:12.753742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:12.760689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:12.799618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:12.815235 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76bdf252-b45e-45f2-8d28-7fb3d87fec61 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1532 microversion: 2.1 time: 0.460843 Oct 17 13:34:12.819220 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2225/4418] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:12 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1532 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:13.079936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:13.082214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.084758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:13.101662 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5b069d0-d7b5-4caa-b086-970b7d9b8080 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.393570 Oct 17 13:34:13.102257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2194/4419] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:12 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:13.111504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.113469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.114249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.115828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.116617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.117319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.267483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:13.282368 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-307fb8a5-315e-4a07-beab-23e7f61d0c3c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1290 microversion: 2.1 time: 0.213503 Oct 17 13:34:13.282990 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2226/4420] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1290 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:13.350045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.350661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:13.367032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.367585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.368042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.368799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.377453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.378088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.654418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:13.671902 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a338eff-56a0-47ee-b3c2-5194299cf5d3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1466 microversion: 2.1 time: 0.325951 Oct 17 13:34:13.673823 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2195/4421] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1466 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:13.845323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:13.846083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:13.857121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.857657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.858100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:13.863051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:13.863787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:13.864241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.221137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:14.237778 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bab050bd-84a4-42eb-a03a-ac930c1b9763 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.397530 Oct 17 13:34:14.247020 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2196/4422] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:14.271321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.272377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:14.293238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.293745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.294351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.306663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.307273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.313883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.400482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:14.401104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:14.413250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.413709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.414148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:14.414857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:14.415305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:14.415725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.321916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:15.336827 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45e278cb-8acd-48cf-846d-2b660061bb09 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 1.088338 Oct 17 13:34:15.337828 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2197/4423] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:14 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:15.343448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:15.356163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:15.383023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.391426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.394427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:15.395401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:15.397258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:15.399012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.053855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:16.063541 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de350d17-19cc-4f93-8777-2dc2ed0f33b4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 0.724375 Oct 17 13:34:16.067730 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2198/4424] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:15 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:16.083313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.084093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:16.094179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.094998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.098109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.099029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.099957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.101477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.370193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0358f6d-10cd-4788-baff-13441b7bd1a3 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1619 microversion: 2.1 time: 2.658932 Oct 17 13:34:16.378756 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2227/4425] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:13 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1619 bytes in 2668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:16.385706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:16.388674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:16.413059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.413800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.414545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.415253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.415750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.416173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:16.778733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:16.801853 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ab035ae-dea8-45be-ac73-9870c18cc348 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.732687 Oct 17 13:34:16.805819 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2199/4426] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:16 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:16.826322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd2f46dc-dd7f-43c6-977d-b8e946e398b6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: .version_select at 0x7f419d11da60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-414281094", "policies": ["affinity"]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.875799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dd2f46dc-dd7f-43c6-977d-b8e946e398b6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:16.881730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dd2f46dc-dd7f-43c6-977d-b8e946e398b6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:16.937629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dd2f46dc-dd7f-43c6-977d-b8e946e398b6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:16.944379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:16.946459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dd2f46dc-dd7f-43c6-977d-b8e946e398b6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:16.966459 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd2f46dc-dd7f-43c6-977d-b8e946e398b6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.158193 Oct 17 13:34:16.968079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2200/4427] 10.222.0.65 () {60 vars in 1174 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:16.975855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8cb3915c-98b6-4ca4-ae5b-5d091c738c30 req-8f00a2b3-2b84-417a-8eab-4e28e063871f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd749c83-0bd0-426d-b7b5-ad4f036e57c3", "tag": "074625ea-9534-4cf8-ba01-e18ee462a41d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:16.985785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8cb3915c-98b6-4ca4-ae5b-5d091c738c30 req-8f00a2b3-2b84-417a-8eab-4e28e063871f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:16.986557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8cb3915c-98b6-4ca4-ae5b-5d091c738c30 req-8f00a2b3-2b84-417a-8eab-4e28e063871f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:16.987336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8cb3915c-98b6-4ca4-ae5b-5d091c738c30 req-8f00a2b3-2b84-417a-8eab-4e28e063871f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.006809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8cb3915c-98b6-4ca4-ae5b-5d091c738c30 req-8f00a2b3-2b84-417a-8eab-4e28e063871f service nova] Creating event network-changed:074625ea-9534-4cf8-ba01-e18ee462a41d for instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 on n-h1-854121-14 Oct 17 13:34:17.015157 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8cb3915c-98b6-4ca4-ae5b-5d091c738c30 req-8f00a2b3-2b84-417a-8eab-4e28e063871f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045865 Oct 17 13:34:17.016550 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2201/4428] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:17.064509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.083334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44469f30-0131-4ce1-991d-49a906663a25 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.703088 Oct 17 13:34:17.085009 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2228/4429] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:16 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:17.102982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.103632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:17.126945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.128509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.129464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.130880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.131759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.132600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.224692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1528308824", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "6960bf96-04ad-403c-8562-3cab493e24d7"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:17.312308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:17.734949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:17.745907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-943550a4-24ca-4777-8d4f-3ab2a31b985e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 0.654393 Oct 17 13:34:17.751013 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2202/4430] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:17 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:17.837583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:17.838913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:17.853045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.853601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.861113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:17.863041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:17.863606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:17.865923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.166727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:18.168785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:18.170276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:18.171081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:18.171836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:18.235218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.238668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.239311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.247961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.250905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.253233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.322237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:18.333904 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1402f0a9-628f-486e-8e58-4c094ba9d3d9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.507192 Oct 17 13:34:18.337808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:18.349768 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2203/4431] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:17 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:18.359380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:18.361633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:18.368826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:18.383525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.387352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.388320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.390246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.394158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.395369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.403910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Going to run 2 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:18.407609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:18.507043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120698) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 17 13:34:18.533842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:18.541180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:18.650355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:18.667919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:18.706730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=06032b3e-136e-4489-b950-8c2f2a527957,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:18.853020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:18.865309 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-017268ff-ccc5-480b-abc2-ae9a2d3fa688 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.514336 Oct 17 13:34:18.871051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:18.875943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2204/4432] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:18 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:18.884772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:18.887857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:18.890627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:18.914043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.916157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.918732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:18.919767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:18.924239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:18.926336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.015043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:19.036552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:19.135489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3438d8e4-385a-4427-97a2-9c8f05d1be0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.917180 Oct 17 13:34:19.140271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2229/4433] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:17 2022] POST /compute/v2.1/servers => generated 32 bytes in 1923 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 17 13:34:19.158662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:19.173457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:19.181324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Searching by: {'deleted': False, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:34:19.233995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:19.237305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:19.238078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.243471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:19.243961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:19.244397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.322118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:34:19.353684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:19.366777 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-537be307-4d2d-4326-9424-aa20d7cda211 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 0.488720 Oct 17 13:34:19.367637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2205/4434] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:18 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:19.373527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:19.374560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:19.391034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:19.392227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:19.392833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.394415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:19.395093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:19.396550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.416862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:19.445760 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b66e497-7353-4ee0-b6c1-77cb31a6c4db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.304217 Oct 17 13:34:19.452434 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2230/4435] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:34:19 2022] GET /compute/v2.1/servers => generated 1003 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:19.472626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d55ea17-b686-4398-b099-4338ba7de8e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:19.474950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d55ea17-b686-4398-b099-4338ba7de8e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:19.878479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1d55ea17-b686-4398-b099-4338ba7de8e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:19.890126 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d55ea17-b686-4398-b099-4338ba7de8e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1219 microversion: 2.1 time: 0.425556 Oct 17 13:34:19.896501 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2231/4436] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:19 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1219 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:19.910336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:19.915373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:19.917031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:19.926663 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b031c8f7-c892-44f1-8eab-90aac4622e58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.557712 Oct 17 13:34:19.941767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2206/4437] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:19 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:19.941956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:19.942530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:19.943149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:19.944021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:19.946728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:19.947336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.407965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:20.408707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:20.435140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.439641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.441418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.442929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.449612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.454497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.519230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:20.544284 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8083d25-18f8-4291-8b44-df6d927c8d5c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.644613 Oct 17 13:34:20.546610 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2232/4438] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:19 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:20.919651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:20.920792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:20.935403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:20.940112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.941623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.945413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.946472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.948001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.951074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.953599 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe0ae6f9-a1d3-4a02-879e-ab8d96efd9ee tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 0.563707 Oct 17 13:34:20.956385 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2207/4439] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:20 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:20.962986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:20.963740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:20.975903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.978685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.985453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:20.987850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:20.988338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:20.988781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.174009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:21.193479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab74293b-d823-46ff-8b79-cd3409c999f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1223 microversion: 2.1 time: 0.280454 Oct 17 13:34:21.213876 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2233/4440] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:20 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1223 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:21.346262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:21.365982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6dfaeac2-010e-4970-810e-37888119ef98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.407367 Oct 17 13:34:21.366871 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2208/4441] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:20 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:21.571631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:21.572231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:21.595580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:21.596476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:21.602065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.602775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:21.604227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:21.606570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:21.884636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:21.895044 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e6578e0-54ab-4dfa-83f7-937972876386 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.327052 Oct 17 13:34:21.897545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2234/4442] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:21 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:21.985088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:21.985847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:22.010705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.014683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.016345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.022255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.026609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.027626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.220972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:22.221703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:22.236676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.240637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.242326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.244826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.245441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.246047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.612427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:22.621835 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7d77042-b41b-4dd0-9aa5-92d43b5b180f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1271 microversion: 2.1 time: 0.405075 Oct 17 13:34:22.623217 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2235/4443] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:22 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1271 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:22.630346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:22.632092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:22.647230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.648371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.649684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.652196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.653992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.655010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.710336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:22.718501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0149a300-285e-4dff-bd34-8a81f4d01d34 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 0.739402 Oct 17 13:34:22.721761 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2209/4444] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:21 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:22.913713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:22.926201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:22.926995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2c69753-4040-47a4-9bb2-74465063d1f1 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.302476 Oct 17 13:34:22.927150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:22.928103 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2236/4445] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:22.935995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.937725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.938337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:22.939207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:22.939798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:22.940359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.174094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:23.184799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ec5dcf9-0d0d-47bd-bd32-ea0df14d43ef tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.264714 Oct 17 13:34:23.188483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2210/4446] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:22 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:23.463343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e734881f-80b6-4042-95b8-fb90ef02e0b1 req-b3b25b5d-9aaa-4029-a1aa-13c80b95b781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd749c83-0bd0-426d-b7b5-ad4f036e57c3", "name": "network-vif-plugged", "status": "completed", "tag": "074625ea-9534-4cf8-ba01-e18ee462a41d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:23.491975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e734881f-80b6-4042-95b8-fb90ef02e0b1 req-b3b25b5d-9aaa-4029-a1aa-13c80b95b781 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.494673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e734881f-80b6-4042-95b8-fb90ef02e0b1 req-b3b25b5d-9aaa-4029-a1aa-13c80b95b781 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.495264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e734881f-80b6-4042-95b8-fb90ef02e0b1 req-b3b25b5d-9aaa-4029-a1aa-13c80b95b781 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.532239 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e734881f-80b6-4042-95b8-fb90ef02e0b1 req-b3b25b5d-9aaa-4029-a1aa-13c80b95b781 service nova] Creating event network-vif-plugged:074625ea-9534-4cf8-ba01-e18ee462a41d for instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 on n-h1-854121-14 Oct 17 13:34:23.549046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e734881f-80b6-4042-95b8-fb90ef02e0b1 req-b3b25b5d-9aaa-4029-a1aa-13c80b95b781 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089732 Oct 17 13:34:23.552265 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2237/4447] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:23.654398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:23.655469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:23.672342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.674475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.677471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.679964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.680652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.682578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.755720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:23.756799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:23.782112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.783405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.784109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.787112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.788759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.794318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.911514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:23.922401 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a483c4c9-46fc-48a8-9f08-ac971bfb4fb7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1279 microversion: 2.1 time: 0.276138 Oct 17 13:34:23.926182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2211/4448] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:23 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:23.959799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:23.960909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:23.978169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.978898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.979557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:23.980544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:23.981183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:23.981807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.018098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:24.319424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:24.332908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4f32302-373f-4d66-8ece-3355063aad1d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 0.583318 Oct 17 13:34:24.348918 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2238/4449] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:23 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:24.362023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:24.363285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:24.368663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:24.376990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.377974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.380548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.382754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.384112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.388089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.851397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:24.871187 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7cdb8f20-63ff-402c-9b60-d222d62ef657 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.916793 Oct 17 13:34:24.872368 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2212/4450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:23 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:24.951209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:24.951826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:24.968837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.969369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.969806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:24.970509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:24.970960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:24.971380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.084582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:25.102001 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9cf976dc-3cbe-4dc8-8c41-d6a138f0efcf tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1502 microversion: 2.1 time: 0.751691 Oct 17 13:34:25.102765 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2239/4451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:24 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1502 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:25.130168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:25.133923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b93bae5d-52d8-4f16-9b9e-abac747b7332"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:25.136454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.142059 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41af1a5e-3bf7-45e9-9914-0cc86e6fcb11 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1277 microversion: 2.1 time: 0.194842 Oct 17 13:34:25.143245 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2213/4452] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:24 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:25.165261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.165776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.166215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.178917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.179758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.180866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.255173 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Cannot 'attach_volume' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state rescued Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/os-volume_attachments HTTP/1.1 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 74 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: {"volumeAttachment": {"volumeId": "b93bae5d-52d8-4f16-9b9e-abac747b7332"}} Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'attach_volume' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state rescued Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': 'ebec799c-df30-4d3d-9947-9ab16c8365d0', 'body': {'volumeAttachment': {'volumeId': 'b93bae5d-52d8-4f16-9b9e-abac747b7332'}}} Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 17 13:34:25.256897 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state rescued Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state rescued Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 409 to user: Cannot 'attach_volume' instance ebec799c-df30-4d3d-9947-9ab16c8365d0 while it is in vm_state rescued {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:25.262632 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-736fcd66-dece-4c21-ac88-e229d6ce942e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.132055 Oct 17 13:34:25.263976 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2240/4453] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:34:25 2022] POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/os-volume_attachments => generated 152 bytes in 135 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 17 13:34:25.271975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:25.272657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.281092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.281696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.282426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.283228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.283791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.284345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.357442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.358313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.370328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.379466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.381649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.382593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.385596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.387062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.528670 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45162823-dde1-4e5f-b552-90435692bcc4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action" status: 202 len: 0 microversion: 2.1 time: 0.260890 Oct 17 13:34:25.532611 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2214/4454] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:34:25 2022] POST /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:25.561692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:25.563582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:25.575057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.575776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.576544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:25.577531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:25.578232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:25.578868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.063794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:26.077206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-659334ab-d88f-4c6b-ad61-b25cd294fc28 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1510 microversion: 2.1 time: 0.543094 Oct 17 13:34:26.106904 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2215/4455] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1510 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:26.117454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:26.118088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:26.142031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.142532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.146366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.153739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.159948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.160751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.668071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:26.676942 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-850f3e19-ef79-4d19-b0cf-e60e942ce637 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1320 microversion: 2.1 time: 1.324898 Oct 17 13:34:26.677558 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2241/4456] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:25 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1320 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:26.752277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:26.754404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:26.784540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.785042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.789804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.794809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:26.798669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:26.800153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:26.956023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:27.109406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:27.118845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6587cc9-46f8-427c-8d7f-25eb60820ba9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 1.009423 Oct 17 13:34:27.137578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2216/4457] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:26 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:27.160118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:27.164015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:27.190052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:27.190981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:27.191693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:27.192635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:27.193335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:27.193981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.065695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:28.086458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0a93a91-16fd-4cb4-950b-26e1edf25024 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 1.388313 Oct 17 13:34:28.087708 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2242/4458] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:26 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:28.122216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:28.123301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:28.132675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.133517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.134304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.135304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.135958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.136698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.189074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:28.203849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8617ec59-24b1-479e-aeb9-81129cacc0ce tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1510 microversion: 2.1 time: 1.068191 Oct 17 13:34:28.204801 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2217/4459] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:27 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1510 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:28.209857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:28.222119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:28.228420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.229246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.230591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.231446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.241980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.249902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.591423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:28.607295 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74c82f0b-7732-4e9a-88aa-08f04f8f4e6f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1501 microversion: 2.1 time: 0.515986 Oct 17 13:34:28.611843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2243/4460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:28 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1501 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:28.639895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:28.640881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:28.648615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.649427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.650069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.651019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:28.651818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:28.652472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:28.896764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:28.912371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62712158-37d4-4ef7-b77e-9ec2f4dce974 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.705958 Oct 17 13:34:28.930778 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2218/4461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:28 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:28.994357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d8bb0f2a-7afd-4315-b07e-b776f6cbd1ba req-7e79155f-1670-4a97-bbf4-d472073543ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06032b3e-136e-4489-b950-8c2f2a527957", "tag": "c0f19e62-9a14-4c10-b7a3-dc993f49b7af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:29.018724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d8bb0f2a-7afd-4315-b07e-b776f6cbd1ba req-7e79155f-1670-4a97-bbf4-d472073543ed service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.019586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d8bb0f2a-7afd-4315-b07e-b776f6cbd1ba req-7e79155f-1670-4a97-bbf4-d472073543ed service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.020283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d8bb0f2a-7afd-4315-b07e-b776f6cbd1ba req-7e79155f-1670-4a97-bbf4-d472073543ed service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.046392 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d8bb0f2a-7afd-4315-b07e-b776f6cbd1ba req-7e79155f-1670-4a97-bbf4-d472073543ed service nova] Creating event network-changed:c0f19e62-9a14-4c10-b7a3-dc993f49b7af for instance 06032b3e-136e-4489-b950-8c2f2a527957 on n-h2-854121-14 Oct 17 13:34:29.055089 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d8bb0f2a-7afd-4315-b07e-b776f6cbd1ba req-7e79155f-1670-4a97-bbf4-d472073543ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064553 Oct 17 13:34:29.056150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2219/4462] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:29.112971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:29.113768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:29.129511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.130372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.131049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.131973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.132645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.133306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.278708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:29.546772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:29.558812 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7317dc31-2edc-475c-9ef8-a21129673896 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1501 microversion: 2.1 time: 0.926679 Oct 17 13:34:29.567952 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2244/4463] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:28 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1501 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:29.583014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:29.594683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf3045ec-2014-4110-a049-46ef5dca124e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.486203 Oct 17 13:34:29.601443 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2220/4464] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:29 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:29.613626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:29.614864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:29.619620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:29.623126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:29.652089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.664662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.665811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.672021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.674139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.677852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.678426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.679113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.683580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.684992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:29.687488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:29.688820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:29.804060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:29.883902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=40 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:30.040742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:30.051718 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-78ebd936-740f-4a0a-8427-e8e9d8a3acb2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1516 microversion: 2.1 time: 0.482437 Oct 17 13:34:30.069417 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2245/4465] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:29 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:30.082973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:30.088972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f61f9401-bb82-41e6-bfaa-a23e34b16bfc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 204 len: 0 microversion: 2.1 time: 0.480009 Oct 17 13:34:30.090504 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2221/4466] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:29 2022] DELETE /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:30.098109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:30.118831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:30.125502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:30.133872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.137741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.140745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.144156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.149843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.153795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.158486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.166595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.169995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.175619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:30.178766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:30.180864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:30.959623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:30.970062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5767bad3-06a0-465b-b6a5-3d39e6995579 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.899419 Oct 17 13:34:30.990125 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2246/4467] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:30.998101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:31.002587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:31.016369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:31.025522 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45b263b4-5a3a-49c5-9852-81d721c69396 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1507 microversion: 2.1 time: 0.929298 Oct 17 13:34:31.029726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.031632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.032030 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2222/4468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1507 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:31.033905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.034796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.035423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.036008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.049947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d96522e9-371b-442f-b811-dc07e1292eda req-2f846cda-0ed8-456c-b401-53e6c6debee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af9f45a-b03a-42ea-ad28-e4cbb0184a9a", "tag": "bbf58c74-c698-4fd8-a37c-e0a09681b906"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:31.078949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d96522e9-371b-442f-b811-dc07e1292eda req-2f846cda-0ed8-456c-b401-53e6c6debee5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:31.079794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d96522e9-371b-442f-b811-dc07e1292eda req-2f846cda-0ed8-456c-b401-53e6c6debee5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:31.080502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d96522e9-371b-442f-b811-dc07e1292eda req-2f846cda-0ed8-456c-b401-53e6c6debee5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:31.108903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d96522e9-371b-442f-b811-dc07e1292eda req-2f846cda-0ed8-456c-b401-53e6c6debee5 service nova] Creating event network-changed:bbf58c74-c698-4fd8-a37c-e0a09681b906 for instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a on n-h2-854121-14 Oct 17 13:34:31.134380 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d96522e9-371b-442f-b811-dc07e1292eda req-2f846cda-0ed8-456c-b401-53e6c6debee5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088178 Oct 17 13:34:31.135381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2223/4469] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:31.300229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:31.311058 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-033c07bb-b1c0-427e-b806-7d72bb2fbe95 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.319558 Oct 17 13:34:31.312209 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2247/4470] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:30 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:32.003970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:32.004710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:32.018198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.018787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.019130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.019849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.020299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.020722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.055835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:32.056451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:32.075226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.075781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.076404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.077085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.093838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.094300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.711764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:32.749970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1917f8aa-ba3a-4afb-8eb8-f4e604d520c3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.742584 Oct 17 13:34:32.755834 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2224/4471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:31 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:32.817147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:32.819555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:32.850176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.850800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.855080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:32.860980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:32.868149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:32.868873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:33.196514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:33.222443 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2ead320-1d47-4341-be51-636b1583c4f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1507 microversion: 2.1 time: 1.164838 Oct 17 13:34:33.223357 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2248/4472] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:32 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1507 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:33.401397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:33.424719 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb05c216-4382-4421-8ba1-c55c2d140b37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.648933 Oct 17 13:34:33.432209 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2225/4473] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:32 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:33.785987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:33.786815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:33.807209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:33.808372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:33.808817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:33.809580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:33.810037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:33.816898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:33.872713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:34.250416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.251770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:34.264011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.264612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.265055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.283501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.284544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.287668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.562716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:34.570828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a212453-6755-4831-a923-37712945b70e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.788911 Oct 17 13:34:34.571423 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2249/4474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:33 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:34.594777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63081e85-19f6-4e0a-a480-bb67e7938dd6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'create', calling method: .version_select at 0x7f419e18df70>, body: {"keypair": {"name": "tempest-keypair-922170140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWWXjzTEGnGbseKatWGWKMSUWJJCAfoO6qUg72gn489kxfAaNE/+HTzy8SMdnB2ubGkCPaH8c76oK+2mTb+XgYHNxW6UhVPdXztXqaaund9gXOYprelL+X0uOxifNjvpA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:34.690508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-63081e85-19f6-4e0a-a480-bb67e7938dd6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for project 6ed221c004a544c79cb496a7b24b831c. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:34.701634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-63081e85-19f6-4e0a-a480-bb67e7938dd6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for user 9258316116624b7181a18659867bd13b and project 6ed221c004a544c79cb496a7b24b831c. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:34.722493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:34.735639 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-727ed051-6a57-436b-8a15-3c3c43e928a2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 200 len: 1465 microversion: 2.1 time: 0.488222 Oct 17 13:34:34.739099 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2226/4475] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 1465 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:34.765376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0938acc9-97d0-411d-a22d-2d6d477ef607 req-2d8832f9-3320-4317-8e06-031d35f80e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd749c83-0bd0-426d-b7b5-ad4f036e57c3", "name": "network-vif-deleted", "tag": "074625ea-9534-4cf8-ba01-e18ee462a41d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:34.795948 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63081e85-19f6-4e0a-a480-bb67e7938dd6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.214712 Oct 17 13:34:34.797892 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2250/4476] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:34:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:34.800405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0938acc9-97d0-411d-a22d-2d6d477ef607 req-2d8832f9-3320-4317-8e06-031d35f80e2b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.805607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0938acc9-97d0-411d-a22d-2d6d477ef607 req-2d8832f9-3320-4317-8e06-031d35f80e2b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.806291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0938acc9-97d0-411d-a22d-2d6d477ef607 req-2d8832f9-3320-4317-8e06-031d35f80e2b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.814198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:34.816988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:34.857205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.858381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.862128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.863114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:34.865928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:34.866621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:34.866809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0938acc9-97d0-411d-a22d-2d6d477ef607 req-2d8832f9-3320-4317-8e06-031d35f80e2b service nova] Creating event network-vif-deleted:074625ea-9534-4cf8-ba01-e18ee462a41d for instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 on n-h1-854121-14 Oct 17 13:34:34.899720 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0938acc9-97d0-411d-a22d-2d6d477ef607 req-2d8832f9-3320-4317-8e06-031d35f80e2b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154852 Oct 17 13:34:34.900965 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2227/4477] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:35.346392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:35.355536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe2e38fe-e856-44c7-a548-e9dbb41b067b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.556298 Oct 17 13:34:35.364476 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2251/4478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:34 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:35.613480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.615588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:35.645116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.645881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.648630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.652259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.659559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.660697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.765292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.766579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:35.790528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:35.794903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.797662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.803321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.809688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:35.816873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:35.817797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:35.862876 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 HTTP/1.1 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'fd749c83-0bd0-426d-b7b5-ad4f036e57c3'} Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.868220 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:35.873025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:35.873025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:35.873025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:35.873025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:35.873025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:34:35.873025 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:34:35.875247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:35.878366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc9b24b8-c958-4009-be8b-9f69bfd78155 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 404 len: 111 microversion: 2.1 time: 0.116596 Oct 17 13:34:35.880298 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2252/4479] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:34:35.895889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0538a411-6fc5-4777-b825-4cb4f49d1e29 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: .version_select at 0x7f419cc3ad30>, body: {"keypair": {"name": "tempest-key-188682988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjkoqHhmnDZJiJFtYoYkcaD+jlqqRRnthCrZA0818E7CKaBGgK+sBpxmC30o28E74RTmFu3TBrdzt+T8dV4ZTHRYgCMzo2Mw0O1WpGkxgwxq6/WeVGRyo+vhKvykozCYA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:35.923307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-0538a411-6fc5-4777-b825-4cb4f49d1e29 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:35.929905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-0538a411-6fc5-4777-b825-4cb4f49d1e29 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:35.963815 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0538a411-6fc5-4777-b825-4cb4f49d1e29 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.071902 Oct 17 13:34:35.965907 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2253/4480] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:34:35 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:35.985213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de3099b9-a5c4-4b0b-92d5-2b486cf6dd6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '.version_select at 0x7f419cc96820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:35.990543 n-d-854121-14 devstack@n-api.service[120698]: WARNING oslo_db.sqlalchemy.utils [None req-de3099b9-a5c4-4b0b-92d5-2b486cf6dd6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 17 13:34:35.996565 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de3099b9-a5c4-4b0b-92d5-2b486cf6dd6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.023721 Oct 17 13:34:35.998116 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2254/4481] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:36.160471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1778569921", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-key-188682988", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:36.299399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:36.824158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:36.837639 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db8ea36b-42ef-4b22-b4f4-30cd4e7175f6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 1.240559 Oct 17 13:34:36.841675 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2228/4482] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:35 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:36.861841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:36.864296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:36.883827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.885599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.887327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:36.888237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:36.888955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:36.889763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.502691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:37.503804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:37.504491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:37.505128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:37.505721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:37.522564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:37.525822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:37.527411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.531275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:37.534673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:37.535423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.584833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:37.599029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:37.640792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:37.643484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:37.649028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:37.668420 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1ab3f33-8224-41bc-87e5-9207566d6b3a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.822692 Oct 17 13:34:37.684289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2229/4483] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:36 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:37.754428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fc2089e-8279-497c-8949-240559dafcf8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597467 Oct 17 13:34:37.757003 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2255/4484] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:34:37.769044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57ee34a2-4803-42ee-b37a-749498439cfd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:37.769949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57ee34a2-4803-42ee-b37a-749498439cfd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:37.877240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:37.878238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:37.894466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:37.896053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:37.896669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.897683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:37.910103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:37.913374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:37.942644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-57ee34a2-4803-42ee-b37a-749498439cfd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:37.953048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57ee34a2-4803-42ee-b37a-749498439cfd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1228 microversion: 2.1 time: 0.186949 Oct 17 13:34:37.954943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2230/4485] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:37 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1228 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:38.283543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:38.293541 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2cc9b61e-494e-44ab-8c7d-8284a6edcdc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.424292 Oct 17 13:34:38.294122 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2256/4486] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:37 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:38.692820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:38.693806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:38.715228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.717410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.720490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:38.723142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:38.726851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:38.727527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:38.994609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:38.998369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:39.027129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.029843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.031302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.034665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.035952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.037926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.126652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:39.136434 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bfd54e00-3c01-4fd4-b8cd-5e7229d0cb67 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.447831 Oct 17 13:34:39.148412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2231/4487] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:38 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:39.173884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:39.184747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e485c10-2c85-4651-b87b-f5c6da17f8b9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1232 microversion: 2.1 time: 0.202376 Oct 17 13:34:39.203582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2257/4488] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:38 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1232 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:39.324340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:39.325417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:39.344855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.345752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.346437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.347396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:39.348089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:39.348736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:39.787842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:39.816287 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-684b16f7-572d-4a53-991d-61681bcce5fa tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.496047 Oct 17 13:34:39.818455 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2232/4489] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:39 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:40.173268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.174403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:40.195595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.196106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.203938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.211383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.211383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.212157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.217408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.220736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:40.255607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.257934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.259430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.261537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.264153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.265539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.462313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:40.475757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e85cb87-11e2-4470-a4c2-213fa87a6238 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1288 microversion: 2.1 time: 0.268171 Oct 17 13:34:40.482052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2233/4490] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1288 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:40.633004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:40.650215 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13379cb1-9bd9-4516-bfba-b70c8430e771 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.477079 Oct 17 13:34:40.650883 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2258/4491] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:40.844566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:40.845852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:40.864430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.864935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.867286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:40.868041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:40.868503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:40.868931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.200647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:41.215672 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77bc2f91-2c79-46cf-a4d9-f9690e4c0327 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.375421 Oct 17 13:34:41.216461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2234/4492] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:40 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:41.518755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.519462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:41.535579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.541800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.544204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.545125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.546400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.546887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.555509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c498062a-6d7a-4fa2-988c-2d96cd18f383 req-49f24929-6253-4f6d-81a1-fb513735b766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06032b3e-136e-4489-b950-8c2f2a527957", "name": "network-vif-plugged", "status": "completed", "tag": "c0f19e62-9a14-4c10-b7a3-dc993f49b7af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:41.570283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c498062a-6d7a-4fa2-988c-2d96cd18f383 req-49f24929-6253-4f6d-81a1-fb513735b766 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.591610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c498062a-6d7a-4fa2-988c-2d96cd18f383 req-49f24929-6253-4f6d-81a1-fb513735b766 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.606052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c498062a-6d7a-4fa2-988c-2d96cd18f383 req-49f24929-6253-4f6d-81a1-fb513735b766 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.644772 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c498062a-6d7a-4fa2-988c-2d96cd18f383 req-49f24929-6253-4f6d-81a1-fb513735b766 service nova] Creating event network-vif-plugged:c0f19e62-9a14-4c10-b7a3-dc993f49b7af for instance 06032b3e-136e-4489-b950-8c2f2a527957 on n-h2-854121-14 Oct 17 13:34:41.661879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c498062a-6d7a-4fa2-988c-2d96cd18f383 req-49f24929-6253-4f6d-81a1-fb513735b766 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110908 Oct 17 13:34:41.669440 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2235/4493] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:41.711405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:41.712190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:41.729733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.740355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.740633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.743923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:41.744415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:41.745480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:41.782253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:41.795757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a5cb3fe7-0723-4b87-952d-e7bc9ba5f11f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1286 microversion: 2.1 time: 0.294049 Oct 17 13:34:41.802667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2259/4494] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1286 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:42.147920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:42.160870 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73080070-a3b8-46b7-808e-a696f8ed483c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.486029 Oct 17 13:34:42.178357 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2236/4495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:41 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:42.242453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:42.243076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:42.250355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:42.250622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:42.258945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:42.259704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:42.260343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:42.260968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:42.819864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:42.820539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:42.827238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:42.827742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:42.828185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:42.828885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:42.829558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:42.833057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:42.951599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:43.012153 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-161c7fb5-a6f9-4747-803d-15a487140296 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1527 microversion: 2.1 time: 0.773447 Oct 17 13:34:43.020947 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2260/4496] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:42 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1527 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:43.099206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-706253768", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b08fd1b8-f823-4fc4-a1e5-d5b611838b68"}], "security_groups": [{"name": "tempest-securitygroup--295990141"}], "key_name": "tempest-keypair-922170140", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:43.221935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:43.249218 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8116884e-0282-468d-819b-090022055469 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.433196 Oct 17 13:34:43.253041 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2237/4497] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:42 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:43.279712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:43.283262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:43.294193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.294193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.294193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.294193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:43.294193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:43.295123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:43.322566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] validate_networks() for [('b08fd1b8-f823-4fc4-a1e5-d5b611838b68', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:43.683777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:43.699992 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68953d1f-a41c-4058-8d29-aa5a7cb07cad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.439376 Oct 17 13:34:43.713199 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2238/4498] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:43 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:44.055248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:44.055248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:44.066783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.067093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.067538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.071809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.073548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.077471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.233278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:44.233816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:44.234279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:44.234691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:44.235203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:44.265401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.267268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.269572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.271946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.273541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.275513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.328777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for project 6ed221c004a544c79cb496a7b24b831c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:44.343778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Getting quotas for user 9258316116624b7181a18659867bd13b and project 6ed221c004a544c79cb496a7b24b831c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:44.378535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:44.387218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:44.455427 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1bcf6312-3215-46d1-906b-4403d8a04d62 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.360247 Oct 17 13:34:44.456269 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2261/4499] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:43 2022] POST /compute/v2.1/servers => generated 408 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:44.468843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:44.473022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:44.502038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.502530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.518613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.519759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:44.519867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:44.520277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:44.738243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:44.765432 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5e4c780-c83e-49d8-9b26-cb6ae79dfe92 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1509 microversion: 2.1 time: 0.721514 Oct 17 13:34:44.767788 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2239/4500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:44 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1509 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:44.990505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:45.000564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-347f31d7-14f5-45f5-8e69-a43aba54e214 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.543213 Oct 17 13:34:45.006377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2262/4501] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:44 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:45.029464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3687cfce-e47a-49dc-800e-cd33414aacb1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:45.036795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3687cfce-e47a-49dc-800e-cd33414aacb1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:45.038782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:45.118599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3687cfce-e47a-49dc-800e-cd33414aacb1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:45.138808 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3687cfce-e47a-49dc-800e-cd33414aacb1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1244 microversion: 2.1 time: 0.128534 Oct 17 13:34:45.141035 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2263/4502] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:45 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1244 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:45.148187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:45.149602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:45.157978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.158768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.160207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.161086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.162335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.162929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.397255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1582513559", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:45.468378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:45.470179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:45.500070 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac746e61-ca41-4b01-9192-b89473956cd9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.357591 Oct 17 13:34:45.505025 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2264/4503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:45 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:45.552166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-508819df-6102-4817-a59f-63f9e7bfbe46 req-de1d35e5-0e87-492f-be79-4e75e7618b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af9f45a-b03a-42ea-ad28-e4cbb0184a9a", "name": "network-vif-plugged", "status": "completed", "tag": "bbf58c74-c698-4fd8-a37c-e0a09681b906"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:45.602670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-508819df-6102-4817-a59f-63f9e7bfbe46 req-de1d35e5-0e87-492f-be79-4e75e7618b86 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.603367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-508819df-6102-4817-a59f-63f9e7bfbe46 req-de1d35e5-0e87-492f-be79-4e75e7618b86 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.605953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-508819df-6102-4817-a59f-63f9e7bfbe46 req-de1d35e5-0e87-492f-be79-4e75e7618b86 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.647806 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-508819df-6102-4817-a59f-63f9e7bfbe46 req-de1d35e5-0e87-492f-be79-4e75e7618b86 service nova] Creating event network-vif-plugged:bbf58c74-c698-4fd8-a37c-e0a09681b906 for instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a on n-h2-854121-14 Oct 17 13:34:45.663232 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-508819df-6102-4817-a59f-63f9e7bfbe46 req-de1d35e5-0e87-492f-be79-4e75e7618b86 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123855 Oct 17 13:34:45.666220 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2265/4504] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:45.684581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c55330f3-7820-4da5-bb45-60b9aeee8a41 req-2f01d09d-ac65-4519-bfeb-78356cdf2770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e5b00d4-baa0-41fc-b51b-476f1d5a9f61", "tag": "650ec240-39f5-4652-86d8-e79801098b92"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:45.726893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c55330f3-7820-4da5-bb45-60b9aeee8a41 req-2f01d09d-ac65-4519-bfeb-78356cdf2770 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.732074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c55330f3-7820-4da5-bb45-60b9aeee8a41 req-2f01d09d-ac65-4519-bfeb-78356cdf2770 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.732926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c55330f3-7820-4da5-bb45-60b9aeee8a41 req-2f01d09d-ac65-4519-bfeb-78356cdf2770 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.754041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c55330f3-7820-4da5-bb45-60b9aeee8a41 req-2f01d09d-ac65-4519-bfeb-78356cdf2770 service nova] Creating event network-changed:650ec240-39f5-4652-86d8-e79801098b92 for instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 on n-h1-854121-14 Oct 17 13:34:45.759848 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c55330f3-7820-4da5-bb45-60b9aeee8a41 req-2f01d09d-ac65-4519-bfeb-78356cdf2770 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091004 Oct 17 13:34:45.762170 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2266/4505] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:45.799116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:45.800728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:45.819281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.820091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.821764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:45.822629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:45.825935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:45.826579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.451206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:46.459728 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0c39102b-73c5-46c0-b8b9-3be0532a1c58 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1509 microversion: 2.1 time: 0.667217 Oct 17 13:34:46.464041 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2267/4506] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:45 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1509 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:46.473248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:46.480139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:46.492840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.493363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.493806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.494514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.495732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.496170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.570079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:46.571130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:46.571829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:46.572827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:46.573474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:46.614490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.615583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.616348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.617453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.618165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.618859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.659315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:46.668333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:46.673615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:46.690140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:46.692803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:46.842808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-773f5f2b-8cb3-46c8-88da-4d185e9710ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.072728 Oct 17 13:34:46.853292 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2240/4507] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:34:46.863497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:46.866640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:46.898253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.898762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.899211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.899938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:46.900402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:46.900828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:46.974658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:46.991933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f1d8886-bee3-472d-92c4-7c4d372b6ee3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.526401 Oct 17 13:34:47.002097 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2268/4508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:46 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:47.015517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.019322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.034211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.037053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.037735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.044082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.045132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.046105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.172164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.194895 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f061b671-9fb8-4b2c-9107-681f14a39aa0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1304 microversion: 2.1 time: 0.345348 Oct 17 13:34:47.198459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2241/4509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:46 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1304 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:47.214163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c8c10d1-d67b-4e09-ab4a-bed5c61f00df tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.215197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c8c10d1-d67b-4e09-ab4a-bed5c61f00df tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.433113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.454875 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abc6e9e0-6657-4c61-a54f-e136f11d56ab tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1319 microversion: 2.1 time: 0.447761 Oct 17 13:34:47.455598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2269/4510] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:47.461958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c8c10d1-d67b-4e09-ab4a-bed5c61f00df tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.472860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c8c10d1-d67b-4e09-ab4a-bed5c61f00df tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1215 microversion: 2.1 time: 0.273070 Oct 17 13:34:47.476714 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2242/4511] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1215 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:47.494901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:47.503896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:47.525839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.527018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.527472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.528222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:47.528684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:47.529145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:47.747884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:47.763054 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d9f710a-5676-4148-8d4a-337f5eb9d570 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1509 microversion: 2.1 time: 0.275588 Oct 17 13:34:47.778776 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2270/4512] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:47 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.050743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.051410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.068339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.069113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.071666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.078280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.079068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.079882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.225842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.226639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.253244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.259029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.260216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.261174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.261825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.262356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.308308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.318858 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e221a8e8-1444-4ae0-af08-3126594e0874 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.297233 Oct 17 13:34:48.340441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2243/4513] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.382318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.392787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fece5a19-a5e8-4366-913d-be8dd7c32e40 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1302 microversion: 2.1 time: 0.171775 Oct 17 13:34:48.394105 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2271/4514] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.485145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.486313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.501519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.502212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.506937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.510131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.510735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.511625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.512540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.513194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.513823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.515973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.517443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.517746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.525925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.526654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.655270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.671822 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff1f7f48-07ee-496b-9efa-f0f499f129f5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1267 microversion: 2.1 time: 0.175292 Oct 17 13:34:48.672423 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2272/4515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.702654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ba53f706-926c-400b-81b5-823238f0fbb8 req-88d4a8ea-2caf-4e50-80d4-92cd1c4af174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c999d9-c3d1-435f-96f0-5505353369b8", "name": "network-vif-unplugged", "status": "completed", "tag": "d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:48.741491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ba53f706-926c-400b-81b5-823238f0fbb8 req-88d4a8ea-2caf-4e50-80d4-92cd1c4af174 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.742092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ba53f706-926c-400b-81b5-823238f0fbb8 req-88d4a8ea-2caf-4e50-80d4-92cd1c4af174 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.742527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ba53f706-926c-400b-81b5-823238f0fbb8 req-88d4a8ea-2caf-4e50-80d4-92cd1c4af174 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.774371 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ba53f706-926c-400b-81b5-823238f0fbb8 req-88d4a8ea-2caf-4e50-80d4-92cd1c4af174 service nova] Creating event network-vif-unplugged:d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7 for instance 54c999d9-c3d1-435f-96f0-5505353369b8 on n-h2-854121-14 Oct 17 13:34:48.790024 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ba53f706-926c-400b-81b5-823238f0fbb8 req-88d4a8ea-2caf-4e50-80d4-92cd1c4af174 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101665 Oct 17 13:34:48.790652 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2273/4516] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:48.812029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.813095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.833655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.834110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.834573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.838134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.838728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.839169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.843812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:48.947103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:48.955645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bb95b57-68fa-4ac1-ad85-3da0381cf65e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1468 microversion: 2.1 time: 0.478067 Oct 17 13:34:48.958975 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2244/4517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1468 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:48.986519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:48.987246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:48.993983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.996360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:48.997523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:48.998826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:48.999530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.000175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.236820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.248661 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-001c5adf-3ddd-456f-bbfc-7398b90cdb39 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1509 microversion: 2.1 time: 0.456794 Oct 17 13:34:49.249666 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2274/4518] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:49.345393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.345393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.352466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.353281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.354013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.356209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.356843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.360586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.381040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.394605 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf3cbb22-23b6-4ff9-a453-d4418f7889b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 200 len: 1469 microversion: 2.1 time: 0.411864 Oct 17 13:34:49.398551 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2245/4519] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:48 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 1469 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:49.422314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.422990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.437905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.441491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.441970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.442722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.443184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.443618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.782352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.791065 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-210d03f9-ba9e-48e9-a051-b0e001b2a207 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.452362 Oct 17 13:34:49.794427 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2275/4520] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:49.801948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.815695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.816603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Searching by: {'reservation_id': 'r-79n5zi38', 'deleted': False, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:34:49.828546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.828954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.829435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.833512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.835362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.835779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.848738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:49.866932 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-025d23c7-7d1f-4fba-8af7-f274328b6066 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.452153 Oct 17 13:34:49.868341 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2246/4521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:49.875689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:49.876566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:49.892511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.893279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.893641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:49.894350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:49.894916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:49.895341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.023412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.035716 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52904dee-a70b-44a4-97bd-ef6285462273 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1267 microversion: 2.1 time: 0.165852 Oct 17 13:34:50.057843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2247/4522] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.073680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:34:50.185008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.193527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.194026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.194471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.281477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.282466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.292836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.293357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.293972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.294840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.295554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.296130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.322082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:50.428081 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7455498-7c4f-42e8-a1b0-3d55217f8e98 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/detail?reservation_id=r-79n5zi38" status: 200 len: 2930 microversion: 2.1 time: 0.632204 Oct 17 13:34:50.428695 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2276/4523] 10.222.0.65 () {58 vars in 1197 bytes} [Mon Oct 17 13:34:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-79n5zi38 => generated 2930 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.454820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-505d42f3-aacf-48f9-851f-cf810f6986c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.501103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.server_groups [None req-505d42f3-aacf-48f9-851f-cf810f6986c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Querying cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) for 2 instances {{(pid=120698) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:34:50.504370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-505d42f3-aacf-48f9-851f-cf810f6986c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.505021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-505d42f3-aacf-48f9-851f-cf810f6986c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.509700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-505d42f3-aacf-48f9-851f-cf810f6986c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.568497 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-505d42f3-aacf-48f9-851f-cf810f6986c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups/6960bf96-04ad-403c-8562-3cab493e24d7" status: 200 len: 265 microversion: 2.1 time: 0.117413 Oct 17 13:34:50.569091 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2277/4524] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/os-server-groups/6960bf96-04ad-403c-8562-3cab493e24d7 => generated 265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:50.581360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.581866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:50.582755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.590112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.590823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.591410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.592431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.593066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.593762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.595078 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2abe723-dfc5-4bc4-b27f-d58a50da27cc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1509 microversion: 2.1 time: 0.318861 Oct 17 13:34:50.602553 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2248/4525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1509 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:50.787008 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24ad4972-2a6c-420d-95a4-ec65d0c44bc5 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 200 len: 1622 microversion: 2.1 time: 0.209960 Oct 17 13:34:50.797650 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2278/4526] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 1622 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:50.819096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.819730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.824149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:50.826633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.827193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.827560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.828155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:50.828263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.828706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.829138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.844710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.846407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.847073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:50.848618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:50.849326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:50.850189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.203056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:51.215408 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-191dd09f-3227-40eb-bff8-a018e2decd85 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1621 microversion: 2.1 time: 0.408849 Oct 17 13:34:51.216549 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2249/4527] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1621 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:51.221427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e29f05c4-2c73-4cf1-b304-6e6653aa57df req-b31cd00e-ba37-449e-a3a9-4abe25fa6afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0000a0ee-91cb-40ec-9d8f-ee7101525586", "tag": "a084652e-4641-4d8e-a921-aa1c0536e920"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:51.231965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e29f05c4-2c73-4cf1-b304-6e6653aa57df req-b31cd00e-ba37-449e-a3a9-4abe25fa6afe service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.232775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e29f05c4-2c73-4cf1-b304-6e6653aa57df req-b31cd00e-ba37-449e-a3a9-4abe25fa6afe service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.233500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e29f05c4-2c73-4cf1-b304-6e6653aa57df req-b31cd00e-ba37-449e-a3a9-4abe25fa6afe service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.242533 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-426f09d6-7e2e-425e-82b9-3337dfad7486 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.421549 Oct 17 13:34:51.246769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2279/4528] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:50 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:51.258633 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e29f05c4-2c73-4cf1-b304-6e6653aa57df req-b31cd00e-ba37-449e-a3a9-4abe25fa6afe service nova] Creating event network-changed:a084652e-4641-4d8e-a921-aa1c0536e920 for instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 on n-h1-854121-14 Oct 17 13:34:51.266826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:51.268027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:51.269669 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e29f05c4-2c73-4cf1-b304-6e6653aa57df req-b31cd00e-ba37-449e-a3a9-4abe25fa6afe service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051574 Oct 17 13:34:51.273990 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2250/4529] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:51.289035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:51.290123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:51.293495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.295520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.297089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.301456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.306306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.306820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.307504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.308321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.309346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.310267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.310267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.315249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.502803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:51.517964 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4ffe160-91c0-48e1-90ad-919f94092dec tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1285 microversion: 2.1 time: 0.242066 Oct 17 13:34:51.519421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2251/4530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:51 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:51.540597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b86acbc7-7844-4576-ac27-4f0100ae8e2b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: .version_select at 0x7f419d121670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-825250572", "policies": ["anti-affinity"]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:51.613126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b86acbc7-7844-4576-ac27-4f0100ae8e2b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:51.624314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b86acbc7-7844-4576-ac27-4f0100ae8e2b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:51.726288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:51.737290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b86acbc7-7844-4576-ac27-4f0100ae8e2b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:51.739429 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca3712ac-6100-4616-9cf6-11351aa06766 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.490712 Oct 17 13:34:51.740214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2280/4531] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:51 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:51.750266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b86acbc7-7844-4576-ac27-4f0100ae8e2b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:51.759485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9f928d58-7175-4e2a-8f05-f7916781087d req-ab18cb59-9546-4551-a7e2-17ec90bf3433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5b00d4-baa0-41fc-b51b-476f1d5a9f61", "name": "network-vif-plugged", "status": "completed", "tag": "650ec240-39f5-4652-86d8-e79801098b92"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:51.767879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b86acbc7-7844-4576-ac27-4f0100ae8e2b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.239969 Oct 17 13:34:51.780220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9f928d58-7175-4e2a-8f05-f7916781087d req-ab18cb59-9546-4551-a7e2-17ec90bf3433 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.781342 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2252/4532] 10.222.0.65 () {60 vars in 1174 bytes} [Mon Oct 17 13:34:51 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:51.783831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9f928d58-7175-4e2a-8f05-f7916781087d req-ab18cb59-9546-4551-a7e2-17ec90bf3433 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.786170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9f928d58-7175-4e2a-8f05-f7916781087d req-ab18cb59-9546-4551-a7e2-17ec90bf3433 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.787310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:51.788013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:51.796872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.796872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.797352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.798072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:51.798534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:51.798959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:51.812200 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9f928d58-7175-4e2a-8f05-f7916781087d req-ab18cb59-9546-4551-a7e2-17ec90bf3433 service nova] Creating event network-vif-plugged:650ec240-39f5-4652-86d8-e79801098b92 for instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 on n-h1-854121-14 Oct 17 13:34:51.820116 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9f928d58-7175-4e2a-8f05-f7916781087d req-ab18cb59-9546-4551-a7e2-17ec90bf3433 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077192 Oct 17 13:34:51.821666 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2281/4533] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:51.952249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-502334139", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4fdb0dcf-357c-48bf-abed-eaf0449d3dda"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:52.013331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.024475 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8993340-fa5f-4dbf-8779-bbd04d6f6e63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1452 microversion: 2.1 time: 0.241238 Oct 17 13:34:52.025073 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2253/4534] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:51 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.051977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.052604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.061672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:34:52.065144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.065680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.066386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.067122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.071064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.075501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.377765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.398744 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f48b9763-a003-4bac-940c-cf212590ebff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1452 microversion: 2.1 time: 0.350702 Oct 17 13:34:52.409220 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2254/4535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1452 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:52.422702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.424081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.452213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.457283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:34:52.457400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:34:52.457869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:34:52.458282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:34:52.458798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:34:52.459972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.462352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.464313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.465291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.466863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.476533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.477022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.477575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.478562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.479680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.480104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.502640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:52.509357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:52.531232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Going to run 2 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:34:52.534911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:52.607732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:52.624002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:52.696557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:52.710756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.711335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:52.723113 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-50ea5d36-f683-479d-9cd4-9ed8ce04b871 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.318367 Oct 17 13:34:52.724727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2255/4536] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.729832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:52.730620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.738295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.739348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.740096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.740416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=42e1d2ad-aba5-4260-ad4d-5fe6945b2c27,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:34:52.741031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.741503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.752965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.785364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lazy-loading 'flavor' on Instance uuid 54c999d9-c3d1-435f-96f0-5505353369b8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:34:52.805821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'shelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state shelved_offloaded Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 14 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: {"shelve": {}} Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'shelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state shelved_offloaded Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'shelve': {}}} Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:34:52.809264 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state shelved_offloaded Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state shelved_offloaded Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'shelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state shelved_offloaded {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32e1a4e7-2bfb-4851-8e5b-ca59cd302ddd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 155 microversion: 2.1 time: 0.084940 Oct 17 13:34:52.813224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2256/4537] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:34:52 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 155 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:34:52.816552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.817224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.827871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.828676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.829294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.830010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.830488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.831937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.851277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:52.860493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:52.886944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:52.938077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:52.948735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:34:52.950323 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73689bb9-24f2-41e2-abcf-6d97df3b33b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1273 microversion: 2.1 time: 0.137815 Oct 17 13:34:52.950782 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2257/4538] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:52.957513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:52.958134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:52.966691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.967203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.967946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.969081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:52.969539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:52.969978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:52.980117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'server_group_members'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:34:53.049073 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64aa909c-c96d-445f-a6e0-dce47899340d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.102942 Oct 17 13:34:53.054718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2282/4539] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:34:51 2022] POST /compute/v2.1/servers => generated 32 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 17 13:34:53.062266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:53.063116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.070945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.071750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.072396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.073611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.074301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.075209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.183374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:34:53.308759 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58784631-3400-4c66-ad6f-3a0eedf42245 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 202 len: 0 microversion: 2.1 time: 0.252347 Oct 17 13:34:53.309949 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2283/4540] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:34:53 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:34:53.316341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.322106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:53.323083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Searching by: {'deleted': False, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:34:53.351842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.352465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.353038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.354506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.355477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.356258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.368847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:53.392648 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb4323b0-7d9d-4a46-aabc-60eacd79ec3a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.440634 Oct 17 13:34:53.395002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2258/4541] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:52 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.396636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:34:53.400645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.402032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.410325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.411187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.412201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.413082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.413852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.414685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.463305 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f9ca333-d1aa-4975-87f3-ff2f7d5f4dad tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.150877 Oct 17 13:34:53.475981 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2284/4542] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.485408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-71ddb4c3-d343-4445-86b2-047fe230dae4 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.489328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-71ddb4c3-d343-4445-86b2-047fe230dae4 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.649271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-71ddb4c3-d343-4445-86b2-047fe230dae4 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:53.662766 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-71ddb4c3-d343-4445-86b2-047fe230dae4 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1218 microversion: 2.1 time: 0.185290 Oct 17 13:34:53.664004 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2285/4543] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.750105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.752170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.769588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.771599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.772115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.774047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.777057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.778172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:53.791991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:53.801598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0987b140-d6b8-4791-944e-4ecb36561618 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1460 microversion: 2.1 time: 0.405181 Oct 17 13:34:53.817931 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2259/4544] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1460 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:53.976843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:53.977756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:53.998397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:53.999092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:53.999539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.000268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.006005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.008241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.106898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.126834 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1af82c5-d511-4062-a40d-c2746f4e31ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1328 microversion: 2.1 time: 0.382632 Oct 17 13:34:54.138448 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2286/4545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.416014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.423176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.424321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.427883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59c1ffef-900d-465b-827b-3779b2631fae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.454839 Oct 17 13:34:54.432903 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2260/4546] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:53 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.446767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.446767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.446767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.446767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.446767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.446767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.690318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39951a3f-476b-4f79-8eee-bd2a1613cad7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.691363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-39951a3f-476b-4f79-8eee-bd2a1613cad7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.831487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.844207 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7247fb7-e604-445a-ab10-50464d247360 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.426203 Oct 17 13:34:54.844804 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2287/4547] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:54.857096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:54.857768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:54.878156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.879200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.879715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.880448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:54.881090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:54.881546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:54.892378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-39951a3f-476b-4f79-8eee-bd2a1613cad7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:54.902406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39951a3f-476b-4f79-8eee-bd2a1613cad7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1218 microversion: 2.1 time: 0.216282 Oct 17 13:34:54.921186 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2261/4548] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1218 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:55.154186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.154806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.181293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.181536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.182242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.184142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.184908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.189582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.190046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.198642 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8ae5758-eb1f-4c70-988c-0a97cbf3944e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1460 microversion: 2.1 time: 0.351805 Oct 17 13:34:55.199970 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2288/4549] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:54 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1460 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:55.461538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.463088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.486419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.488052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.490940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.492989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.494223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.495968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.597703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.644355 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-447f4136-0f1a-4b4b-a818-a2db580407ca tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1510 microversion: 2.1 time: 0.494543 Oct 17 13:34:55.645994 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2262/4550] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1510 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:34:55.685363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.689472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.719204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.721292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.722769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.725152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.726348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.729039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.868589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:55.882416 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2af177c-6ddc-4eeb-96ad-d488d7f3d604 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.429195 Oct 17 13:34:55.883031 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2289/4551] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:55.910546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b0a77a55-3d8b-49ef-9473-0a748379a1b2 req-0d8f1381-fc16-4258-b7ce-68666aa3e3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345f1c3b-cc0b-49f9-82e1-0c6481cad86e", "tag": "b1309fe5-6bb9-4db7-b245-fde58bd11dec"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:55.923191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b0a77a55-3d8b-49ef-9473-0a748379a1b2 req-0d8f1381-fc16-4258-b7ce-68666aa3e3c7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.923676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b0a77a55-3d8b-49ef-9473-0a748379a1b2 req-0d8f1381-fc16-4258-b7ce-68666aa3e3c7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.924194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b0a77a55-3d8b-49ef-9473-0a748379a1b2 req-0d8f1381-fc16-4258-b7ce-68666aa3e3c7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.941191 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b0a77a55-3d8b-49ef-9473-0a748379a1b2 req-0d8f1381-fc16-4258-b7ce-68666aa3e3c7 service nova] Creating event network-changed:b1309fe5-6bb9-4db7-b245-fde58bd11dec for instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e on n-h2-854121-14 Oct 17 13:34:55.949744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b0a77a55-3d8b-49ef-9473-0a748379a1b2 req-0d8f1381-fc16-4258-b7ce-68666aa3e3c7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044723 Oct 17 13:34:55.951290 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2290/4552] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:34:55.957790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:55.958770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:55.969332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.970283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.970974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:55.972029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:55.972636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:55.973269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.190028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:56.200888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ee6be79-833e-4c7f-8a98-62d4e3ad729a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1510 microversion: 2.1 time: 0.524148 Oct 17 13:34:56.207671 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2263/4553] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1510 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:56.218626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.218626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.232706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.235579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.236364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.237357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.237986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.244114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.325006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:56.336536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c96aafb2-6fd0-4a28-92ec-f5ae39a2e208 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.383752 Oct 17 13:34:56.341464 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2291/4554] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:55 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:56.369152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.375885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.379067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:56.387619 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1acb2c4-d791-41e8-a53f-321eb9696013 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1270 microversion: 2.1 time: 0.178572 Oct 17 13:34:56.393772 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2264/4555] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:56.405395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.405905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.406504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.407057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.408041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.409646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.425330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.425833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.426954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:56.455037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.458835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.459314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.460423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.462648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.463108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.540642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:34:56.646124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:56.669678 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d338b15-7b54-489b-8222-5693780c8987 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 204 len: 0 microversion: 2.1 time: 0.273846 Oct 17 13:34:56.674499 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2265/4556] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:34:56 2022] DELETE /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:34:56.687766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:56.688163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:56.708336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.708770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.709236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.709950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:56.710402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:56.710827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:56.728413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:56.983454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:56.995291 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-085c252f-b7bc-4e74-813e-1da21902acc6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1460 microversion: 2.1 time: 0.649623 Oct 17 13:34:56.996456 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2292/4557] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1460 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.014211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.014844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.025040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.026804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.027435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.029071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.030919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.032039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.237816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.248606 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e3df866-84f0-4e2a-8ff4-b3946a3a55f0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1516 microversion: 2.1 time: 0.571935 Oct 17 13:34:57.251149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2266/4558] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1516 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.359271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0675c100-4f87-4dcf-86aa-406ada685844 req-fc3f3559-8507-453f-9ed6-8c92d9c3a981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0000a0ee-91cb-40ec-9d8f-ee7101525586", "name": "network-vif-plugged", "status": "completed", "tag": "a084652e-4641-4d8e-a921-aa1c0536e920"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:57.366962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.375979 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-088dd564-c928-47e5-a25d-008d9ee1640d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.375557 Oct 17 13:34:57.381808 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2293/4559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:56 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.385606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0675c100-4f87-4dcf-86aa-406ada685844 req-fc3f3559-8507-453f-9ed6-8c92d9c3a981 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.386126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0675c100-4f87-4dcf-86aa-406ada685844 req-fc3f3559-8507-453f-9ed6-8c92d9c3a981 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.386585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0675c100-4f87-4dcf-86aa-406ada685844 req-fc3f3559-8507-453f-9ed6-8c92d9c3a981 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.391037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.391770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.408431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.408940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.410636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.412030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.413461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.413785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.428109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0675c100-4f87-4dcf-86aa-406ada685844 req-fc3f3559-8507-453f-9ed6-8c92d9c3a981 service nova] Creating event network-vif-plugged:a084652e-4641-4d8e-a921-aa1c0536e920 for instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 on n-h1-854121-14 Oct 17 13:34:57.448691 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0675c100-4f87-4dcf-86aa-406ada685844 req-fc3f3559-8507-453f-9ed6-8c92d9c3a981 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092082 Oct 17 13:34:57.450525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2267/4560] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:34:57.464751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:57.465800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:57.481938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.484010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.485920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.488874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:57.490383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:57.492204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:57.638192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.647603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae0e64d0-db4c-4904-be62-04be6cde5158 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1276 microversion: 2.1 time: 0.193872 Oct 17 13:34:57.661942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2268/4561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1276 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:57.730105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:57.741700 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ec15113-6239-41a7-ab6a-907c67e65b91 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.361163 Oct 17 13:34:57.742493 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2294/4562] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:57 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:58.022250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:58.022910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:58.028716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:34:58.033872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:58.034379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:58.034815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:58.035877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:58.036487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:58.037237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:58.273372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:58.274200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:58.289361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:58.290057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:58.290931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:58.294546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:58.295976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:58.298878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.135692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.139750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.146754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b56994c7-8768-412e-8f27-ebbb70c731b1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1516 microversion: 2.1 time: 0.877746 Oct 17 13:34:59.150126 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35590941-39d7-476f-88c2-288319bda8c2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 1.133874 Oct 17 13:34:59.152073 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2269/4563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:58 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:59.157249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:59.158115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:59.159466 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2295/4564] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:58 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1516 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:59.167972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:59.168986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:59.174903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.175612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.176379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.177249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.177851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.178423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.188655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.189390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.189985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.191159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.191783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.192363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.344336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.362130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-023dbfd4-f9dd-4f6b-881e-a36d06d1093e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1276 microversion: 2.1 time: 0.201133 Oct 17 13:34:59.364012 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2296/4565] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:59 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:59.373857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:34:59.376942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:34:59.389050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.390179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.392049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.393880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.394574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.395782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.548503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.562431 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9bfc9509-9c53-4cff-aa1f-d4f73224ea94 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.409065 Oct 17 13:34:59.563641 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2270/4566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:59 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:59.651563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:34:59.665329 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c89162bb-ca62-4279-948d-d294be5d451a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1369 microversion: 2.1 time: 0.298533 Oct 17 13:34:59.666647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2297/4567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:34:59 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1369 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:34:59.911250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f76767af-9eac-49e2-8499-a81dc635fffc req-8608de76-2af1-4c8b-8289-1f2632884d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e5b00d4-baa0-41fc-b51b-476f1d5a9f61", "name": "network-vif-deleted", "tag": "650ec240-39f5-4652-86d8-e79801098b92"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:34:59.942700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f76767af-9eac-49e2-8499-a81dc635fffc req-8608de76-2af1-4c8b-8289-1f2632884d6c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:34:59.943592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f76767af-9eac-49e2-8499-a81dc635fffc req-8608de76-2af1-4c8b-8289-1f2632884d6c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:34:59.944031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f76767af-9eac-49e2-8499-a81dc635fffc req-8608de76-2af1-4c8b-8289-1f2632884d6c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:34:59.995407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f76767af-9eac-49e2-8499-a81dc635fffc req-8608de76-2af1-4c8b-8289-1f2632884d6c service nova] Creating event network-vif-deleted:650ec240-39f5-4652-86d8-e79801098b92 for instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 on n-h1-854121-14 Oct 17 13:35:00.005208 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f76767af-9eac-49e2-8499-a81dc635fffc req-8608de76-2af1-4c8b-8289-1f2632884d6c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099178 Oct 17 13:35:00.006462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2271/4568] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:00.176211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.176897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.178701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.179405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.188314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.188826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.189304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.190447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.190912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.191342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.202384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.205408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.206033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.206779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.210001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.210510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.250924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.250924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.251277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.251779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lazy-loading 'fault' on Instance uuid 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:00.375553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:00.388993 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba255f5e-fe58-45c6-9457-6f752b735390 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 200 len: 1318 microversion: 2.1 time: 0.219891 Oct 17 13:35:00.402118 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2298/4569] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:00.409088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.409735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.418884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.419308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.419752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.420465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.420917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.427322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.496417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:00.509860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9895568e-d33d-410c-b7af-04bf8014f7a5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.335263 Oct 17 13:35:00.511087 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2272/4570] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:00.588091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.589632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.603329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.608888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.609822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.611254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.612356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.613972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.731920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:00.744234 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f7e8d7c-4c94-41a9-b8d1-d784c528957c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1318 microversion: 2.1 time: 0.339362 Oct 17 13:35:00.754112 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2299/4571] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:00.782998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:00.788792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:00.802706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.804504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.806826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:00.810829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:00.811536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:00.812162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.001660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:01.015642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c83bb2d-e697-4b46-96f8-ad375c078286 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.432232 Oct 17 13:35:01.019355 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2273/4572] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:01.081992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:01.095768 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a3444df-1231-42ef-b73a-d85a77a3220c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1563 microversion: 2.1 time: 0.323520 Oct 17 13:35:01.101276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2300/4573] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:00 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1563 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:01.148797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.149473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:01.158414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.158980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.159694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.160773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.161449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.162100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.308157 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a494aa68-ae14-41a6-b067-0f03f09f50ee tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165729 Oct 17 13:35:01.309122 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2274/4574] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:35:01 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:01.414020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.415170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:01.430667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.431240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.434685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.435523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.436577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.437924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.470012 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 HTTP/1.1 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '4e5b00d4-baa0-41fc-b51b-476f1d5a9f61'} Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:01.479755 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:01.484224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:01.484224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:01.484224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:01.484224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:01.484224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:35:01.484224 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:01.498412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:01.504847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ebe9d8a8-e41a-4fe3-a060-2feeaffc5a8b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 404 len: 111 microversion: 2.1 time: 0.095597 Oct 17 13:35:01.508220 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2301/4575] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:01 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:01.519970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6542690d-c106-485d-a2d7-afa22fd0ac13 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '.version_select at 0x7f419cdccaf0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.536184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:01.543945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:01.572873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.573988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.575801 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6542690d-c106-485d-a2d7-afa22fd0ac13 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-key-188682988" status: 202 len: 0 microversion: 2.1 time: 0.062301 Oct 17 13:35:01.576601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.579294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:01.579735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2275/4576] 10.222.0.65 () {58 vars in 1206 bytes} [Mon Oct 17 13:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-188682988 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:01.580371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:01.581406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:01.768145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2121271875", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:01.870241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:02.015385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:02.029313 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2af485f-9dec-4d3a-9db9-000add83fc98 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.497922 Oct 17 13:35:02.029919 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2302/4577] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:01 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:02.036044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:02.036646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:02.062267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.063133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.063746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:02.064609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:02.065239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:02.065810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.050484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:03.067203 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77dec52e-6dcb-4428-80fa-a0c243265192 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1318 microversion: 2.1 time: 1.035959 Oct 17 13:35:03.068143 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2303/4578] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:02 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:03.086684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:03.087315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:03.095453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.096669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.097537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.098370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.099313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.099438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.373934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:03.537504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:03.558192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c4f46cf-9451-4855-ac82-24f513891186 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.488022 Oct 17 13:35:03.559488 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2304/4579] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:03 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:03.577259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-32d0d61c-81b7-4c10-a525-83a3d9fed67a req-fd2770ba-1184-4e6c-aaab-c9ad71057e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1897b8cf-4c18-41f0-b7ca-2660dda8bffd", "tag": "cc29a07e-58fe-4da8-8781-260512d40dbc"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:03.591157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-32d0d61c-81b7-4c10-a525-83a3d9fed67a req-fd2770ba-1184-4e6c-aaab-c9ad71057e67 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.591793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-32d0d61c-81b7-4c10-a525-83a3d9fed67a req-fd2770ba-1184-4e6c-aaab-c9ad71057e67 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.596748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-32d0d61c-81b7-4c10-a525-83a3d9fed67a req-fd2770ba-1184-4e6c-aaab-c9ad71057e67 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.627535 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-32d0d61c-81b7-4c10-a525-83a3d9fed67a req-fd2770ba-1184-4e6c-aaab-c9ad71057e67 service nova] Creating event network-changed:cc29a07e-58fe-4da8-8781-260512d40dbc for instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd on n-h1-854121-14 Oct 17 13:35:03.636730 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-32d0d61c-81b7-4c10-a525-83a3d9fed67a req-fd2770ba-1184-4e6c-aaab-c9ad71057e67 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075821 Oct 17 13:35:03.637955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2305/4580] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:03.645647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:03.647011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:03.657286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.658156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.659443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.660635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.661420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.662002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.662783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=48 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:03.813375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:03.814607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:03.815371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:03.816187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:03.816837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:03.832864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.833653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.834248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.835142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:03.835784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:03.836672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:03.866568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:03.875011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:03.906150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:03.910157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:04.009403 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-552b8a12-c14f-42f4-ae12-9be15f06a94e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.245691 Oct 17 13:35:04.010912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2276/4581] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:04.023266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-103807aa-cd68-4b1b-946c-1b972155eb44 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:04.024277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-103807aa-cd68-4b1b-946c-1b972155eb44 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:04.039201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:04.050372 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-230c2798-f6f3-4957-b912-2f33a17b22ab tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.411001 Oct 17 13:35:04.069533 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2306/4582] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:03 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:04.096604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:04.097412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:04.110012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.111749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.112752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.113533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.116187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.116648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.872013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-103807aa-cd68-4b1b-946c-1b972155eb44 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:04.880500 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-103807aa-cd68-4b1b-946c-1b972155eb44 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1209 microversion: 2.1 time: 0.861385 Oct 17 13:35:04.899001 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2277/4583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:04 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1209 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:04.912593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:04.922373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:04.973300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:04.973728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:04.982966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:04.997808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.003352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.009000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.502285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:05.511011 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-144d803f-8778-4954-81b1-12aa41c4ee2d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1318 microversion: 2.1 time: 1.419300 Oct 17 13:35:05.517253 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2307/4584] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:04 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1318 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:05.536422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:05.541819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:05.560394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.568650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.569400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.570340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:05.571041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:05.571776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:05.959525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:05.979780 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c80be3d7-6b63-42e9-b606-f321dca8f54e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 1.079457 Oct 17 13:35:05.990706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2278/4585] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:04 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:06.018665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ddbbcc10-bf51-4504-869d-afb1ad59f645 req-becd5a71-4449-489c-8f6a-a0c2545e814e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e1d2ad-aba5-4260-ad4d-5fe6945b2c27", "tag": "385cb44a-845f-498d-8e7d-45e6726a7269"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:06.070342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ddbbcc10-bf51-4504-869d-afb1ad59f645 req-becd5a71-4449-489c-8f6a-a0c2545e814e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.070836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ddbbcc10-bf51-4504-869d-afb1ad59f645 req-becd5a71-4449-489c-8f6a-a0c2545e814e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.071283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ddbbcc10-bf51-4504-869d-afb1ad59f645 req-becd5a71-4449-489c-8f6a-a0c2545e814e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.129810 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ddbbcc10-bf51-4504-869d-afb1ad59f645 req-becd5a71-4449-489c-8f6a-a0c2545e814e service nova] Creating event network-changed:385cb44a-845f-498d-8e7d-45e6726a7269 for instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 on n-h2-854121-14 Oct 17 13:35:06.148182 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ddbbcc10-bf51-4504-869d-afb1ad59f645 req-becd5a71-4449-489c-8f6a-a0c2545e814e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153563 Oct 17 13:35:06.150252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2279/4586] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:06.170653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:06.172917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:06.200832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.202558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.208879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.211362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.212114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.212565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.614832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:06.642876 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-676829e4-2756-4c9a-9350-7af04aedc27f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1261 microversion: 2.1 time: 0.488632 Oct 17 13:35:06.647471 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2280/4587] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:06 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1261 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:06.667982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:06.668941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:06.678733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.679591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.680292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.682849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.683914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:06.684566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:06.945867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:06.970888 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c58c3b10-f511-4dff-8ec6-f66e6ed198ff tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 1.448277 Oct 17 13:35:06.972376 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2308/4588] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:05 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:06.984278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-322f0ecd-4618-48bb-9e73-d3b33a2aecfe req-aed69744-073a-4e1e-9baa-33aa35615adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345f1c3b-cc0b-49f9-82e1-0c6481cad86e", "name": "network-vif-plugged", "status": "completed", "tag": "b1309fe5-6bb9-4db7-b245-fde58bd11dec"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:06.998162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-322f0ecd-4618-48bb-9e73-d3b33a2aecfe req-aed69744-073a-4e1e-9baa-33aa35615adb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:06.999023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-322f0ecd-4618-48bb-9e73-d3b33a2aecfe req-aed69744-073a-4e1e-9baa-33aa35615adb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.000713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-322f0ecd-4618-48bb-9e73-d3b33a2aecfe req-aed69744-073a-4e1e-9baa-33aa35615adb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.020024 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-322f0ecd-4618-48bb-9e73-d3b33a2aecfe req-aed69744-073a-4e1e-9baa-33aa35615adb service nova] Creating event network-vif-plugged:b1309fe5-6bb9-4db7-b245-fde58bd11dec for instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e on n-h2-854121-14 Oct 17 13:35:07.033286 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-322f0ecd-4618-48bb-9e73-d3b33a2aecfe req-aed69744-073a-4e1e-9baa-33aa35615adb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055709 Oct 17 13:35:07.037258 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2309/4589] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:07.050340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:07.052692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:07.074214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:07.074738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.075191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.075942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:07.076407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.076843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.153006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:07.329577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:07.364050 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9914b112-195f-42ee-aab1-a40a1d83e121 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1318 microversion: 2.1 time: 0.710212 Oct 17 13:35:07.365803 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2281/4590] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:06 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:07.435789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:07.449649 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ffd4e6d4-508e-4a0a-b742-5e0d876c9912 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.408352 Oct 17 13:35:07.450872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2310/4591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:07 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:07.673189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:07.673860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:07.687098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:07.687845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.688695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.689971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:07.698037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:07.698993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:07.856167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:07.864439 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c05fdc6b-6ad2-4c6b-8ece-0ad57dd9165e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1267 microversion: 2.1 time: 0.195210 Oct 17 13:35:07.874194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2282/4592] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:07 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:08.004983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:08.005817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:08.018500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.021433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.023105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.025353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.026107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.028997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.273292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3ba9b68e-3caf-42e4-be6b-0181f2337ea3 req-b6ed8b40-3c0f-4879-a95f-f26a96e1a2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0000a0ee-91cb-40ec-9d8f-ee7101525586", "tag": "a084652e-4641-4d8e-a921-aa1c0536e920"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:08.329451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3ba9b68e-3caf-42e4-be6b-0181f2337ea3 req-b6ed8b40-3c0f-4879-a95f-f26a96e1a2f8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.332837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3ba9b68e-3caf-42e4-be6b-0181f2337ea3 req-b6ed8b40-3c0f-4879-a95f-f26a96e1a2f8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.338930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3ba9b68e-3caf-42e4-be6b-0181f2337ea3 req-b6ed8b40-3c0f-4879-a95f-f26a96e1a2f8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.383383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:08.394677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35fd619d-97bb-4ea8-9c60-af0c64296b37 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.394663 Oct 17 13:35:08.395682 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2311/4593] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:07 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:08.407982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3ba9b68e-3caf-42e4-be6b-0181f2337ea3 req-b6ed8b40-3c0f-4879-a95f-f26a96e1a2f8 service nova] Creating event network-changed:a084652e-4641-4d8e-a921-aa1c0536e920 for instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 on n-h1-854121-14 Oct 17 13:35:08.409703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:08.410364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:08.417864 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3ba9b68e-3caf-42e4-be6b-0181f2337ea3 req-b6ed8b40-3c0f-4879-a95f-f26a96e1a2f8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148096 Oct 17 13:35:08.419216 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2283/4594] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:35:08.431522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.433196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.435200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.436128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.437534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.439430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.476409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:08.477307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:08.490837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.491706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.495638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.496550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.497138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.499725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.836114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:08.862411 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1dc54cca-41e5-4fc1-9de4-03c38a33d446 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1318 microversion: 2.1 time: 0.462229 Oct 17 13:35:08.863019 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2312/4595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:08 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:08.902816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:08.903754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:08.920396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.922014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.924714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:08.927363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:08.928271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:08.932791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.302361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:09.313822 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23ca1a36-dbd3-41d7-b537-6bbd32192eb8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.843051 Oct 17 13:35:09.316149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2284/4596] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:08 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:09.342076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:09.355046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-116d6233-070d-43ec-9987-49449761e43f req-25b50182-f27a-4e26-8f46-21816758645e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1897b8cf-4c18-41f0-b7ca-2660dda8bffd", "name": "network-vif-plugged", "status": "completed", "tag": "cc29a07e-58fe-4da8-8781-260512d40dbc"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:09.357376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-71334a58-f82b-44c5-83a3-fafb0f217fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.458179 Oct 17 13:35:09.366446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-116d6233-070d-43ec-9987-49449761e43f req-25b50182-f27a-4e26-8f46-21816758645e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.367175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-116d6233-070d-43ec-9987-49449761e43f req-25b50182-f27a-4e26-8f46-21816758645e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.370284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-116d6233-070d-43ec-9987-49449761e43f req-25b50182-f27a-4e26-8f46-21816758645e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.371318 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2313/4597] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:08 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:09.391374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-116d6233-070d-43ec-9987-49449761e43f req-25b50182-f27a-4e26-8f46-21816758645e service nova] Creating event network-vif-plugged:cc29a07e-58fe-4da8-8781-260512d40dbc for instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd on n-h1-854121-14 Oct 17 13:35:09.398830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-116d6233-070d-43ec-9987-49449761e43f req-25b50182-f27a-4e26-8f46-21816758645e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047975 Oct 17 13:35:09.399908 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2285/4598] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:09.424079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:09.425084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:09.438228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.439073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.439700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.440806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.441460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.442048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.687669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:09.695635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d23a6c64-01f8-463f-bff1-ea9a5915cd73 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.276943 Oct 17 13:35:09.696214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2314/4599] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:09 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:09.891268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:09.892256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:09.899511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.900009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.901123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:09.902477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:09.903301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:09.903880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.048349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:10.056625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca5028f4-fd7e-40b5-b14d-b10d7cb8c424 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1318 microversion: 2.1 time: 0.170607 Oct 17 13:35:10.057257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2286/4600] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:09 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:10.339962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:10.341052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:10.352742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.353574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.356323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.357120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.357832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.358443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.389495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:10.390469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:10.409756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.410398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.411112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.412087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.413657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.414197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.586415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:10.600926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed0ee546-88d7-4e30-bdb5-c0682c212dfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.265341 Oct 17 13:35:10.604863 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2315/4601] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:10 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:10.628009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:10.639353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96a03af4-4634-49fd-87d2-e6e5213e7efa tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.257488 Oct 17 13:35:10.640152 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2287/4602] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:10 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:10.727129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:10.728105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:10.747762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.748464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.749088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:10.750025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:10.750488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:10.750920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.006052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:11.019486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46c22626-8ddf-4848-a162-215c0f6ee76f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.303670 Oct 17 13:35:11.033995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2316/4603] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:10 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:11.080978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:11.081785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:11.097633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.098421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.098866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.101677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.102339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.102998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.147865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1947ceb1-ed91-4536-80e5-91aa223c10bb req-1f14ed64-5677-4cb0-b7da-870e212aac2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b572d74b-cd63-401a-8da0-df1001a2433d", "tag": "fbcf604e-5362-4f07-932b-7d322cf6245f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:11.177362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1947ceb1-ed91-4536-80e5-91aa223c10bb req-1f14ed64-5677-4cb0-b7da-870e212aac2d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.178569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1947ceb1-ed91-4536-80e5-91aa223c10bb req-1f14ed64-5677-4cb0-b7da-870e212aac2d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.182081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1947ceb1-ed91-4536-80e5-91aa223c10bb req-1f14ed64-5677-4cb0-b7da-870e212aac2d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.214709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1947ceb1-ed91-4536-80e5-91aa223c10bb req-1f14ed64-5677-4cb0-b7da-870e212aac2d service nova] Creating event network-changed:fbcf604e-5362-4f07-932b-7d322cf6245f for instance b572d74b-cd63-401a-8da0-df1001a2433d on n-h1-854121-14 Oct 17 13:35:11.223889 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1947ceb1-ed91-4536-80e5-91aa223c10bb req-1f14ed64-5677-4cb0-b7da-870e212aac2d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080626 Oct 17 13:35:11.229520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2317/4604] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:35:11.397301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:11.408192 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c4b2393-19d5-44f1-96be-1f196308b513 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1468 microversion: 2.1 time: 0.331628 Oct 17 13:35:11.421917 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2288/4605] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:11 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:11.440446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:11.442423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:11.452338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.452831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.456695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.457501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.458056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.459038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.645987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:11.646167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:11.646753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:11.656152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.656640 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24775fc2-11a5-4b97-a314-4e5e102314db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.223221 Oct 17 13:35:11.657103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.657709 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2318/4606] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:11 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:11.668140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:11.668599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.670305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.671032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.671795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.676904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:11.684277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.684901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.685615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.687177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:11.687858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:11.688509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:11.705183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:11.920938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:11.935063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a680f762-574c-4080-bd4f-7fcf534b0c8e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.305746 Oct 17 13:35:11.935684 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2289/4607] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:11 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:11.946134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:11.955295 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7dd92b42-fc21-4058-a20e-7b61c1cc6591 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.296355 Oct 17 13:35:11.955898 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2319/4608] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:11 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:12.046716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.047340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.054240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.055329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.055943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.056659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.057370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.057841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.273292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:12.292151 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe3b0c62-115f-4752-a6f4-2a63f9b56ed8 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.245329 Oct 17 13:35:12.313348 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2290/4609] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:12.681887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.683813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.691295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.693035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.693702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.694576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.695226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:12.695822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:12.961476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:12.962705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:12.996960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:12.998966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.005820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.008752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.014706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.022392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.153419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:13.172985 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-485e6b7c-2ed6-46dd-9771-9bd50bfa8401 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.493644 Oct 17 13:35:13.177015 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2320/4610] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:13.187211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:13.193201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:13.215194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:13.233456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.235626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.236924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.238063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.240472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.241914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.445533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:13.454554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e955c8aa-f3fe-4809-b9b1-bcd7d877c630 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.497276 Oct 17 13:35:13.459445 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2291/4611] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:12 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:13.547776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:13.558940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-774fc60c-0431-43ca-b01f-283d3a28d73a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.379661 Oct 17 13:35:13.559703 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2321/4612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:13 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:13.566460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:13.567354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:13.581960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.584080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.584701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.586336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:13.590644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:13.591793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:13.857636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:13.871196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1981699120", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "a464fd0d-234b-4228-8860-3cff6e270010"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:13.888471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:13.897032 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed83c090-42e7-4f91-8d26-5558ed94763d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.335835 Oct 17 13:35:13.914592 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2322/4613] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:13 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:13.953719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] validate_networks() for [('a464fd0d-234b-4228-8860-3cff6e270010', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:14.205602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:14.206226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:14.216145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.216649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.217091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.217920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.225249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.226353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.529492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:14.542138 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b31f192-956f-4943-b271-e9dd5faddd6b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.340961 Oct 17 13:35:14.543836 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2323/4614] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:14 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:14.552235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:14.562088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:14.569914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.575580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.578013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.579019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.579678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.580277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.731733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:14.732265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:14.732649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:14.733066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:14.733651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:14.761017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=29 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:14.768224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.772015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.772781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.774145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.777970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.780426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.859896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Getting quotas for project 2b3c3210be884205bfc39d5381d2b530. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:14.887213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Getting quotas for user 2da005ee48ff461aae125072250251a9 and project 2b3c3210be884205bfc39d5381d2b530. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:14.922033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:14.926222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:14.934683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:14.936854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7088e01b-cadb-4649-be8d-402d0521aa05 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.390299 Oct 17 13:35:14.941130 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2324/4615] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:14 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:14.961432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:14.962651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:14.981034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.982004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.983400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:14.984416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:14.985147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:14.985865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.011627 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-449f9b45-91dc-4baa-8211-c68b6ae51fc0 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549128 Oct 17 13:35:15.012937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2292/4616] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:15.017753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:15.018628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:15.036267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.039304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.039927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.040769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.042320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.043454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.294609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:15.310118 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f230b71-cd60-4930-a604-cd31143de2fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.366297 Oct 17 13:35:15.313360 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2325/4617] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:14 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:15.333852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca3bc92b-4980-4f64-90b4-8c83b6373b4a tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:15.334479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca3bc92b-4980-4f64-90b4-8c83b6373b4a tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:15.438814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ca3bc92b-4980-4f64-90b4-8c83b6373b4a tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:15.448804 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca3bc92b-4980-4f64-90b4-8c83b6373b4a tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1214 microversion: 2.1 time: 0.132776 Oct 17 13:35:15.449262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:15.466180 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2326/4618] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:15 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1214 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:15.469114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-878c87ab-57e2-45d7-a83f-0a442b7acba5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.454798 Oct 17 13:35:15.474382 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2293/4619] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:15 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:15.568681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:15.569519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:15.580005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.583759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.584907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.587759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.589603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:15.590288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:15.905910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:15.916945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1a0bbed-6f02-4094-8c22-6a5dcbc01ced tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.351158 Oct 17 13:35:15.918316 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2327/4620] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:15 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:15.965837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:15.972317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-14b5c71e-9214-4954-a609-62a778fb87ee req-d5d6ed36-7a60-430e-8d99-cb716fd005f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b572d74b-cd63-401a-8da0-df1001a2433d", "name": "network-vif-plugged", "status": "completed", "tag": "fbcf604e-5362-4f07-932b-7d322cf6245f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:15.975220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:15.996452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:15.998859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.001547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.004036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.005608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.005979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14b5c71e-9214-4954-a609-62a778fb87ee req-d5d6ed36-7a60-430e-8d99-cb716fd005f6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.006722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14b5c71e-9214-4954-a609-62a778fb87ee req-d5d6ed36-7a60-430e-8d99-cb716fd005f6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.007384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.009205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14b5c71e-9214-4954-a609-62a778fb87ee req-d5d6ed36-7a60-430e-8d99-cb716fd005f6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.048571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-14b5c71e-9214-4954-a609-62a778fb87ee req-d5d6ed36-7a60-430e-8d99-cb716fd005f6 service nova] Creating event network-vif-plugged:fbcf604e-5362-4f07-932b-7d322cf6245f for instance b572d74b-cd63-401a-8da0-df1001a2433d on n-h1-854121-14 Oct 17 13:35:16.062294 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-14b5c71e-9214-4954-a609-62a778fb87ee req-d5d6ed36-7a60-430e-8d99-cb716fd005f6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093825 Oct 17 13:35:16.065496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2328/4621] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:35:16.270067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.282320 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48fb24c0-4610-4dc6-aace-62e3f6a5caa9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.322020 Oct 17 13:35:16.282961 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2294/4622] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:15 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:16.338686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:16.339835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.346450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.346943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.347387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.348101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.348561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.348990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.368651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:16.472036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:16.472652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.478796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.479318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.479829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.480562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.480941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.481450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.541463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.552204 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5cc74905-3afd-4eb5-9573-0b42e8f5e28a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.218448 Oct 17 13:35:16.557890 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2329/4623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:16 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:16.566658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:16.568550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.577637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.578134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.578576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.579020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.579375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.579735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.580166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.601410 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e4e2049-04c9-48df-90bb-1003396e406d tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1266 microversion: 2.1 time: 0.133250 Oct 17 13:35:16.602244 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2295/4624] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:16 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:16.779379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:16.790279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3b1e253-8720-4a47-a12c-6e929bfc1028 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.236416 Oct 17 13:35:16.791419 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2330/4625] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:16 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:16.942946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:16.943847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:16.950121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.950527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.950957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:16.951648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:16.952099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:16.952516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.105720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:17.114542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-20963e0c-ddf4-4a11-a077-b0c633dbbd82 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.175263 Oct 17 13:35:17.118605 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2296/4626] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:16 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:17.309236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:17.311048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:17.317876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.318371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.318812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.319705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.319962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.320436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.535974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:17.545824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-137d9dad-5c70-4fb3-af25-78b3b96fe7a0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1315 microversion: 2.1 time: 0.241647 Oct 17 13:35:17.547105 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2331/4627] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:17 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:17.578593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:17.579524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:17.593418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.594482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.595505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.596669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.597375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.598035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.624755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:17.625622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:17.644569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.645097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.647029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.649286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.652075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.652885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.828865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:17.844800 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e86b0d4-e2bd-4fa8-b260-4eb8b2ce67c5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1274 microversion: 2.1 time: 0.223104 Oct 17 13:35:17.847242 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2332/4628] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:17 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:17.865073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:17.865862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:17.887991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.888707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.910256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:17.911067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:17.911732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:17.912202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.031728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:18.042192 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3bef121-bac7-456e-a3ae-e30a3c802013 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1309 microversion: 2.1 time: 0.469585 Oct 17 13:35:18.054035 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2297/4629] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:17 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1309 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:18.142349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f0ef7da5-6c6f-4c78-ad4d-2ea383fd015b req-caa8a33e-db9e-4f16-9f54-049803092050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e1d2ad-aba5-4260-ad4d-5fe6945b2c27", "name": "network-vif-plugged", "status": "completed", "tag": "385cb44a-845f-498d-8e7d-45e6726a7269"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:18.160825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:18.171994 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b917705-30ca-4b12-8805-0aad8654bd85 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.323438 Oct 17 13:35:18.181323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0ef7da5-6c6f-4c78-ad4d-2ea383fd015b req-caa8a33e-db9e-4f16-9f54-049803092050 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.181323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0ef7da5-6c6f-4c78-ad4d-2ea383fd015b req-caa8a33e-db9e-4f16-9f54-049803092050 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.181323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0ef7da5-6c6f-4c78-ad4d-2ea383fd015b req-caa8a33e-db9e-4f16-9f54-049803092050 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.186174 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2333/4630] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:17 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:18.196894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:18.198527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:18.206163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.207106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.207756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.208669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.209338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.210011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.214301 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f0ef7da5-6c6f-4c78-ad4d-2ea383fd015b req-caa8a33e-db9e-4f16-9f54-049803092050 service nova] Creating event network-vif-plugged:385cb44a-845f-498d-8e7d-45e6726a7269 for instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 on n-h2-854121-14 Oct 17 13:35:18.228638 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f0ef7da5-6c6f-4c78-ad4d-2ea383fd015b req-caa8a33e-db9e-4f16-9f54-049803092050 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095282 Oct 17 13:35:18.232727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2298/4631] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:18.439729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:18.451658 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef2d466a-55d5-44a9-acf3-c09b143246aa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.258767 Oct 17 13:35:18.452247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2334/4632] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:18 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:18.579682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:18.580994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:18.598652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.598652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.598652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.600516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.601350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.602487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.872144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:18.872994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:18.880669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.881486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.882096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.883394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.884200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.887087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.940097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:18.954179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e796510-0eba-4e70-a849-b079d25776b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1502 microversion: 2.1 time: 0.384224 Oct 17 13:35:18.958461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2299/4633] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:18 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1502 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:18.982878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:18.985460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:18.993050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.994965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.995674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:18.996762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:18.997262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:18.998058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.010017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.022866 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f702937-5e90-44b7-98a4-17fa95ceaf99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1272 microversion: 2.1 time: 0.157637 Oct 17 13:35:19.030205 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2335/4634] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:18 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:19.046269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:19.068462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:19.069145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:19.079014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.082246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.084182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.086728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.087698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.092108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.235399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:19.239743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6665f6d5-ddc3-4d04-8c0a-d6e2ce5bcb78 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 204 len: 0 microversion: 2.1 time: 0.262677 Oct 17 13:35:19.241608 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2300/4635] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:18 2022] DELETE /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:35:19.253190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:19.254177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:19.267958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.268743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.269376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.270638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.271293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.272078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.336530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.358250 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3026892c-c196-473c-9024-c7959de3bdd3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1491 microversion: 2.1 time: 0.293822 Oct 17 13:35:19.370243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2336/4636] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:19 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1491 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:19.374699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:19.380971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:19.398762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.402704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.403300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.414978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.416593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.417357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.894456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.908830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6284345a-cbf6-4c3c-a7de-8b67a287c170 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.665339 Oct 17 13:35:19.911829 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2301/4637] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:19 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:19.925327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:19.929702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:19.938890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.940065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.940728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.941984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:19.942752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:19.943374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:19.984137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:19.996669 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46d0e328-789b-462b-a7bd-31466b08e075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.636540 Oct 17 13:35:20.003533 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2337/4638] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:19 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.018321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2121271875", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:20.126115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:20.287666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:20.297703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9022496-a0eb-451e-b3b5-f753d54442c7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.382637 Oct 17 13:35:20.317975 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2302/4639] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:19 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.325308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.326272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.333378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.334484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.335420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.336624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.337327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.338886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.726505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:20.743814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbbf9d7a-c687-482a-96d6-0703dd3e6ab5 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1314 microversion: 2.1 time: 0.423161 Oct 17 13:35:20.747823 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2303/4640] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:20.837980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1324d215-f223-423d-b3fe-60c4886b93a8 req-51827f5d-1326-425d-a84f-59f2946aa78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3386fd5b-d627-455f-874b-556f668e58bf", "tag": "c67c2284-f3cb-4d2b-aeab-5592536a752b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:20.855913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1324d215-f223-423d-b3fe-60c4886b93a8 req-51827f5d-1326-425d-a84f-59f2946aa78d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.856417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1324d215-f223-423d-b3fe-60c4886b93a8 req-51827f5d-1326-425d-a84f-59f2946aa78d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.856852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1324d215-f223-423d-b3fe-60c4886b93a8 req-51827f5d-1326-425d-a84f-59f2946aa78d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.877453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1324d215-f223-423d-b3fe-60c4886b93a8 req-51827f5d-1326-425d-a84f-59f2946aa78d service nova] Creating event network-changed:c67c2284-f3cb-4d2b-aeab-5592536a752b for instance 3386fd5b-d627-455f-874b-556f668e58bf on n-h1-854121-14 Oct 17 13:35:20.884134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1324d215-f223-423d-b3fe-60c4886b93a8 req-51827f5d-1326-425d-a84f-59f2946aa78d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050276 Oct 17 13:35:20.885564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2304/4641] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:35:20.940351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:20.941341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:20.953128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:20.953718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:20.954308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:20.954833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:20.955329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.955468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:20.957483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.958115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.959429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.961660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.962258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.968226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.972346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.972346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:20.975062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:20.976364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:20.977087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.020145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:21.026586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:21.042828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:21.045205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:21.105241 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8aa219dd-a32e-49e2-80d4-219a482c0052 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.099539 Oct 17 13:35:21.106524 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2338/4642] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:21.115059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.116087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.127022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.128015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.128660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.129654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.130349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.130984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.184382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.196368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3005906d-9f5a-4f9b-950f-90b9519e8fb3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.263501 Oct 17 13:35:21.207866 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2305/4643] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:20 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.228143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d125ed5f-a5e2-4e15-b0a9-db074650624b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.229563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d125ed5f-a5e2-4e15-b0a9-db074650624b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.330598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d125ed5f-a5e2-4e15-b0a9-db074650624b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.342563 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d125ed5f-a5e2-4e15-b0a9-db074650624b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1209 microversion: 2.1 time: 0.118217 Oct 17 13:35:21.343246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2306/4644] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1209 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.356508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.357124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.366879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.367575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.368349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.370255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.371208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.372950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.378750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:21.436300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.446118 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7ebacbdb-dac7-43ba-ba9c-11b2bb710284 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.338340 Oct 17 13:35:21.447018 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2339/4645] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.769518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:21.770144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:21.777362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.777895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.778338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.779045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:21.779494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:21.779917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:21.945062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.954898 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fd04148-53f4-46c4-b8d9-2aefac49237a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.608647 Oct 17 13:35:21.969727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2307/4646] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:21.970548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:21.978961 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45a7b1ee-07e3-458a-93e0-3224bd5467a2 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1314 microversion: 2.1 time: 0.213184 Oct 17 13:35:21.979590 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2340/4647] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:21 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:22.239976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:22.240763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:22.248061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.248645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.249173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.249955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.250421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.250845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.369803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:22.370619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:22.379647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.380144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.380843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.382225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.383576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.384019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.397901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:22.406035 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-907cb232-57b3-4418-a2d6-1236156c4749 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.170722 Oct 17 13:35:22.421552 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2308/4648] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:22.450566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:22.458285 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ff0f205-7c6a-489b-a00d-a784a988351a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1213 microversion: 2.1 time: 0.094324 Oct 17 13:35:22.459026 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2341/4649] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:22 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:22.471933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:22.472740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:22.480094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.480618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.481089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.481895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.482430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.483220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.624101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:22.634976 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-648b1df7-4144-4a57-9f5a-d3eedc300b62 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.167298 Oct 17 13:35:22.635841 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2309/4650] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:22 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:22.979244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:22.979898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:22.987212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.987716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.988149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:22.988969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:22.989546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:22.990267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.003000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.003610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.011247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.012115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.012805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.013897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.014554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.015192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.228907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.233555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.237624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8da54186-d628-41c4-8396-fcd7f008b4fe tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.262964 Oct 17 13:35:23.238215 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2342/4651] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:22 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:23.242553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2ff15ba-6020-48a9-bbe5-66bfae4d400e tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1314 microversion: 2.1 time: 0.243743 Oct 17 13:35:23.243117 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2310/4652] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:22 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:23.431275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.432189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.438195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.438683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.439119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.439817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.440367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.440680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.484265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.485383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.491003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.491488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.491927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.492633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.493086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.493532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.587058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.600246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-077293b1-6ba0-40c0-9adf-6bde77d60daf tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1213 microversion: 2.1 time: 0.119738 Oct 17 13:35:23.601084 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2311/4653] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:23 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:23.632312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.642382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-658c5fb2-c562-4bb3-a137-f05bdcddd745 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.215275 Oct 17 13:35:23.642906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2343/4654] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:23 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:23.659549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:23.660185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:23.668395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.668933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.669574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.670337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:23.670793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:23.671411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:23.815785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:23.825100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed6e5df2-6d68-468b-8917-d944827c284b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.169734 Oct 17 13:35:23.825722 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2312/4655] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:23 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:24.263341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.265393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.267436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.268152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.274392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.276782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.277317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.277941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.278067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.278940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.279576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.279701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.280261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.281269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.283671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.284301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.498204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.512935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e49e9b6b-3b4d-43d6-836c-77806f9c0603 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.254245 Oct 17 13:35:24.513604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2344/4656] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:24.529598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.529598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7dd3460-d5e0-4c4a-8a77-4e72d3f31c48 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1314 microversion: 2.1 time: 0.261522 Oct 17 13:35:24.530507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2313/4657] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:24.625127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.625741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.631976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.632457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.632919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.633648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.634091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.634864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.668658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.669309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.675513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.675993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.676425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.677120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.677598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.678023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.713973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.722099 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-971014df-1d12-4e17-aee4-1b44d58d03d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1213 microversion: 2.1 time: 0.101495 Oct 17 13:35:24.722687 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2314/4658] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:24.850480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:24.851102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:24.857833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:24.859535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.860420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:24.860552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.868366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcaed2c2-3884-49fc-809e-44e61ad14bdd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.204266 Oct 17 13:35:24.881187 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2345/4659] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:24.882523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:24.882523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:24.882523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:24.882523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.014406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:25.022741 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6cd5c90e-60f2-4f91-9639-96618f0985c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.176419 Oct 17 13:35:25.023321 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2315/4660] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:24 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:25.535909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.536665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.544458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.545041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.545583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.546367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.546838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.547271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.548105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.549287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.556169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.557235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.557862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.558576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.559032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.559460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.787039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:25.790192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:25.794297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:25.796785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-56ae6808-8cb0-47e4-9a20-96bf5388de53 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1314 microversion: 2.1 time: 0.252677 Oct 17 13:35:25.799788 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2316/4661] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:25.800131 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd1cbae8-4b53-4f0e-a859-0e75aa32e8fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.267872 Oct 17 13:35:25.801059 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2346/4662] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:25.806075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8731ce3c-de34-456f-a125-5341e98b2fa4 req-a4fceb8d-4040-469c-a9cf-2845e08b9de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3386fd5b-d627-455f-874b-556f668e58bf", "name": "network-vif-plugged", "status": "completed", "tag": "c67c2284-f3cb-4d2b-aeab-5592536a752b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:25.808216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.808891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.815374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.815991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.816554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.817422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.820642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.821348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.839333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8731ce3c-de34-456f-a125-5341e98b2fa4 req-a4fceb8d-4040-469c-a9cf-2845e08b9de6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.839826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8731ce3c-de34-456f-a125-5341e98b2fa4 req-a4fceb8d-4040-469c-a9cf-2845e08b9de6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.840265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8731ce3c-de34-456f-a125-5341e98b2fa4 req-a4fceb8d-4040-469c-a9cf-2845e08b9de6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.862782 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8731ce3c-de34-456f-a125-5341e98b2fa4 req-a4fceb8d-4040-469c-a9cf-2845e08b9de6 service nova] Creating event network-vif-plugged:c67c2284-f3cb-4d2b-aeab-5592536a752b for instance 3386fd5b-d627-455f-874b-556f668e58bf on n-h1-854121-14 Oct 17 13:35:25.878715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8731ce3c-de34-456f-a125-5341e98b2fa4 req-a4fceb8d-4040-469c-a9cf-2845e08b9de6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075128 Oct 17 13:35:25.886159 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2347/4663] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:25.897211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:25.898360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:25.913012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.913632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.914549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.916129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:25.917127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:25.918547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:25.998316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.011806 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-652dc9ec-044b-42c2-be0e-799fc2c4c6fd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1213 microversion: 2.1 time: 0.208204 Oct 17 13:35:26.012727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2317/4664] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:26.047828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.049079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.058721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.059641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.061961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.063535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.064213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.065985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.182427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.190832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14d13a0b-6fc0-469c-ae60-44927e5222fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.299468 Oct 17 13:35:26.191619 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2348/4665] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:25 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:26.256701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:26.265760 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83ddcb0a-293b-4169-b408-d36c92d3aa9a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.222204 Oct 17 13:35:26.266356 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2318/4666] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:26.828618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.829409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.833753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:26.834475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:26.836915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.837442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.838440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.839513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.840049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.840420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.850480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.851070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.851592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:26.852381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:26.852941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:26.853894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.054301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.063417 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b67d02c1-8de3-44a3-b709-2d3dada2a743 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1314 microversion: 2.1 time: 0.241565 Oct 17 13:35:27.063560 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2319/4667] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:27.066958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.067988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.068594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.075767 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33254ab8-fa38-45a8-9b4e-07c3a13246fa tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.254852 Oct 17 13:35:27.076347 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2349/4668] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:26 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:27.083051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.083051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.083612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.084320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.087135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.087616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.158785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.167181 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9cfccf97-dc1b-4e61-ae5d-c490c849c628 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1261 microversion: 2.1 time: 0.102745 Oct 17 13:35:27.167748 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2320/4669] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1261 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:27.227623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.228137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.240960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.241501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.241969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.242704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.243188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.243604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.388174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.396814 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-761b99c0-bacd-4ac2-b0ef-058b52ce8b4d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.173310 Oct 17 13:35:27.397530 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2350/4670] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:27.421640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.422552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.428920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.429682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.430321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.432375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.433037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.433898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.563117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:27.563293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:27.569451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.569971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.570591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.571472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:27.571986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:27.572590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:27.597643 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa205f43-8cc5-4ffc-b34c-42bf907da8ae tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/ips" status: 200 len: 152 microversion: 2.20 time: 0.319950 Oct 17 13:35:27.598218 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2321/4671] 10.222.0.65 () {60 vars in 1289 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/ips => generated 152 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:35:27.611737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:27.621360 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92937d53-44ac-48d6-b8fa-7c9a0a030272 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.209400 Oct 17 13:35:27.622090 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2351/4672] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:27 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.086749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.088128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.099305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.100168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.116868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.117323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.117777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.118515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.119518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.119868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.120008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.120713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.121535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.122387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.123262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.124702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.362466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.365437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.375523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-04b244b0-f5b0-46c5-be16-899a765cd9f7 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1498 microversion: 2.1 time: 0.293193 Oct 17 13:35:28.375662 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eaaa0fb4-1f7e-4594-8c31-a5ccc78b4670 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.280046 Oct 17 13:35:28.376413 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2322/4673] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1498 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.382337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.383134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.397243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2352/4674] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:28.404885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.405418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.405891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.406547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.407002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.407429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.426068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.427593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.440969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.443782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.444399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.446007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.446904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.449597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.488403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.501988 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67647679-4e06-4856-a371-e42af949e9f5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1261 microversion: 2.1 time: 0.124314 Oct 17 13:35:28.503399 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2323/4675] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1261 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.637530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.646634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:28.647428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:28.662774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-28318c7e-a9a2-48e7-ab1c-7ac37d28efdc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.241290 Oct 17 13:35:28.665497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.666954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.668526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.669705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:28.670169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:28.670604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:28.673320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2353/4676] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:28.686795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:28.944232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:28.977746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbf7fa1f-a86f-418b-a82e-a0482dcea165 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.332645 Oct 17 13:35:28.993751 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2324/4677] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:28 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:29.411845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:29.412495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:29.420389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.421137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.422608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.423237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.423707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.424137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.526616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:29.527923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:29.549671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.550457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.551058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.551947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.552559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.553144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.612399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:29.621376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94e78fba-e752-4497-b2cb-1695bc76af83 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.213925 Oct 17 13:35:29.622857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2354/4678] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:29 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:29.651631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:29.659798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82f0dbee-d867-43dd-8dc2-1c9dca7b668b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1261 microversion: 2.1 time: 0.137643 Oct 17 13:35:29.660553 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2325/4679] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:29 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1261 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:29.693009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:29.693685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:29.700132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.700662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.701111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.701921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:29.702395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:29.702938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:29.868217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:29.877849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c3f62d3-8fa7-4f4a-8e3d-29906458826e tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.188956 Oct 17 13:35:29.878448 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2355/4680] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:29 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:30.007037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.007991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.014571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.015498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.015945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.017635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.018147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.018675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.217131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.225684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-584b2e0f-86a4-45ed-be8c-0464624f7cc4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.222703 Oct 17 13:35:30.226507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2326/4681] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:30.626541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:30.627336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.640693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.642732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.643277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.643908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.644359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.644675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.644782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.645126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.656452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.658255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.658720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.659453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.659920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.660362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.670917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lazy-loading 'flavor' on Instance uuid 8faa31c3-68ee-4cc1-9c10-59fedd583313 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:30.825249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.835775 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7156bb35-0a68-4a63-9b78-f9fc0c7df33c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1318 microversion: 2.1 time: 0.194951 Oct 17 13:35:30.836759 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2327/4682] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:30.842099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.842796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.850770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.851962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.852976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.854793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.856340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.857037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.905352 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b364223-942c-4cdc-b454-b074a36a1b0a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/action" status: 202 len: 0 microversion: 2.20 time: 0.282901 Oct 17 13:35:30.906353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2356/4683] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:35:30 2022] POST /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:35:30.919215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.920268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.934780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.935283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.936000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.937067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.937890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.938326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.944814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:30.954145 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6170a84e-9b12-4f5d-b6f9-38b92e30e7c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1261 microversion: 2.1 time: 0.116169 Oct 17 13:35:30.954981 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2328/4684] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1261 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:30.969533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:30.970929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:30.982406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.982908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.983354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.984051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:30.984677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:30.985300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:30.991675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:31.034886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:31.208912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.214294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.219928 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a21cd48-66e1-466c-9de8-aa798225f33b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.310662 Oct 17 13:35:31.220937 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2357/4685] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:31.223239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.224726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.226559 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b6e2b80-ad8d-4b79-87c8-865d07ae7e27 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.268678 Oct 17 13:35:31.226857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.227433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.228027 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2329/4686] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:30 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:31.250157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.251108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.257537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.258026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.258641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.259346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.260701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.260830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.261208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.261321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.261759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.262850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.263320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.263746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.299305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:35:31.337433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:31.400119 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3227627-ed2b-4450-8a96-d8d0a1bb0834 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 204 len: 0 microversion: 2.1 time: 0.177081 Oct 17 13:35:31.404263 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2358/4687] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:35:31 2022] DELETE /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:35:31.411466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.412188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.414582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.424053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.424265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-956cf6d8-dd4a-4a84-ad01-30a070ec6733 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1508 microversion: 2.1 time: 0.178405 Oct 17 13:35:31.424567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.424988 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2330/4688] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:31.425114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.425752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.426207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.426814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.581718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:31.590707 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-689ee26d-dea3-4142-87c1-2af29a9b2508 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1504 microversion: 2.1 time: 0.183883 Oct 17 13:35:31.591305 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2359/4689] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:31.863112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.863736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.871375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.871902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.872339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.873504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.874115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.874696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.980213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:31.980869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:31.985360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:31.989845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.990483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.991498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:31.991848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:31.992621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:31.993207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.017388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:32.130828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.140587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe059ebb-30aa-4d0e-b1f0-faa9d46c630c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1261 microversion: 2.1 time: 0.165056 Oct 17 13:35:32.145358 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2360/4690] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:32.164442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.180101 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6587529-0327-4d07-b38c-3ae93eebeac8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1468 microversion: 2.1 time: 0.320950 Oct 17 13:35:32.180805 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2331/4691] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:31 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1468 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:32.212028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.220559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.221781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Searching by: {'reservation_id': 'r-yqjqjza1', 'deleted': False, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c'} {{(pid=120698) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 13:35:32.230466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.230466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.230466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.230466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.230789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.231337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.247040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.247913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.268089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.269607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.270282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.271500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.272176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.272772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.378303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.multi_cell_list [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120698) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 13:35:32.473920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.486965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.487491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.488021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.586692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:32.598194 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af7ee7e3-3ee7-4cce-8407-c77624843f08 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.357565 Oct 17 13:35:32.627546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2332/4692] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:32.659175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.666633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.689763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.693795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.694987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.695780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.701568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.702239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.885820 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f3c67143-5edc-4add-aedf-04389d0ecb68 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/detail?reservation_id=r-yqjqjza1" status: 200 len: 2929 microversion: 2.1 time: 0.679588 Oct 17 13:35:32.886856 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2361/4693] 10.222.0.65 () {58 vars in 1197 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yqjqjza1 => generated 2929 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:32.923613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:32.926101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:32.949638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.951533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.957779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:32.958562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:32.959222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:32.960011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.049844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.052860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.055169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.058399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.059386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'fault' on Instance uuid 345f1c3b-cc0b-49f9-82e1-0c6481cad86e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:33.060906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.067545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.068813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61070a05-f4e8-4d16-9455-2bbe5bec97b5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.425917 Oct 17 13:35:33.086360 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2333/4694] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:33.098484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9aa1a7bf-a2a1-4517-a0de-0347f6001a98 req-ea9991fe-3dae-492a-8d06-bc0e9d055eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345f1c3b-cc0b-49f9-82e1-0c6481cad86e", "name": "network-vif-deleted", "tag": "b1309fe5-6bb9-4db7-b245-fde58bd11dec"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:33.117206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9aa1a7bf-a2a1-4517-a0de-0347f6001a98 req-ea9991fe-3dae-492a-8d06-bc0e9d055eec service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.117783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9aa1a7bf-a2a1-4517-a0de-0347f6001a98 req-ea9991fe-3dae-492a-8d06-bc0e9d055eec service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.118231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9aa1a7bf-a2a1-4517-a0de-0347f6001a98 req-ea9991fe-3dae-492a-8d06-bc0e9d055eec service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.134135 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9aa1a7bf-a2a1-4517-a0de-0347f6001a98 req-ea9991fe-3dae-492a-8d06-bc0e9d055eec service nova] Creating event network-vif-deleted:b1309fe5-6bb9-4db7-b245-fde58bd11dec for instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e on n-h2-854121-14 Oct 17 13:35:33.143168 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9aa1a7bf-a2a1-4517-a0de-0347f6001a98 req-ea9991fe-3dae-492a-8d06-bc0e9d055eec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054720 Oct 17 13:35:33.144376 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2334/4695] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:33.153446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.154229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.161292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.161792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.162235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.163095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.163526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.164059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.189545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.205537 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-597916a4-58a4-4afd-9a42-76add24090b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1305 microversion: 2.1 time: 0.296932 Oct 17 13:35:33.208223 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2362/4696] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:32 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1305 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:33.223198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9cb62fcc-7df5-4ef5-b9cc-e82e8dd577b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.260276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.server_groups [None req-9cb62fcc-7df5-4ef5-b9cc-e82e8dd577b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Querying cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) for 2 instances {{(pid=120698) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 17 13:35:33.261152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cb62fcc-7df5-4ef5-b9cc-e82e8dd577b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.262447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cb62fcc-7df5-4ef5-b9cc-e82e8dd577b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.263207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cb62fcc-7df5-4ef5-b9cc-e82e8dd577b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.318988 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9cb62fcc-7df5-4ef5-b9cc-e82e8dd577b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups/4fdb0dcf-357c-48bf-abed-eaf0449d3dda" status: 200 len: 270 microversion: 2.1 time: 0.108557 Oct 17 13:35:33.319640 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2363/4697] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/os-server-groups/4fdb0dcf-357c-48bf-abed-eaf0449d3dda => generated 270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:33.325826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.326614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.335840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.336790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.338010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.339270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.340550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.341436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.507269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.522979 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86b697b0-2779-4ce3-a523-43a8ceb92ca9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1267 microversion: 2.1 time: 0.200946 Oct 17 13:35:33.523898 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2364/4698] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:33.543493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.544215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.551783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.552506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.553368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.554374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.555059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.555748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.579882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:33.589983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53460251-fdb8-478b-9fb1-1caad7f01a99 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1504 microversion: 2.1 time: 0.443962 Oct 17 13:35:33.590946 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2335/4699] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:33.664315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:33.665221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:33.692621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.694751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.695988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:33.699898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:33.701878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:33.702545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.261386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.272134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80fdae4b-0b6e-40f1-a8bc-33d6dbd0967c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.623498 Oct 17 13:35:34.279472 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2336/4700] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:34.281501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-772647a4-7478-40f9-b0a7-f332a13adaad tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1621 microversion: 2.1 time: 0.753399 Oct 17 13:35:34.289877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.291360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.297660 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2365/4701] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:33 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1621 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:34.345132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.345662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.346102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.346845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.347576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.347723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.657456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.668455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.675259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.679925 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d729e673-18b8-46b0-8516-9353ef5f64a0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.396506 Oct 17 13:35:34.682929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2337/4702] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:34.690893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.692874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.705953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.707725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.715043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.715682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a2c3a6a7-9dbc-4058-aed8-055ba9704298 req-d5851644-576c-4c78-9344-ecc5b1260a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3386fd5b-d627-455f-874b-556f668e58bf", "name": "network-vif-deleted", "tag": "c67c2284-f3cb-4d2b-aeab-5592536a752b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:34.719155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.722057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.722595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.734933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a2c3a6a7-9dbc-4058-aed8-055ba9704298 req-d5851644-576c-4c78-9344-ecc5b1260a24 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.738319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a2c3a6a7-9dbc-4058-aed8-055ba9704298 req-d5851644-576c-4c78-9344-ecc5b1260a24 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.739021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a2c3a6a7-9dbc-4058-aed8-055ba9704298 req-d5851644-576c-4c78-9344-ecc5b1260a24 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.769541 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a2c3a6a7-9dbc-4058-aed8-055ba9704298 req-d5851644-576c-4c78-9344-ecc5b1260a24 service nova] Creating event network-vif-deleted:c67c2284-f3cb-4d2b-aeab-5592536a752b for instance 3386fd5b-d627-455f-874b-556f668e58bf on n-h1-854121-14 Oct 17 13:35:34.775966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a2c3a6a7-9dbc-4058-aed8-055ba9704298 req-d5851644-576c-4c78-9344-ecc5b1260a24 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.475116 Oct 17 13:35:34.777024 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2366/4703] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:34.797866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.800151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.810629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.811417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.811659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.812088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.812588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.813027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'fault' on Instance uuid 345f1c3b-cc0b-49f9-82e1-0c6481cad86e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:34.813148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.814087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.814709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.815373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.896245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:34.916947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcb78665-0691-4f67-a8dc-c8356b07a4c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 200 len: 1305 microversion: 2.1 time: 0.230049 Oct 17 13:35:34.918473 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2338/4704] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 1305 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:34.927207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:34.928178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:34.950192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.950705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.951150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:34.952766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:34.953295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:34.953733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.067501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f2aa733-b31f-4813-8dc0-fc06195ca58a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1621 microversion: 2.1 time: 0.279533 Oct 17 13:35:35.068110 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2367/4705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1621 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:35.087282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.089585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.113721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.114228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.114850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.115749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.116401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.116950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.165302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.165989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.167396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.167879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lazy-loading 'fault' on Instance uuid 3386fd5b-d627-455f-874b-556f668e58bf {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:35.274952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da005ee48ff461aae125072250251a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3c3210be884205bfc39d5381d2b530', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.283029 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c2a8dba-cf6c-447c-829c-2b5ac278e40b tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 200 len: 1304 microversion: 2.1 time: 0.200970 Oct 17 13:35:35.284433 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2368/4706] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 1304 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:35.289332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-182074988", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "509d327d-d2cb-4993-9f10-b5550138a4d7"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:35.292530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.300883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fdf64f0a-e88a-41b2-9097-6e1f3b2a1dce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.380467 Oct 17 13:35:35.301686 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2339/4707] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:34 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:35.307544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.308442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.315446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.316265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.316949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.317914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.318604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.319253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.410324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:35.695909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:35.707031 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5be4336f-3ab7-4348-a67b-4e52b25db671 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.402431 Oct 17 13:35:35.707644 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2340/4708] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:35.729377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:35.730382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:35.737621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.738324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.738918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.739817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:35.740422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:35.740999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:35.746258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:36.390112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:36.390607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:36.405775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.410386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:36.411185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:36.411840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:36.425993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.430246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.430963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.432394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.433120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.433961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.434431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.436413 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-009c6a53-28bc-4f5e-bb36-dedfcc4ff480 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.713818 Oct 17 13:35:36.437246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2341/4709] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:35 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:36.437389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.449715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f95b442f-a141-4527-a319-17bc60dcf804 req-3cdc156b-e8c6-410d-aedb-955d8f99fb9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c999d9-c3d1-435f-96f0-5505353369b8", "name": "network-vif-plugged", "status": "completed", "tag": "d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:36.474891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f95b442f-a141-4527-a319-17bc60dcf804 req-3cdc156b-e8c6-410d-aedb-955d8f99fb9c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.475429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f95b442f-a141-4527-a319-17bc60dcf804 req-3cdc156b-e8c6-410d-aedb-955d8f99fb9c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.477042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f95b442f-a141-4527-a319-17bc60dcf804 req-3cdc156b-e8c6-410d-aedb-955d8f99fb9c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.483894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:36.498904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:36.507368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f95b442f-a141-4527-a319-17bc60dcf804 req-3cdc156b-e8c6-410d-aedb-955d8f99fb9c service nova] Creating event network-vif-plugged:d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7 for instance 54c999d9-c3d1-435f-96f0-5505353369b8 on n-h2-854121-14 Oct 17 13:35:36.513361 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f95b442f-a141-4527-a319-17bc60dcf804 req-3cdc156b-e8c6-410d-aedb-955d8f99fb9c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070077 Oct 17 13:35:36.514387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2342/4710] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:36.519947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.520719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.524702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:36.527997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.528427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.528930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.529526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:36.530042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.530567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.531172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.546913 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e HTTP/1.1 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '345f1c3b-cc0b-49f9-82e1-0c6481cad86e'} Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:36.548843 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:36.554031 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e1990b4-ce26-49ca-a3ae-9d288b5d144b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 404 len: 111 microversion: 2.1 time: 0.035573 Oct 17 13:35:36.565182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2343/4711] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:36.565182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.565182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] [instance: 3386fd5b-d627-455f-874b-556f668e58bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.572145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.572641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.573078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.573817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.574387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.574818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.595028 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] HTTP exception thrown: Instance 3386fd5b-d627-455f-874b-556f668e58bf could not be found. Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Request method failure captured: Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf HTTP/1.1 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVoOsBTwxwwzrY9M8X9MpxCruTPtwXwMyOAHCayXYPMIkRGY8aYQCpA4YYD9Idz3MlsYkVlp_AETptao5HUxDjnHmNW3vsnBIE1Cow0T-bopda7JpYRE1HUz_rpHSAnaZpnngmDNOZ0WrEuXWA-6Tp973ht_XFlkhx33gQq5W64u0X0 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2b3c3210be884205bfc39d5381d2b530 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesActionsTest-1092705314 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2b3c3210be884205bfc39d5381d2b530"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b3c3210be884205bfc39d5381d2b530"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2b3c3210be884205bfc39d5381d2b530"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2b3c3210be884205bfc39d5381d2b530"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesActionsTest-1092705314 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2b3c3210be884205bfc39d5381d2b530 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesActionsTest-1092705314 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesActionsTest-1092705314-project Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 2da005ee48ff461aae125072250251a9 Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesActionsTest-1092705314-project Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 3386fd5b-d627-455f-874b-556f668e58bf could not be found. Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3386fd5b-d627-455f-874b-556f668e58bf'} Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3386fd5b-d627-455f-874b-556f668e58bf could not be found. Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3386fd5b-d627-455f-874b-556f668e58bf could not be found. Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:36.596611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3386fd5b-d627-455f-874b-556f668e58bf could not be found. Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] Returning 404 to user: Instance 3386fd5b-d627-455f-874b-556f668e58bf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2cb12ca1-983b-476e-b657-dbe61003c858 tempest-VolumesActionsTest-1092705314 tempest-VolumesActionsTest-1092705314-project] 10.222.0.65 "GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf" status: 404 len: 111 microversion: 2.1 time: 0.038679 Oct 17 13:35:36.600457 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2344/4712] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/3386fd5b-d627-455f-874b-556f668e58bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:36.627482 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-655e982d-79c2-4c3f-a1ec-3087a608d7a6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339072 Oct 17 13:35:36.629089 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2369/4713] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:36.644477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.650054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.664082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-897225a6-f82e-48fe-af59-e911fb83dbab req-7727ab0a-d817-494c-bb3d-65cff367b2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3b7d43-a0e3-402c-8f4f-f9f9cc151642", "tag": "60383b5f-0d3f-4720-b918-21d926c1e743"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:36.674466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.675789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.676798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.677691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.678511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.679535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.718292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-897225a6-f82e-48fe-af59-e911fb83dbab req-7727ab0a-d817-494c-bb3d-65cff367b2f3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.718790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-897225a6-f82e-48fe-af59-e911fb83dbab req-7727ab0a-d817-494c-bb3d-65cff367b2f3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.725201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-897225a6-f82e-48fe-af59-e911fb83dbab req-7727ab0a-d817-494c-bb3d-65cff367b2f3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.754607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-897225a6-f82e-48fe-af59-e911fb83dbab req-7727ab0a-d817-494c-bb3d-65cff367b2f3 service nova] Creating event network-changed:60383b5f-0d3f-4720-b918-21d926c1e743 for instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 on n-h2-854121-14 Oct 17 13:35:36.767265 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-897225a6-f82e-48fe-af59-e911fb83dbab req-7727ab0a-d817-494c-bb3d-65cff367b2f3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128061 Oct 17 13:35:36.769587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2370/4714] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:36.779959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49090b2b-253b-4897-958e-20ac758d5850 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.783703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-49090b2b-253b-4897-958e-20ac758d5850 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.956094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-49090b2b-253b-4897-958e-20ac758d5850 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:36.965726 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49090b2b-253b-4897-958e-20ac758d5850 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1216 microversion: 2.1 time: 0.194875 Oct 17 13:35:36.969454 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2371/4715] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:36.974304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:36.974921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:36.992736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.993298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.993737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:36.994460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:36.994925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:36.995355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.137280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.175231 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bcb6842-e5e1-408d-8d00-1fffe57540c6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.570962 Oct 17 13:35:37.188235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2345/4716] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:37.216001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-417531595", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:37.257296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.273738 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-725b0919-679a-4c07-ab38-532868383cef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.303092 Oct 17 13:35:37.274329 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2372/4717] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:36 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:37.293278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:35:37.481728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:37.483057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:37.500498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.503034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.503495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.504233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.504691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.505122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.771081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.780484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.783777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:37.787847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14f56fe4-bf6c-4ce6-b6d8-4de1ab94714c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.313765 Oct 17 13:35:37.790223 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2373/4718] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:37 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:37.954868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:35:37.956064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:35:37.956453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:35:37.956901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:35:37.957465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:35:37.968475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.968963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.973590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.974681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:37.975401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:37.976002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:37.993016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:37.995191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.002168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.002937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.003561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.004483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.005104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.005715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.016807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:38.023065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:35:38.031435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:35:38.050661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:35:38.053205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:35:38.124075 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e073666c-733e-48a9-abd7-5c8214daee03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928778 Oct 17 13:35:38.125871 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2346/4719] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:35:38.140712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.151323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4f784f62-2f28-442d-af4b-3eea8f517fe1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.152803 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b280f5b-2112-4b82-8850-7cb035d4b849 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1220 microversion: 2.1 time: 0.164706 Oct 17 13:35:38.154100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4f784f62-2f28-442d-af4b-3eea8f517fe1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.154659 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2374/4720] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:37 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1220 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:38.200714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.201461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.216781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.216781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.219671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.222594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.224796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.225390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.306592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4f784f62-2f28-442d-af4b-3eea8f517fe1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.473833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.487828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9cc1fff-0f62-4edb-aa04-f38dbb623722 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.290382 Oct 17 13:35:38.492510 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2375/4721] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:38.513708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.514943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.537856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.538593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.539271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.540221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.541224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.542363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.615454 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4f784f62-2f28-442d-af4b-3eea8f517fe1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1214 microversion: 2.1 time: 0.482075 Oct 17 13:35:38.624152 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2347/4722] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1214 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:38.731932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.741919 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce56686e-5671-419d-9892-5b61fe106699 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.247209 Oct 17 13:35:38.742510 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2376/4723] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:38.814732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:38.816195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:38.821439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.822096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.822582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.823384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:38.823713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:38.824135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:38.963724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.974390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.976247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:38.977749 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc36e03e-c1bd-43ea-9425-b583f2a9e4ba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.166976 Oct 17 13:35:38.979294 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2348/4724] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:38 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:39.179508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.180131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.186927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.187414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.187862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.188545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.189014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.189445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.256759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:39.265222 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22d3524f-972a-4fd4-b1a9-c8036798bb6c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1220 microversion: 2.1 time: 0.089855 Oct 17 13:35:39.266197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2377/4725] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:39.523818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.524525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.524756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "466cf195-d6fd-49dc-a91f-e47e140448df"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:39.531211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.541080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.543907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.544636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.545339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.545668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.546660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.547493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.548070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.548250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.549525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.549953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.551109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.742047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:39.801832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:39.811695 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c20f138a-0750-4a2f-8c8f-0a721649084e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.296655 Oct 17 13:35:39.812745 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2349/4726] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:39.818246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.818931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.829713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.830413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.830909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.831835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.832404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.832973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.910722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:39.935008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37e269c4-09a9-4fd7-8f38-995a8d67cade tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1218 microversion: 2.1 time: 0.120702 Oct 17 13:35:39.935611 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2350/4727] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1218 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:39.958950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:39.959996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:39.969012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.970258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.970866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.971751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:39.972371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:39.973829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:39.976384 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76193b0b-c774-4352-8f8a-4fd2fbe36ead tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459493 Oct 17 13:35:39.978647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2378/4728] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:35:39 2022] POST /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:40.009090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.013304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.028382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.029282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.030212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.033926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.034775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.035333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.251698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.266217 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d52cfb6-7f98-498a-a5fa-197c715df9f9 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.319323 Oct 17 13:35:40.267674 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2351/4729] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:40.297285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.299982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.300627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.308449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.309559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.310085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.311581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.312204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.312311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.312769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.313952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.326509 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9835458-90b2-49ff-b1a3-1cc4e2a6030d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.325286 Oct 17 13:35:40.329275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2379/4730] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:39 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:40.394911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:40.404289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fea56313-a82c-4f5a-9ca9-906b3dfc3fe7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1220 microversion: 2.1 time: 0.113379 Oct 17 13:35:40.406145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2352/4731] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:40 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:40.836043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.836653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.844629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.845106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.845621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.846263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.846714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.847134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.960435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:40.961068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:40.985560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.987542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.992960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:40.994676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:40.995326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:40.995773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.033151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.042791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3519bb0-4a0b-4d05-abbc-bb04ba18a661 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.210588 Oct 17 13:35:41.043805 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2380/4732] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:40 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:41.094871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.109820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5918b572-4865-4a1d-b006-72581d5b8c3e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1218 microversion: 2.1 time: 0.153583 Oct 17 13:35:41.111032 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2353/4733] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:40 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:41.293663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:41.294832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:41.303314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.304135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.304819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.305861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.307197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.307885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.359173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:41.361028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:41.379532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.380446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.383056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.384505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.385981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.388455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.580444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.592090 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ee2defb-4b1a-4981-a1aa-7b01da00b5dd tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.303398 Oct 17 13:35:41.592686 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2381/4734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:41 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:41.603871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:41.605172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:41.614154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.615146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.615812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.616990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:41.617696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:41.618347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:41.639907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.654230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.669837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.671385 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1eccbbc8-17fa-48d2-9ac4-0bfa3cf2376f tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.316746 Oct 17 13:35:41.673703 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2354/4735] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:41 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:41.758610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:41.787749 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1eb6b167-85c3-4a5e-9a8e-13c0c1ed7ae9 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1220 microversion: 2.1 time: 0.193544 Oct 17 13:35:41.788891 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2382/4736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:41 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1220 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:42.068648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:42.069922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:42.082284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.083412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.084095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.085372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.086753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.087806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.138227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:42.139396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:42.148870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.149404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.150608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.156010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.156010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.156010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.314493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:42.322715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55e43922-383b-4604-8f08-5dec701a56d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1218 microversion: 2.1 time: 0.190285 Oct 17 13:35:42.323621 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2383/4737] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:42 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:42.384964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:42.399465 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7df2099f-c9ae-4b37-95bf-d69b8f40b34c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.335187 Oct 17 13:35:42.416594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2355/4738] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:42 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:42.627635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:42.628314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:42.646894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.647400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.647847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.653219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.653700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.656058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.702730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:42.703785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:42.716773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.717708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.719259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:42.722995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:42.724893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:42.726135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.471788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.489366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89984cb7-6de0-454d-b9b8-7ae56c1bfeea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1518 microversion: 2.1 time: 0.874002 Oct 17 13:35:43.493545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2384/4739] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:42 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1518 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:43.512264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:43.514697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:43.525200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.543243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.556088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.560177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.561040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.565961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41bb9262-0336-4c87-a4b5-aa28def1f1b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.870205 Oct 17 13:35:43.568972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.584627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.585277 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2356/4740] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:42 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:43.586601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.593802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.605200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:43.607365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:43.629832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.641766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.642964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.644572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.648388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.650341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.931157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.942205 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05153a05-5674-47ea-bf81-6596106e4033 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1210 microversion: 2.1 time: 0.355766 Oct 17 13:35:43.943234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:43.946347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2357/4741] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:43 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1210 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:43.957192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3ccba95-ebfb-4e12-95c5-7212e4279d75 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1268 microversion: 2.1 time: 0.460715 Oct 17 13:35:43.959012 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2385/4742] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:43 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1268 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:43.961759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:43.968961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:43.984815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.988331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.989439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:43.991640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:43.993373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:43.994128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:44.280242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:44.290089 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-633a30a0-f507-4968-a522-c986dc94d589 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.342129 Oct 17 13:35:44.308594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2358/4743] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:43 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:44.517235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:44.518568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:44.532307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:44.534885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:44.535605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:44.536575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:44.539154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:44.539885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:44.600876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:44.602461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:44.619635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:44.622466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:44.623414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:44.626072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:44.633009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:44.633920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.227526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.248515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.266227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.266847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a68c8c0-c927-4c38-90ea-3da0254750c7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.748001 Oct 17 13:35:45.269653 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2386/4744] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:44 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:45.280351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.283761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a4e031f-8251-4e7e-ab15-4961a3106412 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.686747 Oct 17 13:35:45.286066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.289871 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2359/4745] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:44 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:45.293347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.311233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.313893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.328958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.331054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.331536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.332270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.336323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.336323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.339582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.341381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.344150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.344928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.345531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.345885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.423991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.436562 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9535d9e-cdb2-40b3-89c8-1b1c05987078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1266 microversion: 2.1 time: 0.165532 Oct 17 13:35:45.441405 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2387/4746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:45.450540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.451446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.466687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.469634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.470205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.472832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.473667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.475656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.512760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.523508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-813b8900-4934-408d-9dd1-219a1728aecb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1274 microversion: 2.1 time: 0.230209 Oct 17 13:35:45.529613 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2360/4747] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:45.541383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.542039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.562979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.563981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.564822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.565903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.566373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.567018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.596615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:45.800534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.822605 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46c77427-ebae-41ca-a60d-6dede370e7d5 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.376548 Oct 17 13:35:45.842265 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2388/4748] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:45.868294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:45.869932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:45.890878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.891172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.894118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.894907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:45.895392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:45.899503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:45.977685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:45.996120 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0bb8257-eca5-42ef-b531-718a7f7636ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.465240 Oct 17 13:35:46.011911 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2361/4749] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:46.328204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.328834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:46.345649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.346155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.354895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.363618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.364624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.367693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.457459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:46.581355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.603647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5af28913-68e0-4a1e-81a5-9843dd6348b2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.726997 Oct 17 13:35:46.605196 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2389/4750] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:45 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:46.637906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.638899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:46.658588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.659388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.670869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.672076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.672973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.679636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.716238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.734799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.736390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.737679 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5de5a1a9-a80e-422c-82e5-aebf19d3b81a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.415386 Oct 17 13:35:46.766550 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2362/4751] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:46 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:46.785666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:46.786277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:46.801611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.813642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.814371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.815283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:46.815894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:46.816613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:46.944972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:46.954250 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d991e0fe-ebc8-48d2-b65f-d48beebe1400 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1272 microversion: 2.1 time: 0.327883 Oct 17 13:35:46.969248 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2390/4752] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:46 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1272 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:46.981447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a99837ca-7713-4426-ae4c-48f1007c4ea6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:46.997750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:47.003993 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a99837ca-7713-4426-ae4c-48f1007c4ea6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 6b0cb13f-941d-4898-9a66-31436d1085f9 has no mapping to a cell. Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a99837ca-7713-4426-ae4c-48f1007c4ea6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/6b0cb13f-941d-4898-9a66-31436d1085f9/action HTTP/1.1 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 15 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: {"os-stop": {}} Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 6b0cb13f-941d-4898-9a66-31436d1085f9 has no mapping to a cell. Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '6b0cb13f-941d-4898-9a66-31436d1085f9', 'body': {'os-stop': {}}} Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 6b0cb13f-941d-4898-9a66-31436d1085f9 has no mapping to a cell. Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:47.030123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b0cb13f-941d-4898-9a66-31436d1085f9 has no mapping to a cell. Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b0cb13f-941d-4898-9a66-31436d1085f9 has no mapping to a cell. Oct 17 13:35:47.041502 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:47.056969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a99837ca-7713-4426-ae4c-48f1007c4ea6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 6b0cb13f-941d-4898-9a66-31436d1085f9 has no mapping to a cell. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:47.059306 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a99837ca-7713-4426-ae4c-48f1007c4ea6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/6b0cb13f-941d-4898-9a66-31436d1085f9/action" status: 404 len: 117 microversion: 2.1 time: 0.087862 Oct 17 13:35:47.060608 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2391/4753] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:46 2022] POST /compute/v2.1/servers/6b0cb13f-941d-4898-9a66-31436d1085f9/action => generated 117 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:47.076738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.079352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.088599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.090231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.091357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.092335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.093067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.093762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.451670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.471523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c12ca1e-2a50-4ffb-aee1-eb3a0463f145 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.698535 Oct 17 13:35:47.477091 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2363/4754] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:46 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:47.506275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.508330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.542874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.544638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.546042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.547039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.547735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.548417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.805791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.818531 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6bb5196-41c0-49b4-9845-11d986e1bf56 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.756606 Oct 17 13:35:47.824322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2392/4755] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:47.835338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.837328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.856726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.858393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:47.858832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.859381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.860138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.860606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.863335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.867969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2c705b6-80e4-4775-a3da-8da1024186af tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.388888 Oct 17 13:35:47.872387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2364/4756] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:47.902072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:47.903073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:47.911496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.925793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.926378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.929711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:47.936584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:47.937220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:47.990611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:48.613220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:48.614861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:48.627977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:48.633589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:48.643786 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa183ee4-e012-49d3-b650-1c474735cb31 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 0.815620 Oct 17 13:35:48.646761 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2393/4757] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:48.659319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:48.659957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:48.679689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.679689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.679979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.683608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.685250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.685775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.726935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:48.748155 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dabdfa4b-b68f-44c0-adbb-6904b52b59ce tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.850256 Oct 17 13:35:48.748777 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2365/4758] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:47 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:48.777867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:48.778499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:48.806029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.807029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.812487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:48.813837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:48.814327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:48.814826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.142055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.150996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ac9a9e0-2a24-4ac9-a441-a39b4c5fae7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.503087 Oct 17 13:35:49.151593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2394/4759] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:48 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:49.161025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e538f465-0a2a-40c9-8c46-5d631f446607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:49.161609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e538f465-0a2a-40c9-8c46-5d631f446607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: c7aabf05-561c-42d6-9953-06d7471d1dda] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:49.174046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e538f465-0a2a-40c9-8c46-5d631f446607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance c7aabf05-561c-42d6-9953-06d7471d1dda could not be found. Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e538f465-0a2a-40c9-8c46-5d631f446607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/c7aabf05-561c-42d6-9953-06d7471d1dda/action HTTP/1.1 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 15 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: {"suspend": {}} Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance c7aabf05-561c-42d6-9953-06d7471d1dda could not be found. Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'c7aabf05-561c-42d6-9953-06d7471d1dda', 'body': {'suspend': {}}} Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7aabf05-561c-42d6-9953-06d7471d1dda could not be found. Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7aabf05-561c-42d6-9953-06d7471d1dda could not be found. Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:35:49.175862 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:35:49.180743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:35:49.180743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:35:49.180743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7aabf05-561c-42d6-9953-06d7471d1dda could not be found. Oct 17 13:35:49.180743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:35:49.182750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e538f465-0a2a-40c9-8c46-5d631f446607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance c7aabf05-561c-42d6-9953-06d7471d1dda could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:35:49.183832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e538f465-0a2a-40c9-8c46-5d631f446607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/c7aabf05-561c-42d6-9953-06d7471d1dda/action" status: 404 len: 111 microversion: 2.1 time: 0.027567 Oct 17 13:35:49.188764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2395/4760] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:49 2022] POST /compute/v2.1/servers/c7aabf05-561c-42d6-9953-06d7471d1dda/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:35:49.194490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:49.195412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:49.206170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.206852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.207687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.208678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.209326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.209902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.252895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:49.305525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:49.334456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-662fadf3-fe85-415e-9e1a-4199aadf5abc tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.584419 Oct 17 13:35:49.335656 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2366/4761] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:48 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:49.342357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:49.347322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:49.359794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.360498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.361331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:49.362439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:49.363149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:49.363741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.020385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.032635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0db236ce-bced-45e1-9979-8031ee8cd25b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.842427 Oct 17 13:35:50.034311 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2396/4762] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:49 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:50.141009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.158076 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bfa446a7-049c-4653-9353-c53174634fdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.819129 Oct 17 13:35:50.182485 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2367/4763] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:49 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:50.187605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-25403dca-f95c-43d1-93b8-e72eaed6c01d req-cdde660f-e83c-424f-a8c9-154fb10315e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a93b5065-c76d-4c37-86b6-90256e9eed8a", "tag": "ed2c335e-5600-480c-8a82-255f4b4dc421"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:50.213380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-25403dca-f95c-43d1-93b8-e72eaed6c01d req-cdde660f-e83c-424f-a8c9-154fb10315e6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.214882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-25403dca-f95c-43d1-93b8-e72eaed6c01d req-cdde660f-e83c-424f-a8c9-154fb10315e6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.215577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-25403dca-f95c-43d1-93b8-e72eaed6c01d req-cdde660f-e83c-424f-a8c9-154fb10315e6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.240333 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-25403dca-f95c-43d1-93b8-e72eaed6c01d req-cdde660f-e83c-424f-a8c9-154fb10315e6 service nova] Creating event network-changed:ed2c335e-5600-480c-8a82-255f4b4dc421 for instance a93b5065-c76d-4c37-86b6-90256e9eed8a on n-h2-854121-14 Oct 17 13:35:50.248405 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-25403dca-f95c-43d1-93b8-e72eaed6c01d req-cdde660f-e83c-424f-a8c9-154fb10315e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064239 Oct 17 13:35:50.250655 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2368/4764] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:50.260495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.266105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.286264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.286772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.287218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.287943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.288402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.288833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.308117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f81d5147-2903-4ecd-ab62-54785fff8ff7 req-205d618c-3d0a-493a-b991-90b13f252298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3b7d43-a0e3-402c-8f4f-f9f9cc151642", "name": "network-vif-plugged", "status": "completed", "tag": "60383b5f-0d3f-4720-b918-21d926c1e743"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:50.333675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f81d5147-2903-4ecd-ab62-54785fff8ff7 req-205d618c-3d0a-493a-b991-90b13f252298 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.334163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f81d5147-2903-4ecd-ab62-54785fff8ff7 req-205d618c-3d0a-493a-b991-90b13f252298 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.334629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f81d5147-2903-4ecd-ab62-54785fff8ff7 req-205d618c-3d0a-493a-b991-90b13f252298 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.388328 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f81d5147-2903-4ecd-ab62-54785fff8ff7 req-205d618c-3d0a-493a-b991-90b13f252298 service nova] Creating event network-vif-plugged:60383b5f-0d3f-4720-b918-21d926c1e743 for instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 on n-h2-854121-14 Oct 17 13:35:50.409877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f81d5147-2903-4ecd-ab62-54785fff8ff7 req-205d618c-3d0a-493a-b991-90b13f252298 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.371325 Oct 17 13:35:50.422860 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2397/4765] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:50.434829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.436051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.444059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:50.446370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.449324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.450033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.451608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.452233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.452859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.785392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.798310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.799851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.801172 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f7e908b-00fd-4800-9491-be35cfd18807 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.548313 Oct 17 13:35:50.801662 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2369/4766] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:50.837822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.842123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.854144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.855264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.855887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.858409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.859791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.860421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.860864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:50.871289 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6819fe16-9c9a-4916-aa0e-3877fd99a431 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.444599 Oct 17 13:35:50.891767 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2398/4767] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:50.904614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:50.906679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:50.920165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.922119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.922577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:50.923300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:50.923773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:50.924199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.239707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.260953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2c3e8cf-3b3c-4dce-8c98-0fa2e894ee09 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.436005 Oct 17 13:35:51.261853 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2370/4768] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:51.267181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.268019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.288428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.290172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.293803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.294776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.298155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.298783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.404428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.436580 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ca900a3-93b1-44e7-847b-11f69a60fda6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.543082 Oct 17 13:35:51.437379 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2399/4769] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:50 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:51.451778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:51.452867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.464278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.473563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.475081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.477349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.478414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.480497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.528747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lazy-loading 'flavor' on Instance uuid 54c999d9-c3d1-435f-96f0-5505353369b8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:51.592567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:51.604598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6b36482-8f03-4bb2-870d-20a29a7befc0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.341212 Oct 17 13:35:51.606652 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2371/4770] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:51.611395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f8b45433-a704-4003-b2cb-5b80629738e0 req-57a1bb19-6eb1-499f-8ecb-efb54cad4b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5e1c49-2fc3-445d-9adc-9dc1437a2128", "tag": "4e54f807-32c1-454a-99fa-f92857911b0e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:51.645863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8b45433-a704-4003-b2cb-5b80629738e0 req-57a1bb19-6eb1-499f-8ecb-efb54cad4b83 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.646629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8b45433-a704-4003-b2cb-5b80629738e0 req-57a1bb19-6eb1-499f-8ecb-efb54cad4b83 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.647272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8b45433-a704-4003-b2cb-5b80629738e0 req-57a1bb19-6eb1-499f-8ecb-efb54cad4b83 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.661792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f8b45433-a704-4003-b2cb-5b80629738e0 req-57a1bb19-6eb1-499f-8ecb-efb54cad4b83 service nova] Creating event network-changed:4e54f807-32c1-454a-99fa-f92857911b0e for instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 on n-h2-854121-14 Oct 17 13:35:51.675547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f8b45433-a704-4003-b2cb-5b80629738e0 req-57a1bb19-6eb1-499f-8ecb-efb54cad4b83 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067588 Oct 17 13:35:51.685841 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2372/4771] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:51.726659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-105f0abd-253c-49aa-9241-7d4960d48cd2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 202 len: 0 microversion: 2.1 time: 0.287911 Oct 17 13:35:51.728783 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2400/4772] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:51 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:35:51.736546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.737285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.754560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.754987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.755635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.756539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.757180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.757775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.832201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:51.833202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:51.844398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.846979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.847611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:51.848506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:51.851146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:51.851757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.182011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.196432 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87e28367-3fed-43f3-a0f7-1c5842f2e79a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1513 microversion: 2.1 time: 0.464045 Oct 17 13:35:52.197947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2373/4773] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1513 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:52.204400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.208418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.220140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.221655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.222976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.224569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.225395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.226940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.388519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.402110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.405044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.407585 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19ade851-2de3-4ea0-b9c3-86b450045e34 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.579857 Oct 17 13:35:52.409068 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2401/4774] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:51 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:52.465609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.466256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.481798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.482660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.483196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.484136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.484612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.497340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.498437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.511851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f1fde74-7e42-42fb-b1ca-52dc6f0eeb53 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.312154 Oct 17 13:35:52.512443 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2374/4775] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:52.631306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:52.631972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:52.639265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.639801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.640315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.641270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:52.642146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:52.642630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:52.778101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.785958 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-863ea327-c988-4411-8282-8bf656755969 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.325850 Oct 17 13:35:52.786550 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2402/4776] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:52.902478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:52.910603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-457ef7c9-61d1-45a2-952a-040b221456f2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.284714 Oct 17 13:35:52.911196 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2375/4777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:52 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:53.221457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.222080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.229231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.229729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.230173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.230899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.231340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.232008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.435221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.436273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.443639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.444160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.444607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.445352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.445811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.446294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.490345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.508386 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c6ad4e2-5023-44e8-9481-6042838a4dcb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1513 microversion: 2.1 time: 0.287183 Oct 17 13:35:53.523502 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2403/4778] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:53.535744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.536737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.560311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.562182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.562644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.563420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.563879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.564304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.851722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.855497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.862898 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-460d237b-7c11-46d5-a337-e6291a340256 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.331702 Oct 17 13:35:53.864806 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2404/4779] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:53.871569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.872469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.886172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.888096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:53.889919 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0759f03f-4717-42e5-8737-f5154de4692e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.459093 Oct 17 13:35:53.890091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.891231 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2376/4780] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:53.898304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8f097ea2-8dfa-45a0-a77e-7eb56ea202db req-92fbb2ff-b96f-4ac0-ad4a-0210d8c2c559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "name": "network-vif-plugged", "status": "completed", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:53.908136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.908918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.910699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.911360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.911987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.917707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f097ea2-8dfa-45a0-a77e-7eb56ea202db req-92fbb2ff-b96f-4ac0-ad4a-0210d8c2c559 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.918451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f097ea2-8dfa-45a0-a77e-7eb56ea202db req-92fbb2ff-b96f-4ac0-ad4a-0210d8c2c559 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.919073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f097ea2-8dfa-45a0-a77e-7eb56ea202db req-92fbb2ff-b96f-4ac0-ad4a-0210d8c2c559 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.933700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8f097ea2-8dfa-45a0-a77e-7eb56ea202db req-92fbb2ff-b96f-4ac0-ad4a-0210d8c2c559 service nova] Creating event network-vif-plugged:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:35:53.940031 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8f097ea2-8dfa-45a0-a77e-7eb56ea202db req-92fbb2ff-b96f-4ac0-ad4a-0210d8c2c559 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046943 Oct 17 13:35:53.942120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2377/4781] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:53.948805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:53.950125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:53.957038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.957691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.958137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:53.959017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:53.959807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:53.960423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.149042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.163288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.164205 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c69c1c84-7793-4f31-b2cc-776a20b84669 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.297008 Oct 17 13:35:54.179198 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2405/4782] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:54.188241 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4e920d6-7597-4d31-b4c7-133c46350e8f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.244764 Oct 17 13:35:54.188827 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2378/4783] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:53 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:54.535264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:54.535814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:54.544042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.544904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.545378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.547040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.547534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.547967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.740790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:54.768032 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b5f6b6a-cbc4-4ac2-b28d-b27842188722 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1513 microversion: 2.1 time: 0.224097 Oct 17 13:35:54.797609 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2406/4784] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:54 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:54.890602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:54.891349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:54.900506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.901129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.901782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.902539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.903257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.903832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.916768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:54.917777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:54.931300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.934213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.937908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:54.938685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:54.939171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:54.939612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.294904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.307994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4ef8840-176e-4171-ba54-c2f43096fc91 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.421912 Oct 17 13:35:55.310144 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2379/4785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:54 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:55.317850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:55.321400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:55.330040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.332150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.332859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.334014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.334755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.335468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.341617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:55.378033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'flavor' on Instance uuid 0000a0ee-91cb-40ec-9d8f-ee7101525586 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:35:55.402298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.414555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.419433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.421518 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb520e4c-cddd-42d8-857b-63319548b78b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.508604 Oct 17 13:35:55.438004 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2407/4786] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:54 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:55.453451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:55.454356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:55.464953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.466238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.467319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.468270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.468940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.471387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.646383 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f906b702-4559-41c1-b55e-08557d23bc57 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/action" status: 200 len: 32 microversion: 2.1 time: 0.333168 Oct 17 13:35:55.650584 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2380/4787] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:35:55 2022] POST /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:35:55.671514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:55.672746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:55.698474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.699029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.699496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.712954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.715366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.715846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.917068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:55.934896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac73494e-f035-42b3-9c14-e0516ec42cda tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.495181 Oct 17 13:35:55.935879 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2408/4788] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:55 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:55.949770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:55.956183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:55.970507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.978033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.978948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:55.979818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:55.980773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:55.981448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.011585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.032001 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89876ec1-42e4-4d8c-954e-f65ecee3afac tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.383497 Oct 17 13:35:56.037281 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2381/4789] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:55 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:56.063118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:56.068123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:56.099247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.100919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.103331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.107527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.110613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.111216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.312267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.320729 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61fb42c2-fe14-4e2e-8765-aa8772330295 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.383705 Oct 17 13:35:56.333562 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2409/4790] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:55 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:56.348445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:56.352404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:56.364485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.365269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.365890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.366775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.367386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.368003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.379084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.395834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68ae3f6a-4a72-41e4-8749-e83173a89c16 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1513 microversion: 2.1 time: 0.355490 Oct 17 13:35:56.405986 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2382/4791] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:56 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:56.457308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:56.457927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:56.465303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.465785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.466229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.466944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.467831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.468240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.607041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.617833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a08bb459-9726-4120-9620-2485fe167aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.282857 Oct 17 13:35:56.635491 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2410/4792] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:56 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:56.777892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.798068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.805234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:56.815401 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab279b11-8f79-40b9-ac54-d868a6a3dcba tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.354837 Oct 17 13:35:56.816381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2383/4793] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:56 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:35:56.962854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:56.962854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:56.978874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.979376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.979818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:56.980529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:56.986762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:56.987438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.062348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:57.063540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:57.075777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.077784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.078415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.080455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.082631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.085460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.306847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.316396 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5441c4b-d604-4686-9449-b9500d544283 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.360057 Oct 17 13:35:57.323513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2411/4794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:56 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:57.350700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:57.351330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:57.369730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.374042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.374695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.375590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.376397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.377017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.394989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:57.545646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.565100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6ac3ad9-b166-4bb3-98a1-d44cc24044ea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1309 microversion: 2.1 time: 0.504927 Oct 17 13:35:57.569289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2384/4795] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1309 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:57.589661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:57.590286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:57.600567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.601072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.601560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.602462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.603796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.604403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.942278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.957685 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e790701-e742-4562-9b07-a17b704dfce2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.610374 Oct 17 13:35:57.959303 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2412/4796] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:57.968737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:57.970249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:57.970883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:57.977229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.981379 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc3ac4b8-1b45-43a1-bf8d-31cd33901068 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1513 microversion: 2.1 time: 0.404757 Oct 17 13:35:57.987115 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2385/4797] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1513 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:57.989541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:57.992529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:57.993948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:57.999942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.001918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.002080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.002647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.019870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.020467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.020990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.021928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.022639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.025200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.341936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.356449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.364759 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62b89184-7590-43f1-a281-796361dce7b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.403355 Oct 17 13:35:58.371296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.374638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2413/4798] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:58.375388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.376850 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1d53f734-c170-4ca1-a227-15cc82c12dbf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.388529 Oct 17 13:35:58.377927 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2386/4799] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:57 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:35:58.384932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.385787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.392425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.393028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.393598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.394504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.395079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.395599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.573960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.583350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55115df6-6ec1-4d25-a77f-cffe90e0ea81 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.207316 Oct 17 13:35:58.584828 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2414/4800] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:58.613716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.614274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.621020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.621546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.621992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.622699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.623419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.623852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.763085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.771337 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d42d7f49-2965-4271-94a6-82447c67847e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1491 microversion: 2.1 time: 0.162707 Oct 17 13:35:58.771923 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2387/4801] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1491 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:58.794845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.795386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.803214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.803708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.804143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.804837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.805333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.805805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.948597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:58.956647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9099f997-e8ce-47ea-a06a-4e40cf563a20 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1491 microversion: 2.1 time: 0.166578 Oct 17 13:35:58.957285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2415/4802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1491 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:58.980499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.981228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.983478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:58.984423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:58.990399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.991229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.991737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.992084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.992217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.993041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.993364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.993531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.994115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:58.994352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:58.994683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:58.995120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.614238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:59.623278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55159314-aa23-4f0b-b976-f2f331fb1edb tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.643857 Oct 17 13:35:59.624484 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2416/4803] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:35:59.632978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:59.635846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:59.639920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:59.648984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84027317-4a08-4a20-a8ff-04d041f6e6e1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1491 microversion: 2.1 time: 0.673520 Oct 17 13:35:59.652389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.652893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.653472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.654514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.654909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.655417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.665931 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2388/4804] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:58 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1491 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:59.674429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-aabead8f-9342-4a3d-bbc5-8b8a3e754e64 req-bc2c91aa-65c9-4195-9de7-873557e07b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93b5065-c76d-4c37-86b6-90256e9eed8a", "name": "network-vif-plugged", "status": "completed", "tag": "ed2c335e-5600-480c-8a82-255f4b4dc421"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:35:59.688790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aabead8f-9342-4a3d-bbc5-8b8a3e754e64 req-bc2c91aa-65c9-4195-9de7-873557e07b83 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.689306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aabead8f-9342-4a3d-bbc5-8b8a3e754e64 req-bc2c91aa-65c9-4195-9de7-873557e07b83 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.690572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aabead8f-9342-4a3d-bbc5-8b8a3e754e64 req-bc2c91aa-65c9-4195-9de7-873557e07b83 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.704972 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-aabead8f-9342-4a3d-bbc5-8b8a3e754e64 req-bc2c91aa-65c9-4195-9de7-873557e07b83 service nova] Creating event network-vif-plugged:ed2c335e-5600-480c-8a82-255f4b4dc421 for instance a93b5065-c76d-4c37-86b6-90256e9eed8a on n-h2-854121-14 Oct 17 13:35:59.710977 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-aabead8f-9342-4a3d-bbc5-8b8a3e754e64 req-bc2c91aa-65c9-4195-9de7-873557e07b83 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043365 Oct 17 13:35:59.716313 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2389/4805] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:35:59.722188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:59.722899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:59.726019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:35:59.735225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.735744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.736583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.737771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.738396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.739268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.897524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:59.911279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3604cb72-0ff8-4fb0-bf08-f1300ad9cb89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1496 microversion: 2.1 time: 0.279877 Oct 17 13:35:59.931214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:35:59.941443 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5161f569-c22b-478e-a848-f537c572b31e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.223659 Oct 17 13:35:59.942039 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2390/4807] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:59 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:59.948640 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2417/4807] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:59 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1496 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:35:59.949370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:59.950236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:59.954138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:35:59.954748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:35:59.961338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.961988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.963152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.964403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.965047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.965666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.975292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.975864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.976343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:35:59.977153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:35:59.978048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:35:59.978714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.216346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.228276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.238566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.240949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.242477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60d0f1b9-8f35-4c14-a99a-94c7ec81502a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.299191 Oct 17 13:36:00.242646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0eeeee7a-1bee-487e-92a9-88e2a5473cd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.292289 Oct 17 13:36:00.257217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2391/4808] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:35:59 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:00.257715 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2418/4809] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:35:59 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:00.265576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:00.266366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.266856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:00.267511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.273260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.273944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.274608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.275168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.275856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.276204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.276494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.276990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.277433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.277842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.278075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.278880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.307018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lazy-loading 'flavor' on Instance uuid 54c999d9-c3d1-435f-96f0-5505353369b8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:00.308939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:00.321963 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'suspend' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state suspended Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 15 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: {"suspend": {}} Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'suspend' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state suspended Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'suspend': {}}} Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 17 13:36:00.324494 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state suspended Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state suspended Oct 17 13:36:00.328670 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:00.331387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'suspend' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state suspended {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:00.334012 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b4ba9ed-b90b-4a25-95ef-55f3f10433fb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 148 microversion: 2.1 time: 0.073610 Oct 17 13:36:00.334824 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2419/4810] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:00 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 148 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:36:00.345833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:00.346494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.356324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.356813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.357277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.358113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.358644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.359077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.426645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be31e163-7f92-4c69-809a-7f23cfadefdd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 204 len: 0 microversion: 2.1 time: 0.167272 Oct 17 13:36:00.427420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2392/4811] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:00 2022] DELETE /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:00.439544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:00.440286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.449001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.449789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.450388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.451252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.452020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.453140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.458933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76bc8704-4d83-4074-bca8-25ad7e3bbb14 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 202 len: 0 microversion: 2.1 time: 0.116211 Oct 17 13:36:00.463226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2420/4812] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:00 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:00.469529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:00.470703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.478517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.479139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.479579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.480316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.480826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.481440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.760248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.764341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.772127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:00.773053 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-afc43764-5155-477a-8aa7-648e7af3bc38 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1502 microversion: 2.1 time: 0.308263 Oct 17 13:36:00.773793 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2421/4813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:00 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:00.776845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-81325c94-450b-4ba0-8959-a6e4c73f28a4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1497 microversion: 2.1 time: 0.343021 Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.789187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.791240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2393/4814] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:00 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:00.940326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:00.952819 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e7a511a-4dea-4558-a61a-3eb2decb754f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.177477 Oct 17 13:36:00.954148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2422/4815] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:00 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:00.967383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:00.967993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:00.974866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.975360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.975824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:00.976503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:00.976961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:00.977411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.131810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:01.140919 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a08209e-156e-4ee5-b6a8-43425e571ef2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.178599 Oct 17 13:36:01.141808 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2394/4816] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:00 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:01.269866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:01.270431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:01.278813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:01.279431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:01.285721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.286218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.286651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.287351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.287812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.288212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.307121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.307609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.308000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.308737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.309187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.309613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.573302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:01.574240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:01.586176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:01.588987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:01.590988 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9416e54-e451-4e7a-b3a1-4612c50c7726 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.325041 Oct 17 13:36:01.591712 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2423/4817] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:01 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:01.616368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a58dca6-d37e-48ab-b36d-b370dbec3e3c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.341924 Oct 17 13:36:01.625299 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2395/4818] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:01 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:01.803086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:01.803635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:01.804024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:01.804700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:01.812322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.812828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.813184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.813480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.813812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.814199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.814639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.814785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.815085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:01.815791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:01.816695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:01.817732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.039626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.049494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.055093 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-772ffbdb-202b-445f-b1a3-166bada91a63 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1502 microversion: 2.1 time: 0.256913 Oct 17 13:36:02.056860 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2424/4819] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:01 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:02.059837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22dba40e-1ca0-45c5-8fe6-0927b2972664 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1497 microversion: 2.1 time: 0.260608 Oct 17 13:36:02.064248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:02.065150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:02.071613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.072133 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2396/4820] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:01 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1497 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:02.073094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.073726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.074631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.075286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.075870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.166254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:02.166793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:02.177420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.177932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.178386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.179108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.179574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.180167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.249635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.259854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b991bac-0771-491b-b1f1-f87e752d4ff1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.201427 Oct 17 13:36:02.264349 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2425/4821] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:02 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:02.398725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.412832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c590fa77-f864-4ef0-93d0-398186bd81fa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.250486 Oct 17 13:36:02.414176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2397/4822] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:02 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:02.630709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:02.631346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:02.641657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:02.642454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:02.650512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.650954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.655236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.655347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.655758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.656482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.656818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.656947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.657366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.669805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:02.670415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:02.670950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:02.906332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.919577 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a959a6e9-5602-4b4e-94ba-734b32658438 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.282126 Oct 17 13:36:02.935480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2398/4823] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:02 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:02.959097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.968650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.970136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:02.971332 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df985301-dff0-4fcd-9d42-d97158113309 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1745 microversion: 2.20 time: 0.354134 Oct 17 13:36:02.972215 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2426/4824] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:02 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1745 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:03.084890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.085836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.086191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.086463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.094665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.095337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.095531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.096289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.097438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.099117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.099483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.099979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.100100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.100716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.101207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.101649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.345683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:03.361299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-396af6f6-9c0a-48f4-9192-9b75982d44ea tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1502 microversion: 2.1 time: 0.280926 Oct 17 13:36:03.361905 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2399/4825] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:03.373536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.375988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.402813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.403262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:03.403415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.403799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.404531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.404990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.405901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.406855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:03.416010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dab74783-35a8-4e93-9fb0-fc0eeb2e10c5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1497 microversion: 2.1 time: 0.333987 Oct 17 13:36:03.417188 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2427/4826] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1497 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:03.445937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.448442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.457097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.458893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.459587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.460721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.461607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.462293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.676537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:03.690519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0be8da9b-29eb-407e-8ec9-7b4fb5253bf3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.327345 Oct 17 13:36:03.694857 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2400/4827] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:03.717385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:03.728702 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-276107f2-3cdb-42d4-b949-e8f3f82b9828 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.288680 Oct 17 13:36:03.729313 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2428/4828] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:03.944382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.945101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:03.952367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.952859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.953333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.954045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:03.954507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:03.954938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:03.997569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:03.998696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.006534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.007207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.007770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.008587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.009551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.010080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.148275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.157047 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c4cb164b-7dec-47e9-96ab-afdda6323c6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.217630 Oct 17 13:36:04.172985 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2401/4829] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:04.185528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.194211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.195806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.197460 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7cb4900-7567-4b6a-95ac-4f853f2e9b07 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.203925 Oct 17 13:36:04.198117 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2429/4830] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:03 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:36:04.392706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.393360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.400875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.401408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.402067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.402895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.403368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.403808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.443672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.444466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.451648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.452150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.452865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.454023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.454511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.455081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.607331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.623028 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-06adfa4d-9de4-4cf9-9f47-ba3ed39ea160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1502 microversion: 2.1 time: 0.235244 Oct 17 13:36:04.624145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2402/4831] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:04.658062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.669294 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-584a1a5c-f42d-4369-a681-0c5fd477250a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1497 microversion: 2.1 time: 0.230507 Oct 17 13:36:04.670072 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2430/4832] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:04.718302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.719005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.726983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.728574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.729227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.730030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.730627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.731173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.755924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:04.756599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:04.764649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.765422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.765918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.767256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:04.768265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:04.772487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:04.972138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:04.991304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e07e8e77-cd45-4278-a71d-59e8d548b616 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.275629 Oct 17 13:36:04.992409 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2403/4833] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:05.053788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.066016 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c5e7998-b9fc-4ca0-9191-674de8162d43 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.314118 Oct 17 13:36:05.078144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2431/4834] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:04 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:05.182329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:05.183202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:05.193413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.195005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.197886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.198884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.200028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.201638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.225282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:05.226141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:05.243994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.244328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.249585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.250829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.252325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.253068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.557671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.574170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.574514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.575552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.577622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8745000-68f3-4db9-aa9a-8b4243af2a02 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.357173 Oct 17 13:36:05.578525 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2432/4835] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:05 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:05.606165 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71df2ad1-07ea-45e0-b326-dfb8f3c6bb60 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.428546 Oct 17 13:36:05.623522 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2404/4836] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:05 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:05.652001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:05.652666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:05.660112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.660344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.660797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.661549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.662426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.663053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.693867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:05.694495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:05.706998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.707511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.707974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.708706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:05.709189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:05.709633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:05.832786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.848236 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b986a953-daa9-4687-b962-2f3dd5dabcdf tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1502 microversion: 2.1 time: 0.200804 Oct 17 13:36:05.849636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2433/4837] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:05 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:05.979102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:05.995427 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e3f4695-15a9-4d0d-b719-971d06cb8f1e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1497 microversion: 2.1 time: 0.306114 Oct 17 13:36:05.996851 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2405/4838] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:05 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1497 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:06.016687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:06.017619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:06.027922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.029911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.032012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.033003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.035969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.036655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.090714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:06.091703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:06.099563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.101313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.101973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.103798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.104473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.105084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.320366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:06.333291 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcf100f8-a5bd-4494-b941-516bfea367ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.320524 Oct 17 13:36:06.340968 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2434/4839] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:06 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:06.367668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:06.380907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-35041369-059f-466e-8173-7b935472da4f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.294164 Oct 17 13:36:06.381716 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2406/4840] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:06 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:06.616158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:06.616946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:06.633950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:06.634591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:06.649491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.652560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.653684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.656521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.669136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.670166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.670378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.671176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.671790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:06.672714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:06.673436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:06.685047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.221321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:07.235584 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85183371-0e7c-462e-a8af-7800fa79b556 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1316 microversion: 2.1 time: 0.602569 Oct 17 13:36:07.236246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2407/4841] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:06 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:07.241001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:07.253902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:07.264022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:07.265829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:07.266717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:07.271284 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e5fa472-bbfc-4990-bca0-a1119fbd6601 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.665424 Oct 17 13:36:07.275257 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2435/4842] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:06 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:07.280368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:07.289275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.290670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.291733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:07.292354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.293268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.294785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.298765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.310258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.315050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.315700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.316815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:07.317570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:07.318152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:07.951579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:07.975958 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2022691a-d3a4-4de5-af9e-d9a2df4c3cdb tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1502 microversion: 2.1 time: 0.738619 Oct 17 13:36:07.983692 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2408/4843] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:07 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1502 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:08.004805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:08.006888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:08.041573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:08.044107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.049444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.050383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.054361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.059517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.060930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.066486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c332a3cd-2c62-4b7a-a332-e164a6617ae4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 200 len: 1497 microversion: 2.1 time: 0.785631 Oct 17 13:36:08.073147 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2436/4844] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:07 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 1497 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:08.092679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:08.094455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:08.122592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.123817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.124288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:08.125416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:08.125915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:08.128671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.008382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.029006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.042278 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-14533460-2121-4642-8e4b-e482e5953de4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 1.056911 Oct 17 13:36:09.042979 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-999592a4-e2a8-4bcf-9740-320f8d2abd4b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.967203 Oct 17 13:36:09.043753 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2437/4845] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:08 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:09.057572 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2409/4846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:07 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:09.064597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.068560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-45b256e0-a701-45ff-80f2-b0527fda5658 req-83e81429-bc33-4b4b-bdf9-9e75c6167a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3b7d43-a0e3-402c-8f4f-f9f9cc151642", "name": "network-vif-deleted", "tag": "60383b5f-0d3f-4720-b918-21d926c1e743"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:09.072805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.082477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.082990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.083622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.084510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.085184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.085805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.095373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45b256e0-a701-45ff-80f2-b0527fda5658 req-83e81429-bc33-4b4b-bdf9-9e75c6167a99 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.098023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45b256e0-a701-45ff-80f2-b0527fda5658 req-83e81429-bc33-4b4b-bdf9-9e75c6167a99 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.098624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45b256e0-a701-45ff-80f2-b0527fda5658 req-83e81429-bc33-4b4b-bdf9-9e75c6167a99 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.124415 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-45b256e0-a701-45ff-80f2-b0527fda5658 req-83e81429-bc33-4b4b-bdf9-9e75c6167a99 service nova] Creating event network-vif-deleted:60383b5f-0d3f-4720-b918-21d926c1e743 for instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 on n-h2-854121-14 Oct 17 13:36:09.159049 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-45b256e0-a701-45ff-80f2-b0527fda5658 req-83e81429-bc33-4b4b-bdf9-9e75c6167a99 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099669 Oct 17 13:36:09.159968 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2410/4847] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:09.185206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.188784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.233457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.235952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.239013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.241569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.242781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.245427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.266778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:09.610404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.624763 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4f3a864-3984-493c-bf8f-2e78815c93bd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1466 microversion: 2.1 time: 0.563908 Oct 17 13:36:09.625397 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2438/4848] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1466 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:09.633524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-41fcac9c-d178-4626-a9b0-49c6f0b59910 req-5ce54e90-e154-4481-9903-a84236d663b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5e1c49-2fc3-445d-9adc-9dc1437a2128", "name": "network-vif-plugged", "status": "completed", "tag": "4e54f807-32c1-454a-99fa-f92857911b0e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:09.661118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-41fcac9c-d178-4626-a9b0-49c6f0b59910 req-5ce54e90-e154-4481-9903-a84236d663b5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.661648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-41fcac9c-d178-4626-a9b0-49c6f0b59910 req-5ce54e90-e154-4481-9903-a84236d663b5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.662091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-41fcac9c-d178-4626-a9b0-49c6f0b59910 req-5ce54e90-e154-4481-9903-a84236d663b5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.684161 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-41fcac9c-d178-4626-a9b0-49c6f0b59910 req-5ce54e90-e154-4481-9903-a84236d663b5 service nova] Creating event network-vif-plugged:4e54f807-32c1-454a-99fa-f92857911b0e for instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 on n-h2-854121-14 Oct 17 13:36:09.695057 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-41fcac9c-d178-4626-a9b0-49c6f0b59910 req-5ce54e90-e154-4481-9903-a84236d663b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067989 Oct 17 13:36:09.700265 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2439/4849] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:09.714259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.718014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.719906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.729434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.730902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:09.732105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ba7a2a1-7f8f-4c81-a51a-d26ce8fcf83d tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.570859 Oct 17 13:36:09.732862 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2411/4850] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:09.735103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.735599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.736042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.747225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.748060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.748917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.749592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.761737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.769364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.769867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.770387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.771120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.771578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.772008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.798694 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 HTTP/1.1 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4c3b7d43-a0e3-402c-8f4f-f9f9cc151642'} Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:09.800461 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e08dfaee-f975-4736-9af2-a456d4d3a61d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 404 len: 111 microversion: 2.1 time: 0.068297 Oct 17 13:36:09.805512 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2412/4851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:09.819625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:09.820260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:09.847220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.847772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.848168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:09.848976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:09.849811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:09.849978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.142941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:10.156536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d216d42-9ab0-4359-bc03-f4e3164f35ef tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.454719 Oct 17 13:36:10.157128 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2440/4852] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:10.162020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.166247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.184646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.185181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.185726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.186308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.186958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.187533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.234753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:10.263821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf310802-3965-440d-a8dd-849d156dcf1a tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1619 microversion: 2.1 time: 0.460305 Oct 17 13:36:10.264404 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2413/4853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:09 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1619 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:10.268940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.282331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.301398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.301900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.307859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.315760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.318374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.319035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.431238 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cfe55153-8383-41a7-a803-e8539e3794cb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 204 len: 0 microversion: 2.1 time: 0.271978 Oct 17 13:36:10.436872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2441/4854] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:10 2022] DELETE /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:10.462206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.468489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.481495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.486805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.487692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.488721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.489419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.490020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.640534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:10.650662 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9f8c335-7c85-41c8-ad7b-605d00d6dcbd tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.385197 Oct 17 13:36:10.655989 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2414/4855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:10.671755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.674110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.682722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.683520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.684133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.685025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.685928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.686519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.892556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:10.903115 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-651d82a0-6bb4-4670-929e-169f42705131 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1314 microversion: 2.1 time: 0.462295 Oct 17 13:36:10.904082 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2442/4856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:10.929914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:10.932507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:10.942087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.942930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.943586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.945069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:10.946377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:10.947499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:10.985338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:11.065376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.073966 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e4816ce-df90-43aa-b13b-118f1350c82c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.406876 Oct 17 13:36:11.083032 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2415/4857] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:11.088937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-739376545", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["509d327d-d2cb-4993-9f10-b5550138a4d7"]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:11.164013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:11.363755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.373016 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e58a959-c874-4055-a789-fec81f4203a5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1497 microversion: 2.1 time: 0.463639 Oct 17 13:36:11.385815 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2443/4858] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:10 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1497 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:11.401376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:11.401992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:11.414101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.414603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.421006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.421983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.422473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.422919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.795141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.816159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.817637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:11.819270 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-513ff8c1-7e18-43ea-a72a-1f32f6683c65 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.432034 Oct 17 13:36:11.819399 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2444/4859] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:11 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:11.854345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53513d9a-2449-442d-adf2-38d4641da607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:11.860068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53513d9a-2449-442d-adf2-38d4641da607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:11.872491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:11.875795 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-53513d9a-2449-442d-adf2-38d4641da607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d could not be found. Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53513d9a-2449-442d-adf2-38d4641da607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d/action HTTP/1.1 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 15 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: {"unpause": {}} Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d could not be found. Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d', 'body': {'unpause': {}}} Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d could not be found. Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d could not be found. Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:11.877942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d could not be found. Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53513d9a-2449-442d-adf2-38d4641da607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53513d9a-2449-442d-adf2-38d4641da607 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d/action" status: 404 len: 111 microversion: 2.1 time: 0.041016 Oct 17 13:36:11.882743 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2445/4860] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:11 2022] POST /compute/v2.1/servers/0adb4b0b-46ee-4c3b-ae70-2a6e3d961d5d/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:11.890776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:11.891570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:11.904799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.905345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.905800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.907106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.907588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.908029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.918962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:11.921043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:11.921979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:11.922543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:11.922969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:11.955714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.956201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.956640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:11.969643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:11.970254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:11.970718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.022916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:12.037283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:12.068613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:12.072390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:12.188763 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6df8b0dd-f259-44c8-845a-5c59ce2324e8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104296 Oct 17 13:36:12.194720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2416/4861] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:12.217249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:12.218063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:12.244692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.251385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.252086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.255705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.257854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.261823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.268403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:12.281111 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbcdb4ce-8287-4f87-afe4-2309b62c2e5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.399702 Oct 17 13:36:12.285212 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2446/4862] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:11 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:12.304314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:12.304921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:12.331975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.332512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.332926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:12.333674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:12.343146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:12.343146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.114667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.125858 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c77ebeac-0462-4240-986c-7afbe186da70 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.929962 Oct 17 13:36:13.127904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.155203 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2417/4863] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:12 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:13.165924 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d94f7ead-ae39-4042-bff8-3fc01a78d192 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1501 microversion: 2.1 time: 0.880008 Oct 17 13:36:13.186432 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2447/4864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:12 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1501 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:13.202178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.203256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:13.222990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.223769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.224231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.227723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.228229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.230151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.263182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.264408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:13.276989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.279312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.280225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.281475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.282170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.283784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.788656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.806418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6844e65-99dc-4d99-bf95-40b9f47d50a1 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 200 len: 1455 microversion: 2.1 time: 0.618685 Oct 17 13:36:13.820596 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2448/4865] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:13 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 1455 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:13.827144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:13.855497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9c6eddd-fc56-4c50-b3d9-3f4a9a686a0a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1220 microversion: 2.1 time: 0.696168 Oct 17 13:36:13.869890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2418/4866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:13 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1220 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:13.870136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:13.881472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:13.890124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-700eea73-d9f7-41e8-bb81-ebfd174939f5 req-7dec46b5-2cd6-4131-965d-1f219abf386b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b572d74b-cd63-401a-8da0-df1001a2433d", "name": "network-vif-deleted", "tag": "fbcf604e-5362-4f07-932b-7d322cf6245f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:13.919004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.923438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.923897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.924640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.925101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.936668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.940722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-700eea73-d9f7-41e8-bb81-ebfd174939f5 req-7dec46b5-2cd6-4131-965d-1f219abf386b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:13.955850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-700eea73-d9f7-41e8-bb81-ebfd174939f5 req-7dec46b5-2cd6-4131-965d-1f219abf386b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:13.956127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-700eea73-d9f7-41e8-bb81-ebfd174939f5 req-7dec46b5-2cd6-4131-965d-1f219abf386b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:13.996838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-700eea73-d9f7-41e8-bb81-ebfd174939f5 req-7dec46b5-2cd6-4131-965d-1f219abf386b service nova] Creating event network-vif-deleted:fbcf604e-5362-4f07-932b-7d322cf6245f for instance b572d74b-cd63-401a-8da0-df1001a2433d on n-h1-854121-14 Oct 17 13:36:14.026011 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-700eea73-d9f7-41e8-bb81-ebfd174939f5 req-7dec46b5-2cd6-4131-965d-1f219abf386b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163881 Oct 17 13:36:14.028026 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2419/4867] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:14.058854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.064240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.109750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.111202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.116360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.117236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.117724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.118814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.242563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.252373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.268167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.278215 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-190f784c-ee98-47d7-affd-fab3802ce307 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.433703 Oct 17 13:36:14.281076 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2449/4868] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:13 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:14.316390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.324675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.361699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.367369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.369406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.371786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.375089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.375734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.806781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:14.819456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac4083e7-1e83-4ab0-b4ba-9fbaa9e45811 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.790114 Oct 17 13:36:14.822131 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2420/4869] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:14.853603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:14.854326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:14.898119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.898641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.899153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.903396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:14.905347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:14.912224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:14.964655 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d HTTP/1.1 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b572d74b-cd63-401a-8da0-df1001a2433d'} Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:14.978528 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:14.983425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:14.983425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:14.983425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:14.983425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:14.983425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:36:14.983425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:14.989584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:14.994989 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a3865e9-9772-42be-8d8d-40a3f57a0fdc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 404 len: 111 microversion: 2.1 time: 0.153117 Oct 17 13:36:14.995779 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2421/4870] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:36:15.013711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:15.014683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.035835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.036197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.036977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.037604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.040343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.042163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.045624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.060816 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-259a8541-d1e9-43a6-be6e-0fed7a4c44d4 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1733 microversion: 2.1 time: 0.760274 Oct 17 13:36:15.065071 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2450/4871] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:14 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1733 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:15.082670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.089526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.112993 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'unpause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:15.116503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.121299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.122000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.122941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.126773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.128843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 15 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: {"unpause": {}} Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'unpause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'unpause': {}}} Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state active. Cannot unpause while the instance is in this state. Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:15.139655 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:15.144894 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:15.144894 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:15.144894 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:15.144894 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:15.144894 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:15.144894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'unpause' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:15.150123 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40e15eee-3772-470d-bccc-328212893160 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 145 microversion: 2.1 time: 0.152161 Oct 17 13:36:15.154964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2422/4872] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:14 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 145 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:36:15.160584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.169037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.181590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.182202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.182658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.183411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.191795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.192447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.375619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.385352 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46bd1dc4-9dd4-41b3-94af-1cff976615d8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1276 microversion: 2.1 time: 0.317455 Oct 17 13:36:15.409280 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2451/4873] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1276 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:15.424438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.427983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.445809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.449113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.449829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.451209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.453013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.454324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.622972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.638498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67d367e8-b5bd-45dd-8aeb-c15aa1878a0a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.481965 Oct 17 13:36:15.639764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2423/4874] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:15.657644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-244626201", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:15.770727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:15.848497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.877666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.880393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:15.881902 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8ba92ac-d15e-484d-a7d4-998b64502fe2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.471482 Oct 17 13:36:15.905880 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2452/4875] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:15.918223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:15.921928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:15.969971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.970807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.971449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:15.975403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:15.976921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:15.979236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.573655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:16.583665 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d83b541-6683-4db2-ae5f-16bdd85e6d8a tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.676303 Oct 17 13:36:16.589978 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2453/4876] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:15 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:16.609101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:16.611345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:16.633022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.634596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.635288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:16.640227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:16.640894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:16.641573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.432594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:17.448754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-76a7ba70-dd24-4fd6-bb4b-ecadfd08dc20 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1713 microversion: 2.1 time: 0.854532 Oct 17 13:36:17.456878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2454/4877] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:16 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1713 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:17.471827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:17.475690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:17.502436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.505054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.507586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.510259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.512422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.514518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.604430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:17.605072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:17.605426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:17.606115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:17.606897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:17.646428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.647602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.651307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.652624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.654754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.661697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.720073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:17.722047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:17.731035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a1d232b-dc66-42b0-9121-2f297f00b563 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1274 microversion: 2.1 time: 0.271044 Oct 17 13:36:17.732193 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2455/4878] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:17 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:17.737970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98d7543c-2906-4d15-9490-514dd84f1e45 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:17.739012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98d7543c-2906-4d15-9490-514dd84f1e45 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 33049816-bded-4a45-b464-412a9ac6f366] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:17.739202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:17.750318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-98d7543c-2906-4d15-9490-514dd84f1e45 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 33049816-bded-4a45-b464-412a9ac6f366 could not be found. Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98d7543c-2906-4d15-9490-514dd84f1e45 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/33049816-bded-4a45-b464-412a9ac6f366/action HTTP/1.1 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 18 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: {"unshelve": null} Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 33049816-bded-4a45-b464-412a9ac6f366 could not be found. Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '33049816-bded-4a45-b464-412a9ac6f366', 'body': {'unshelve': None}} Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33049816-bded-4a45-b464-412a9ac6f366 could not be found. Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33049816-bded-4a45-b464-412a9ac6f366 could not be found. Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:17.752376 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33049816-bded-4a45-b464-412a9ac6f366 could not be found. Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98d7543c-2906-4d15-9490-514dd84f1e45 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 33049816-bded-4a45-b464-412a9ac6f366 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98d7543c-2906-4d15-9490-514dd84f1e45 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/33049816-bded-4a45-b464-412a9ac6f366/action" status: 404 len: 111 microversion: 2.1 time: 0.021975 Oct 17 13:36:17.757355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2456/4879] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:17 2022] POST /compute/v2.1/servers/33049816-bded-4a45-b464-412a9ac6f366/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:17.764974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:17.773532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:17.778702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:17.781710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:17.793070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.795231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.796372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.797425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:17.798226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.799813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.799813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.921518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c7d446a-d8e1-4028-8927-308026cf9b75 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.273173 Oct 17 13:36:17.930247 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2424/4880] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:17.944419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ac0327f-268c-4091-9f09-18d947baa531"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:17.948355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:17.960907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.975053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.975804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:17.976964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:17.978386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:17.979380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:18.564706 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fce9ea7-9a49-41f7-bdc5-fbc1d3921290 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.631238 Oct 17 13:36:18.565639 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2425/4881] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:36:17 2022] POST /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128/os-volume_attachments => generated 194 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:18.580121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:18.587977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:18.593581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:18.594351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:18.603592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:18.608254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2546261b-d3c2-4b98-9aa1-0ec8228b1f4e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.850114 Oct 17 13:36:18.610943 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2457/4882] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:17 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:18.616277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:18.619644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:18.629976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:18.642007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:18.643030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:18.647400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:18.647905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:18.648382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:18.676322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:18.686255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:18.687979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:18.689393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:18.697863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:18.702603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:18.920407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Cannot 'detach_volume' instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 while it is in vm_state rescued Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments/466cf195-d6fd-49dc-a91f-e47e140448df HTTP/1.1 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'detach_volume' instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 while it is in vm_state rescued Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': '0000a0ee-91cb-40ec-9d8f-ee7101525586', 'id': '466cf195-d6fd-49dc-a91f-e47e140448df'} Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 while it is in vm_state rescued Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:18.925302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:18.930312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:18.930312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:18.930312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:18.930312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:18.930312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 while it is in vm_state rescued Oct 17 13:36:18.930312 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:18.935638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 409 to user: Cannot 'detach_volume' instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 while it is in vm_state rescued {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:18.937998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5de28cef-ea1a-42b0-b01e-90996a74a168 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments/466cf195-d6fd-49dc-a91f-e47e140448df" status: 409 len: 152 microversion: 2.1 time: 0.369914 Oct 17 13:36:18.941082 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2426/4883] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:36:18 2022] DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments/466cf195-d6fd-49dc-a91f-e47e140448df => generated 152 bytes in 375 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:36:18.953677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73075650-3cd6-4275-9593-215269cfb5ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:18.955516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73075650-3cd6-4275-9593-215269cfb5ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.222700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73075650-3cd6-4275-9593-215269cfb5ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:19.241778 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73075650-3cd6-4275-9593-215269cfb5ad tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1208 microversion: 2.1 time: 0.292890 Oct 17 13:36:19.244177 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2427/4884] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:18 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1208 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:19.255376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:19.257752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.276950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.278955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.279946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.283011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.283830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.285347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.489709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:19.509902 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6c12d34-80dd-435f-a80b-1af9f397ebe7 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.894888 Oct 17 13:36:19.513439 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2458/4885] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:18 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:19.534222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:19.536737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.557746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.560448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.564607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.568401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.568939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.569424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.733874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:19.751382 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-259115ff-a258-4824-9dac-f24fa0b42625 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.502399 Oct 17 13:36:19.762971 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2428/4886] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:19 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:19.789358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:19.791375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.793973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0f7d719-16c6-4e21-b866-8d5e035278a9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/action" status: 202 len: 0 microversion: 2.1 time: 0.277888 Oct 17 13:36:19.795680 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2459/4887] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:19 2022] POST /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:19.821934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.823202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:19.824490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.825114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.829388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.834168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.836762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.850470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:19.870303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.870812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.871259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:19.871982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:19.872468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:19.872881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.297918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:20.308487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:20.315781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:20.318409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c584056-96a2-443a-a02d-02d0e823257a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.505821 Oct 17 13:36:20.321838 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2460/4888] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:19 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:20.329152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:20.339387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:20.353589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.354313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.357782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.359420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.363041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.363494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.377720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:20.390131 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9f3d175-4153-4bca-b404-f0467fae2de3 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.623514 Oct 17 13:36:20.409452 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2429/4889] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:19 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:20.420068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:20.424471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:20.440311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.447036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.447881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.448848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.450380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:20.451147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.451798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.748894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:20.762332 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42e02338-c66f-4535-9a15-8e72ce9e64dc tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1268 microversion: 2.1 time: 0.344884 Oct 17 13:36:20.763153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2430/4890] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:20 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1268 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:20.784542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:20.785194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:20.809886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.811894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.812911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.813848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.816157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.818133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.828704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:20.895847 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Cannot 'unshelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action HTTP/1.1 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 18 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: {"unshelve": null} Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'unshelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'unshelve': None}} Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 in vm_state active. Cannot unshelve while the instance is in this state. Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:36:20.900132 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active Oct 17 13:36:20.904638 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:20.917453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 409 to user: Cannot 'unshelve' instance 54c999d9-c3d1-435f-96f0-5505353369b8 while it is in vm_state active {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:20.922904 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbae62ee-e1dd-4996-b26a-37001eb41771 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action" status: 409 len: 146 microversion: 2.1 time: 0.151877 Oct 17 13:36:20.924475 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2431/4891] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:36:20 2022] POST /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8/action => generated 146 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:36:20.935814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:20.947468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:20.980171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.981359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.984664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:20.990140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:20.991180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:20.994876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.019412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:21.039164 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7ab932e0-0e30-466d-9d4d-90213842e52b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1721 microversion: 2.1 time: 0.711322 Oct 17 13:36:21.040610 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2461/4892] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:20 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1721 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:21.064825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.066053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.093805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.094314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.094767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.095497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.106839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.108969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.407314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:21.419950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbec48c5-645b-4c89-80b6-4e304967d487 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.491636 Oct 17 13:36:21.434787 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2432/4893] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:20 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:21.455418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.456427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.471119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.471913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.472539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.473676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.476669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.480003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.520285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:21.529184 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16277114-5493-4180-b012-6f42b789d73c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.483188 Oct 17 13:36:21.529788 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2462/4894] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:21.560276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:21.560901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:21.580770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.581238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.587609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.588511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:21.589315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:21.589915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:21.928377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:21.984185 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-250f27fc-a960-4938-9ba3-7d3cc5567644 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.432677 Oct 17 13:36:21.991738 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2463/4895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:22.015982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.018229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.062580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.063247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.063585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.078100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.083789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.085529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.165528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:22.184471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:22.191407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:22.214406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fdaf5cc1-68ff-4e65-a8e5-7e43f72dd59b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.776311 Oct 17 13:36:22.222326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2433/4896] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:22.244431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85d0ff6e-e566-4123-8c25-68a21cad3948 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1541753226_updated"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:22.256530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85d0ff6e-e566-4123-8c25-68a21cad3948 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: d563c4b0-f6c5-4531-96dd-22ec00246d83] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.284225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-85d0ff6e-e566-4123-8c25-68a21cad3948 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance d563c4b0-f6c5-4531-96dd-22ec00246d83 could not be found. Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85d0ff6e-e566-4123-8c25-68a21cad3948 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/servers/d563c4b0-f6c5-4531-96dd-22ec00246d83 HTTP/1.1 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 81 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1541753226_updated"}} Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d563c4b0-f6c5-4531-96dd-22ec00246d83 could not be found. Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd563c4b0-f6c5-4531-96dd-22ec00246d83', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1541753226_updated'}}} Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d563c4b0-f6c5-4531-96dd-22ec00246d83 could not be found. Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 17 13:36:22.287302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d563c4b0-f6c5-4531-96dd-22ec00246d83 could not be found. Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d563c4b0-f6c5-4531-96dd-22ec00246d83 could not be found. Oct 17 13:36:22.292675 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:22.296269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85d0ff6e-e566-4123-8c25-68a21cad3948 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance d563c4b0-f6c5-4531-96dd-22ec00246d83 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:22.300619 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85d0ff6e-e566-4123-8c25-68a21cad3948 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "PUT /compute/v2.1/servers/d563c4b0-f6c5-4531-96dd-22ec00246d83" status: 404 len: 111 microversion: 2.1 time: 0.071973 Oct 17 13:36:22.304653 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2434/4897] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:36:22 2022] PUT /compute/v2.1/servers/d563c4b0-f6c5-4531-96dd-22ec00246d83 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:22.328987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.339441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.372164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.373849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.374840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.376064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.380235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.381630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.411051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:22.423194 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-56585b87-1b31-4b87-a867-4b0bea0203ae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1266 microversion: 2.1 time: 0.430296 Oct 17 13:36:22.423777 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2464/4898] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:21 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1266 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:22.440609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4ebc646e-a225-4e71-968a-93f87d63fdf9 req-0a18e5f2-be9f-4b70-b8c4-850111f2d0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba229fd-d2dd-4994-ab49-08fe17338e27", "tag": "5ad206f9-6dae-4fdf-a353-450509a3cb44"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:22.467822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ebc646e-a225-4e71-968a-93f87d63fdf9 req-0a18e5f2-be9f-4b70-b8c4-850111f2d0b7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.471691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ebc646e-a225-4e71-968a-93f87d63fdf9 req-0a18e5f2-be9f-4b70-b8c4-850111f2d0b7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.473687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ebc646e-a225-4e71-968a-93f87d63fdf9 req-0a18e5f2-be9f-4b70-b8c4-850111f2d0b7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.514383 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4ebc646e-a225-4e71-968a-93f87d63fdf9 req-0a18e5f2-be9f-4b70-b8c4-850111f2d0b7 service nova] Creating event network-changed:5ad206f9-6dae-4fdf-a353-450509a3cb44 for instance eba229fd-d2dd-4994-ab49-08fe17338e27 on n-h2-854121-14 Oct 17 13:36:22.532318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4ebc646e-a225-4e71-968a-93f87d63fdf9 req-0a18e5f2-be9f-4b70-b8c4-850111f2d0b7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103796 Oct 17 13:36:22.537084 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2465/4899] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:22.553896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.558051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.573865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.575297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.576159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.577340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.578042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:22.578716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:22.957863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:22.966423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c34fd98-a5b2-43a9-bff5-727309f69ec2 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.427693 Oct 17 13:36:22.967020 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2466/4900] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:22 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:22.982526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:22.983322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:22.998808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:22.999480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.000097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.006090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.006992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.007660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.440703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:23.451145 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2cf6b60-90fe-40fb-a9aa-e4c0a3f9cbd9 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1721 microversion: 2.1 time: 1.141248 Oct 17 13:36:23.466418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2435/4901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:22 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1721 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:23.492158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:23.504130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:23.530423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.531223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.531897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.532887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.533610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.534249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.760171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:23.770110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f867817-362e-4df4-ad39-d2d3e9ca8c2a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.792482 Oct 17 13:36:23.773843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2467/4902] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:22 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:23.786783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:23.796328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:23.816923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.819979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.820676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.822254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.830794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.831548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.926950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:23.938826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9654534-e781-444d-a120-bd4d3cecce17 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.470936 Oct 17 13:36:23.942570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2436/4903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:23 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:23.957686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:23.960051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:23.982715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.983980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.986238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:23.988336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:23.990912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:23.994754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.222376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:24.251405 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-44d2476a-894d-4989-875b-8f2b929950de tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1266 microversion: 2.1 time: 0.299124 Oct 17 13:36:24.252107 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2437/4904] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:23 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:24.276588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2db61cd-ab03-4193-b4c6-e1a4dbc5c365 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2db61cd-ab03-4193-b4c6-e1a4dbc5c365 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: request: PUT /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 HTTP/1.1 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 280 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.287423 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2db61cd-ab03-4193-b4c6-e1a4dbc5c365 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:24.291769 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2db61cd-ab03-4193-b4c6-e1a4dbc5c365 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "PUT /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 400 len: 619 microversion: 2.1 time: 0.030660 Oct 17 13:36:24.300775 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2438/4905] 10.222.0.65 () {60 vars in 1257 bytes} [Mon Oct 17 13:36:24 2022] PUT /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 619 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:36:24.304894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:24.315554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:24.321929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:24.323318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a20d69c3-f644-4a59-98c8-f14211cddf15 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.541785 Oct 17 13:36:24.333203 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2468/4906] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:23 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:24.335690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:24.343192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:24.371295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.371802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.372232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.378718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.381016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.381675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.484960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:24.485613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:24.492448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.514283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.514820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.515607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:24.516081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:24.516511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:24.949018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:24.966179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea1020da-d5ce-4ba9-83f8-89245bd24639 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.662705 Oct 17 13:36:24.984339 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2439/4907] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:24 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:24.996165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:24.996798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:25.026051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.043077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.043928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.044943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.045651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.046320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.276983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:25.286487 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2430de83-be08-421a-957f-6ba20b4a990a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1721 microversion: 2.1 time: 0.806529 Oct 17 13:36:25.294101 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2469/4908] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:24 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1721 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:25.310000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:25.311003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:25.319830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.326977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.327821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.328862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.329585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.330344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.652618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:25.666026 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d0eeea7-46cc-4077-9914-f5e1edfcca8b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.680455 Oct 17 13:36:25.669445 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2440/4909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:24 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:25.674424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:25.678471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:25.712687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.716713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.717293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:25.718110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:25.729596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:25.730250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.284466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:26.293576 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da758102-9c83-42df-811b-4b9cc5cd709d tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.998047 Oct 17 13:36:26.325078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2470/4910] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:25 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:26.333238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.334088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.341657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.342474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.343200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.344069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.344683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.345316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.389947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:26.410105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcea01cf-d596-4107-8be6-8a3390466e7f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1308 microversion: 2.1 time: 0.735232 Oct 17 13:36:26.412119 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2441/4911] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:25 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1308 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:26.428027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f58b6e4e-a185-4318-a730-2b21976ad3ef req-2ac2331c-740c-4844-994a-1d8f3541c2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b570d2-c12b-4e16-9970-d4008147815e", "tag": "9cea7416-4e05-4f89-a878-d4c048416fa5"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:26.471675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f58b6e4e-a185-4318-a730-2b21976ad3ef req-2ac2331c-740c-4844-994a-1d8f3541c2a4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.472178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f58b6e4e-a185-4318-a730-2b21976ad3ef req-2ac2331c-740c-4844-994a-1d8f3541c2a4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.482029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f58b6e4e-a185-4318-a730-2b21976ad3ef req-2ac2331c-740c-4844-994a-1d8f3541c2a4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.561890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f58b6e4e-a185-4318-a730-2b21976ad3ef req-2ac2331c-740c-4844-994a-1d8f3541c2a4 service nova] Creating event network-changed:9cea7416-4e05-4f89-a878-d4c048416fa5 for instance c7b570d2-c12b-4e16-9970-d4008147815e on n-h1-854121-14 Oct 17 13:36:26.585661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f58b6e4e-a185-4318-a730-2b21976ad3ef req-2ac2331c-740c-4844-994a-1d8f3541c2a4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172117 Oct 17 13:36:26.597755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2442/4912] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:26.617050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:26.617959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:26.627150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.627650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.628131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:26.628827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:26.629325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:26.629759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.409113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.422315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.425029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.427320 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5ac2be3-08b7-4a9c-bf6c-b6d7b101bb47 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 1.100885 Oct 17 13:36:27.428556 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2471/4913] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:27.431730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.435983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23931d7c-9753-436f-b958-1c5445a31e1c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23931d7c-9753-436f-b958-1c5445a31e1c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: request: PUT /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 HTTP/1.1 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 24 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: {"server": {"name": ""}} Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8', 'body': {'server': {'name': ''}}} Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi '' Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:36:27.440675 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 17 13:36:27.446844 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:27.447704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4d2b8fa-d872-4f06-9aef-b88026adde1e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1727 microversion: 2.1 time: 0.844682 Oct 17 13:36:27.447704 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2443/4914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:26 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1727 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:27.449817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23931d7c-9753-436f-b958-1c5445a31e1c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:27.450938 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23931d7c-9753-436f-b958-1c5445a31e1c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "PUT /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 400 len: 108 microversion: 2.1 time: 0.020912 Oct 17 13:36:27.451764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2472/4915] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:36:27 2022] PUT /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:36:27.457684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.458534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.459253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.460595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.471085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.471594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.472133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.473307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.473420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.474029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.474746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.475414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.476620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.477399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.478052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.480465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.695573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:27.855892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.864014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:27.870886 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f008b3eb-8905-421c-b949-762b37b35c50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.424956 Oct 17 13:36:27.872832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c626f413-66b8-40c2-9c5b-5374b0c0bf41 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1308 microversion: 2.1 time: 0.418857 Oct 17 13:36:27.873800 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2444/4916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:27.879606 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2473/4917] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:27.890010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.890523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.890808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:27.892498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:27.903728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.904386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.904991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.906320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.909783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.910390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.918641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.919146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.919593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:27.920314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:27.927434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:27.927966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.160708 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8e04eaa-ed1e-4631-870f-303ec483a568 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279906 Oct 17 13:36:28.166275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2474/4918] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-interface => generated 285 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:28.459866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:28.460502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:28.461687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.470972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.472360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.473047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.474026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.474437 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b3b20f8-887e-44e3-a3f4-af9828aff740 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1505 microversion: 2.1 time: 0.597549 Oct 17 13:36:28.474943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.475582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.506231 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2445/4919] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:27 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:28.897800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.908769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.911264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:28.912799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0cd63905-56b9-467f-b8d9-aa216a7160d0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.457080 Oct 17 13:36:28.936111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:28.936944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:28.944494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2475/4920] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:28 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:28.952463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.952975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.953451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.954178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.956631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:28.958056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.958610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.960076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:28.972859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.973399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.973843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:28.979568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:28.982719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:28.983388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.235887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=14 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:29.696235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:29.724521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19219c29-4d6c-4c9b-a1ce-6e018544402b tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1308 microversion: 2.1 time: 0.808241 Oct 17 13:36:29.735914 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2446/4921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:28 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1308 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:29.888429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:29.908104 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb2ebe0d-8ec1-4be2-8cdc-8605d3a93592 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.962396 Oct 17 13:36:29.929251 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2476/4922] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:28 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:29.940621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:29.941478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:29.951725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.953705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.954272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:29.956164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:29.956759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:29.962157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:30.277099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:30.294816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:30.327727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:30.327727 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10c73d9b-1cc6-4612-8bc0-d9c6e1be88a5 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.382590 Oct 17 13:36:30.328442 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2447/4923] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:29 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:30.780781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:30.782091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:30.804382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:30.806471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:30.811109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:30.812337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:30.815506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:30.816194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:30.980456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:30.981398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:31.000932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.002540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.003032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.009125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.010944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.032299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.730370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:31.749103 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f5a76c9-e988-4cb8-bac1-e84aa10ac001 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1308 microversion: 2.1 time: 0.964702 Oct 17 13:36:31.766431 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2477/4924] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:30 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1308 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:31.782005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:31.783859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:31.792842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.793482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.794773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:31.796682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:31.797951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:31.802351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.010122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:32.021453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c7722355-0784-4dd2-8709-babd52cd1631 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 1.046250 Oct 17 13:36:32.041728 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2448/4925] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:30 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:32.320020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:32.332832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:32.338802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:32.350937 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b2383c9-dacb-4428-8ea8-bd9b45d40c74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.583195 Oct 17 13:36:32.354148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2478/4926] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:31 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:32.741572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b0ada031-bdea-488f-b327-786ef3b1bbda req-e0ef80ba-685c-487e-91ef-96a6481d6709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0000a0ee-91cb-40ec-9d8f-ee7101525586", "tag": "a084652e-4641-4d8e-a921-aa1c0536e920"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:32.765367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b0ada031-bdea-488f-b327-786ef3b1bbda req-e0ef80ba-685c-487e-91ef-96a6481d6709 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.767852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b0ada031-bdea-488f-b327-786ef3b1bbda req-e0ef80ba-685c-487e-91ef-96a6481d6709 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.768417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b0ada031-bdea-488f-b327-786ef3b1bbda req-e0ef80ba-685c-487e-91ef-96a6481d6709 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.782235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:32.783736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:32.802666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.803831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.806435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.808388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.809037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.810663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.823825 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b0ada031-bdea-488f-b327-786ef3b1bbda req-e0ef80ba-685c-487e-91ef-96a6481d6709 service nova] Creating event network-changed:a084652e-4641-4d8e-a921-aa1c0536e920 for instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 on n-h1-854121-14 Oct 17 13:36:32.832394 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b0ada031-bdea-488f-b327-786ef3b1bbda req-e0ef80ba-685c-487e-91ef-96a6481d6709 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095466 Oct 17 13:36:32.839619 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2449/4927] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:32.884135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1d407541-931f-48c8-8ac2-2a06cfee2aed req-0ff4dc57-6670-424c-b36c-021b65f03969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b570d2-c12b-4e16-9970-d4008147815e", "name": "network-vif-plugged", "status": "completed", "tag": "9cea7416-4e05-4f89-a878-d4c048416fa5"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:32.897627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1d407541-931f-48c8-8ac2-2a06cfee2aed req-0ff4dc57-6670-424c-b36c-021b65f03969 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:32.898107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1d407541-931f-48c8-8ac2-2a06cfee2aed req-0ff4dc57-6670-424c-b36c-021b65f03969 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:32.898810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1d407541-931f-48c8-8ac2-2a06cfee2aed req-0ff4dc57-6670-424c-b36c-021b65f03969 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:32.915202 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1d407541-931f-48c8-8ac2-2a06cfee2aed req-0ff4dc57-6670-424c-b36c-021b65f03969 service nova] Creating event network-vif-plugged:9cea7416-4e05-4f89-a878-d4c048416fa5 for instance c7b570d2-c12b-4e16-9970-d4008147815e on n-h1-854121-14 Oct 17 13:36:32.935457 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1d407541-931f-48c8-8ac2-2a06cfee2aed req-0ff4dc57-6670-424c-b36c-021b65f03969 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057065 Oct 17 13:36:32.944276 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2450/4928] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:33.061290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:33.062760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:33.089361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.090089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.090781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.091838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.096709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.097297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.364274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.368967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:33.379386 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a59a8682-935c-4562-8178-ebfa7f5b9499 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1308 microversion: 2.1 time: 0.601077 Oct 17 13:36:33.380265 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2479/4929] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:32 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1308 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:33.387007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:33.393453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:33.406082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.407068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.408549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.409449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:33.410042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:33.410627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:33.674801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.692223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.698646 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-006dc7f3-3c75-4f0c-89ac-1d60cca44fd1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.644780 Oct 17 13:36:33.704052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.705796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:33.706657 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2451/4930] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:33 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:33.708050 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fee19aa4-c4ea-43a5-9d77-431c1890b4a3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1740 microversion: 2.20 time: 0.326835 Oct 17 13:36:33.713625 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2480/4931] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:33 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:34.408199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:34.409086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:34.444487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.446377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.448776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.452028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.452718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.453841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.524091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:34.729047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:34.731461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:34.750535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.751221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.751696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:34.756733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:34.757324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:34.764285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.119881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.136339 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3eb53d67-ed90-4563-b355-0324c6447fd9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1489 microversion: 2.1 time: 0.732990 Oct 17 13:36:35.137546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2452/4932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:34 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1489 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:35.158411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:35.159338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.166949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.177987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.178911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.180531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.181299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.183133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.249932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.264862 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57df9f16-b7ed-4db6-af68-6cae73f4cae7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.534849 Oct 17 13:36:35.266049 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2481/4933] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:34 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:35.274172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-604acb14-5bb9-4067-8cbf-66fc1513c6e1 req-66a89846-3bdd-444d-93c3-d186b634930a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0000a0ee-91cb-40ec-9d8f-ee7101525586", "tag": "a084652e-4641-4d8e-a921-aa1c0536e920"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:35.299598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-604acb14-5bb9-4067-8cbf-66fc1513c6e1 req-66a89846-3bdd-444d-93c3-d186b634930a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.300494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-604acb14-5bb9-4067-8cbf-66fc1513c6e1 req-66a89846-3bdd-444d-93c3-d186b634930a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.301584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-604acb14-5bb9-4067-8cbf-66fc1513c6e1 req-66a89846-3bdd-444d-93c3-d186b634930a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.329649 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-604acb14-5bb9-4067-8cbf-66fc1513c6e1 req-66a89846-3bdd-444d-93c3-d186b634930a service nova] Creating event network-changed:a084652e-4641-4d8e-a921-aa1c0536e920 for instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 on n-h1-854121-14 Oct 17 13:36:35.335874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-604acb14-5bb9-4067-8cbf-66fc1513c6e1 req-66a89846-3bdd-444d-93c3-d186b634930a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066349 Oct 17 13:36:35.338036 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2482/4934] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:35.347615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:35.350756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.359500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.360244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.360867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.361803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.362619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.363240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.456084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.468430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.471074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.472766 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8fdcfcc-6faa-4b64-949a-9a2aca5ebacd tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1722 microversion: 2.20 time: 0.328601 Oct 17 13:36:35.472965 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b10ab00e-db78-47e3-a375-da60e870cc33 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "PUT /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1084 microversion: 2.1 time: 0.130846 Oct 17 13:36:35.473671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2483/4935] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:36:35 2022] PUT /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1084 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:35.474349 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2453/4936] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:35 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:35.501628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:35.502341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.514966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.515703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.516508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.517845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.518488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.519253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.822629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:35.833138 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a999800-6489-45d8-9c73-84f290597fde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1510 microversion: 2.1 time: 0.337614 Oct 17 13:36:35.836290 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2454/4937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:35 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:35.863819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:35.865179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:35.879429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.881226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.882060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:35.883001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:35.884293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:35.884882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.147299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.148190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.156388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.157314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.157991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.159030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.159774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.160460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.168804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:36.178825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47989662-f57f-43e1-ae38-088b317458a9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1510 microversion: 2.1 time: 0.319067 Oct 17 13:36:36.179412 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2484/4938] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:35 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:36.203659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.204776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.213973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.215655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.216527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.217515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.218889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:36.220388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.221062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.256105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:36.390832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-799be839-8585-4fb8-b6a2-d9f4b6faafa7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 204 len: 0 microversion: 2.1 time: 0.190843 Oct 17 13:36:36.391571 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2485/4939] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:36 2022] DELETE /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:36:36.412429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.413554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.431672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.433814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.434491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.436137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.438374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.439185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.481061 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3f153eb-b0aa-48f6-ae33-1a3b5d6440ef tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 204 len: 0 microversion: 2.1 time: 0.337604 Oct 17 13:36:36.482679 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2455/4940] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:36 2022] DELETE /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:36:36.494724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.495766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.517665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.518178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.518629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.519354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.519827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.520266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.818986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:36.823230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:36.833406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fbf394ab-c4e0-488f-9bff-456193b0c380 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1516 microversion: 2.1 time: 0.348761 Oct 17 13:36:36.834479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8da8930e-755c-48c7-92ff-fababe885da8 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.436953 Oct 17 13:36:36.834936 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2456/4941] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:36 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1516 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:36.837670 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2486/4942] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:36 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:36.841798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.842716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.842963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:36.843602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:36.850704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.851621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.852752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.854132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.854329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.854736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.855135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.855251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.855892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:36.856122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:36.856586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:36.857049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.155632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.168858 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-183c14dd-6018-44bc-8a3d-a7130d534890 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1553 microversion: 2.1 time: 0.332342 Oct 17 13:36:37.186492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2457/4943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:36 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1553 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:37.198318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-117bfa89-97b2-4043-998e-6fecab28099a req-3b047fac-c19c-4475-b09e-c7e5f813b72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba229fd-d2dd-4994-ab49-08fe17338e27", "name": "network-vif-plugged", "status": "completed", "tag": "5ad206f9-6dae-4fdf-a353-450509a3cb44"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:37.212284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-117bfa89-97b2-4043-998e-6fecab28099a req-3b047fac-c19c-4475-b09e-c7e5f813b72a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.212772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-117bfa89-97b2-4043-998e-6fecab28099a req-3b047fac-c19c-4475-b09e-c7e5f813b72a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.213229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-117bfa89-97b2-4043-998e-6fecab28099a req-3b047fac-c19c-4475-b09e-c7e5f813b72a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.226037 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-117bfa89-97b2-4043-998e-6fecab28099a req-3b047fac-c19c-4475-b09e-c7e5f813b72a service nova] Creating event network-vif-plugged:5ad206f9-6dae-4fdf-a353-450509a3cb44 for instance eba229fd-d2dd-4994-ab49-08fe17338e27 on n-h2-854121-14 Oct 17 13:36:37.231804 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-117bfa89-97b2-4043-998e-6fecab28099a req-3b047fac-c19c-4475-b09e-c7e5f813b72a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042926 Oct 17 13:36:37.236167 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2458/4944] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:37.253499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.265296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.266880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:37.268297 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6cbf533-d580-48f1-8900-d4b03c6c07c6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1722 microversion: 2.20 time: 0.429393 Oct 17 13:36:37.269284 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2487/4945] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:36 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:37.873311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.874875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.885691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:37.886556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:37.896200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.898419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.899450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.900282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.900973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.901655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.903185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.903545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:37.904179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.904824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:37.905490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:37.906109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.233784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.243925 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86ec4b8c-1443-4166-9fc3-1c27dac64bae tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1516 microversion: 2.1 time: 0.362569 Oct 17 13:36:38.247965 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2488/4946] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:37 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1516 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:38.260852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.265905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.275285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.276150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.276777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.277693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.279451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.280224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.303194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.338885 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc3c6fb6-281b-4f71-b0fb-cb6357fdb2cb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.467984 Oct 17 13:36:38.340190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2459/4947] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:37 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:38.345526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.346841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.354924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.357137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.357893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.358849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.359537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.360223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.364321 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e HTTP/1.1 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'ac32659d-2fef-4b01-a1f2-62a4478f719e'} Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:38.371795 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.376465 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.378076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:38.380525 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a62c2ab3-ecc7-47da-9caa-2e181aef788b tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 404 len: 111 microversion: 2.1 time: 0.127244 Oct 17 13:36:38.385594 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2489/4948] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:38 2022] DELETE /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:38.405877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.406775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.419514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.420264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.420923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.421966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.422604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.423185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.685992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.700277 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6f6f908e-f3d2-4bab-9d65-75cd2626cc60 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1553 microversion: 2.1 time: 0.354402 Oct 17 13:36:38.701279 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2460/4949] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:38 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1553 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:38.712323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.724095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.725121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: ac32659d-2fef-4b01-a1f2-62a4478f719e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.736253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.743908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:38.749514 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-126c3fde-8681-4936-934e-d0520cbc1c70 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1722 microversion: 2.20 time: 0.358159 Oct 17 13:36:38.750930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.751841 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2490/4950] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:38 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:38.753839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.754460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.755342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.757026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.757686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.780608 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e HTTP/1.1 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ac32659d-2fef-4b01-a1f2-62a4478f719e'} Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:38.783903 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance ac32659d-2fef-4b01-a1f2-62a4478f719e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:38.792016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e74e0ef-589b-4f87-817e-b5c612e874d6 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e" status: 404 len: 111 microversion: 2.1 time: 0.081622 Oct 17 13:36:38.795318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:38.795990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:38.800958 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2461/4951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:38 2022] GET /compute/v2.1/servers/ac32659d-2fef-4b01-a1f2-62a4478f719e => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:38.803611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.804107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.804719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.806466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:38.807256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:38.807907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:38.868958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:36:39.059985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:39.080409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed22d10f-a394-4956-a8bf-32012912a473 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "DELETE /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 204 len: 0 microversion: 2.1 time: 0.289123 Oct 17 13:36:39.085813 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2491/4952] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:36:38 2022] DELETE /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:36:39.091859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-690beee6-6ceb-4aad-85bb-b2a14840b12f req-d5f60233-0a1a-4278-bcee-723a0101328c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b570d2-c12b-4e16-9970-d4008147815e", "name": "network-vif-deleted", "tag": "9cea7416-4e05-4f89-a878-d4c048416fa5"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:39.125818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.131416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.144766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-690beee6-6ceb-4aad-85bb-b2a14840b12f req-d5f60233-0a1a-4278-bcee-723a0101328c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.149673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-690beee6-6ceb-4aad-85bb-b2a14840b12f req-d5f60233-0a1a-4278-bcee-723a0101328c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.151231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-690beee6-6ceb-4aad-85bb-b2a14840b12f req-d5f60233-0a1a-4278-bcee-723a0101328c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.154988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.161106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.161772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.165421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.168015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.168561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.181039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-690beee6-6ceb-4aad-85bb-b2a14840b12f req-d5f60233-0a1a-4278-bcee-723a0101328c service nova] Creating event network-vif-deleted:9cea7416-4e05-4f89-a878-d4c048416fa5 for instance c7b570d2-c12b-4e16-9970-d4008147815e on n-h1-854121-14 Oct 17 13:36:39.186751 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-690beee6-6ceb-4aad-85bb-b2a14840b12f req-d5f60233-0a1a-4278-bcee-723a0101328c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099590 Oct 17 13:36:39.189914 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2462/4953] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:39.271986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.272975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.285298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.287917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.290581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.291625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.295867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.296664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.392633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.393501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.394111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.394773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lazy-loading 'fault' on Instance uuid c7b570d2-c12b-4e16-9970-d4008147815e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:39.538732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.557048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d8d5cec-fdf7-4e11-8d15-7efe009a51ce tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 200 len: 1319 microversion: 2.1 time: 0.286788 Oct 17 13:36:39.565985 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2463/4954] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:39.572915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.574247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.582714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.584135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.585135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.588001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.588863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.589803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.854587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.871197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5fe72667-7c95-495d-a199-0f530c8e6a26 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.774596 Oct 17 13:36:39.871800 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2492/4955] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:39.876837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e196bc04-5065-4cc5-bb35-f2fca4dfe499 req-d0ec48c8-b744-4c86-85ea-0873b02cb212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "name": "network-vif-unplugged", "status": "completed", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:39.912788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e196bc04-5065-4cc5-bb35-f2fca4dfe499 req-d0ec48c8-b744-4c86-85ea-0873b02cb212 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.913525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e196bc04-5065-4cc5-bb35-f2fca4dfe499 req-d0ec48c8-b744-4c86-85ea-0873b02cb212 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.914097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e196bc04-5065-4cc5-bb35-f2fca4dfe499 req-d0ec48c8-b744-4c86-85ea-0873b02cb212 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.916596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:39.928903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3845b4a-6046-4e07-b69e-2e83c80b04d1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.359575 Oct 17 13:36:39.929539 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2464/4956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:39.951834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:39.952601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:39.966395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.966947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.969347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.970214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:39.970703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:39.971160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:39.974595 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e196bc04-5065-4cc5-bb35-f2fca4dfe499 req-d0ec48c8-b744-4c86-85ea-0873b02cb212 service nova] Creating event network-vif-unplugged:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:36:39.986942 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e196bc04-5065-4cc5-bb35-f2fca4dfe499 req-d0ec48c8-b744-4c86-85ea-0873b02cb212 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113672 Oct 17 13:36:39.989393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2493/4957] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:40.028161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:40.030648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:40.041841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.042776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.043532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.044734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.045495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.046419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.087402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:40.526105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:40.537756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:40.542160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:40.544046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:40.549373 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea85ae17-1e91-4065-94a7-edffb7c1dfe5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1553 microversion: 2.1 time: 0.602116 Oct 17 13:36:40.551048 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-081ff0c8-8cc0-401f-8f6c-48e351388bd3 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1722 microversion: 2.20 time: 0.560392 Oct 17 13:36:40.551696 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2465/4958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1553 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:40.552476 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2494/4959] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:39 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1722 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:40.591140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:40.592068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:40.599695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.600463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.601117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.602082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.602864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.603497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.625291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e HTTP/1.1 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c7b570d2-c12b-4e16-9970-d4008147815e'} Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:40.627303 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:40.631854 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ea8aac6-ef26-4cbd-9138-9e0c8f068f31 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 404 len: 111 microversion: 2.1 time: 0.042404 Oct 17 13:36:40.653182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2466/4960] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:40 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:40.779127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1685105059", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "c02f38a5-2dc5-4349-9043-58857a569731"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:40.851291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] validate_networks() for [('c02f38a5-2dc5-4349-9043-58857a569731', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:40.898294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:40.899420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:40.910774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.911464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.912007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:40.913197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:40.913874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:40.914522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:41.585969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:41.596148 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aaee6c48-8b22-4374-b385-0aeb6aab9d9c tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.702585 Oct 17 13:36:41.596737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2467/4961] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:40 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:41.604726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:41.605356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:41.621606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:41.623265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:41.623962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:41.624706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:41.625366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:41.625968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.090454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.101721 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de58508d-4824-4779-9659-b233f9ea2a49 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.503550 Oct 17 13:36:42.113426 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2468/4962] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:41 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:42.126721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.127708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.147171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:42.151491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.152278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.154425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.155524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.159096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.159633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.193610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:42.296871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:42.298114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:42.298879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:42.299708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:42.300332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:42.318502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.319026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.319594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.320453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.321238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.321800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.357205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:42.363868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Getting quotas for user 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 and project 11d2886e38a242ab9408cb7307f058cb. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:42.389569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:42.392438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:42.451578 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52147ef0-fbc5-4f0c-95de-7f87f00cb397 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676636 Oct 17 13:36:42.452861 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2495/4963] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:42.462864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.464793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.466636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.474836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.475621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.477660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.479200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.479993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.480686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.490141 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84c925ec-d8d8-4f69-993f-da4bca80a310 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1553 microversion: 2.1 time: 0.386512 Oct 17 13:36:42.495068 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2469/4964] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1553 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:42.513110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2997f71-aafd-4766-997d-66482e8911c9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.514592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a2997f71-aafd-4766-997d-66482e8911c9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.628273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a2997f71-aafd-4766-997d-66482e8911c9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.641853 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2997f71-aafd-4766-997d-66482e8911c9 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1209 microversion: 2.1 time: 0.142507 Oct 17 13:36:42.643035 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2470/4965] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:42.650837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:42.652047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.659526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.660217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.661392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.662550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.662944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.663381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.837965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.847879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.853616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:42.854851 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6cd2525-478f-4eed-918c-4fe77be7c98e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1725 microversion: 2.20 time: 0.399668 Oct 17 13:36:42.855415 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2496/4966] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1725 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:42.895456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6241180a-488b-4fa7-bc6a-9fa99ab47fc5"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:42.898231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:42.915504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.916461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.917126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:42.918204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:42.921434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:42.922204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.034012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:43.044120 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a63ddaa5-0589-4a1f-842a-a32bb911e94f tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.399824 Oct 17 13:36:43.048156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2471/4967] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:42 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:43.138846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.139856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.151595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.152381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.153022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.155763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.157483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.158191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.411810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:43.424100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd39eea8-82c1-4d3d-9f53-b25f76c65533 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.290760 Oct 17 13:36:43.425262 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2472/4968] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:43 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:43.521081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.522209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.533929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.537360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.538042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.539064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.540785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.542545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.556208 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9541110a-9005-426a-8378-f56505521d53 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.664994 Oct 17 13:36:43.557409 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2497/4969] 10.222.0.65 () {62 vars in 1364 bytes} [Mon Oct 17 13:36:42 2022] POST /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-volume_attachments => generated 188 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 13:36:43.664899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:43.665579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:43.677838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.678589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.685431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.686542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:43.687198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:43.687793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:43.990491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:44.006293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d801df63-c042-4ad5-8e1e-6e8040c8ef6a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1261 microversion: 2.1 time: 0.343806 Oct 17 13:36:44.010136 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2498/4970] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:43 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1261 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:44.022870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:44.025578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:44.043252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.043804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.046230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.047017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.051430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.052067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.128345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:44.142553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ef03d92-870e-4136-870f-bc8a89e69610 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1553 microversion: 2.1 time: 0.625746 Oct 17 13:36:44.143457 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2473/4971] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:43 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1553 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:44.148432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:44.149715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:44.157439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.158325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.158972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.159907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.160581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.161016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.441702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:44.459684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9c9bdf4-94a2-4467-b0f9-3907ac55f0bc tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1511 microversion: 2.1 time: 0.313412 Oct 17 13:36:44.462569 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2474/4972] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:44 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1511 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:44.475493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:44.479108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:44.500006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.502396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.503626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.509809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.511844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.518467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.659223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f9bd13a-50a9-48de-a6e4-09beb692e9b9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-volume_attachments/6241180a-488b-4fa7-bc6a-9fa99ab47fc5" status: 202 len: 0 microversion: 2.20 time: 0.647901 Oct 17 13:36:44.660923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2499/4973] 10.222.0.65 () {60 vars in 1457 bytes} [Mon Oct 17 13:36:44 2022] DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-volume_attachments/6241180a-488b-4fa7-bc6a-9fa99ab47fc5 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:36:44.762065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:44.762733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:44.773353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.774437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.774901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.775630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:44.776090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:44.776523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:44.873065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 13:36:45.001633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1616ee10-be1c-47c7-8820-6dcd1b59d630 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "POST /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/action" status: 202 len: 0 microversion: 2.20 time: 0.244051 Oct 17 13:36:45.002963 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2500/4974] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:36:44 2022] POST /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:36:45.019529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.021595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.043835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.045883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.046328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.050245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.051658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.052114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.147530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.162724 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2667241a-091e-4bab-8dbd-52b443028038 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1316 microversion: 2.1 time: 0.698345 Oct 17 13:36:45.165421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2475/4975] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:44 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1316 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:45.186547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.187197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.208537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.209047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.209528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.212270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.212710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.216348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.481719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.500671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52c243f3-5596-4b93-a32a-26b2cdbc8ec5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1267 microversion: 2.1 time: 0.334575 Oct 17 13:36:45.509543 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2476/4976] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1267 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:45.530905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.531410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.547091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.553972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.554774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.556387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.557240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.557859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.756066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.770480 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5e36891-0925-4ac6-8cd5-0dd00baf4be3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1345 microversion: 2.1 time: 0.259316 Oct 17 13:36:45.779786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2477/4977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1345 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:45.802389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6de969f6-0bc8-4ac3-8b90-dbaf88d8d9cc req-2b1de5e6-1c01-4f30-a94d-a4bf4039a0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5e1c49-2fc3-445d-9adc-9dc1437a2128", "name": "network-vif-deleted", "tag": "4e54f807-32c1-454a-99fa-f92857911b0e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:45.859798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6de969f6-0bc8-4ac3-8b90-dbaf88d8d9cc req-2b1de5e6-1c01-4f30-a94d-a4bf4039a0a0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.860355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6de969f6-0bc8-4ac3-8b90-dbaf88d8d9cc req-2b1de5e6-1c01-4f30-a94d-a4bf4039a0a0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.860743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6de969f6-0bc8-4ac3-8b90-dbaf88d8d9cc req-2b1de5e6-1c01-4f30-a94d-a4bf4039a0a0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.881338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.898274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.905924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:45.907202 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dcd0a844-7fd4-4e65-9b18-c5d30e598837 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1673 microversion: 2.20 time: 0.900355 Oct 17 13:36:45.924157 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2501/4978] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1673 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:45.924403 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6de969f6-0bc8-4ac3-8b90-dbaf88d8d9cc req-2b1de5e6-1c01-4f30-a94d-a4bf4039a0a0 service nova] Creating event network-vif-deleted:4e54f807-32c1-454a-99fa-f92857911b0e for instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 on n-h2-854121-14 Oct 17 13:36:45.924521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:45.924521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:45.924895 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6de969f6-0bc8-4ac3-8b90-dbaf88d8d9cc req-2b1de5e6-1c01-4f30-a94d-a4bf4039a0a0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142836 Oct 17 13:36:45.926549 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2478/4979] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:45.953695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.954208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.954661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:45.955404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:45.965615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:45.966315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.127023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:46.132044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e7690597-6bb3-4464-b57c-acaebf5b4d29 req-f0b24a15-0942-483c-8fc3-530de4fa59b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c999d9-c3d1-435f-96f0-5505353369b8", "name": "network-vif-deleted", "tag": "d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:46.138223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fba595e-4d42-4085-8061-0429d053ee89 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1301 microversion: 2.1 time: 0.225687 Oct 17 13:36:46.169336 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2502/4980] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:45 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1301 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:46.171661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e7690597-6bb3-4464-b57c-acaebf5b4d29 req-f0b24a15-0942-483c-8fc3-530de4fa59b9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.172168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e7690597-6bb3-4464-b57c-acaebf5b4d29 req-f0b24a15-0942-483c-8fc3-530de4fa59b9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.174708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e7690597-6bb3-4464-b57c-acaebf5b4d29 req-f0b24a15-0942-483c-8fc3-530de4fa59b9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.188144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.188941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.193544 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e7690597-6bb3-4464-b57c-acaebf5b4d29 req-f0b24a15-0942-483c-8fc3-530de4fa59b9 service nova] Creating event network-vif-deleted:d8d05a02-a4e5-4c10-9b9d-c4b6f697e5a7 for instance 54c999d9-c3d1-435f-96f0-5505353369b8 on n-h2-854121-14 Oct 17 13:36:46.198800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.201725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e7690597-6bb3-4464-b57c-acaebf5b4d29 req-f0b24a15-0942-483c-8fc3-530de4fa59b9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273203 Oct 17 13:36:46.201875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.202549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.202952 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2479/4981] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:46.203474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.204877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.205352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.536033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.540112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.566835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.567337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.567788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.568508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.568983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.569450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.627290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:46.642938 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-195d85d5-ec03-4902-8c02-43519f9a584e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1466 microversion: 2.1 time: 0.459570 Oct 17 13:36:46.648122 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2503/4982] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1466 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:46.672354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.672981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.684697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.685232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.685681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.686393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.686847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.687278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.721282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:46.730262 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89e02b88-a204-4c42-96fe-5c3341d52f67 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1267 microversion: 2.1 time: 0.208514 Oct 17 13:36:46.730855 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2480/4983] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1267 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:46.803755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:46.804579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:46.819441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.826915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.827387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:46.831537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:46.832326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:46.837830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.079298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:47.091110 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-090f5c67-4c01-4f41-a218-f26a1113e21f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1345 microversion: 2.1 time: 0.291969 Oct 17 13:36:47.091709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2481/4984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1345 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:47.119716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:47.120354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:47.149632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.150156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.150609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.151371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.166250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.169085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.339768 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb43be8b-182b-4080-b059-a5f2b986c63b tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1619 microversion: 2.1 time: 0.671031 Oct 17 13:36:47.371648 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2504/4985] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:46 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1619 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:47.385452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:47.386217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:47.416094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.419118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.422135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.428073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.429046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.430416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.574036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:47.574636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:47.575151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:47.577151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lazy-loading 'fault' on Instance uuid 54c999d9-c3d1-435f-96f0-5505353369b8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:47.579448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:47.839407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275516fa54254d86940a372e51ef39f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b4b7fe8f2da4c379be512ea0d916676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:47.848602 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b19a53b-d362-4412-8f0f-d9a83a739f48 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 200 len: 1306 microversion: 2.1 time: 0.475747 Oct 17 13:36:47.866575 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2505/4986] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:47 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 1306 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:47.879355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1270407679", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "509d327d-d2cb-4993-9f10-b5550138a4d7"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:47.972306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:48.029106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.051416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.057835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.060922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-335831d9-f130-4080-aeb5-8ee1013c97ed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1673 microversion: 2.20 time: 0.968226 Oct 17 13:36:48.062153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2482/4987] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:47 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1673 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:48.083311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.085368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:48.106358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.107354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.109801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.110676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.114720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.119753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.531243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:48.533143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:48.533874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:48.534834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:48.536318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:48.555442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.556671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.557398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.558536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.559257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.560484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.590684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:48.600724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Getting quotas for user 8cbdae957ed942b6af3ad2a2efce7ca2 and project ca30f56f7d2d4734a24b383da7ea958c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:48.612443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:48.627253 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce117a63-c3bc-434e-83fc-316ee2f2d94f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1309 microversion: 2.1 time: 0.559857 Oct 17 13:36:48.628159 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2483/4988] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:48 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1309 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:48.639382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.643235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:48.650564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:36:48.653922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:36:48.657394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.657897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.658338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.659044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:48.659493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:48.659927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:48.810226 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b92d3ec-72b6-4be4-8f8d-7006674a304f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939793 Oct 17 13:36:48.820907 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2506/4989] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:36:48.830823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8016adc7-00aa-4ea9-bf18-92500965ee37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:48.831930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8016adc7-00aa-4ea9-bf18-92500965ee37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.297624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:49.343343 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f280e39-71da-4ef6-82cb-e9a5b6b934d8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1345 microversion: 2.1 time: 0.712276 Oct 17 13:36:49.345464 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2484/4990] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:48 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1345 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:49.558610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8016adc7-00aa-4ea9-bf18-92500965ee37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:49.577670 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8016adc7-00aa-4ea9-bf18-92500965ee37 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1217 microversion: 2.1 time: 0.753819 Oct 17 13:36:49.589763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2507/4991] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:48 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1217 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:49.593626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-57f8ebb4-fb2a-49d9-bf31-23d6a27dcc14 req-d545ef08-cd8f-43cf-aa95-9488c697a3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9c33d1-9687-49cb-8972-3832284ef9c7", "tag": "95bfffa4-6041-448b-aeeb-a8663cc984e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:49.625208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-57f8ebb4-fb2a-49d9-bf31-23d6a27dcc14 req-d545ef08-cd8f-43cf-aa95-9488c697a3a6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.629662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-57f8ebb4-fb2a-49d9-bf31-23d6a27dcc14 req-d545ef08-cd8f-43cf-aa95-9488c697a3a6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.631626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-57f8ebb4-fb2a-49d9-bf31-23d6a27dcc14 req-d545ef08-cd8f-43cf-aa95-9488c697a3a6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.660758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-57f8ebb4-fb2a-49d9-bf31-23d6a27dcc14 req-d545ef08-cd8f-43cf-aa95-9488c697a3a6 service nova] Creating event network-changed:95bfffa4-6041-448b-aeeb-a8663cc984e0 for instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 on n-h1-854121-14 Oct 17 13:36:49.675188 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-57f8ebb4-fb2a-49d9-bf31-23d6a27dcc14 req-d545ef08-cd8f-43cf-aa95-9488c697a3a6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091427 Oct 17 13:36:49.675855 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2508/4992] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:49.679172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.680356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] [instance: 54c999d9-c3d1-435f-96f0-5505353369b8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.692540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.693958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.694077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.695184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.696296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.697039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.697508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.700718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.706261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.706865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.707416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.708305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.708886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.710303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.729223 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] HTTP exception thrown: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 could not be found. Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Request method failure captured: Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 HTTP/1.1 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVlEQLgeBgmDQsJZmeNV2_cVgorqhtTajzgJB0fl2CFCsd-6BpdzKpTa4pQu3jzUs-fd_gwbNi4M07kAOcZV5ZXKC67_Selz6yFJpo_DkGEny5v7n0n-xPB6ldZw9CpPMfDW3kmM5Z8Bw5sGKVlh5YNnJw_c6LDUFoddRKPBGqoUehg Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0b4b7fe8f2da4c379be512ea0d916676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0b4b7fe8f2da4c379be512ea0d916676 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1355814013 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 275516fa54254d86940a372e51ef39f4 Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-1355814013-project Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 could not be found. Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '54c999d9-c3d1-435f-96f0-5505353369b8'} Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 could not be found. Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 could not be found. Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:49.739573 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 could not be found. Oct 17 13:36:49.745233 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:49.746725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] Returning 404 to user: Instance 54c999d9-c3d1-435f-96f0-5505353369b8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:49.750202 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc20b46a-2ded-4bad-9e3a-ab30acde7f50 tempest-ServersNegativeTestJSON-1355814013 tempest-ServersNegativeTestJSON-1355814013-project] 10.222.0.65 "GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8" status: 404 len: 111 microversion: 2.1 time: 0.402355 Oct 17 13:36:49.751613 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2485/4993] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:49 2022] GET /compute/v2.1/servers/54c999d9-c3d1-435f-96f0-5505353369b8 => generated 111 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:49.766449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:49.767271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:49.777617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.778505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.779225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:49.780248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:49.780869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:49.781537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.241666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.263782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.266323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.268105 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9c325b7-9769-46d0-a745-c9b19b48ac55 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.588997 Oct 17 13:36:50.269520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2509/4994] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:49 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:50.370710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:50.371743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:50.378804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.379670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.380333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.381323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.382001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.382646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.400993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.419148 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70fb4b39-80a3-446b-af81-2384fd306548 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1309 microversion: 2.1 time: 0.666282 Oct 17 13:36:50.419738 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2486/4995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:49 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1309 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:50.543655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.562114 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-726b4c53-56e8-4049-95a3-49cc720057af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1345 microversion: 2.1 time: 0.196156 Oct 17 13:36:50.563929 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2510/4996] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:50 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:36:50.603233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:50.604154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:50.625600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.626717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.629720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.631981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:50.633455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:50.634095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:50.777041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:50.790448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af7e751a-dc50-42cf-a6f6-0ce04bbea40f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1213 microversion: 2.1 time: 0.190972 Oct 17 13:36:50.794417 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2487/4997] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:50 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1213 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:51.295882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.296747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.306725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.307584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.308243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.309022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.309885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.310440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.443987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.445918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.457524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.463823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.464549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.465523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.467639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.468337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.479133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.490612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.493331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.494851 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19fce9df-2d7c-450f-9869-b5ee1f077c44 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.203717 Oct 17 13:36:51.510881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2511/4998] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:51.592994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.593828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.611941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.612929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.618397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.622667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.628429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.629970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.858883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.868767 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0afb8877-9256-4afe-b391-48d0b8db9af6 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1309 microversion: 2.1 time: 0.429158 Oct 17 13:36:51.879394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2488/4999] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1309 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:51.885088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:51.885739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:51.917659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.918123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.918759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.919693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:51.920314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:51.920913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:51.935586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:51.965044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:51.993925 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a92588a-f0b3-4b07-bce0-4c2af550b201 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1345 microversion: 2.1 time: 0.404671 Oct 17 13:36:52.006144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2512/5000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1345 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:52.073741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:52.087376 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7b53d03-d28f-4435-8039-5e79c3f15c3e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1277 microversion: 2.1 time: 0.206276 Oct 17 13:36:52.097477 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2489/5001] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:51 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:52.526302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:52.527136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:52.552184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:52.553388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:52.557037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:52.558303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:52.560117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:52.561204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:52.907784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:52.910223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:52.930776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:52.935570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:52.938628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:52.939399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:52.940671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:52.943908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:52.944643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.166046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.178978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.182091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.185601 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e189be5a-b30e-43bf-a96e-afd3c776aa01 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.665493 Oct 17 13:36:53.187922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2513/5002] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:52 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:53.205302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:53.208113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:53.232179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.232887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.233711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.243122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.251233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.252058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.348957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.350791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.356036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.356956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.357711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'fault' on Instance uuid dc5e1c49-2fc3-445d-9adc-9dc1437a2128 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:53.370341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3eb7a4a0-506a-41ba-981a-6015be2b6895 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1309 microversion: 2.1 time: 0.469164 Oct 17 13:36:53.373063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2490/5003] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:52 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1309 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:53.386468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:53.389082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:53.409956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.411375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.412162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.413510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:53.415037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:53.420203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:53.460403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.469988 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d01cac86-1cf1-4508-b40a-cf108d576dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1350 microversion: 2.1 time: 0.280588 Oct 17 13:36:53.478824 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2514/5004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:53 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1350 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:53.600260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:53.613214 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-903596e5-2cff-4587-878e-0087a7957d86 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1275 microversion: 2.1 time: 0.236518 Oct 17 13:36:53.629254 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2491/5005] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:53 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:54.219832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.221425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:54.237596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.238735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.241334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.242983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.243690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.244349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.410716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.411385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:54.443080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.443762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.447754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.450454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.453745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.455535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.556353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:54.583854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:54.590050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:54.596538 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-986308ac-20eb-413e-8af5-ad7087b59332 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.377899 Oct 17 13:36:54.600315 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2515/5006] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:54.630076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:54.632298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:54.663680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.669617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.672875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.675252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.676109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.680689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.783026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:54.783562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:54.784006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:54.784468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'fault' on Instance uuid dc5e1c49-2fc3-445d-9adc-9dc1437a2128 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:55.004371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:55.019589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:55.024433 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf9e4482-4db8-43fc-ae6c-89f248089181 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1309 microversion: 2.1 time: 0.623061 Oct 17 13:36:55.026180 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2492/5007] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1309 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:55.034148 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f8361f1-d2dc-43ed-9905-bc7e8d4853ba tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 200 len: 1304 microversion: 2.1 time: 0.429666 Oct 17 13:36:55.048345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:55.048345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:55.048688 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2516/5008] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:54 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 1304 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:55.068679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.069745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.070533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.071414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.076136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.076719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.118452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4fca229d-09fd-41b8-a4ad-cc94b3f82e09 req-9325ffbf-7297-42c3-ad6b-1c8733e342d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9c33d1-9687-49cb-8972-3832284ef9c7", "name": "network-vif-plugged", "status": "completed", "tag": "95bfffa4-6041-448b-aeeb-a8663cc984e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:55.140113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4fca229d-09fd-41b8-a4ad-cc94b3f82e09 req-9325ffbf-7297-42c3-ad6b-1c8733e342d3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.140113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4fca229d-09fd-41b8-a4ad-cc94b3f82e09 req-9325ffbf-7297-42c3-ad6b-1c8733e342d3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.140113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4fca229d-09fd-41b8-a4ad-cc94b3f82e09 req-9325ffbf-7297-42c3-ad6b-1c8733e342d3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.169741 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4fca229d-09fd-41b8-a4ad-cc94b3f82e09 req-9325ffbf-7297-42c3-ad6b-1c8733e342d3 service nova] Creating event network-vif-plugged:95bfffa4-6041-448b-aeeb-a8663cc984e0 for instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 on n-h1-854121-14 Oct 17 13:36:55.186271 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4fca229d-09fd-41b8-a4ad-cc94b3f82e09 req-9325ffbf-7297-42c3-ad6b-1c8733e342d3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070430 Oct 17 13:36:55.189682 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2517/5009] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:36:55.296210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:55.312042 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb86b7b0-4367-4109-bfbb-bdb718b453c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1275 microversion: 2.1 time: 0.284604 Oct 17 13:36:55.313337 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2493/5010] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:55 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1275 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:55.635554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:55.637809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:55.669388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.671268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.672412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:55.676277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:55.678542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:55.681249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.006909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.033991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.035530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.044719 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e02c7e29-38aa-4fec-afb9-27375fa0eebf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.415675 Oct 17 13:36:56.046301 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2518/5011] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:55 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:56.051402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.052033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.062114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.064076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.069411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.071888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.072503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.073101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.074036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.074528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.082079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.083030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.083782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.084744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.085612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.087189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.128299 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 HTTP/1.1 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'dc5e1c49-2fc3-445d-9adc-9dc1437a2128'} Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:56.131661 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.140292 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.144594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:56.146029 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48c869ff-8ed0-4c0f-b1cd-ff8536d9e050 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 404 len: 111 microversion: 2.1 time: 0.080738 Oct 17 13:36:56.147340 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2519/5012] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:56.337795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.338420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.341693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:56.350171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.350684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.351290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.352550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.353011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.353470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.394858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.419719 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8e3f716-d637-4313-8c90-30635b08f1be tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1309 microversion: 2.1 time: 0.372581 Oct 17 13:36:56.420767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2494/5013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1309 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:56.425707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.427975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.455045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.455940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.456602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.457624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.460428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.465057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.498082 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.500372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128/os-volume_attachments HTTP/1.1 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': 'dc5e1c49-2fc3-445d-9adc-9dc1437a2128'} Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:36:56.500954 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:36:56.505104 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:36:56.508849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:36:56.510027 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b289503-8ba5-46fb-9692-4b5130e5bd2d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.088311 Oct 17 13:36:56.511113 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2495/5014] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128/os-volume_attachments => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:36:56.542647 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43d1701a-8bf9-44f8-bce4-2e540dbe7e9b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1275 microversion: 2.1 time: 0.201916 Oct 17 13:36:56.542647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2520/5015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:56 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:56.753678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:56.754516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:56.775044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.776061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.776859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.778007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:56.778727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:56.780217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:56.962232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1265205231", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:36:57.097808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'services' on Instance uuid 0000a0ee-91cb-40ec-9d8f-ee7101525586 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:36:57.221219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:36:57.354784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4365e12d-64e9-47da-ac39-10eb16dfe48d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments/466cf195-d6fd-49dc-a91f-e47e140448df" status: 202 len: 0 microversion: 2.1 time: 0.601212 Oct 17 13:36:57.357512 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2496/5016] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:36:56 2022] DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments/466cf195-d6fd-49dc-a91f-e47e140448df => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:36:57.380214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:57.381876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:57.419025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.422048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.422685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:57.423587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:57.424834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:57.428800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.137727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:58.155301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:58.159460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:58.165109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f968c4cb-8a55-4a33-8eab-43545ab66e05 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.802108 Oct 17 13:36:58.166602 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2497/5017] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:36:57 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:36:58.182293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:58.192529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:58.217265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.225591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.227444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.228520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.230284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.231223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.346289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3317536f-0739-4de4-9955-50a951480392 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177264 Oct 17 13:36:58.360263 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2498/5018] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:36:58 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:36:58.388001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:58.388635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:36:58.400799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.405936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.409299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.412480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:58.418004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:58.418824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:58.578581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:59.569769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:36:59.830382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:36:59.831607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:36:59.832367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:36:59.833226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:36:59.833829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:36:59.864718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:59.868526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:59.872181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.876267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:36:59.878159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:36:59.883260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:36:59.942850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:36:59.964628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:36:59.965790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:36:59.976177 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9f7bc93-561d-4223-8cdd-7a84c75b4bb3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1490 microversion: 2.1 time: 1.614527 Oct 17 13:36:59.981832 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2499/5019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:58 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1490 bytes in 1621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:36:59.988170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:36:59.994292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:00.014948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.015837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.021375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.022649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:00.025650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.027046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.027743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.036282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:00.253198 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a813bea-9e2c-4ef2-8d41-3a6640ca2a47 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.295007 Oct 17 13:37:00.255464 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2521/5020] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:36:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:00.267858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:00.268550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:00.287092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.287608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.292755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.295153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.295355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.295810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.774672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:00.785995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a640573c-0e7d-4b55-8f35-d30f91839cd0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.802778 Oct 17 13:37:00.786598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2500/5021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:36:59 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:00.827437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:00.830929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:00.838634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.839252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.839700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.841563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.842206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.842796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.893940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23f0741b-a555-47be-8695-efe441750338 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085564 Oct 17 13:37:00.894919 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2501/5022] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:00 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:00.909923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2025559171"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:00.922066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:00.930347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.931212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.932656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:00.933785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:00.934402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:00.935315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.136287 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b24916a-2745-4829-bf43-91f4a3a45444 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "PUT /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1075 microversion: 2.1 time: 0.240064 Oct 17 13:37:01.160435 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2502/5023] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:37:00 2022] PUT /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1075 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:01.167895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dea2c497-63e1-4d30-80f8-8a7bce8cdd03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:01.169073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dea2c497-63e1-4d30-80f8-8a7bce8cdd03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:01.196353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:01.220872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:01.224052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:01.226337 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0697123e-ea62-4949-a57a-58fc650d5aaa tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.969793 Oct 17 13:37:01.244897 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2522/5024] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:00 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:01.266464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:01.267495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:01.280057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.281427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.282805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.284706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.286228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.287242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.365695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dea2c497-63e1-4d30-80f8-8a7bce8cdd03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:01.379512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dea2c497-63e1-4d30-80f8-8a7bce8cdd03 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21" status: 200 len: 1215 microversion: 2.1 time: 0.217329 Oct 17 13:37:01.386237 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2503/5025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:01 2022] GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 => generated 1215 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:01.416033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:01.417112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:01.459199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:01.502347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.518071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.519133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.656909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:01.657943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:01.658630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:01.661125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'flavor' on Instance uuid 0d7d5302-650f-4027-88db-33a3f2552f21 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:01.699865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'system_metadata' on Instance uuid 0d7d5302-650f-4027-88db-33a3f2552f21 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:01.828470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'metadata' on Instance uuid 0d7d5302-650f-4027-88db-33a3f2552f21 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:01.978888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:02.012419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:02.013530 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb43b053-dbdb-4624-ab82-f058ec53b9fb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1501 microversion: 2.1 time: 0.751744 Oct 17 13:37:02.015518 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2523/5026] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:01 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1501 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:02.021706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:02.029354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:02.064592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.067345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:02.071512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:02.074687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.079162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:02.080744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:02.805409 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.scheduler.client.report [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Deleted allocations for instance 0d7d5302-650f-4027-88db-33a3f2552f21 Oct 17 13:37:02.839333 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83c1b99f-ffd3-4bc5-a728-2ca990502fed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21" status: 204 len: 0 microversion: 2.1 time: 1.426800 Oct 17 13:37:02.840723 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2504/5027] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:01 2022] DELETE /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 => generated 0 bytes in 1432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:02.852625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:02.861063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:02.878796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.879599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:02.880253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:02.881202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.881841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:02.883242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:02.960239 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-97ca3224-05b5-4e67-ac9f-99a9d38f4e08 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118028 Oct 17 13:37:02.963597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2505/5028] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:02 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:02.975307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:02.976746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:02.991184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.993940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:02.995182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:02.998904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:02.999873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:03.000820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:03.783460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:03.800018 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40dedcf8-8f8b-4a0c-b129-983a26708130 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 1.782969 Oct 17 13:37:03.813394 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2524/5029] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:02 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:03.819200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:03.827475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:03.856966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:03.861267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:03.861849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:03.865361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:03.868537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:03.873800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:03.937737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:03.947595 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40c14988-2628-4ef5-9694-7d5211d3b84a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1501 microversion: 2.1 time: 0.982591 Oct 17 13:37:03.948751 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2506/5030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:02 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1501 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:03.954183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-808e9973-69a8-4a75-a32e-e980fe409f5f req-0556fbe0-cfe4-4f86-b23c-9f68ff63137f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63526cf5-08e6-411d-87a0-3b538ba19a44", "tag": "d6548a8f-f738-4566-81ef-d8509e7ffe7e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:03.964562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-808e9973-69a8-4a75-a32e-e980fe409f5f req-0556fbe0-cfe4-4f86-b23c-9f68ff63137f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:03.965355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-808e9973-69a8-4a75-a32e-e980fe409f5f req-0556fbe0-cfe4-4f86-b23c-9f68ff63137f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:03.965949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-808e9973-69a8-4a75-a32e-e980fe409f5f req-0556fbe0-cfe4-4f86-b23c-9f68ff63137f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:03.980077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-808e9973-69a8-4a75-a32e-e980fe409f5f req-0556fbe0-cfe4-4f86-b23c-9f68ff63137f service nova] Creating event network-changed:d6548a8f-f738-4566-81ef-d8509e7ffe7e for instance 63526cf5-08e6-411d-87a0-3b538ba19a44 on n-h1-854121-14 Oct 17 13:37:03.985851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-808e9973-69a8-4a75-a32e-e980fe409f5f req-0556fbe0-cfe4-4f86-b23c-9f68ff63137f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035317 Oct 17 13:37:03.987065 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2507/5031] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:03.993743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:03.994726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:04.003411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.004250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.005703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:04.016204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.017009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.017671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:04.047381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 HTTP/1.1 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0d7d5302-650f-4027-88db-33a3f2552f21'} Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:04.049454 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:37:04.054477 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:04.060677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:04.063333 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e0d7890-fa87-4bec-baa7-6dfb422a6ca3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21" status: 404 len: 111 microversion: 2.1 time: 0.073561 Oct 17 13:37:04.073790 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2508/5032] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:03 2022] GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:04.096009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-040e2540-2e4b-47b4-afb7-8a05ca22ee90 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:04.141030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2540-2e4b-47b4-afb7-8a05ca22ee90 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.145890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2540-2e4b-47b4-afb7-8a05ca22ee90 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.155579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-040e2540-2e4b-47b4-afb7-8a05ca22ee90 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:04.229904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-040e2540-2e4b-47b4-afb7-8a05ca22ee90 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:37:04.346003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-040e2540-2e4b-47b4-afb7-8a05ca22ee90 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "POST /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7/action" status: 202 len: 0 microversion: 2.1 time: 0.253370 Oct 17 13:37:04.350048 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2509/5033] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:04 2022] POST /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:37:04.378640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:04.391478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:04.412381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:04.434535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.434535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.434910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:04.435676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.436140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.436575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:04.583629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4d215b5-6fc6-43c7-a987-95ab4667a480 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231081 Oct 17 13:37:04.584830 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2510/5034] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:04 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:04.595561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-596128982", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:04.654651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:04.657652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:04.671680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:04.685656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:04.690713 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f088fbf3-dfe9-4b83-88cd-8165dd457cdf tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.875569 Oct 17 13:37:04.701809 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2525/5035] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:03 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:04.718067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:04.731407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:04.759601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.769940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.770412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:04.771182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:04.771648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:04.778607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.170433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:05.179350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:05.195878 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7745b8e5-c0e3-4bfd-a9a1-23286fdfad4d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.492612 Oct 17 13:37:05.196491 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2526/5036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:04 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:05.204384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:05.204994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:05.223125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.229566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.229985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.230747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.234371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.235307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.565975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:05.576176 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-99a9593b-c77b-450a-b406-0250377a5092 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.374866 Oct 17 13:37:05.590086 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2527/5037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:05 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:05.618797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:05.621896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:05.631731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.632828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.633929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.634948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.635663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.636348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.724289 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42ba6b7a-24dc-4470-aae0-35a79770463d tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118427 Oct 17 13:37:05.725880 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2528/5038] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:05 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:05.733453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:05.734069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:05.741533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.741999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.742662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:05.743539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:05.744174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:05.744772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.296443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:06.314125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:06.322059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:06.324608 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9a6bb528-d0ee-4578-8d43-90da26039eed tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.595856 Oct 17 13:37:06.351006 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2529/5039] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:05 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:06.364326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:06.369374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:06.390098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.390602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.393117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.394083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.394893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.395217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.436734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:06.437346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:06.437646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:06.438056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:06.438465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:06.464280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.464775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.465297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.473029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.473607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.474060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.540665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:06.553800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:06.602532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:06.612543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:06.761663 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa6945c0-79d0-49b7-869e-b7500ac0564f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.173934 Oct 17 13:37:06.770497 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2511/5040] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:06.776240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:06.777152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:06.779316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:06.794229 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7003e01a-a135-4353-bb4e-4c85f37a8da0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.437521 Oct 17 13:37:06.794962 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2530/5041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:06 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:06.798948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.799781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.802401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.803533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.806013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.807369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:06.810885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:06.823885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.832916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.833712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.835222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.838105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:06.838792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:06.839404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:06.917678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6102cdf-0669-4974-8d56-2df179ebfd5f tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121574 Oct 17 13:37:06.918280 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2531/5042] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:06 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:06.934013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a661613-6fd7-43c6-aaf7-444e5973cfe0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:06.934679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a661613-6fd7-43c6-aaf7-444e5973cfe0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:07.081455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2a661613-6fd7-43c6-aaf7-444e5973cfe0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:07.103735 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a661613-6fd7-43c6-aaf7-444e5973cfe0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1214 microversion: 2.1 time: 0.184385 Oct 17 13:37:07.117613 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2532/5043] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:06 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:07.229693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:07.239820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36524f2f-d9f5-4a54-af5d-4a88fa405066 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.467739 Oct 17 13:37:07.257150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2512/5044] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:06 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:07.360892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:07.361907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:07.376612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.377359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.378003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.378959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.379544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.380183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.826006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:07.827256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:07.838125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.841811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.842528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:07.846012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:07.846718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:07.847390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.065342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:08.080932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:08.090953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:08.092965 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3a3e74b-b0ca-4b34-ba3c-1ad0d8885113 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.738571 Oct 17 13:37:08.096237 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2533/5045] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:07 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:08.103484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:08.137021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:08.184969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.186478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.190505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.192444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.192926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.193381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.272307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:08.289653 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1d414da-8781-42c5-aff4-36d24b715a4f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.469220 Oct 17 13:37:08.289896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-885e5653-184e-40c0-a532-5e33affbea78 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192044 Oct 17 13:37:08.290263 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2513/5046] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:07 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:08.290434 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2534/5047] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:08 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:08.299798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:08.300404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:08.306532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:08.309609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:08.310081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.310861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.313204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.317656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.319190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.320340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.341071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.349211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.350365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.355149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.355695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.356179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.581312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:08.590613 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2bfbe6d8-b491-4d31-8afc-a29d5aea9021 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1266 microversion: 2.1 time: 0.299170 Oct 17 13:37:08.610317 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2535/5048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:08 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:08.620804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f1b89f2c-444b-483e-9c62-f5367c7fe3b3 req-dedb3018-1ff3-4b29-b971-3c0e3ff6f1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63526cf5-08e6-411d-87a0-3b538ba19a44", "name": "network-vif-plugged", "status": "completed", "tag": "d6548a8f-f738-4566-81ef-d8509e7ffe7e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:08.640929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f1b89f2c-444b-483e-9c62-f5367c7fe3b3 req-dedb3018-1ff3-4b29-b971-3c0e3ff6f1e5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:08.641452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f1b89f2c-444b-483e-9c62-f5367c7fe3b3 req-dedb3018-1ff3-4b29-b971-3c0e3ff6f1e5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:08.641885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f1b89f2c-444b-483e-9c62-f5367c7fe3b3 req-dedb3018-1ff3-4b29-b971-3c0e3ff6f1e5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:08.694582 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f1b89f2c-444b-483e-9c62-f5367c7fe3b3 req-dedb3018-1ff3-4b29-b971-3c0e3ff6f1e5 service nova] Creating event network-vif-plugged:d6548a8f-f738-4566-81ef-d8509e7ffe7e for instance 63526cf5-08e6-411d-87a0-3b538ba19a44 on n-h1-854121-14 Oct 17 13:37:08.704457 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f1b89f2c-444b-483e-9c62-f5367c7fe3b3 req-dedb3018-1ff3-4b29-b971-3c0e3ff6f1e5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092763 Oct 17 13:37:08.712738 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2536/5049] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:08.915624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:08.931799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d44a308e-6e55-4521-bcbb-f1780afe76e3 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.637833 Oct 17 13:37:08.932412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2514/5050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:08 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:09.133434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.134635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.144659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.145622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.146572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.148510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.149220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.149861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.316023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.318433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.326804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.327576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.328197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.329080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.329711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.330525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.368566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b2967ee-8812-4873-aec9-de342d8b770e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056230 Oct 17 13:37:09.369594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2515/5051] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:37:09 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:37:09.382906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.385201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.395912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.396417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.399345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.400218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.400687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.401123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.650008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.665273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.667258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.668650 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac16328c-3fc8-40ca-b379-d5cd710f4a9a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.545565 Oct 17 13:37:09.669758 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2537/5052] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:09 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:09.674768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:09.677265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.683854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.684734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.685377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.686262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.686865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.687440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.727329 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Cannot 'reboot' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action HTTP/1.1 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 28 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: {"reboot": {"type": "HARD"}} Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot 'reboot' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e5b4c131-aeca-40af-9e61-6014c8c16f02', 'body': {'reboot': {'type': 'HARD'}}} Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:37:09.730163 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.734993 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.736629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 409 to user: Cannot 'reboot' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:09.738003 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb39376c-9db7-4a75-853d-7b06c1ceccda tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action" status: 409 len: 145 microversion: 2.1 time: 0.066849 Oct 17 13:37:09.739487 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2538/5053] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:09 2022] POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:37:09.746611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.747235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.762557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.763052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.763693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.764562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.765214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.765813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.774052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.803841 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c498fc48-e310-4347-8caf-6c3fd19d5740 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.432447 Oct 17 13:37:09.804707 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2516/5054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:09 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:09.811665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:09.814767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.827318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.828968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.829846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.831950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.832674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.833410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.850068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:09.859489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25199f8c-65c9-4853-aa85-b43de72f714d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1272 microversion: 2.1 time: 0.118716 Oct 17 13:37:09.864875 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2539/5055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:09 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:09.886045 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Cannot 'rebuild' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action HTTP/1.1 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 65 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: exception: Cannot 'rebuild' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'e5b4c131-aeca-40af-9e61-6014c8c16f02', 'body': {'rebuild': {'imageRef': 'db51f7c1-415a-4ea9-94a7-afd34c3636cd'}}} Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:09.887877 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 409 to user: Cannot 'rebuild' instance e5b4c131-aeca-40af-9e61-6014c8c16f02 while it is in vm_state rescued {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e1cc6d0-ba0d-43aa-bd4f-2dc92aabc2a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action" status: 409 len: 146 microversion: 2.1 time: 0.084985 Oct 17 13:37:09.891969 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2517/5056] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:09 2022] POST /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02/action => generated 146 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:37:09.901562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.902251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.911367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.911864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.912716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.917041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.919186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.919661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.920559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:09.965295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:09.967129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:09.984840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.985718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.986759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:09.990839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:09.991512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:09.993257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.020604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:10.188781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bff8c7ff-3bf1-43f1-a54a-cddd0198d34c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 204 len: 0 microversion: 2.1 time: 0.288066 Oct 17 13:37:10.192995 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2540/5057] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:09 2022] DELETE /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:10.214147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:10.218391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:10.243473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.244065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.246198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.247923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.248367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.249972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.382924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:10.397414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5bca341-579d-4056-89a6-35602641aa61 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.442563 Oct 17 13:37:10.400481 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2518/5058] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:09 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:10.700351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:10.700973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:10.715668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.716392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.716821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:10.717882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:10.718483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:10.719071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.153655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.157439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.171453 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c16b894e-69a5-493b-9a2c-8063af77bc33 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1687 microversion: 2.1 time: 0.972325 Oct 17 13:37:11.172789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.177876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.181225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7417d21b-08aa-4f69-a793-4eff9c93f3b7 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.483768 Oct 17 13:37:11.184246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2519/5059] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:10 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:37:11.188315 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2541/5060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:10 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1687 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:11.196670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.198807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.199723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:11.209323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:11.211711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.216320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.217053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.217572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.218237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.219143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.219389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.219938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.220826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.221486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.223650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.224242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.716673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.723722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:11.726842 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1aec2bf6-3e60-4640-9d0e-86122684edc9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.537248 Oct 17 13:37:11.746159 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2542/5061] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:11.756869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:11.758575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:11.771325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.772160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.772841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.774159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:11.779767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:11.780752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:11.921077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:11.925089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:11.939263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87f10154-3f26-4633-af07-531671bc6779 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.752506 Oct 17 13:37:11.954277 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2520/5062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:12.071705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.091608 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d12034c6-5923-487d-85cb-19bae5dbf4b1 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.342438 Oct 17 13:37:12.109833 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2543/5063] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:11 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:12.196625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.197260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:12.214492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.217305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.217959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.219575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.220867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.221088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.222748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.223404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:12.237787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.239087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.240549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.242437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.244058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.244791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.674891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.704324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.706551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.708845 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-962f602c-bd00-4b46-a1b3-8ba5035c2475 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.498440 Oct 17 13:37:12.710019 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2544/5064] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:12.738748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.747723 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60fac0b9-9d87-43c4-8322-a7a77e745c99 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1687 microversion: 2.1 time: 0.555925 Oct 17 13:37:12.748321 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2521/5065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1687 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:12.755257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.755881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:12.767779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.768348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.768802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.771525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.774191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.774657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.965890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:12.966511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:12.973252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:12.983160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.983634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.984078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.984795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:12.985284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:12.985716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:12.987907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d3823b29-4d2b-48be-b100-a79263c7ef25 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.237195 Oct 17 13:37:12.988504 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2545/5066] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:13.116805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:13.117903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:13.128152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.129313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.130004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.132699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.134115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.136235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.193918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:13.203769 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ec53472-abc8-44e4-b6a9-aa4fb38429e7 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.241652 Oct 17 13:37:13.205500 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2522/5067] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:12 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:13.373416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:13.391180 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48b1bc82-3f6d-46ad-b796-b04c57834002 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1317 microversion: 2.1 time: 0.279172 Oct 17 13:37:13.395744 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2546/5068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:13 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:13.736029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:13.737034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:13.755002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.756550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.757330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.759846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.765886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.766665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.774879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:13.775530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:13.792392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.793005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.793495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:13.798140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:13.800988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:13.801687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.022531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.041411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.044403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.050134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ff437a4-f372-4e17-a847-892fce907695 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.317329 Oct 17 13:37:14.053403 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2523/5069] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:13 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:14.065106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:14.071220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:14.090970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.092789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.096566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.098932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.103075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.103863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.357527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.372958 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b82a119e-a0e9-4c37-b616-67c47f486ccc tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1687 microversion: 2.1 time: 0.601691 Oct 17 13:37:14.375133 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2547/5070] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:13 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1687 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:14.410055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:14.411112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:14.428530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.431612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.434948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.435937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.438287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.438979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.495808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.508235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31dba40b-8518-4cfd-8b90-f79f2ac33124 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.452526 Oct 17 13:37:14.530175 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2524/5071] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:14 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:14.537520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:14.538351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:14.548314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.549110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.550442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.551470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.552125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.553584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.814863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.825148 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60c95a74-fe36-4ce2-a41a-d1ae75bd0a01 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1466 microversion: 2.1 time: 0.293396 Oct 17 13:37:14.831928 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2525/5072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:14 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1466 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:14.860901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:14.861861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:14.874603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.875362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.876256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.877637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:14.878902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:14.880472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:14.903335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:14.917709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2043a7d3-c933-4398-a29b-e1732e21cc09 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.524031 Oct 17 13:37:14.923024 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2548/5073] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:14 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:15.078430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.079199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:15.092216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.092889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.093486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.094578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.095165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.097621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.413515 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-169988b2-4c79-48db-89e3-e18f034756b2 tempest-ServersOnMultiNodesTest-481079272 tempest-ServersOnMultiNodesTest-481079272-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1619 microversion: 2.1 time: 0.558749 Oct 17 13:37:15.427758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:15.440237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:15.441595 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2526/5074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:14 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1619 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:15.444525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:15.450270 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f8103f0-281f-4d0e-8445-7ac8136d1270 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.376232 Oct 17 13:37:15.451001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.452582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:15.453252 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2549/5075] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:37:15.460485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.463187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.463849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.465227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.465962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:15.467926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.469223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.470044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.479287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.487772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.488291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.489046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.489541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.497790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.546811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:15.733143 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bce1e928-f1c8-4e5f-9fb8-7d06bcf68b05 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 204 len: 0 microversion: 2.1 time: 0.278404 Oct 17 13:37:15.734508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2550/5076] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:15 2022] DELETE /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:15.745613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.746542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:15.762601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.763420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.764206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.765492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:15.766245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:15.766914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:15.905526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:15.919271 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-234a5215-6a6f-4905-9161-fd7b3ccf33f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1687 microversion: 2.1 time: 0.470870 Oct 17 13:37:15.919932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2527/5077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1687 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:15.974787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:15.986147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:16.005643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.006788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.008187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.009770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.010490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.011146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.326862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:16.342882 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-03df2e02-8e47-4d34-b444-f3daa86dce74 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.606638 Oct 17 13:37:16.344760 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2551/5078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:16.356664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ab363785-ac80-4198-8dfe-b812cedff6de req-ad721653-9dc0-4417-8cb0-16ed98f869ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d0faf4-32af-4016-8ee2-4f25d49ba895", "tag": "0dac7e87-dae6-46cd-8efd-98ef61427b85"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:16.375793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ab363785-ac80-4198-8dfe-b812cedff6de req-ad721653-9dc0-4417-8cb0-16ed98f869ac service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.376775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ab363785-ac80-4198-8dfe-b812cedff6de req-ad721653-9dc0-4417-8cb0-16ed98f869ac service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.390685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ab363785-ac80-4198-8dfe-b812cedff6de req-ad721653-9dc0-4417-8cb0-16ed98f869ac service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.425115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:16.438283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32ab951f-2528-4423-b87b-db4cdde4b0e2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1472 microversion: 2.1 time: 0.502365 Oct 17 13:37:16.441897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ab363785-ac80-4198-8dfe-b812cedff6de req-ad721653-9dc0-4417-8cb0-16ed98f869ac service nova] Creating event network-changed:0dac7e87-dae6-46cd-8efd-98ef61427b85 for instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 on n-h1-854121-14 Oct 17 13:37:16.453930 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2528/5079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:15 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1472 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:16.461196 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ab363785-ac80-4198-8dfe-b812cedff6de req-ad721653-9dc0-4417-8cb0-16ed98f869ac service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114888 Oct 17 13:37:16.462607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2552/5080] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:16.479119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:16.479119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:16.510793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.511544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.521702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.524592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.525970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.526951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.528339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:16.560263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:16.561997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:16.603896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.606153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.607731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:16.609726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:16.614352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:16.618470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:16.618890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.099457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:17.275016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.291458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4680494a-f64f-417e-b18f-5b527f370635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.829187 Oct 17 13:37:17.292598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2529/5081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:16 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.321104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f33d173a-f9a7-4ab5-a35c-246e6b070193 req-c84d03e1-e496-41e5-a408-7c701342eeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "name": "network-vif-plugged", "status": "completed", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:17.335073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f33d173a-f9a7-4ab5-a35c-246e6b070193 req-c84d03e1-e496-41e5-a408-7c701342eeaf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.336125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f33d173a-f9a7-4ab5-a35c-246e6b070193 req-c84d03e1-e496-41e5-a408-7c701342eeaf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.336748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f33d173a-f9a7-4ab5-a35c-246e6b070193 req-c84d03e1-e496-41e5-a408-7c701342eeaf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.352680 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f33d173a-f9a7-4ab5-a35c-246e6b070193 req-c84d03e1-e496-41e5-a408-7c701342eeaf service nova] Creating event network-vif-plugged:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:37:17.364938 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f33d173a-f9a7-4ab5-a35c-246e6b070193 req-c84d03e1-e496-41e5-a408-7c701342eeaf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056857 Oct 17 13:37:17.367324 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2530/5082] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:17.374951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.375667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:17.385197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.385696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.386140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.387052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.387659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.388276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.449004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.464938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.467180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.468986 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5927ba8a-10b3-4641-840b-388e6244344b tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.962924 Oct 17 13:37:17.470028 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2553/5083] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:16 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:17.481327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.482772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:17.490728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.491333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.491861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.492709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.493190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.493749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.781438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:17.796882 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96c1557d-2c62-41b2-bf6e-af6a1960054a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 200 len: 1620 microversion: 2.1 time: 0.424042 Oct 17 13:37:17.797597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2531/5084] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 1620 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:17.828771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:17.829271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:17.860361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.864085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.864737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:17.866000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:17.867212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:17.872305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.839308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:18.854428 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67fc07a0-885e-44f1-ae7f-5ca578fed835 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1430 microversion: 2.1 time: 1.028623 Oct 17 13:37:18.874644 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2532/5085] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1430 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:18.876917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:18.878374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:18.901149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.901699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.902206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.903026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:18.903546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:18.903982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:18.982091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:18.993368 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff5c4ab0-0fba-4631-a3de-98f0d43f3cfa tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 1.521254 Oct 17 13:37:18.993969 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2554/5086] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:17 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:19.024514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:19.025601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:19.053347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.053885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.056172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.057665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.059210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.061686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.458838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:19.473446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:19.477940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:19.482011 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38facf61-068c-441b-b88b-95da6d2eac74 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.471067 Oct 17 13:37:19.498082 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2555/5087] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:18 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:19.506601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:19.516347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6265df3c-dd7d-4d4c-a2d9-05ac2121158f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.645058 Oct 17 13:37:19.516859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a05e1c59-528d-4e3a-92c1-03daa136d412 req-53831f3e-7180-42a2-9e29-2489dfc4b309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0000a0ee-91cb-40ec-9d8f-ee7101525586", "name": "network-vif-deleted", "tag": "a084652e-4641-4d8e-a921-aa1c0536e920"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:19.524346 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2533/5088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:18 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:19.529747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:19.530587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: 0000a0ee-91cb-40ec-9d8f-ee7101525586] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:19.540692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:19.542741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a05e1c59-528d-4e3a-92c1-03daa136d412 req-53831f3e-7180-42a2-9e29-2489dfc4b309 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.543363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a05e1c59-528d-4e3a-92c1-03daa136d412 req-53831f3e-7180-42a2-9e29-2489dfc4b309 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.543904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a05e1c59-528d-4e3a-92c1-03daa136d412 req-53831f3e-7180-42a2-9e29-2489dfc4b309 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.550745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.551546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.552171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.555031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.557777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.558512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.575643 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a05e1c59-528d-4e3a-92c1-03daa136d412 req-53831f3e-7180-42a2-9e29-2489dfc4b309 service nova] Creating event network-vif-deleted:a084652e-4641-4d8e-a921-aa1c0536e920 for instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 on n-h1-854121-14 Oct 17 13:37:19.588109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 could not be found. Oct 17 13:37:19.593129 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a05e1c59-528d-4e3a-92c1-03daa136d412 req-53831f3e-7180-42a2-9e29-2489dfc4b309 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085706 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 HTTP/1.1 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 could not be found. Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0000a0ee-91cb-40ec-9d8f-ee7101525586'} Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 could not be found. Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 could not be found. Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:19.595304 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 could not be found. Oct 17 13:37:19.600478 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:19.601563 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2556/5089] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:19.604883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 404 to user: Instance 0000a0ee-91cb-40ec-9d8f-ee7101525586 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:19.608544 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6af2a176-290f-434c-945b-22f39733252b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586" status: 404 len: 111 microversion: 2.1 time: 0.082117 Oct 17 13:37:19.610029 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2534/5090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:19 2022] GET /compute/v2.1/servers/0000a0ee-91cb-40ec-9d8f-ee7101525586 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:19.619960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cc10f90-c18f-4d7c-a751-b4faf25bbf16 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '.version_select at 0x7f41a1f4aee0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:19.628166 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8cc10f90-c18f-4d7c-a751-b4faf25bbf16 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [38c12e21-730b-4665-a16a-58172f95ed86] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:37:19.881678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:19.883352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:19.895815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.901581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.905043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:19.906687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:19.907521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:19.911259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.047926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.048590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.049116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.055542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lazy-loading 'fault' on Instance uuid 63526cf5-08e6-411d-87a0-3b538ba19a44 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:20.166414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:20.176079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f144078-be13-4a1c-80d4-a1b3edd7dfff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 200 len: 1307 microversion: 2.1 time: 0.298694 Oct 17 13:37:20.180689 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2535/5091] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:19 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 1307 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:20.190942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.191444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:20.212748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.213606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.215565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.217717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.218443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.219946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.636864 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-8cc10f90-c18f-4d7c-a751-b4faf25bbf16 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [38c12e21-730b-4665-a16a-58172f95ed86] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 46344. Oct 17 13:37:20.670542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cc10f90-c18f-4d7c-a751-b4faf25bbf16 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922170140" status: 202 len: 0 microversion: 2.1 time: 1.055576 Oct 17 13:37:20.671565 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2557/5092] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922170140 => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:37:20.674077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8cc10f90-c18f-4d7c-a751-b4faf25bbf16 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.678400 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8cc10f90-c18f-4d7c-a751-b4faf25bbf16 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004623 Oct 17 13:37:20.687868 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2558/5093] 10.222.0.65 () {56 vars in 886 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:37:20.693853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.694957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:20.704090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.704935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.705563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.706481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.707106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.708784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.732053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:20.743440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1daa01e-a6a4-4791-af52-6875aa372074 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.561306 Oct 17 13:37:20.744057 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2536/5094] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:20.769987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:20.770896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:20.795517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.798734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.801342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:20.802332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:20.805246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:20.805884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.531869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:21.554305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:21.555892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:21.572830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c16dc59-8787-473d-98c3-3881d186ce9e tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.879675 Oct 17 13:37:21.573543 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2559/5095] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:21.583310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:21.586830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 63526cf5-08e6-411d-87a0-3b538ba19a44] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:21.601682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.602471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.603070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.606373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.607009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.607609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.630695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:21.648744 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a5edc8d-d2ee-44af-8dda-3ca04932763f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.902509 Oct 17 13:37:21.650127 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance 63526cf5-08e6-411d-87a0-3b538ba19a44 could not be found. Oct 17 13:37:21.651540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2537/5096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:20 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 HTTP/1.1 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 63526cf5-08e6-411d-87a0-3b538ba19a44 could not be found. Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '63526cf5-08e6-411d-87a0-3b538ba19a44'} Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63526cf5-08e6-411d-87a0-3b538ba19a44 could not be found. Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63526cf5-08e6-411d-87a0-3b538ba19a44 could not be found. Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:21.662307 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63526cf5-08e6-411d-87a0-3b538ba19a44 could not be found. Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance 63526cf5-08e6-411d-87a0-3b538ba19a44 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:21.667735 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70ad813a-2d3b-4d63-ae95-92a972b509ff tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44" status: 404 len: 111 microversion: 2.1 time: 0.089754 Oct 17 13:37:21.669121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d1482e14-9ff4-4ea6-bba6-c6dd33f83d99 req-58e6df62-37df-487a-873e-7d7744fa5116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63526cf5-08e6-411d-87a0-3b538ba19a44", "name": "network-vif-deleted", "tag": "d6548a8f-f738-4566-81ef-d8509e7ffe7e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:21.669403 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2560/5097] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:21 2022] GET /compute/v2.1/servers/63526cf5-08e6-411d-87a0-3b538ba19a44 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:21.684457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:21.684961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:21.707220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d1482e14-9ff4-4ea6-bba6-c6dd33f83d99 req-58e6df62-37df-487a-873e-7d7744fa5116 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.709956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.710492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.710934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.711388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d1482e14-9ff4-4ea6-bba6-c6dd33f83d99 req-58e6df62-37df-487a-873e-7d7744fa5116 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.711720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.714605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.715063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.716198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d1482e14-9ff4-4ea6-bba6-c6dd33f83d99 req-58e6df62-37df-487a-873e-7d7744fa5116 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.768091 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d1482e14-9ff4-4ea6-bba6-c6dd33f83d99 req-58e6df62-37df-487a-873e-7d7744fa5116 service nova] Creating event network-vif-deleted:d6548a8f-f738-4566-81ef-d8509e7ffe7e for instance 63526cf5-08e6-411d-87a0-3b538ba19a44 on n-h1-854121-14 Oct 17 13:37:21.788024 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d1482e14-9ff4-4ea6-bba6-c6dd33f83d99 req-58e6df62-37df-487a-873e-7d7744fa5116 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135001 Oct 17 13:37:21.792884 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2538/5098] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:21.818603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:21.819333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:21.831755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:21.836463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:21.844127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.844632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.845072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.868633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:21.869817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:21.871303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:21.898332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:22.047622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2d77a3d-99e3-473d-9d81-3243a11d3e76 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 204 len: 0 microversion: 2.1 time: 0.376467 Oct 17 13:37:22.052138 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2561/5099] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:21 2022] DELETE /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:22.064089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:22.064763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:22.078710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.079215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.079658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.080377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.080830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.086303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.411328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:22.420079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8c0a407-a8c0-41d9-88df-2b41c4eb325b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.625793 Oct 17 13:37:22.420678 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2539/5100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:21 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:22.521925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:22.534125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e9f3ca5-9fda-40d1-86b5-e7fe979588db tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1472 microversion: 2.1 time: 0.480290 Oct 17 13:37:22.534893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2562/5101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:22 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1472 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:22.603337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:22.603949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:22.620366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.636234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.637739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.638701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.639379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.640223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.675177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:22.676289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:22.688724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.689263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.689704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.690417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:22.690868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:22.691286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:22.990720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:23.001885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:23.019331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:23.020786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:23.022032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-24066a78-fb38-4a3f-abe7-84c90aeecef1 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1731 microversion: 2.20 time: 0.423901 Oct 17 13:37:23.039494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2540/5102] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:22 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1731 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:23.050152 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d38ff8f-4398-423b-8b9f-c19b00ff3bea tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.379321 Oct 17 13:37:23.053757 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2563/5103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:22 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:23.449719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:23.450699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:23.458096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:23.460647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:23.463392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:23.464383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:23.465483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:23.467377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:23.568340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:23.569219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:23.589590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:23.590765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:23.592610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:23.593899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:23.596795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:23.597705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.035919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:25.041767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:25.064017 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36cb5694-a999-4f96-ab96-f2b47a842388 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 1.623448 Oct 17 13:37:25.064441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46cfce72-85c3-4631-bae8-c0c4b44f7201 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1472 microversion: 2.1 time: 1.498611 Oct 17 13:37:25.066030 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2541/5104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:23 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:25.066587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2564/5105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:23 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1472 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:25.075737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:25.078979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:25.087762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:25.088414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:25.111975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.114249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.114936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.117002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.117835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.118920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.119736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.120844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.121883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:25.124328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.135514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:25.137671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:25.999093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.023633 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dbbb25c0-d7fb-43d5-a116-d7fea1eaffde tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.951474 Oct 17 13:37:26.024495 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2542/5106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:25 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:26.048398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.062608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ffa51155-de2c-4f79-a621-7a6d9b4fc41f req-ba469a0c-cb0a-4302-b5bb-0c671ce849cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba229fd-d2dd-4994-ab49-08fe17338e27", "name": "network-vif-deleted", "tag": "5ad206f9-6dae-4fdf-a353-450509a3cb44"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:26.071918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.075800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.077124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7921e8c6-d7e1-4b24-ac8b-7999802f0744 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1718 microversion: 2.20 time: 1.009302 Oct 17 13:37:26.082577 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2565/5107] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:37:25 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1718 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:37:26.094764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ffa51155-de2c-4f79-a621-7a6d9b4fc41f req-ba469a0c-cb0a-4302-b5bb-0c671ce849cd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.095496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ffa51155-de2c-4f79-a621-7a6d9b4fc41f req-ba469a0c-cb0a-4302-b5bb-0c671ce849cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.096120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ffa51155-de2c-4f79-a621-7a6d9b4fc41f req-ba469a0c-cb0a-4302-b5bb-0c671ce849cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.107035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:26.108002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:26.135092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.135626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.136042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.136807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.137477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.137708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.156810 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ffa51155-de2c-4f79-a621-7a6d9b4fc41f req-ba469a0c-cb0a-4302-b5bb-0c671ce849cd service nova] Creating event network-vif-deleted:5ad206f9-6dae-4fdf-a353-450509a3cb44 for instance eba229fd-d2dd-4994-ab49-08fe17338e27 on n-h2-854121-14 Oct 17 13:37:26.177726 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ffa51155-de2c-4f79-a621-7a6d9b4fc41f req-ba469a0c-cb0a-4302-b5bb-0c671ce849cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132636 Oct 17 13:37:26.180439 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2543/5108] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:26.198625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:26.199350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:26.232761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.234964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.238287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.240612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.244411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.247293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.351330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.354610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.355181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.355898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lazy-loading 'fault' on Instance uuid eba229fd-d2dd-4994-ab49-08fe17338e27 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:26.518625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.532497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-748f3f89-20e3-46cf-8ea8-7cb9a007e469 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 200 len: 1306 microversion: 2.1 time: 0.345337 Oct 17 13:37:26.561864 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2544/5109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:26 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 1306 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:26.575787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-25480797-76b5-40da-bb85-884d5d2b191d req-e8b045bf-eda4-47d9-ad75-39fced48b73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d0faf4-32af-4016-8ee2-4f25d49ba895", "name": "network-vif-plugged", "status": "completed", "tag": "0dac7e87-dae6-46cd-8efd-98ef61427b85"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:26.651511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-25480797-76b5-40da-bb85-884d5d2b191d req-e8b045bf-eda4-47d9-ad75-39fced48b73d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:26.653647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-25480797-76b5-40da-bb85-884d5d2b191d req-e8b045bf-eda4-47d9-ad75-39fced48b73d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:26.658908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-25480797-76b5-40da-bb85-884d5d2b191d req-e8b045bf-eda4-47d9-ad75-39fced48b73d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:26.700871 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-25480797-76b5-40da-bb85-884d5d2b191d req-e8b045bf-eda4-47d9-ad75-39fced48b73d service nova] Creating event network-vif-plugged:0dac7e87-dae6-46cd-8efd-98ef61427b85 for instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 on n-h1-854121-14 Oct 17 13:37:26.724147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-25480797-76b5-40da-bb85-884d5d2b191d req-e8b045bf-eda4-47d9-ad75-39fced48b73d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160523 Oct 17 13:37:26.725052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2545/5110] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:26.951561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:26.974833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1e3e7b4-74c0-459f-ab38-cc8af9f48067 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.871101 Oct 17 13:37:26.979346 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2566/5111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:26 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:27.056566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:27.057552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:27.070247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.075105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.076227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.078333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.079097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.081806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.576480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:27.577101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: eba229fd-d2dd-4994-ab49-08fe17338e27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:27.595351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.596181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.598587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:27.603599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.608150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.609235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.611187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.625385 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91529d50-b72f-45b0-9b78-289f0c5bd9d4 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.575360 Oct 17 13:37:27.666604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance eba229fd-d2dd-4994-ab49-08fe17338e27 could not be found. Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 HTTP/1.1 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance eba229fd-d2dd-4994-ab49-08fe17338e27 could not be found. Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'eba229fd-d2dd-4994-ab49-08fe17338e27'} Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba229fd-d2dd-4994-ab49-08fe17338e27 could not be found. Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba229fd-d2dd-4994-ab49-08fe17338e27 could not be found. Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:27.668382 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba229fd-d2dd-4994-ab49-08fe17338e27 could not be found. Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:27.673767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance eba229fd-d2dd-4994-ab49-08fe17338e27 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:27.674275 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2546/5112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:27 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:27.675313 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4718fabf-bbb2-4dcc-800b-d8f64d249256 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27" status: 404 len: 111 microversion: 2.1 time: 0.102906 Oct 17 13:37:27.677871 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2567/5113] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:27 2022] GET /compute/v2.1/servers/eba229fd-d2dd-4994-ab49-08fe17338e27 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:37:27.687077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:27.687578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:27.706865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.707366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.707807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.708530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.708982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.709438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.785034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:27.959423 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-076aa14b-e6ae-4890-b374-b501b8f8681f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 204 len: 0 microversion: 2.1 time: 0.275221 Oct 17 13:37:27.963267 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2547/5114] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:27 2022] DELETE /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:27.969849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:27.970554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:27.988047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.991300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.992910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:27.994456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:27.996997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:27.998774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.001890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:28.002824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:28.016078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:28.017859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.018512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.019154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.020106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.020713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.024014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.596717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:28.608825 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6f9f6ac-f942-4329-8c89-1aebd73472c7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1314 microversion: 2.1 time: 0.611485 Oct 17 13:37:28.631692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:28.634237 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2548/5115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:27 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:28.656062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:28.656570 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ad63a54-7a76-4db0-aaf5-e829597ff6cd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1472 microversion: 2.1 time: 0.682842 Oct 17 13:37:28.656768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:28.658068 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2568/5116] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:27 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1472 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:28.699179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.699645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.700087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:28.700838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:28.702753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:28.703416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:29.037106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:29.054338 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5b67e41-d810-4428-b074-fdfab512926c tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.401373 Oct 17 13:37:29.056112 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2549/5117] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:28 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:29.637818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:29.638990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:29.661435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:29.661942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:29.662380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:29.663199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:29.664156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:29.664588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:29.685777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:29.686934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:29.703650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:29.705096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:29.708840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:29.711170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:29.713019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:29.715106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.173078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:30.188953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f1740db-673e-4f46-bf52-a46e70d955f6 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1472 microversion: 2.1 time: 0.507150 Oct 17 13:37:30.189620 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2550/5118] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:29 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1472 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:30.206120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:30.209275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:30.230248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:30.230742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:30.231180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.231890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:30.232340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:30.232765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.239135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:30.251220 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-85430651-ae02-49fc-bfb6-9f4625ac9866 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1501 microversion: 2.1 time: 0.618304 Oct 17 13:37:30.252200 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2569/5119] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:29 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1501 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:30.282257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:30.282811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:30.289854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:30.290722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:30.291384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.292338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:30.293125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:30.293925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.403422 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-708614ae-a234-4dde-a11f-768c9968821d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895/action" status: 202 len: 0 microversion: 2.1 time: 0.124625 Oct 17 13:37:30.404717 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2570/5120] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:37:30 2022] POST /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:37:30.428927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:30.441855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:30.470923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:30.477970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:30.481384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.482345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:30.482981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:30.483745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:30.737227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:30.777934 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85501bd8-b6ca-426a-be2d-8ec47a13bc38 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.583279 Oct 17 13:37:30.789695 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2551/5121] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:30 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:30.958178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:30.969176 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3986f916-1e62-4490-9147-38a80a61b3a6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1506 microversion: 2.1 time: 0.550757 Oct 17 13:37:30.973142 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2571/5122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:30 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1506 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:31.215549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:31.216119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:31.235295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.236243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.236913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.238119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.238949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.239486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.374833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:31.387499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c17debd-46d6-4a71-b6dc-eac27c0e7703 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1430 microversion: 2.1 time: 0.175822 Oct 17 13:37:31.390967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2552/5123] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:31 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1430 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:31.531048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6f6ec79a-0ba6-4244-9621-c582794deba1 req-d4fb6937-619a-46cf-9c85-b4d4fb518d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a93b5065-c76d-4c37-86b6-90256e9eed8a", "name": "network-vif-deleted", "tag": "ed2c335e-5600-480c-8a82-255f4b4dc421"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:31.562158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6f6ec79a-0ba6-4244-9621-c582794deba1 req-d4fb6937-619a-46cf-9c85-b4d4fb518d03 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.566285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6f6ec79a-0ba6-4244-9621-c582794deba1 req-d4fb6937-619a-46cf-9c85-b4d4fb518d03 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.567117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6f6ec79a-0ba6-4244-9621-c582794deba1 req-d4fb6937-619a-46cf-9c85-b4d4fb518d03 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.621963 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6f6ec79a-0ba6-4244-9621-c582794deba1 req-d4fb6937-619a-46cf-9c85-b4d4fb518d03 service nova] Creating event network-vif-deleted:ed2c335e-5600-480c-8a82-255f4b4dc421 for instance a93b5065-c76d-4c37-86b6-90256e9eed8a on n-h2-854121-14 Oct 17 13:37:31.643786 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6f6ec79a-0ba6-4244-9621-c582794deba1 req-d4fb6937-619a-46cf-9c85-b4d4fb518d03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116744 Oct 17 13:37:31.648593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2572/5124] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:37:31.819934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:31.820690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:31.837251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.844554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.845026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.845972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:31.846443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:31.846872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:31.998047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:31.999108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:32.012188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.016052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.016662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.018362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.020193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.024765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.292165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:32.307909 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1032617-89cd-48d7-a8fa-8170803c0940 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.500107 Oct 17 13:37:32.309600 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2553/5125] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:31 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:32.416261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:32.418091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:32.424863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.432420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.445921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.447183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.447971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.451909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.527318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:32.583740 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa348c30-d86c-4e8c-b523-8ac88aa03d2b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1486 microversion: 2.1 time: 0.591355 Oct 17 13:37:32.588483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2573/5126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:31 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1486 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:32.594616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.595302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.596811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.599253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lazy-loading 'fault' on Instance uuid a93b5065-c76d-4c37-86b6-90256e9eed8a {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:32.633535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:32.634903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:32.662173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.662942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.664490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.665634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:32.666367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:32.681894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:32.730930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:32.733918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:32.746331 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f91c41b-fcf5-4822-a961-1face132f44f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 200 len: 1306 microversion: 2.1 time: 0.330868 Oct 17 13:37:32.748941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:32.750063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2554/5127] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:32 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 1306 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:32.979637 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c10b6550-4a86-407b-b3b0-7ea278309020 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 204 len: 0 microversion: 2.1 time: 0.364162 Oct 17 13:37:32.981014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2574/5128] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:32 2022] DELETE /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:32.996202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:32.997925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.018596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.019293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.021208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.024168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.025555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.028035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.334483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:33.335812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.344978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.345753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.346749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.347728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.349008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.349802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.376678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:33.384153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:33.396485 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c706327e-401d-444d-b3f9-bb6343644007 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1492 microversion: 2.1 time: 0.409519 Oct 17 13:37:33.414217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2555/5129] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:32 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1492 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:33.781112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:33.781756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: a93b5065-c76d-4c37-86b6-90256e9eed8a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.800617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.801114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.801578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.802985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.803450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.806827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.847183 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance a93b5065-c76d-4c37-86b6-90256e9eed8a could not be found. Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a HTTP/1.1 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance a93b5065-c76d-4c37-86b6-90256e9eed8a could not be found. Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a93b5065-c76d-4c37-86b6-90256e9eed8a'} Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a93b5065-c76d-4c37-86b6-90256e9eed8a could not be found. Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a93b5065-c76d-4c37-86b6-90256e9eed8a could not be found. Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:33.849658 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a93b5065-c76d-4c37-86b6-90256e9eed8a could not be found. Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance a93b5065-c76d-4c37-86b6-90256e9eed8a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76ca7ea9-2b9a-421d-8c02-456aa0ff7bdb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a" status: 404 len: 111 microversion: 2.1 time: 0.082267 Oct 17 13:37:33.854327 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2556/5130] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:33 2022] GET /compute/v2.1/servers/a93b5065-c76d-4c37-86b6-90256e9eed8a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:33.864616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:33.865116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:33.875136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.875870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.876494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.877393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:33.877998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:33.878575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:33.907627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:34.065066 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c30a3f59-b0db-4bcf-b140-77e2da4e8198 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 204 len: 0 microversion: 2.1 time: 0.208605 Oct 17 13:37:34.069684 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2557/5131] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:33 2022] DELETE /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:34.081052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:34.082224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:34.090821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.091533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.092539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.094156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.094861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.095454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.110712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:34.120316 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5394d4d1-18ac-42c6-90cf-21c99db0437a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.789902 Oct 17 13:37:34.120899 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2575/5132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:33 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:34.170715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:34.277198 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-55fa094e-a919-49fb-b9ff-c0b07f81b57a tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 204 len: 0 microversion: 2.1 time: 0.203903 Oct 17 13:37:34.278599 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2558/5133] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:34 2022] DELETE /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:34.290280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:34.291138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:34.299897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.300673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.301288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.302158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.302926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.303573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.427247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:34.427954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:34.444698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.447346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.448293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.451684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:34.452334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:34.453475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:34.672189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:34.692445 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8572d8f3-1822-42e2-bbd2-624e9566218c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1474 microversion: 2.1 time: 0.409057 Oct 17 13:37:34.697737 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2576/5134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:34 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1474 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:35.033857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:35.043676 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28233555-d027-4571-a0f6-7da3a61ecf50 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1492 microversion: 2.1 time: 0.622120 Oct 17 13:37:35.047987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2559/5135] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:34 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1492 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:35.137430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:35.138229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:35.148823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:35.149732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:35.163672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.164376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.164833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.165768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.166231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.166658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.169260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.170550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.171008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.171749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.172211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.172641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.251739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:35.467976 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-152d1275-b98a-4626-838d-7e75abea1ba6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "DELETE /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 204 len: 0 microversion: 2.1 time: 0.332606 Oct 17 13:37:35.477799 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2577/5136] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:35 2022] DELETE /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:35.488271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:35.489116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:35.505558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.506615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.507740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.509851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.511741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.514328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.623615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:35.640590 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d224d15-7881-4ea6-9b7d-4c206ade5635 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1511 microversion: 2.1 time: 0.495991 Oct 17 13:37:35.650660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2560/5137] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:35 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:35.726849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:35.728337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:35.744951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.745392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.745843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.753087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:35.756254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:35.757346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:35.931110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:35.944046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8dd94929-9433-41e3-9475-413247416aa1 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1507 microversion: 2.1 time: 0.464314 Oct 17 13:37:35.964272 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2578/5138] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:35 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.061884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:36.072196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.072807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:36.073496 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-566c64d2-ee33-4615-ab8b-044e497f9536 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1474 microversion: 2.1 time: 0.350695 Oct 17 13:37:36.083805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.084311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.084746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.085823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.086282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.086709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.091863 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2561/5139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:35 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.343164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:36.355817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-085be6f7-ddef-41cb-88dd-5cfa08d6b2f9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1492 microversion: 2.1 time: 0.287590 Oct 17 13:37:36.357204 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2579/5140] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1492 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:36.675917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.676605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:36.683339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.684056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.686225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.690832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:36.693181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:36.693852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:36.950848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:36.964179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-362b9cd2-2742-448a-a17d-357e11cba46a tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1488 microversion: 2.1 time: 0.292074 Oct 17 13:37:36.965883 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2562/5141] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1488 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:36.990456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:36.992121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:37.004733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1848390135"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:37.014238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.016962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:37.018011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.018825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.023515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.024755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.025504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.032889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.033621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.034068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.034790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.035328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.035769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.160937 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2f900d4-cbae-4048-b6a9-8d2dad5c1684 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "PUT /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1061 microversion: 2.1 time: 0.166369 Oct 17 13:37:37.165085 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2563/5142] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 13:37:36 2022] PUT /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1061 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:37.172632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:37.173485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:37.181769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.182518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.183175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.184070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.185830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.186458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.424219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:37.450569 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fc7f2f1-59ae-4024-a5bf-55211e08b963 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 200 len: 1432 microversion: 2.1 time: 0.282524 Oct 17 13:37:37.475033 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2564/5143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:37 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 1432 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:37.502332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:37.505224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:37.528703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.536741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.542459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:37.550734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.552480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.557730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.558444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.565131 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcce00d6-0a1d-4bf1-9987-e0968fd6a055 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1507 microversion: 2.1 time: 0.589646 Oct 17 13:37:37.570163 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2580/5144] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:36 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1507 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:37.594791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ba550d83-99a8-4294-8196-54a06e28c143 req-b1b10184-a6d9-45d6-85ad-5c42cf8fbe37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e1d2ad-aba5-4260-ad4d-5fe6945b2c27", "name": "network-vif-deleted", "tag": "385cb44a-845f-498d-8e7d-45e6726a7269"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:37.643635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ba550d83-99a8-4294-8196-54a06e28c143 req-b1b10184-a6d9-45d6-85ad-5c42cf8fbe37 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.644119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ba550d83-99a8-4294-8196-54a06e28c143 req-b1b10184-a6d9-45d6-85ad-5c42cf8fbe37 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.655751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ba550d83-99a8-4294-8196-54a06e28c143 req-b1b10184-a6d9-45d6-85ad-5c42cf8fbe37 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.712830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ba550d83-99a8-4294-8196-54a06e28c143 req-b1b10184-a6d9-45d6-85ad-5c42cf8fbe37 service nova] Creating event network-vif-deleted:385cb44a-845f-498d-8e7d-45e6726a7269 for instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 on n-h2-854121-14 Oct 17 13:37:37.730261 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ba550d83-99a8-4294-8196-54a06e28c143 req-b1b10184-a6d9-45d6-85ad-5c42cf8fbe37 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158198 Oct 17 13:37:37.731756 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2581/5145] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:37.747804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:37.748724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:37.762440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.762867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.763311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:37.764026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:37.764480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:37.769716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.068113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.096922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8356179-1790-491c-bceb-6aff66b9025e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1488 microversion: 2.1 time: 0.612872 Oct 17 13:37:38.097836 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2565/5146] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:37 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1488 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.126577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.136131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.173900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.175924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.188010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.197732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.201588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.205249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.347380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.376125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f3489996-0cba-45af-a623-6a1f3792af1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1492 microversion: 2.1 time: 0.630267 Oct 17 13:37:38.378055 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2582/5147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:37 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1492 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.491686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.492303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.501738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.502564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.503102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.504003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.504639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.505260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.533000 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 could not be found. Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 HTTP/1.1 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 could not be found. Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '42e1d2ad-aba5-4260-ad4d-5fe6945b2c27'} Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 could not be found. Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 could not be found. Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:38.536664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 could not be found. Oct 17 13:37:38.544180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:38.546013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance 42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:38.547222 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2ed1442-6d3b-4e54-a9c6-8de693e65a6e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27" status: 404 len: 111 microversion: 2.1 time: 0.061017 Oct 17 13:37:38.548421 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2583/5148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/42e1d2ad-aba5-4260-ad4d-5fe6945b2c27 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:38.559921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.561027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.571074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.573551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.576260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.577197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.578271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.579091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.591949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.620637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23c2d8ab-6f82-4910-ad50-10f63d2643bb tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1488 microversion: 2.1 time: 0.498126 Oct 17 13:37:38.621521 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2566/5149] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1488 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.648434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.649931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.657567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.658288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.658892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.659753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.660367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.660787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.796269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.816660 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8989683-0b90-4159-9d2c-b8781adfd9c5 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1474 microversion: 2.1 time: 0.258888 Oct 17 13:37:38.821750 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2584/5150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.843671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:38.844732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:38.853404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:38.865789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63587a63-82bb-437b-b372-139898d7a1a8 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1507 microversion: 2.1 time: 0.242950 Oct 17 13:37:38.867362 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2567/5151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:38 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:38.884461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.885064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.895812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.897302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.898877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.899640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.907036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ce05f8e0-92b2-433f-9dc5-a56b95468304 req-41697a8a-57c1-4ed6-ba9e-0cf6090820e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1897b8cf-4c18-41f0-b7ca-2660dda8bffd", "name": "network-vif-unplugged", "status": "completed", "tag": "cc29a07e-58fe-4da8-8781-260512d40dbc"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:38.933730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce05f8e0-92b2-433f-9dc5-a56b95468304 req-41697a8a-57c1-4ed6-ba9e-0cf6090820e4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:38.937252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce05f8e0-92b2-433f-9dc5-a56b95468304 req-41697a8a-57c1-4ed6-ba9e-0cf6090820e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:38.939227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce05f8e0-92b2-433f-9dc5-a56b95468304 req-41697a8a-57c1-4ed6-ba9e-0cf6090820e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:38.956147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:38.960955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ce05f8e0-92b2-433f-9dc5-a56b95468304 req-41697a8a-57c1-4ed6-ba9e-0cf6090820e4 service nova] Creating event network-vif-unplugged:cc29a07e-58fe-4da8-8781-260512d40dbc for instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd on n-h1-854121-14 Oct 17 13:37:38.961997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:38.969920 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ce05f8e0-92b2-433f-9dc5-a56b95468304 req-41697a8a-57c1-4ed6-ba9e-0cf6090820e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071791 Oct 17 13:37:38.974529 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2568/5152] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:37:39.104816 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcbafc8b-3aa5-4a24-83b2-db82a38d7a14 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 204 len: 0 microversion: 2.1 time: 0.281182 Oct 17 13:37:39.107593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2585/5153] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:38 2022] DELETE /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:39.120393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:39.121105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:39.138178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.138997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.139659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.140612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.141333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.141971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.371736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:39.393495 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fe77942-46f4-4336-a3a7-03dd38acbc39 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1494 microversion: 2.1 time: 0.278184 Oct 17 13:37:39.394927 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2569/5154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:39 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1494 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:39.415536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:39.418204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:39.426424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.426914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.427349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.428082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.429056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.429558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.623763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:39.638483 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f96a4d1-bfe3-480e-b5e6-eb3655007db9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1492 microversion: 2.1 time: 0.235610 Oct 17 13:37:39.681304 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2586/5155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:39 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1492 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:39.853832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:39.854573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:39.862749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.863858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.863858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.865060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.865539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.866749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.922666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:39.923239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:39.937375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.938514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.939335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:39.941330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:39.942872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:39.943578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.083724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:40.100895 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ccc56148-0c11-4945-9ed6-b622f7534cbb tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1474 microversion: 2.1 time: 0.248969 Oct 17 13:37:40.102278 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2570/5156] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:39 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1474 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:40.427765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:40.428427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:40.455472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.457360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.457360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.459628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:40.467008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.471623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.472817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fdabadb4-e8d5-4100-9ead-92b6ee2755f6 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1507 microversion: 2.1 time: 0.570222 Oct 17 13:37:40.478709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.481529 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2587/5157] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:39 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1507 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:40.486417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ecb9502a-14e6-4d35-8b98-c8b544ca7514 req-910cb27b-5bc3-4407-b617-85825650ff61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d0faf4-32af-4016-8ee2-4f25d49ba895", "name": "network-vif-deleted", "tag": "0dac7e87-dae6-46cd-8efd-98ef61427b85"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:40.522717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ecb9502a-14e6-4d35-8b98-c8b544ca7514 req-910cb27b-5bc3-4407-b617-85825650ff61 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.533871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ecb9502a-14e6-4d35-8b98-c8b544ca7514 req-910cb27b-5bc3-4407-b617-85825650ff61 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.534757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ecb9502a-14e6-4d35-8b98-c8b544ca7514 req-910cb27b-5bc3-4407-b617-85825650ff61 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.655026 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ecb9502a-14e6-4d35-8b98-c8b544ca7514 req-910cb27b-5bc3-4407-b617-85825650ff61 service nova] Creating event network-vif-deleted:0dac7e87-dae6-46cd-8efd-98ef61427b85 for instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 on n-h1-854121-14 Oct 17 13:37:40.719335 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ecb9502a-14e6-4d35-8b98-c8b544ca7514 req-910cb27b-5bc3-4407-b617-85825650ff61 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205540 Oct 17 13:37:40.727631 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2588/5158] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:40.767474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:40.768257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:40.816730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.829362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.832262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.837664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.843490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:40.844193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:40.992946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:40.998746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.000208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.007460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'fault' on Instance uuid 79d0faf4-32af-4016-8ee2-4f25d49ba895 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:41.335929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:41.355742 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-379ca52d-c46f-4838-b9cb-b04c7ac812ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 200 len: 1304 microversion: 2.1 time: 0.626024 Oct 17 13:37:41.361102 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2589/5159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:40 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 1304 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:41.387024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-adb79963-1013-4411-84ad-51a8d6aeb4af req-7b43bb48-4bee-4f38-81d2-2921b9db5356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d0faf4-32af-4016-8ee2-4f25d49ba895", "name": "network-vif-unplugged", "status": "completed", "tag": "0dac7e87-dae6-46cd-8efd-98ef61427b85"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:41.406005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-adb79963-1013-4411-84ad-51a8d6aeb4af req-7b43bb48-4bee-4f38-81d2-2921b9db5356 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.414531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-adb79963-1013-4411-84ad-51a8d6aeb4af req-7b43bb48-4bee-4f38-81d2-2921b9db5356 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.421355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-adb79963-1013-4411-84ad-51a8d6aeb4af req-7b43bb48-4bee-4f38-81d2-2921b9db5356 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.436460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:41.466088 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-318951cf-94e9-4c90-9148-695f1819abc8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1494 microversion: 2.1 time: 1.042310 Oct 17 13:37:41.471888 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2571/5160] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:40 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1494 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:41.495644 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-adb79963-1013-4411-84ad-51a8d6aeb4af req-7b43bb48-4bee-4f38-81d2-2921b9db5356 service nova] Creating event network-vif-unplugged:0dac7e87-dae6-46cd-8efd-98ef61427b85 for instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 on n-h1-854121-14 Oct 17 13:37:41.511047 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-adb79963-1013-4411-84ad-51a8d6aeb4af req-7b43bb48-4bee-4f38-81d2-2921b9db5356 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148275 Oct 17 13:37:41.515482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:41.516419 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2590/5161] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:41.517319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:41.529485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:41.533387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:41.562510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.564217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.564912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.565786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.571875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.575126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.576561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.576858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.579125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.581222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.581980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.585533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.629399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:41.730820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.733814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.736099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.738233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lazy-loading 'fault' on Instance uuid 1897b8cf-4c18-41f0-b7ca-2660dda8bffd {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:41.788842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:41.794416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:41.796884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:41.798756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'fault' on Instance uuid e5b4c131-aeca-40af-9e61-6014c8c16f02 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:41.876093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:41.892634 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-323e4446-a0b8-4c1e-a0c3-0437a2837615 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 200 len: 1308 microversion: 2.1 time: 0.411847 Oct 17 13:37:41.893923 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2572/5162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:41 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:41.933914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:41.942671 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d9b2cac-6bc2-4e8a-ab4f-a7a19c5c2fc2 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1312 microversion: 2.1 time: 0.424910 Oct 17 13:37:41.943459 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2591/5163] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:41 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:42.292988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-41e8f68d-db92-43bf-8627-c6b1920fdb6e req-93705be9-45ef-4601-8cc7-ee0945aebeef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9c33d1-9687-49cb-8972-3832284ef9c7", "name": "network-vif-deleted", "tag": "95bfffa4-6041-448b-aeeb-a8663cc984e0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:42.308452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-41e8f68d-db92-43bf-8627-c6b1920fdb6e req-93705be9-45ef-4601-8cc7-ee0945aebeef service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.308719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-41e8f68d-db92-43bf-8627-c6b1920fdb6e req-93705be9-45ef-4601-8cc7-ee0945aebeef service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.313298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-41e8f68d-db92-43bf-8627-c6b1920fdb6e req-93705be9-45ef-4601-8cc7-ee0945aebeef service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.347381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-41e8f68d-db92-43bf-8627-c6b1920fdb6e req-93705be9-45ef-4601-8cc7-ee0945aebeef service nova] Creating event network-vif-deleted:95bfffa4-6041-448b-aeeb-a8663cc984e0 for instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 on n-h1-854121-14 Oct 17 13:37:42.364301 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-41e8f68d-db92-43bf-8627-c6b1920fdb6e req-93705be9-45ef-4601-8cc7-ee0945aebeef service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075164 Oct 17 13:37:42.365496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2573/5164] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:42.403475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:42.404123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:42.418815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:42.423375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.423987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.424780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.425973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.431453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.432422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.466006 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 HTTP/1.1 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '79d0faf4-32af-4016-8ee2-4f25d49ba895'} Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:42.469409 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:37:42.473676 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:42.475855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:42.477228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1fdae15-26da-4fd4-93e5-c3d65d0a40a9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 404 len: 111 microversion: 2.1 time: 0.082476 Oct 17 13:37:42.495249 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2592/5165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:42 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:42.510979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:42.512177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:42.549761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.550268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.552855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.554319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.555085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.555603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.705092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1492839012", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:42.784613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:42.797304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70954661-ae7b-4891-8c06-003721738cc5 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 200 len: 1292 microversion: 2.1 time: 0.297296 Oct 17 13:37:42.798418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2574/5166] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:42 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 1292 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:42.803376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1897b8cf-4c18-41f0-b7ca-2660dda8bffd", "name": "network-vif-deleted", "tag": "cc29a07e-58fe-4da8-8781-260512d40dbc"}, {"server_uuid": "e5b4c131-aeca-40af-9e61-6014c8c16f02", "name": "network-vif-deleted", "tag": "7b809b30-e58d-4a82-a66f-2fde13274130"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:42.814367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.815289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.815882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.823829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:37:42.844955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] Creating event network-vif-deleted:cc29a07e-58fe-4da8-8781-260512d40dbc for instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd on n-h1-854121-14 Oct 17 13:37:42.851243 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] Creating event network-vif-deleted:7b809b30-e58d-4a82-a66f-2fde13274130 for instance e5b4c131-aeca-40af-9e61-6014c8c16f02 on n-h1-854121-14 Oct 17 13:37:42.868095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-69067feb-7d92-4677-8f8f-9a4744e38e80 req-c5cc10db-5656-4250-ace2-37f5a2a94bf5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068321 Oct 17 13:37:42.873733 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2575/5167] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:42.922386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:42.923078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 1897b8cf-4c18-41f0-b7ca-2660dda8bffd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:42.963156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.966644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.970381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:42.972112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:42.973729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:42.974772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.051505 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd could not be found. Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd HTTP/1.1 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd could not be found. Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '1897b8cf-4c18-41f0-b7ca-2660dda8bffd'} Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd could not be found. Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd could not be found. Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:43.060624 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd could not be found. Oct 17 13:37:43.066648 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.073930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance 1897b8cf-4c18-41f0-b7ca-2660dda8bffd could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:43.075147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e10d1c4d-bb33-43d2-bdcb-6d998ebd5d84 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd" status: 404 len: 111 microversion: 2.1 time: 0.158403 Oct 17 13:37:43.076527 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2576/5168] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:42 2022] GET /compute/v2.1/servers/1897b8cf-4c18-41f0-b7ca-2660dda8bffd => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:37:43.082655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.085978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.109698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.110918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.111671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.112636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.115529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.120531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.259821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.260619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.261269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.265441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lazy-loading 'fault' on Instance uuid e5b4c131-aeca-40af-9e61-6014c8c16f02 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:43.375066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:43.395656 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d805e0a5-4a05-469e-ba83-0e5c9706b5f3 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 200 len: 1312 microversion: 2.1 time: 0.317773 Oct 17 13:37:43.412570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2577/5169] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:43 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:43.447224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a9262ee-8262-445d-9311-92f7252caa50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.554717 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a9262ee-8262-445d-9311-92f7252caa50 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/4fdb0dcf-357c-48bf-abed-eaf0449d3dda" status: 204 len: 0 microversion: 2.1 time: 0.129692 Oct 17 13:37:43.555589 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2578/5170] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:37:43 2022] DELETE /compute/v2.1/os-server-groups/4fdb0dcf-357c-48bf-abed-eaf0449d3dda => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:43.563995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.564495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.594633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.595154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.595602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.596325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.596788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.597312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.670945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:43.867818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a439131-8857-4d73-87eb-33048b0d2a0d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 204 len: 0 microversion: 2.1 time: 0.304748 Oct 17 13:37:43.868546 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2579/5171] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:43 2022] DELETE /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:43.881616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.882856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.899850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.900720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.901530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.903304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.904017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.904722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.922455 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 HTTP/1.1 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '9c9c33d1-9687-49cb-8972-3832284ef9c7'} Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.925183 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:43.930049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:43.930049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:43.930049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:43.930049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:43.930049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:43.930049 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:43.930767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:37:43.930767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:37:43.930767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:37:43.930767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:37:43.930767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:37:43.936199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:43.937089 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0bf62377-fcea-463a-912c-aea9d8a0e517 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 404 len: 111 microversion: 2.1 time: 0.066973 Oct 17 13:37:43.937708 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2580/5172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:43 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:43.947120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:43.947937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:43.950724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.951219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.957790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.958900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.959718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.960250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.963566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.967065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.968803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.972347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:43.973782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:43.975716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:43.993023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:37:43.998844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:37:44.013932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:37:44.015828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:44.016854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:37:44.087521 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-271cb6d7-0fdb-4a73-8218-f126459a089e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.388212 Oct 17 13:37:44.093878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2593/5173] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:37:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:37:44.105604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.109495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.119077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.119793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.120430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.121516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.122121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.122855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.158273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 HTTP/1.1 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '9c9c33d1-9687-49cb-8972-3832284ef9c7'} Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.161411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.168849 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.170941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.171831 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc912ea9-8ca6-46a7-be1c-73370223eda8 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 404 len: 111 microversion: 2.1 time: 0.076628 Oct 17 13:37:44.172513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2594/5174] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:44 2022] DELETE /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.179578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:44.184944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d23df92-789b-427a-a721-e9628d0946b4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.185912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d23df92-789b-427a-a721-e9628d0946b4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.186140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d664e98-7524-4885-86b5-7c891337d23d tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 204 len: 0 microversion: 2.1 time: 0.243103 Oct 17 13:37:44.187341 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2581/5175] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:43 2022] DELETE /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:44.193692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.195149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 9c9c33d1-9687-49cb-8972-3832284ef9c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.208851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.209627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.210359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.211463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.212161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.213021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.231473 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 HTTP/1.1 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '9c9c33d1-9687-49cb-8972-3832284ef9c7'} Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.247826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.252179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.252179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.252179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.252179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.252179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. Oct 17 13:37:44.252179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.254163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 9c9c33d1-9687-49cb-8972-3832284ef9c7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.258734 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48adbcff-cabc-4724-900f-56364941fbf0 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7" status: 404 len: 111 microversion: 2.1 time: 0.069887 Oct 17 13:37:44.259810 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2582/5176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/9c9c33d1-9687-49cb-8972-3832284ef9c7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.271457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.272370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.282122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.290892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.291608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.292525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.293527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.294374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.305818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3d23df92-789b-427a-a721-e9628d0946b4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.315944 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d23df92-789b-427a-a721-e9628d0946b4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1215 microversion: 2.1 time: 0.142127 Oct 17 13:37:44.316462 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2595/5177] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:44.330243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.330905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.338436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.339327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.339932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.342798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.344593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.345441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.378624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e HTTP/1.1 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'c7b570d2-c12b-4e16-9970-d4008147815e'} Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.381147 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.385189 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.387509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.388806 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc515c68-8688-408c-8f99-9b70c897e34f tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 404 len: 111 microversion: 2.1 time: 0.069569 Oct 17 13:37:44.389739 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2596/5178] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:44 2022] DELETE /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.405218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.409568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: c7b570d2-c12b-4e16-9970-d4008147815e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.427390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.428121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.428961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.430002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.431409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.431814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.457804 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e HTTP/1.1 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'c7b570d2-c12b-4e16-9970-d4008147815e'} Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.462419 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.466475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance c7b570d2-c12b-4e16-9970-d4008147815e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.468373 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bfc871dc-7ca4-4c6b-b90a-637f5ced099d tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e" status: 404 len: 111 microversion: 2.1 time: 0.073642 Oct 17 13:37:44.469115 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2597/5179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/c7b570d2-c12b-4e16-9970-d4008147815e => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.488239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.489071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: e5b4c131-aeca-40af-9e61-6014c8c16f02] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.499553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.501607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.503160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.505581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.507264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.508292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.545763 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 could not be found. Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 HTTP/1.1 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 could not be found. Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'e5b4c131-aeca-40af-9e61-6014c8c16f02'} Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 could not be found. Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 could not be found. Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.548415 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 could not be found. Oct 17 13:37:44.552529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.555179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 404 to user: Instance e5b4c131-aeca-40af-9e61-6014c8c16f02 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.556608 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f80d1442-6583-4d57-8c97-afc41edbfeb0 tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02" status: 404 len: 111 microversion: 2.1 time: 0.084075 Oct 17 13:37:44.558670 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2598/5180] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/e5b4c131-aeca-40af-9e61-6014c8c16f02 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.564820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.565421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.571972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.573897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.575642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.576858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.577588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.578252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.616123 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 HTTP/1.1 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '4c3b7d43-a0e3-402c-8f4f-f9f9cc151642'} Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.618701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.623253 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.626197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.627233 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3eb6fdb-91b7-410c-90be-b089ff0fa7da tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 404 len: 111 microversion: 2.1 time: 0.067387 Oct 17 13:37:44.632225 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2599/5181] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:44 2022] DELETE /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.651947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.654672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.670970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.674720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.675455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.676375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.677003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.677794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.728744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:44.742457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:44.748689 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5be0f28-605a-49d0-8ddf-0d17f8ddd3ac tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 200 len: 1475 microversion: 2.1 time: 0.487600 Oct 17 13:37:44.753385 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2583/5182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 1475 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:44.765141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.766479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.794684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.795609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.796213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.802018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.802951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.813207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.856706 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 HTTP/1.1 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4c3b7d43-a0e3-402c-8f4f-f9f9cc151642'} Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.861950 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.876547 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.876547 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.876547 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:44.876547 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:44.876547 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. Oct 17 13:37:44.876547 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.883537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:44.884947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-807f708a-9eb5-485f-99d7-3bfa1411f196 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642" status: 404 len: 111 microversion: 2.1 time: 0.133482 Oct 17 13:37:44.893020 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2584/5183] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/4c3b7d43-a0e3-402c-8f4f-f9f9cc151642 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:44.908301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.917854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.937189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.938193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.939674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.942262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.943706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.945219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.950157 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42a5c0ec-f480-424b-b3c9-8a58515df78e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 204 len: 0 microversion: 2.1 time: 0.314307 Oct 17 13:37:44.952871 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2600/5184] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:44 2022] DELETE /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:44.964788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:44.968806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:44.984106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.987322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.988112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.989078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:44.989736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:44.992883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:44.994610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d HTTP/1.1 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b572d74b-cd63-401a-8da0-df1001a2433d'} Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:44.997194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.001767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.006019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.009143 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e977f9a-7319-4f5a-9051-141ab8b4744e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 404 len: 111 microversion: 2.1 time: 0.114710 Oct 17 13:37:45.011800 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2585/5185] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:44 2022] DELETE /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.036208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.074737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: b572d74b-cd63-401a-8da0-df1001a2433d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.103215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.118528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.121204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.123866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.126821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.127519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.162414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d HTTP/1.1 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b572d74b-cd63-401a-8da0-df1001a2433d'} Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.165564 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance b572d74b-cd63-401a-8da0-df1001a2433d could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bed27432-cc8f-4e06-87a6-ef65b7f94d12 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d" status: 404 len: 111 microversion: 2.1 time: 0.151177 Oct 17 13:37:45.172268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2586/5186] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/b572d74b-cd63-401a-8da0-df1001a2433d => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.188896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.189455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.198809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.199603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.200532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.202007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.202730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.203498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.226103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 HTTP/1.1 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4e5b00d4-baa0-41fc-b51b-476f1d5a9f61'} Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.230073 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.234225 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.236124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.237604 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b676868b-81a0-4954-ae7c-a4d726472760 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 404 len: 111 microversion: 2.1 time: 0.063725 Oct 17 13:37:45.238766 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2587/5187] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:45 2022] DELETE /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.247731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.252643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.261863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.262888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.263690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.264891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.265944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.266698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.305685 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 HTTP/1.1 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4e5b00d4-baa0-41fc-b51b-476f1d5a9f61'} Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.307392 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.313128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.313128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.313128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.313128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.313128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. Oct 17 13:37:45.313128 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.315080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.318807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-761a7e90-3f82-4d5b-be2e-07c3d8f6f4c2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61" status: 404 len: 111 microversion: 2.1 time: 0.072779 Oct 17 13:37:45.318807 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2588/5188] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/4e5b00d4-baa0-41fc-b51b-476f1d5a9f61 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.331477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.332074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.348692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.353030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.353528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.354265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.354730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.355270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.362721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:45.383077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 HTTP/1.1 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'fd749c83-0bd0-426d-b7b5-ad4f036e57c3'} Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.384915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf31d877-80fd-47f6-b03c-c94a4efe6666 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 404 len: 111 microversion: 2.1 time: 0.064124 Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2589/5189] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:45 2022] DELETE /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.392292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.393282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.396830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.401465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.402056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.403026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.403751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.404213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.404952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.409001 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d62e65ca-9c88-40e0-b2d7-d0a25f24322c tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.452742 Oct 17 13:37:45.415219 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2601/5190] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:44 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:45.436399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.437437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: fd749c83-0bd0-426d-b7b5-ad4f036e57c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.445125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.446221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.446699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.447703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.448222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.448752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.464164 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 HTTP/1.1 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'fd749c83-0bd0-426d-b7b5-ad4f036e57c3'} Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.465942 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance fd749c83-0bd0-426d-b7b5-ad4f036e57c3 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc4bd5fe-67d5-4d01-9672-821f23370ebd tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3" status: 404 len: 111 microversion: 2.1 time: 0.036374 Oct 17 13:37:45.470062 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2602/5191] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/fd749c83-0bd0-426d-b7b5-ad4f036e57c3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.476467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.477048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 17c139b1-9522-4e1a-b39b-cc44299559c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.483352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.483925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.484425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.485209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.485750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.486243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.502272 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 HTTP/1.1 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '17c139b1-9522-4e1a-b39b-cc44299559c9'} Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.503991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e699030-1513-43fc-b825-72e742c9946e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9" status: 404 len: 111 microversion: 2.1 time: 0.032924 Oct 17 13:37:45.510958 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2603/5192] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:45 2022] DELETE /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.515259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.516280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.516963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: 17c139b1-9522-4e1a-b39b-cc44299559c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.523519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.524094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.524735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.525710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.526507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.527140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.527698 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6dbc2a17-4a9c-4a7f-b999-28b17e5d7f98 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1219 microversion: 2.1 time: 0.139026 Oct 17 13:37:45.528910 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2590/5193] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:45.560467 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 HTTP/1.1 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '17c139b1-9522-4e1a-b39b-cc44299559c9'} Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.562389 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:45.566998 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:45.566998 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:45.566998 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:45.566998 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:45.566998 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. Oct 17 13:37:45.566998 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:45.568980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance 17c139b1-9522-4e1a-b39b-cc44299559c9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:45.570982 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce932c2f-ce61-47d3-9840-4037207c0605 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9" status: 404 len: 111 microversion: 2.1 time: 0.059474 Oct 17 13:37:45.576074 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2604/5194] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/17c139b1-9522-4e1a-b39b-cc44299559c9 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:45.581620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.582460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.597242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.597932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.598652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.617669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.618309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.618747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.667013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:45.774348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.774965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.775428 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80b4c9fa-8cca-4788-84bd-9bebad835682 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 204 len: 0 microversion: 2.1 time: 0.198145 Oct 17 13:37:45.776399 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2591/5195] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:45 2022] DELETE /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:45.784304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.785065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.785750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.786626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.787230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.787860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.793654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:45.798110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:45.810353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.814312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.814967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.815992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:45.816697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:45.817230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:45.987748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:45.998332 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64b09069-cc1d-4039-9bf1-bd267c572b66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 200 len: 1475 microversion: 2.1 time: 0.228720 Oct 17 13:37:45.998913 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2605/5196] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 1475 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:46.143556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:46.170682 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2678035-3a36-4b41-9041-ccecc9b47a63 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1480 microversion: 2.1 time: 0.390076 Oct 17 13:37:46.174687 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2592/5197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:45 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1480 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:46.552662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:46.554106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:46.563369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.564369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.565219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.566139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.566804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.567444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.676257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:46.687405 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd316b36-1514-4ccb-addb-bd2f30ede594 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1219 microversion: 2.1 time: 0.138934 Oct 17 13:37:46.702432 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2593/5198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:46 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:46.829552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:46.830386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:46.841843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.842628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.843073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:46.843791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:46.844244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:46.844665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.022764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:47.023515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:47.035005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.035799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.036259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.037114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.038467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.038906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.041413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.052543 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c1e21052-f14e-4ac9-99c0-214c96c885ec tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.612353 Oct 17 13:37:47.053582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2606/5199] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:46 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:47.203761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:47.205299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:47.213710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.214667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.215451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.216505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.217486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.218128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.232694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.243307 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9e56bae-bf83-40c1-b1c4-711474848ccd tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 200 len: 1475 microversion: 2.1 time: 0.224064 Oct 17 13:37:47.243952 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2594/5200] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:47 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 1475 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:47.390308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.405186 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e131d1e-8479-48e5-90e5-9a1678d55cd2 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1480 microversion: 2.1 time: 0.206246 Oct 17 13:37:47.405773 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2607/5201] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:47 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1480 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:47.717270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:47.717901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:47.737141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.739868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.740986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.742020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:47.742781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:47.744442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:47.854273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:47.863367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4154d5be-04ce-4866-929a-d5c302262e08 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1219 microversion: 2.1 time: 0.156239 Oct 17 13:37:47.868783 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2595/5202] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:47 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:48.083875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:48.084545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:48.102905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.103582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.105241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.109574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.110849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.111712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.273120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:48.274446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:48.282981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.283823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.284744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.285732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:48.286444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:48.287371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:48.975948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:48.983986 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1924c29-e2ed-4d58-b6b7-bf6df803dc4e tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.907463 Oct 17 13:37:48.989520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2608/5203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:48 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:48.995213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.001036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.022446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.022961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.024356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.025242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.025715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.026150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.172982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:49.192540 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-adfea8bf-4900-4a57-ae84-1a6e94917bc0 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 200 len: 1475 microversion: 2.1 time: 0.927002 Oct 17 13:37:49.196795 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2596/5204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:48 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 1475 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:49.210252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:49.211581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:49.222444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.223818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.224479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:49.228612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:49.229815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:49.234055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.076948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.086566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2a779c2-9c70-4457-a89a-375ca598cec6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1273 microversion: 2.1 time: 0.888317 Oct 17 13:37:50.096815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2597/5205] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:49 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1273 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.107421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-346604a3-8088-40b3-8fad-6c4cfdaa0a11 req-13ff85b1-918b-4ff1-bb59-b3936b2a811a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06032b3e-136e-4489-b950-8c2f2a527957", "name": "network-vif-deleted", "tag": "c0f19e62-9a14-4c10-b7a3-dc993f49b7af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:50.130435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-346604a3-8088-40b3-8fad-6c4cfdaa0a11 req-13ff85b1-918b-4ff1-bb59-b3936b2a811a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.130918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-346604a3-8088-40b3-8fad-6c4cfdaa0a11 req-13ff85b1-918b-4ff1-bb59-b3936b2a811a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.131348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-346604a3-8088-40b3-8fad-6c4cfdaa0a11 req-13ff85b1-918b-4ff1-bb59-b3936b2a811a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.161211 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-346604a3-8088-40b3-8fad-6c4cfdaa0a11 req-13ff85b1-918b-4ff1-bb59-b3936b2a811a service nova] Creating event network-vif-deleted:c0f19e62-9a14-4c10-b7a3-dc993f49b7af for instance 06032b3e-136e-4489-b950-8c2f2a527957 on n-h2-854121-14 Oct 17 13:37:50.171052 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-346604a3-8088-40b3-8fad-6c4cfdaa0a11 req-13ff85b1-918b-4ff1-bb59-b3936b2a811a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073039 Oct 17 13:37:50.171795 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2598/5206] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:50.176917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.181797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.203309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.203771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.204416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.215767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.216687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.217331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.395179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.422279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-152682e6-fbe3-4a27-8fe1-3f6d2b7b2714 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1480 microversion: 2.1 time: 1.431362 Oct 17 13:37:50.423612 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2609/5207] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:48 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1480 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.431891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.432631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 06032b3e-136e-4489-b950-8c2f2a527957] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.460431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.460940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.461407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.462127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.462584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.463008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.498525 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance 06032b3e-136e-4489-b950-8c2f2a527957 could not be found. Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 HTTP/1.1 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 06032b3e-136e-4489-b950-8c2f2a527957 could not be found. Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '06032b3e-136e-4489-b950-8c2f2a527957'} Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06032b3e-136e-4489-b950-8c2f2a527957 could not be found. Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06032b3e-136e-4489-b950-8c2f2a527957 could not be found. Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:50.500717 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06032b3e-136e-4489-b950-8c2f2a527957 could not be found. Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance 06032b3e-136e-4489-b950-8c2f2a527957 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e04dd63-c464-495e-9e94-a128f98e6f85 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957" status: 404 len: 111 microversion: 2.1 time: 0.076420 Oct 17 13:37:50.504853 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2610/5208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/06032b3e-136e-4489-b950-8c2f2a527957 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:50.510766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-11b21d50-1a12-4498-abf0-a88c397eff5c req-19034cbc-6827-467f-bed5-b0c9b7932ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af9f45a-b03a-42ea-ad28-e4cbb0184a9a", "name": "network-vif-unplugged", "status": "completed", "tag": "bbf58c74-c698-4fd8-a37c-e0a09681b906"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:50.522704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-11b21d50-1a12-4498-abf0-a88c397eff5c req-19034cbc-6827-467f-bed5-b0c9b7932ebf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.523514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-11b21d50-1a12-4498-abf0-a88c397eff5c req-19034cbc-6827-467f-bed5-b0c9b7932ebf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.524137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-11b21d50-1a12-4498-abf0-a88c397eff5c req-19034cbc-6827-467f-bed5-b0c9b7932ebf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.542658 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-11b21d50-1a12-4498-abf0-a88c397eff5c req-19034cbc-6827-467f-bed5-b0c9b7932ebf service nova] Creating event network-vif-unplugged:bbf58c74-c698-4fd8-a37c-e0a09681b906 for instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a on n-h2-854121-14 Oct 17 13:37:50.548949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-11b21d50-1a12-4498-abf0-a88c397eff5c req-19034cbc-6827-467f-bed5-b0c9b7932ebf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044000 Oct 17 13:37:50.550862 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2611/5209] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:50.557563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:50.558709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:50.567699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.568747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.569489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.570615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.571640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.572342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:50.902798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9258316116624b7181a18659867bd13b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed221c004a544c79cb496a7b24b831c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:50.911817 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ab3edd3-5172-49c6-916c-51c549154d4a tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 200 len: 1522 microversion: 2.1 time: 0.738878 Oct 17 13:37:50.919664 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2599/5210] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 1522 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:50.980338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-862ab733-296b-4152-9441-8942f55649a9 req-337352ba-7241-4403-b658-b5e0a7526cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebec799c-df30-4d3d-9947-9ab16c8365d0", "name": "network-vif-deleted", "tag": "0622d030-b335-4225-b818-f277b4b0383e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:50.996180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-862ab733-296b-4152-9441-8942f55649a9 req-337352ba-7241-4403-b658-b5e0a7526cc2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:50.996667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-862ab733-296b-4152-9441-8942f55649a9 req-337352ba-7241-4403-b658-b5e0a7526cc2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:50.997090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-862ab733-296b-4152-9441-8942f55649a9 req-337352ba-7241-4403-b658-b5e0a7526cc2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.049647 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-862ab733-296b-4152-9441-8942f55649a9 req-337352ba-7241-4403-b658-b5e0a7526cc2 service nova] Creating event network-vif-deleted:0622d030-b335-4225-b818-f277b4b0383e for instance ebec799c-df30-4d3d-9947-9ab16c8365d0 on n-h1-854121-14 Oct 17 13:37:51.068225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-862ab733-296b-4152-9441-8942f55649a9 req-337352ba-7241-4403-b658-b5e0a7526cc2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091020 Oct 17 13:37:51.071063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2600/5211] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:51.128604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.130467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.153967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.155292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.160139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.161691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.167655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.168353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.454930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:51.470187 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a32656f8-60ee-4e57-b0ce-9913d856f92b tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1474 microversion: 2.1 time: 0.917817 Oct 17 13:37:51.471276 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2612/5212] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:50 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1474 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:51.478351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:51.478975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:51.523622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.524943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.527244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:51.528193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:51.530484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:51.532890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.108901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.132175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c4bebe1-f5b3-4ba1-bf9b-47c1b708097f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1315 microversion: 2.1 time: 1.012688 Oct 17 13:37:52.150627 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2601/5213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1315 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.176884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.180028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.182916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] [instance: ebec799c-df30-4d3d-9947-9ab16c8365d0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.189228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79d4b030-8844-490d-a140-d0dd27fa5772 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1480 microversion: 2.1 time: 0.714890 Oct 17 13:37:52.189969 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2613/5214] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:51 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1480 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:52.194955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.195753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.196429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.197490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.198276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.199066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.216699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1a977f9b-9b83-4175-b98f-1e399f1ab194 req-547c152e-8234-46f2-aff3-5e2fc86cdfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f661374-0ad9-401b-9177-c62128ff2257", "tag": "c6ae6435-3d70-4d00-b3c1-16bd9e719a88"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:52.248423 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] HTTP exception thrown: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 could not be found. Oct 17 13:37:52.251598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1a977f9b-9b83-4175-b98f-1e399f1ab194 req-547c152e-8234-46f2-aff3-5e2fc86cdfe2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Request method failure captured: Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 HTTP/1.1 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVl9GemZE9cAmp7AEu7L0P4OPnlVXq6FZx7DtcPtRt-zbqOqG49jyF6EU4Qt7nAl8jnwqSQWidi0iUDCI7P4X9Jz_ZzpZ7EZZ7vM3O8QQHs0fNRQMrpj_-F7nTjbxPR-jc47VZrw8nsgi2xLBXYkL-F6Px1lLUxE0JcYhlynZo8NnUc Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_6ed221c004a544c79cb496a7b24b831c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 6ed221c004a544c79cb496a7b24b831c Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1071738742 Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 9258316116624b7181a18659867bd13b Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1071738742-project Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 could not be found. Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'ebec799c-df30-4d3d-9947-9ab16c8365d0'} Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 could not be found. Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 could not be found. Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.253314 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 could not be found. Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:52.259470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] Returning 404 to user: Instance ebec799c-df30-4d3d-9947-9ab16c8365d0 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:52.261294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1a977f9b-9b83-4175-b98f-1e399f1ab194 req-547c152e-8234-46f2-aff3-5e2fc86cdfe2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.262192 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40ee21be-6ad8-4a7c-a269-f7ec5be6204b tempest-ServerRescueNegativeTestJSON-1071738742 tempest-ServerRescueNegativeTestJSON-1071738742-project] 10.222.0.65 "GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0" status: 404 len: 111 microversion: 2.1 time: 0.104893 Oct 17 13:37:52.262844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1a977f9b-9b83-4175-b98f-1e399f1ab194 req-547c152e-8234-46f2-aff3-5e2fc86cdfe2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.267869 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2602/5215] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] GET /compute/v2.1/servers/ebec799c-df30-4d3d-9947-9ab16c8365d0 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:52.306407 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1a977f9b-9b83-4175-b98f-1e399f1ab194 req-547c152e-8234-46f2-aff3-5e2fc86cdfe2 service nova] Creating event network-changed:c6ae6435-3d70-4d00-b3c1-16bd9e719a88 for instance 3f661374-0ad9-401b-9177-c62128ff2257 on n-h1-854121-14 Oct 17 13:37:52.320930 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1a977f9b-9b83-4175-b98f-1e399f1ab194 req-547c152e-8234-46f2-aff3-5e2fc86cdfe2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110779 Oct 17 13:37:52.325013 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2614/5216] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:52.497529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:52.498103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:52.505039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.512982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.513626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.514510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.515522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.521890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.604393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a6d0555d-e04f-49db-b0d5-c6097434ba8a req-242483e9-2140-4a8f-9221-26f66074b788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f789d693-646c-483d-9ae4-fe5988d5c4c3", "name": "network-vif-unplugged", "status": "completed", "tag": "90ab39cc-bbab-4ab6-a004-eae44b430694"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:52.642957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6d0555d-e04f-49db-b0d5-c6097434ba8a req-242483e9-2140-4a8f-9221-26f66074b788 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.646319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6d0555d-e04f-49db-b0d5-c6097434ba8a req-242483e9-2140-4a8f-9221-26f66074b788 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.649350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a6d0555d-e04f-49db-b0d5-c6097434ba8a req-242483e9-2140-4a8f-9221-26f66074b788 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.651228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:52.652724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:52.654361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:52.656072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lazy-loading 'fault' on Instance uuid 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:52.704480 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a6d0555d-e04f-49db-b0d5-c6097434ba8a req-242483e9-2140-4a8f-9221-26f66074b788 service nova] Creating event network-vif-unplugged:90ab39cc-bbab-4ab6-a004-eae44b430694 for instance f789d693-646c-483d-9ae4-fe5988d5c4c3 on n-h2-854121-14 Oct 17 13:37:52.730195 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a6d0555d-e04f-49db-b0d5-c6097434ba8a req-242483e9-2140-4a8f-9221-26f66074b788 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135446 Oct 17 13:37:52.734289 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2615/5217] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:52.753880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:52.766222 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2f007e4-83ca-4089-b722-4c5c6eb0c77e tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 200 len: 1309 microversion: 2.1 time: 0.272905 Oct 17 13:37:52.767617 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2603/5218] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:52 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 1309 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:53.133565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af9f45a-b03a-42ea-ad28-e4cbb0184a9a", "name": "network-vif-deleted", "tag": "bbf58c74-c698-4fd8-a37c-e0a09681b906"}, {"server_uuid": "f789d693-646c-483d-9ae4-fe5988d5c4c3", "name": "network-vif-deleted", "tag": "90ab39cc-bbab-4ab6-a004-eae44b430694"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:53.154232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.157687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.157929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.158679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.161442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.175703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:53.181010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] Creating event network-vif-deleted:bbf58c74-c698-4fd8-a37c-e0a09681b906 for instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a on n-h2-854121-14 Oct 17 13:37:53.181865 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] Creating event network-vif-deleted:90ab39cc-bbab-4ab6-a004-eae44b430694 for instance f789d693-646c-483d-9ae4-fe5988d5c4c3 on n-h2-854121-14 Oct 17 13:37:53.185575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.186197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.186652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.190411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.190884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.193078 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3ee09424-7c4a-4be2-be37-df8c5b62fb7c req-0284d17d-fa09-4b6d-8968-e812cea128e1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071765 Oct 17 13:37:53.194438 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2616/5219] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:53.198922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.221579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.226040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.260990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.264076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.266370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.267341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.270417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.271116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.319829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.320615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.321326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.322000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lazy-loading 'fault' on Instance uuid f789d693-646c-483d-9ae4-fe5988d5c4c3 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:53.490337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51a5b1d9a26a4fbf9db5c7ea49b0ccc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d2886e38a242ab9408cb7307f058cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.506098 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f2bcea2-ccf0-4c4b-a79a-0ae1db7cbbc3 tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 200 len: 1282 microversion: 2.1 time: 0.293922 Oct 17 13:37:53.507428 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2617/5220] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 1282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:53.704550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:53.715302 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b80f15c-0484-4086-bdb6-2df487be7511 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1315 microversion: 2.1 time: 0.561588 Oct 17 13:37:53.716051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2604/5221] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:53.795978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.796887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.809110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.811331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.812956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.815472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.816736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.817222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.863941 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a could not be found. Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a HTTP/1.1 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a could not be found. Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '6af9f45a-b03a-42ea-ad28-e4cbb0184a9a'} Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a could not be found. Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a could not be found. Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:53.872955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a could not be found. Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance 6af9f45a-b03a-42ea-ad28-e4cbb0184a9a could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50596c04-1af8-4c41-b0ce-5c5a11b33b45 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a" status: 404 len: 111 microversion: 2.1 time: 0.085255 Oct 17 13:37:53.879175 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2618/5222] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:53 2022] GET /compute/v2.1/servers/6af9f45a-b03a-42ea-ad28-e4cbb0184a9a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:53.888091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-293e5c61-9358-4f64-b140-13aa2410ec66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.925656 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-293e5c61-9358-4f64-b140-13aa2410ec66 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/6960bf96-04ad-403c-8562-3cab493e24d7" status: 204 len: 0 microversion: 2.1 time: 0.041468 Oct 17 13:37:53.926777 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2605/5223] 10.222.0.65 () {58 vars in 1266 bytes} [Mon Oct 17 13:37:53 2022] DELETE /compute/v2.1/os-server-groups/6960bf96-04ad-403c-8562-3cab493e24d7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:53.936134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:53.939552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:53.955677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.958888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.962440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.964114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:53.966095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:53.969266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:53.984658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:54.022982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:37:54.321036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:54.330934 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2eeee054-d12c-4d9e-85f7-ca6c4431193f tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "DELETE /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 204 len: 0 microversion: 2.1 time: 0.398053 Oct 17 13:37:54.338037 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2619/5224] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:37:53 2022] DELETE /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:37:54.346887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.347665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.365248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.366670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.367181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.374392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.375152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.375614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.531702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.532704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] [instance: f789d693-646c-483d-9ae4-fe5988d5c4c3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.544864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.545533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.545826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.549495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.549958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.553028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.581723 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] HTTP exception thrown: Instance f789d693-646c-483d-9ae4-fe5988d5c4c3 could not be found. Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Request method failure captured: Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 HTTP/1.1 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVm8o4w7GZZ57sD4FsMLT0xpGL_qzj15FNS05G3VY9-Ruw4U_UFuGjb5WfllTyjgClX-pLZBon58EoNLSQ5iur6tX5cWTzn0D0DzhftZEb-DF6_sazTsRlm_GoF9qLdEmDQ8MdbBzIq3HNiqSTM_7wVjjErpJBapDvmN544wE0ZyFxE Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_11d2886e38a242ab9408cb7307f058cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersTestJSON-617869357 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 11d2886e38a242ab9408cb7307f058cb Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersTestJSON-617869357 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersTestJSON-617869357-project Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 51a5b1d9a26a4fbf9db5c7ea49b0ccc7 Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersTestJSON-617869357-project Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance f789d693-646c-483d-9ae4-fe5988d5c4c3 could not be found. Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f789d693-646c-483d-9ae4-fe5988d5c4c3'} Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f789d693-646c-483d-9ae4-fe5988d5c4c3 could not be found. Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f789d693-646c-483d-9ae4-fe5988d5c4c3 could not be found. Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:54.583621 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:54.588131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:54.588131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:54.588131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:54.588131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:54.588131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f789d693-646c-483d-9ae4-fe5988d5c4c3 could not be found. Oct 17 13:37:54.588131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:37:54.590056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] Returning 404 to user: Instance f789d693-646c-483d-9ae4-fe5988d5c4c3 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:54.591155 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0be4e837-0d10-4220-b4d3-e8121b4e227e tempest-ServersTestJSON-617869357 tempest-ServersTestJSON-617869357-project] 10.222.0.65 "GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3" status: 404 len: 111 microversion: 2.1 time: 0.064404 Oct 17 13:37:54.596684 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2620/5225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/f789d693-646c-483d-9ae4-fe5988d5c4c3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:54.740083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:54.741728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:54.748218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.749041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.749763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.750958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:54.751634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:54.752312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:54.809407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:54.824166 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ea3a40d-f65f-4010-974d-af0bc79079a2 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1472 microversion: 2.1 time: 0.481877 Oct 17 13:37:54.824787 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2606/5226] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1472 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:55.494865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:55.507050 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-121d6d5f-0ccd-4816-b0b3-144ac49f99b2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1315 microversion: 2.1 time: 0.767822 Oct 17 13:37:55.511223 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2621/5227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:54 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1315 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:55.941945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:55.944542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:55.958843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.960788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.962462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:55.965641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:55.966374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:55.967648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.026446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:37:56.540251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:56.541259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:56.552888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.557875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.558495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:56.560611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:56.561368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:56.562003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.157671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:57.169735 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6cbcc701-101e-4e6c-aa56-e415b8e6a496 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1472 microversion: 2.1 time: 1.232197 Oct 17 13:37:57.170329 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2607/5228] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:55 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1472 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:57.302384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:57.316355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6776e22c-763e-43f0-a8e7-45d36c616959 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1315 microversion: 2.1 time: 0.780721 Oct 17 13:37:57.319865 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2622/5229] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:56 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:37:57.494853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9e16cb50-9c57-47db-a040-8aef0eaf39d3 req-b634ea1f-fd9a-486a-bc29-5271514cb362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509d327d-d2cb-4993-9f10-b5550138a4d7", "name": "network-vif-deleted", "tag": "f49487c7-680d-46f2-9563-3549e8d4f532"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:57.518299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e16cb50-9c57-47db-a040-8aef0eaf39d3 req-b634ea1f-fd9a-486a-bc29-5271514cb362 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.521571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e16cb50-9c57-47db-a040-8aef0eaf39d3 req-b634ea1f-fd9a-486a-bc29-5271514cb362 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.522284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-bca7ca3a-9c5d-4ef6-b5a5-a40160b4e2af req-ed35e91f-d295-4231-a0be-84af30af7e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f661374-0ad9-401b-9177-c62128ff2257", "name": "network-vif-plugged", "status": "completed", "tag": "c6ae6435-3d70-4d00-b3c1-16bd9e719a88"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:37:57.522861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9e16cb50-9c57-47db-a040-8aef0eaf39d3 req-b634ea1f-fd9a-486a-bc29-5271514cb362 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.555793 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9e16cb50-9c57-47db-a040-8aef0eaf39d3 req-b634ea1f-fd9a-486a-bc29-5271514cb362 service nova] Creating event network-vif-deleted:f49487c7-680d-46f2-9563-3549e8d4f532 for instance 509d327d-d2cb-4993-9f10-b5550138a4d7 on n-h1-854121-14 Oct 17 13:37:57.562878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bca7ca3a-9c5d-4ef6-b5a5-a40160b4e2af req-ed35e91f-d295-4231-a0be-84af30af7e01 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:57.570444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bca7ca3a-9c5d-4ef6-b5a5-a40160b4e2af req-ed35e91f-d295-4231-a0be-84af30af7e01 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:57.571468 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9e16cb50-9c57-47db-a040-8aef0eaf39d3 req-b634ea1f-fd9a-486a-bc29-5271514cb362 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080702 Oct 17 13:37:57.572540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bca7ca3a-9c5d-4ef6-b5a5-a40160b4e2af req-ed35e91f-d295-4231-a0be-84af30af7e01 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:57.574503 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2608/5230] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:57.629035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-bca7ca3a-9c5d-4ef6-b5a5-a40160b4e2af req-ed35e91f-d295-4231-a0be-84af30af7e01 service nova] Creating event network-vif-plugged:c6ae6435-3d70-4d00-b3c1-16bd9e719a88 for instance 3f661374-0ad9-401b-9177-c62128ff2257 on n-h1-854121-14 Oct 17 13:37:57.667239 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-bca7ca3a-9c5d-4ef6-b5a5-a40160b4e2af req-ed35e91f-d295-4231-a0be-84af30af7e01 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149902 Oct 17 13:37:57.677764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2623/5231] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:37:58.199538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.201635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.220508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.221088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.223631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.227590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.228121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.228569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.305891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.306696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.307339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.308061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lazy-loading 'fault' on Instance uuid 509d327d-d2cb-4993-9f10-b5550138a4d7 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:37:58.344518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:58.345266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:58.367642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.369253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.369924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.371152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:58.371859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:58.374892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:58.464803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cbdae957ed942b6af3ad2a2efce7ca2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca30f56f7d2d4734a24b383da7ea958c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.475707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8e2d8785-9608-4e12-97a8-cf12b9d606b7 tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 200 len: 1306 microversion: 2.1 time: 0.282571 Oct 17 13:37:58.492526 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2609/5232] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 1306 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:58.924776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:37:58.948744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2271f34-998a-40bd-aba9-25c8f5e53f67 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1315 microversion: 2.1 time: 0.605444 Oct 17 13:37:58.951656 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2624/5233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:58 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:37:59.504337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:59.504961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] [instance: 509d327d-d2cb-4993-9f10-b5550138a4d7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:37:59.524575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.526964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.527696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.530594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:37:59.532354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:37:59.534855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:37:59.576536 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] HTTP exception thrown: Instance 509d327d-d2cb-4993-9f10-b5550138a4d7 could not be found. Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Request method failure captured: Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 HTTP/1.1 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVnEqpWw4YvdWIFvD40-At7G_iPnYWOxE3MwVCHElBScCMwJTSi-YeDuPtCFjDqL4mZy7a6m1UaDJ8o6JGh6z_i3zkKrr3aBl1lhn6VRFyJVQOO54DWAY8zU20qA009g7nqpL72GN7_fVaRMjgzzqys15gAUBluCImDRlOmGdqBnqhI Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ca30f56f7d2d4734a24b383da7ea958c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: ca30f56f7d2d4734a24b383da7ea958c Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1375979911 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 8cbdae957ed942b6af3ad2a2efce7ca2 Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersOnMultiNodesTest-1375979911-project Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 509d327d-d2cb-4993-9f10-b5550138a4d7 could not be found. Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '509d327d-d2cb-4993-9f10-b5550138a4d7'} Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509d327d-d2cb-4993-9f10-b5550138a4d7 could not be found. Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509d327d-d2cb-4993-9f10-b5550138a4d7 could not be found. Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:37:59.581391 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509d327d-d2cb-4993-9f10-b5550138a4d7 could not be found. Oct 17 13:37:59.586812 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:37:59.598556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] Returning 404 to user: Instance 509d327d-d2cb-4993-9f10-b5550138a4d7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:37:59.602650 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8bda68a-25a5-461b-a56c-bd30572fb25c tempest-ServersOnMultiNodesTest-1375979911 tempest-ServersOnMultiNodesTest-1375979911-project] 10.222.0.65 "GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7" status: 404 len: 111 microversion: 2.1 time: 0.103085 Oct 17 13:37:59.610222 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2610/5234] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:59 2022] GET /compute/v2.1/servers/509d327d-d2cb-4993-9f10-b5550138a4d7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:37:59.989029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:37:59.991036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.008790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.012281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.012281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.012281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.012281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.012904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.548542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:00.565065 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edccae22-c80c-45a7-b5a6-db9343268040 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1503 microversion: 2.1 time: 0.591127 Oct 17 13:38:00.567428 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2625/5235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:37:59 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1503 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:00.595583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:00.596681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:00.608620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.614727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.616288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.617683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:00.618405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:00.620356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:00.705660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'flavor' on Instance uuid 3f661374-0ad9-401b-9177-c62128ff2257 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:01.269991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08621b83-cc5c-464d-9e79-b14c1e3c1b82 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257/action" status: 202 len: 0 microversion: 2.1 time: 0.677300 Oct 17 13:38:01.272873 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2611/5236] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:38:00 2022] POST /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:38:01.281655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:01.283982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:01.307755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.310451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.313284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:01.314798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:01.318388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:01.319759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:03.229719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:03.316165 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a956d19-a898-4c03-8850-723ade0da97a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 2.034119 Oct 17 13:38:03.336301 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2626/5237] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:01 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:04.352629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:04.353981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:04.390386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.391398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.396749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:04.399491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:04.403803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:04.406160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:05.065946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:05.092679 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05448bbd-6249-4602-bfdd-6bce2dc98a4c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.747253 Oct 17 13:38:05.109458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2612/5238] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:04 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:06.130571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:06.131398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:06.135617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:06.190813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.191643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.192369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.193405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:06.198452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:06.200002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:06.797194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:06.810004 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c92e2637-adc7-4254-834b-9171212477fc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.695933 Oct 17 13:38:06.812451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2627/5239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:06 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:07.839151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:07.839918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:07.864862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.867037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.868039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:07.870784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:07.871976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:07.873968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:08.262867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:08.305346 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48d824b4-97d0-43a7-ad00-cdcc885b77ed tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.470599 Oct 17 13:38:08.306445 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2613/5240] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:07 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:09.303278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.308114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.311435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.312712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.314242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.316184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.324933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.332089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.333429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:09.348531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.354078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.356129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.356914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.358652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.359280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.411235 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de3ae914-f75a-4671-a382-5de228a59d37 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.688961 Oct 17 13:38:09.412129 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2628/5241] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:38:08 2022] GET /compute/v2.1/os-services => generated 949 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:09.425525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.430242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.430729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.431164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.431889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.432336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.432754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.510710 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5bd4bf2e-3d7e-45e6-828a-3538afb9030f tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?host=n-d-854121-14" status: 200 len: 581 microversion: 2.1 time: 0.088873 Oct 17 13:38:09.512074 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2629/5242] 10.222.0.65 () {58 vars in 1174 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/os-services?host=n-d-854121-14 => generated 581 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:09.527368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.531563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.532053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.532567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.533453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.533917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.534339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.575318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac0c760b-230f-47de-bb1a-9f94df1f4905 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.053620 Oct 17 13:38:09.607087 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2630/5243] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:09.618765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:09.628402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.636295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.647148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.648875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:09.654060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:09.654871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:09.687609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:09.707664 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f15d2f8e-3c2c-40c4-8284-78f4dc5ef251 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.376608 Oct 17 13:38:09.709815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2614/5244] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:09.744165 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49b3d19a-8552-48a4-98b6-da19d2acbe52 tempest-ServicesAdminTestJSON-785878641 tempest-ServicesAdminTestJSON-785878641-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.135219 Oct 17 13:38:09.745195 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2631/5245] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:38:09 2022] GET /compute/v2.1/os-services => generated 949 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:10.733143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:10.733792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:10.747941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.748456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.748923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:10.749674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:10.750542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:10.751007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:11.227931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:11.242139 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30c81824-add5-4c4d-99ba-a9d96bab5e8f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.512657 Oct 17 13:38:11.242766 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2615/5246] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:10 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:12.268570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:12.269147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:12.276488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.276978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.277445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.286507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:12.287452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:12.288103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:12.620294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:12.643431 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-335eee14-9dde-47eb-b6eb-211332aa0b15 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.378746 Oct 17 13:38:12.646830 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2632/5247] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:12 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:13.666680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a10f283-fea1-4220-9f6f-360ee20242af tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] Calling method '.version_select at 0x7f419d073d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.674087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:13.674706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:13.696543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.697064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.697595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:13.698337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:13.698800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:13.702328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:14.018836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:14.032973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-78faa9d0-f297-420c-8653-1181af88fa88 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.362056 Oct 17 13:38:14.036110 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2633/5248] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:14.130870 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a10f283-fea1-4220-9f6f-360ee20242af tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.996343 Oct 17 13:38:14.143660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2616/5249] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:38:13 2022] GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d/defaults => generated 371 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:14.144883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09f54a98-02ee-48c4-b7bf-bc739193eb62 tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] Calling method '.version_select at 0x7f419ce7be50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:15.062349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:15.063912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:15.071682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=84,nova_api:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:15.086347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:15.090682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:15.092521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:15.102554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:15.105348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:15.107635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:15.311241 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09f54a98-02ee-48c4-b7bf-bc739193eb62 tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d" status: 200 len: 371 microversion: 2.1 time: 1.171119 Oct 17 13:38:15.316026 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2634/5250] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:38:14 2022] GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d => generated 371 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:38:15.333475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-121b9dc9-7b5b-44a4-b16f-7e81bdae02d4 tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] Calling method '.version_select at 0x7f419cf3e1f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:15.831549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:15.845697 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72e2523b-0436-4389-a080-937530f65991 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.785739 Oct 17 13:38:15.849123 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2617/5251] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:15 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:15.893425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-121b9dc9-7b5b-44a4-b16f-7e81bdae02d4 tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d/defaults" status: 200 len: 371 microversion: 2.1 time: 0.564514 Oct 17 13:38:15.894470 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2635/5252] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:38:15 2022] GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d/defaults => generated 371 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:15.910599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d416d40-312f-4546-b9dd-7d6988bee700 tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] Calling method '.version_select at 0x7f419cd2cc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.184746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d416d40-312f-4546-b9dd-7d6988bee700 tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d" status: 200 len: 371 microversion: 2.1 time: 0.278610 Oct 17 13:38:16.187103 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2618/5253] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 13:38:15 2022] GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d => generated 371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:16.208133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9deb1d06-1bae-4c03-b352-cd5f22648bba tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] Calling method '.version_select at 0x7f419ce1e4c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.685847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9deb1d06-1bae-4c03-b352-cd5f22648bba tempest-QuotasTestJSON-1614344849 tempest-QuotasTestJSON-1614344849-project] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d?user_id=63181f853df44860abc08b7cad96e136" status: 200 len: 371 microversion: 2.1 time: 0.488122 Oct 17 13:38:16.695289 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2636/5254] 10.222.0.65 () {58 vars in 1323 bytes} [Mon Oct 17 13:38:16 2022] GET /compute/v2.1/os-quota-sets/bd8f79e0f875409eb5b02be2cb9b8f0d?user_id=63181f853df44860abc08b7cad96e136 => generated 371 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:16.873876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:16.875613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:16.887448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.888966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.892115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:16.895268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:16.897402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:16.899010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:17.256472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:17.267454 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a14e1811-f749-49b9-8de5-9f6063787641 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.398815 Oct 17 13:38:17.273723 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2619/5255] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:16 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:18.296379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:18.297268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:18.305252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.305838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.306757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.307588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:18.308143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:18.308789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:18.824109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:18.851268 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb93eecc-86ef-4f21-8149-38de362cbf40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.559246 Oct 17 13:38:18.868151 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2637/5256] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:18 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:19.880363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:19.886831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:19.901489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.901988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.902435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:19.903599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:19.903599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:19.904030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:20.545139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:20.554643 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-880af215-56e7-4f52-a362-78c94787aa21 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.678310 Oct 17 13:38:20.570104 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2620/5257] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:19 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:21.595475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:21.596281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:21.609218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:21.616370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.629102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.630316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:21.636351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:21.637504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:21.638139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:22.404464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:22.422667 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5fffa9fe-aa7d-4c29-a5ef-c6a42c4ba60e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.831026 Oct 17 13:38:22.423266 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2638/5258] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:21 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:23.451931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:23.452603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:23.479334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.480133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.480796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:23.482742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:23.484085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:23.485682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:24.165657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:24.187282 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1e23493-20d7-4f92-a8b3-f4053b1af7f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.740058 Oct 17 13:38:24.192958 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2621/5259] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:23 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:25.221054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:25.221727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:25.239697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.243546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.244028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.244764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:25.245256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:25.245693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:25.269523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:25.919920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:25.931205 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3932f9e-0320-4e8e-bb31-504108422354 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1509 microversion: 2.1 time: 0.714479 Oct 17 13:38:25.949548 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2639/5260] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:25 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1509 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:26.960827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:26.961487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:26.974001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:26.976756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.977307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.977794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:26.978528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:26.996315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:26.997047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:27.014640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:27.758559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:27.790807 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b17033c9-c81d-4d2e-a62c-5f0cc4b4b1af tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1530 microversion: 2.1 time: 0.834809 Oct 17 13:38:27.794501 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2622/5261] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:26 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1530 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:28.820139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:28.820850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:28.839710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:28.844062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.860149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.864032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:28.868680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:28.869999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:28.871979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:29.360793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:29.370104 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-615211ba-676b-450b-857c-8d2458ab0bd6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.556799 Oct 17 13:38:29.378041 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2640/5262] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:28 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:30.406657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:30.407417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:30.444585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.446806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.448804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.449810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:30.454528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:30.457189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:30.885770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:30.897764 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4591746-c2e5-429d-bb98-027f63064075 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.497325 Oct 17 13:38:30.899309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2623/5263] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:30 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:31.885758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1643643525", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "2c6fbf12-cb67-49a8-836c-8925cccb331f"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:31.926467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:31.927094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:31.956657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.957506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.960881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:31.961913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:31.965152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:31.970534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:32.043337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] validate_networks() for [('2c6fbf12-cb67-49a8-836c-8925cccb331f', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:32.836196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:32.846742 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbdad6fd-76d4-4f84-93d0-eb0a5828cdcb tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.924430 Oct 17 13:38:32.847384 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2624/5264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:31 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:33.251960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.255265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:33.280282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.282584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.283549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.293280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.294967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.295618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.421612 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fdc9139f-09f4-4f2d-8172-394df67d2896 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.169256 Oct 17 13:38:33.427929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2625/5265] 10.222.0.65 () {60 vars in 1343 bytes} [Mon Oct 17 13:38:33 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313/os-volume_attachments => generated 25 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:33.628227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:33.629103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:33.649079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.654741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.655763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.660869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:33.663675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:33.666195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:33.815282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:38:34.130973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:34.133150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:34.134113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:34.135238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:34.135890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:34.137233 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21eb19c9-e31c-4aa2-b77b-6d5b32ceb564 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 204 len: 0 microversion: 2.20 time: 0.513091 Oct 17 13:38:34.138210 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2626/5266] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:38:33 2022] DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 13:38:34.144023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.144800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:34.155177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.156246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.156986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.159490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.161770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.165407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.179700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.186226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.195337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.196102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.196574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.197002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.197259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Getting quotas for project 851c954f637d4d48b9122fd813a1a54f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:34.204303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Getting quotas for user da15f84d135f4d339445770b44e9578b and project 851c954f637d4d48b9122fd813a1a54f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:34.225256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:34.228574 n-d-854121-14 devstack@n-api.service[120698]: WARNING nova.utils [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1643643525 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-164364352 Oct 17 13:38:34.230189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:34.303462 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3d725739-7a2b-4771-8056-7962f47d8bb6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.938345 Oct 17 13:38:34.305508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2641/5267] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:34.311201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:34.312443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:34.322162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.323053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.323967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:34.325135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:34.326567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:34.327464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:35.348195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.361320 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91237bdd-44fa-42b5-af3d-8e3e7b7d77c3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 1.221757 Oct 17 13:38:35.362085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.378372 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2627/5268] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:35.385047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc028652-77ce-44a1-a2a6-1abb05ed96f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:35.404077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc028652-77ce-44a1-a2a6-1abb05ed96f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:35.417077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.418999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.420677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-463c10ea-d056-475a-bdb5-29eb009e6925 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 1.113622 Oct 17 13:38:35.448851 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2642/5269] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:34 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:35.789515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc028652-77ce-44a1-a2a6-1abb05ed96f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:35.804963 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc028652-77ce-44a1-a2a6-1abb05ed96f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1232 microversion: 2.1 time: 0.424286 Oct 17 13:38:35.828374 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2628/5270] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:35 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1232 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:36.410836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:36.411516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:36.427601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:36.434414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.435675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.438273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.441801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.446076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.449365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.456381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:36.457263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:36.487079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.489077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.490948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:36.495256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:36.497383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:36.501678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:39.739409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:39.759619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:39.763929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:39.765585 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b49ba50-9a23-4795-8ebe-32f6c0e3ffbc tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1724 microversion: 2.20 time: 3.314927 Oct 17 13:38:39.768643 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2629/5271] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:36 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1724 bytes in 3319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:39.780006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:39.781228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:39.790376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:39.791177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:39.791850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:39.792792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:39.793495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:39.794129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.103782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:40.114682 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68e241b0-5bdb-434f-9195-b906ad1d9474 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 3.707948 Oct 17 13:38:40.122098 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2643/5272] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:36 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 3716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:40.127159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b3531a11-e1c6-4caa-8eef-e1a4feda4a6c req-e10df1a9-bf94-4ee9-a3f7-06bb6bd8e8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f661374-0ad9-401b-9177-c62128ff2257", "name": "network-vif-plugged", "status": "completed", "tag": "c6ae6435-3d70-4d00-b3c1-16bd9e719a88"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:40.191535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b3531a11-e1c6-4caa-8eef-e1a4feda4a6c req-e10df1a9-bf94-4ee9-a3f7-06bb6bd8e8d7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.198073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b3531a11-e1c6-4caa-8eef-e1a4feda4a6c req-e10df1a9-bf94-4ee9-a3f7-06bb6bd8e8d7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.198642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b3531a11-e1c6-4caa-8eef-e1a4feda4a6c req-e10df1a9-bf94-4ee9-a3f7-06bb6bd8e8d7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.219697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b3531a11-e1c6-4caa-8eef-e1a4feda4a6c req-e10df1a9-bf94-4ee9-a3f7-06bb6bd8e8d7 service nova] Creating event network-vif-plugged:c6ae6435-3d70-4d00-b3c1-16bd9e719a88 for instance 3f661374-0ad9-401b-9177-c62128ff2257 on n-h1-854121-14 Oct 17 13:38:40.257041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b3531a11-e1c6-4caa-8eef-e1a4feda4a6c req-e10df1a9-bf94-4ee9-a3f7-06bb6bd8e8d7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130002 Oct 17 13:38:40.263195 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2644/5273] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:40.756099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:40.768288 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29d4834a-9c03-4db2-ae0c-258b474274da tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1290 microversion: 2.1 time: 0.997919 Oct 17 13:38:40.771555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2630/5274] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:39 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1290 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:40.804467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dbae2be-e1ba-4f52-8ede-70acd9029cf6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: .version_select at 0x7f419cde8d30>, body: {"keypair": {"name": "tempest-keypair-109968744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr+w5MJw3q+Fq1QustujtyemUdw2bZ2b9lMO2GYdWhs67VSXSYsYZ7JSz5B8E84PEFdOtnMEF8Abu8kQpOTbZSf5iImFaXcnceR/SlJlYXbT4DEMwGV0AhZj5JvV2/iYQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:40.807116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:40.808004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:40.834614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.843801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.845725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.846505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:40.846989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:40.851380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:40.870524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5dbae2be-e1ba-4f52-8ede-70acd9029cf6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:40.888525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5dbae2be-e1ba-4f52-8ede-70acd9029cf6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:40.979992 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5dbae2be-e1ba-4f52-8ede-70acd9029cf6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.715496 Oct 17 13:38:40.981099 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2645/5275] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:38:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:41.141572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.198541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.233635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:41.250315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:41.252191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:41.261186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-524e67b1-5c6f-4f2e-b819-53788a2dfab9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1657 microversion: 2.20 time: 0.458923 Oct 17 13:38:41.282153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2631/5276] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:40 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1657 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:41.799980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:41.801763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:41.823058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.823559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.824003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:41.826216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:41.828020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:41.828835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.868523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:42.888531 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68b3174a-dc6d-4a2c-b3cb-7923f12fdc4f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1290 microversion: 2.1 time: 1.088235 Oct 17 13:38:42.906180 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2632/5277] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:41 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1290 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:42.916523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:42.917489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:42.928789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.929642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.931572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:42.933324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:42.933998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:42.934630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.177499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.186347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.187805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.188994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e413d58e-844d-427d-aaa6-f64591c6ff38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1657 microversion: 2.20 time: 0.281018 Oct 17 13:38:43.196871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:43.202995 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2633/5278] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:42 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1657 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:43.211498 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c1e21be-2d7b-4f96-a099-ad127f65b09d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 2.073716 Oct 17 13:38:43.215780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-65b9db7e-edf2-4253-b7ce-d367f4ef166b req-32178a3d-a7ee-46b6-b910-d25d892fdf7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "name": "network-vif-unplugged", "status": "completed", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:43.219450 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2646/5279] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:41 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:43.256232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-65b9db7e-edf2-4253-b7ce-d367f4ef166b req-32178a3d-a7ee-46b6-b910-d25d892fdf7b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.256761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-65b9db7e-edf2-4253-b7ce-d367f4ef166b req-32178a3d-a7ee-46b6-b910-d25d892fdf7b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.257195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-65b9db7e-edf2-4253-b7ce-d367f4ef166b req-32178a3d-a7ee-46b6-b910-d25d892fdf7b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.315984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-65b9db7e-edf2-4253-b7ce-d367f4ef166b req-32178a3d-a7ee-46b6-b910-d25d892fdf7b service nova] Creating event network-vif-unplugged:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:38:43.336713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-65b9db7e-edf2-4253-b7ce-d367f4ef166b req-32178a3d-a7ee-46b6-b910-d25d892fdf7b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132355 Oct 17 13:38:43.337344 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2634/5280] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:43.914108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:43.915211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:43.926638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.938595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.942881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:43.943915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:43.950277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:43.951566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:44.181998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:44.231150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:44.231841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:44.247115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:44.247618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:44.248053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:44.266561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:44.267014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:44.267399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:44.829260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:44.844405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:44.847096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:44.849916 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a77af5d-7ba4-4745-99f9-1b6bca4ef25c tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1657 microversion: 2.20 time: 0.622870 Oct 17 13:38:44.852096 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2635/5281] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:44 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1657 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:38:44.858430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:44.859674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:44.902108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:44.903946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:44.904719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:44.909242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:44.913316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:44.914065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:45.479485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:45.492438 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-40888500-92bd-4c32-bdc9-c4630f48a0b0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 1.583164 Oct 17 13:38:45.495834 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2647/5282] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:43 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:45.521657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-48fa542a-4981-44c3-a112-28cd763b58a7 req-0c6906b1-e3c9-4e8d-a684-cca311fe7366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8faa31c3-68ee-4cc1-9c10-59fedd583313", "name": "network-vif-deleted", "tag": "03cfa6e2-664f-48de-8ac4-7d5cced01526"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:45.594792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-48fa542a-4981-44c3-a112-28cd763b58a7 req-0c6906b1-e3c9-4e8d-a684-cca311fe7366 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:45.596976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-48fa542a-4981-44c3-a112-28cd763b58a7 req-0c6906b1-e3c9-4e8d-a684-cca311fe7366 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:45.598023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-48fa542a-4981-44c3-a112-28cd763b58a7 req-0c6906b1-e3c9-4e8d-a684-cca311fe7366 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:45.703396 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-48fa542a-4981-44c3-a112-28cd763b58a7 req-0c6906b1-e3c9-4e8d-a684-cca311fe7366 service nova] Creating event network-vif-deleted:03cfa6e2-664f-48de-8ac4-7d5cced01526 for instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 on n-h2-854121-14 Oct 17 13:38:45.748503 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-48fa542a-4981-44c3-a112-28cd763b58a7 req-0c6906b1-e3c9-4e8d-a684-cca311fe7366 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246673 Oct 17 13:38:45.753633 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2648/5283] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:45.802120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:45.879612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:45.882103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:45.901154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:45.904879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:45.905794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:45.909232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:45.910081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:45.911240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:46.026217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:46.027443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:46.028197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:46.030881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lazy-loading 'fault' on Instance uuid 8faa31c3-68ee-4cc1-9c10-59fedd583313 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:38:46.357485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:46.386200 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-277ff942-22ef-430f-aaeb-6bfdd618870e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 1.532271 Oct 17 13:38:46.405223 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2636/5284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:44 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:46.412355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:46.430677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1666523689", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2795df-2862-45cf-a8ed-080978866cd4"}], "security_groups": [{"name": "tempest-securitygroup--1561069892"}], "key_name": "tempest-keypair-109968744", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:46.436442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:46.452970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa21bb7cfd2244a3ba5f0d3bdc41e437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c551f3219d4f78a100f1c60213c87a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:46.472522 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-355e557c-fd97-461c-9c64-84f5587e980a tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 200 len: 1372 microversion: 2.20 time: 0.597041 Oct 17 13:38:46.473379 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2649/5285] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:45 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 1372 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:38:46.486688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:46.522476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:46.523223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:46.580735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:46.581709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:46.582257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:46.589428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:46.595763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:46.596758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:48.246839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] validate_networks() for [('be2795df-2862-45cf-a8ed-080978866cd4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:38:48.576250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:48.594239 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbd90fe9-01f6-4e41-b289-0707e99b676c tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 2.072516 Oct 17 13:38:48.596975 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2650/5286] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:46 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:48.619297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:48.624663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:48.642644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:48.645296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:48.647515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:48.649642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:48.656796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:48.657666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.536290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:50.551940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9be4a2b3-89b1-4ae2-bd61-19e846cab5c1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 1.946688 Oct 17 13:38:50.557896 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2651/5287] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:48 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:50.573960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:50.574489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:50.625331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.626076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.626525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.639180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:50.639822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:50.640271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:50.754359 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] HTTP exception thrown: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Request method failure captured: Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 HTTP/1.1 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVjCBw7h_P3mKvp4spFDrMI71PuzaggJm7GSLgDW4OXVahCJakLHyMKheEuK3bYu4Of_GU7waQid8nNtGlg89P4cITe9Ji_mH72LxbO8bYB_8prp9zWqR53l9o_25u1wlslgJ7JBvnLDZgPiI2fr-rdjJwJCdS3QqJ7lMeB6snj86xY Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fa21bb7cfd2244a3ba5f0d3bdc41e437 Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8faa31c3-68ee-4cc1-9c10-59fedd583313'} Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.758054 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Returning 404 to user: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:38:50.764665 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f6b81a0-62ec-478d-904f-e63c12a761a6 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 404 len: 111 microversion: 2.20 time: 0.198942 Oct 17 13:38:50.789950 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2652/5288] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:38:50 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:38:50.923371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:51.580744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80b7475a-3778-4899-a1ea-e6260fc8b409 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Action: 'create', calling method: .version_select at 0x7f419ce07040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2145980120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6kRzBP79yrFkMYK4lWIaZYf1oM0CWgUvlWQqq3f0XDmMMCBUIgo04Mz+R7axZ5QJRktK+S7Hf+74q51GYWUUdxyghS/PsDXuIZqx/pkpF+PR39VkoHk7eviscUESkZ8Q=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:51.617298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-80b7475a-3778-4899-a1ea-e6260fc8b409 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Getting quotas for project 2f41ab167b724769806eab69c5e944bf. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:51.625079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-80b7475a-3778-4899-a1ea-e6260fc8b409 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Getting quotas for user f32f2340dcd144efb568e55679e758eb and project 2f41ab167b724769806eab69c5e944bf. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:51.687654 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80b7475a-3778-4899-a1ea-e6260fc8b409 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.895983 Oct 17 13:38:51.699558 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2653/5289] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:38:50 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:51.705298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:51.706149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:51.714799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.715568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.716183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:51.717723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:51.718400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:51.719007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.051190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:38:52.051718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:38:52.052982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:38:52.053764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:38:52.054253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:38:52.091040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.091600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.092029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.096063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.096545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.096990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.192334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:38:52.218112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:38:52.279411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:38:52.285326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:38:52.471191 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f044c075-1e4b-4d91-b264-837cbd00c52e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.068906 Oct 17 13:38:52.481133 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2637/5290] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:38:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 6083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:38:52.492932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc8f11ae-1ae0-42c9-b439-59d57a8076f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '.version_select at 0x7f419cbc9a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:52.540757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc8f11ae-1ae0-42c9-b439-59d57a8076f2 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784670233" status: 204 len: 0 microversion: 2.20 time: 0.058350 Oct 17 13:38:52.542230 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2638/5291] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:38:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784670233 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:38:52.571269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:52.576865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:52.592099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:52.604189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.606092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.607022 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bfd090a5-3f31-40f7-8bf7-9bc9db042ee0 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 0.905873 Oct 17 13:38:52.607681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.610077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.610564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.611014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.635119 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2654/5292] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:51 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:52.664335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-327ea343-3330-4703-ab1a-75f391db86ea req-8432c94d-2087-4d36-bf80-751159bd3422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06966ba-ff77-4aca-af73-ef0c7f82fa7d", "tag": "86098d82-0b66-4c32-b459-7b085d5cd7d6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:38:52.700271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-327ea343-3330-4703-ab1a-75f391db86ea req-8432c94d-2087-4d36-bf80-751159bd3422 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:52.702159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-327ea343-3330-4703-ab1a-75f391db86ea req-8432c94d-2087-4d36-bf80-751159bd3422 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:52.706058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-327ea343-3330-4703-ab1a-75f391db86ea req-8432c94d-2087-4d36-bf80-751159bd3422 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:52.760080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-327ea343-3330-4703-ab1a-75f391db86ea req-8432c94d-2087-4d36-bf80-751159bd3422 service nova] Creating event network-changed:86098d82-0b66-4c32-b459-7b085d5cd7d6 for instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d on n-h1-854121-14 Oct 17 13:38:52.795156 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-327ea343-3330-4703-ab1a-75f391db86ea req-8432c94d-2087-4d36-bf80-751159bd3422 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158291 Oct 17 13:38:52.808189 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2655/5293] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:38:52.842187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82d8cb79-31e7-4426-80ae-447e63a32242 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:52.842676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82d8cb79-31e7-4426-80ae-447e63a32242 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:52.979767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82d8cb79-31e7-4426-80ae-447e63a32242 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:52.996799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82d8cb79-31e7-4426-80ae-447e63a32242 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1241 microversion: 2.1 time: 0.181465 Oct 17 13:38:52.997679 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2656/5294] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:52 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:53.142368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:53.154434 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-381e938f-ff63-4f3b-8d24-22db389635f2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.608980 Oct 17 13:38:53.156252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2639/5295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:52 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:53.658196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:53.660095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:53.713204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.724753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.725861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:53.726788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:53.727416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:53.728046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.024417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.025333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.048031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.052071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.053549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.055103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.060122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.061077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.108412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:54.201713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.210513 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b63e535e-b874-4d13-972b-7579580fd1d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1237 microversion: 2.1 time: 0.193078 Oct 17 13:38:54.216136 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2640/5296] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1237 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:54.223146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:54.223528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:54.243929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.244422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.244863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.245587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:54.246039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:54.246462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:54.336812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.366183 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94a07e8c-a8bb-4557-8aab-7a2ed21aa793 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 0.732913 Oct 17 13:38:54.366903 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2657/5297] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:53 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:54.848420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:54.861499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c96d69d-c43e-439e-9447-1fee4133d526 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.644214 Oct 17 13:38:54.862568 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2641/5298] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:54 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:55.241798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:55.243360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:55.258390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.259284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.262472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.263615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.267610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.268827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.395138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:55.396692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:55.408198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.413027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.414393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.415800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.417496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.418879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.893511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:55.900254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=82 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:38:55.906668 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5ec8125-0ab8-4dd2-9053-f36900a955fb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1293 microversion: 2.1 time: 0.668564 Oct 17 13:38:55.921246 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2658/5299] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:55 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1293 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:55.928743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:55.929123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:55.947491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.948040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.953866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:55.954712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:55.955202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:55.955640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.474922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:56.483337 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec6011bb-2db2-4db4-8877-51036598a6e2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 1.091996 Oct 17 13:38:56.483915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2642/5300] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:55 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:56.939888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:56.940703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:56.951163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.951709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.952153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.952883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:56.953385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:56.968442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:56.992024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:57.047800 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7d5df8d-6263-47ed-8c2a-1b7be40534f1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 1.133080 Oct 17 13:38:57.054473 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2659/5301] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:55 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:57.504786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:57.511986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:57.513378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:57.520978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8734aaf1-9074-4074-b58c-5a1b2d455ac0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1299 microversion: 2.1 time: 0.585649 Oct 17 13:38:57.521639 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2643/5302] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:56 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1299 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:38:57.529623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.538720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.540394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:57.541741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:57.542463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:57.546816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.071539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:58.072265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.084755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.101612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.103744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.104805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.106040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.107431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.821667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:58.837536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d0ec5fa-1670-4798-9c1b-460fe24c6530 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 1.329543 Oct 17 13:38:58.839056 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2660/5303] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:57 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:58.864628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:58.867098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:58.876945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.877994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.878652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:58.880302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:58.881015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:58.881773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.001734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:59.018785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61c80b33-8624-4fe8-8e41-e3c24a5d4dd4 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.951075 Oct 17 13:38:59.022213 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2644/5304] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:58 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:59.235579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:38:59.250920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39afe0db-6552-41f9-9956-d3022537085d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1299 microversion: 2.1 time: 0.388790 Oct 17 13:38:59.252063 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2661/5305] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:58 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1299 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:38:59.864681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:38:59.865286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:38:59.883990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.884493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.884937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:38:59.885769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:38:59.889834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:38:59.890297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.044881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:00.046469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:00.056508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.057383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.058048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:00.059014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:00.059754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:00.060456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.361249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:01.376622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a583912-cd3a-49a9-9df6-0b0910f81839 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 1.336038 Oct 17 13:39:01.378629 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2662/5306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:00 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:01.384542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:01.385155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:01.419553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.420137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.420774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.421715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.422234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.422697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.730184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:01.749454 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4833f8b7-3fa9-479b-aa2c-2bca9d6ec2fe tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 1.883004 Oct 17 13:39:01.777920 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2645/5307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:38:59 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:01.797612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:01.798628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:01.819442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.828875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.829643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.830914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.832042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.835226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:01.893334 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] HTTP exception thrown: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Request method failure captured: Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 HTTP/1.1 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjCBw7h_P3mKvp4spFDrMI71PuzaggJm7GSLgDW4OXVahCJakLHyMKheEuK3bYu4Of_GU7waQid8nNtGlg89P4cITe9Ji_mH72LxbO8bYB_8prp9zWqR53l9o_25u1wlslgJ7JBvnLDZgPiI2fr-rdjJwJCdS3QqJ7lMeB6snj86xY Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fa21bb7cfd2244a3ba5f0d3bdc41e437 Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '8faa31c3-68ee-4cc1-9c10-59fedd583313'} Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:01.906779 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:01.913091 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:01.917945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Returning 404 to user: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:01.922909 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df332069-7b16-4ab7-852b-804bc7d46b38 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 404 len: 111 microversion: 2.20 time: 0.139301 Oct 17 13:39:01.923964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2646/5308] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:39:01 2022] DELETE /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:01.940557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5c9ad32c-8b8b-4508-8e47-c3dec914a905 req-427d0b50-9645-43c2-acf2-ff7221094d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06966ba-ff77-4aca-af73-ef0c7f82fa7d", "name": "network-vif-plugged", "status": "completed", "tag": "86098d82-0b66-4c32-b459-7b085d5cd7d6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:01.991277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5c9ad32c-8b8b-4508-8e47-c3dec914a905 req-427d0b50-9645-43c2-acf2-ff7221094d5d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:01.994530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5c9ad32c-8b8b-4508-8e47-c3dec914a905 req-427d0b50-9645-43c2-acf2-ff7221094d5d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:01.997070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5c9ad32c-8b8b-4508-8e47-c3dec914a905 req-427d0b50-9645-43c2-acf2-ff7221094d5d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.016809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5c9ad32c-8b8b-4508-8e47-c3dec914a905 req-427d0b50-9645-43c2-acf2-ff7221094d5d service nova] Creating event network-vif-plugged:86098d82-0b66-4c32-b459-7b085d5cd7d6 for instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d on n-h1-854121-14 Oct 17 13:39:02.025752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5c9ad32c-8b8b-4508-8e47-c3dec914a905 req-427d0b50-9645-43c2-acf2-ff7221094d5d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100140 Oct 17 13:39:02.027517 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2647/5309] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:02.040785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:02.042098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 8faa31c3-68ee-4cc1-9c10-59fedd583313] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.055549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.056498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.057266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.058674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.060514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.061699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.111019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] HTTP exception thrown: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Request method failure captured: Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 HTTP/1.1 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVjCBw7h_P3mKvp4spFDrMI71PuzaggJm7GSLgDW4OXVahCJakLHyMKheEuK3bYu4Of_GU7waQid8nNtGlg89P4cITe9Ji_mH72LxbO8bYB_8prp9zWqR53l9o_25u1wlslgJ7JBvnLDZgPiI2fr-rdjJwJCdS3QqJ7lMeB6snj86xY Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: fa21bb7cfd2244a3ba5f0d3bdc41e437 Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '8faa31c3-68ee-4cc1-9c10-59fedd583313'} Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:02.113583 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. Oct 17 13:39:02.121651 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:02.140011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Returning 404 to user: Instance 8faa31c3-68ee-4cc1-9c10-59fedd583313 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:02.140899 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8cbd3c4-e912-4617-88af-f4d0064edbda tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313" status: 404 len: 111 microversion: 2.20 time: 0.111438 Oct 17 13:39:02.141623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2648/5310] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:02 2022] GET /compute/v2.1/servers/8faa31c3-68ee-4cc1-9c10-59fedd583313 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:02.407437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:02.409472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.440297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:02.445343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:02.451657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.454157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.456112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.457132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.460000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.460988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.539181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:02.557777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c0e5b4c4-3d7a-4884-8205-06bd99ea747f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1367 microversion: 2.1 time: 1.176603 Oct 17 13:39:02.563674 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2663/5311] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:01 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1367 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:02.784060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:02.785316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:02.799386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.806488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.807498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.814890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:02.817971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:02.819293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:02.986897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:03.859197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:03.876614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d70eeaf5-6853-4c81-bca2-0eca8864a589 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 1.472631 Oct 17 13:39:03.882822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2649/5312] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:02 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:03.898499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:03.899939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:03.924597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.925764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.929131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:03.935213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:03.936083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:03.939103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.640188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:04.650902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:04.658787 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-44d089d1-f62d-47f4-adce-81d976d4bf6b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1367 microversion: 2.1 time: 0.773456 Oct 17 13:39:04.659416 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2650/5313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:03 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1367 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:04.661961 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20618b63-4260-4097-8d9e-8f5108711668 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1332 microversion: 2.1 time: 1.882172 Oct 17 13:39:04.664771 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2664/5314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:02 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1332 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:04.908861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:04.909596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:04.930649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.931757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.934370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:04.935140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:04.935712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:04.936018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.200777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:05.213500 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ea15e71-c750-43f1-8420-eb1cfa5a69b6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1525 microversion: 2.1 time: 0.310167 Oct 17 13:39:05.229052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2651/5315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:04 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1525 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:05.239927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a980ff3b-dea2-4863-b6c6-a63f9b5fae5d req-517bc57d-578e-4e9a-b1a2-a346210e6c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888adf9b-f81d-46a5-8539-c89ff12a8eb5", "tag": "18735d3c-a2a7-4448-b9f6-1d0b56baaba9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:05.277097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a980ff3b-dea2-4863-b6c6-a63f9b5fae5d req-517bc57d-578e-4e9a-b1a2-a346210e6c45 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.280177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a980ff3b-dea2-4863-b6c6-a63f9b5fae5d req-517bc57d-578e-4e9a-b1a2-a346210e6c45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.280641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a980ff3b-dea2-4863-b6c6-a63f9b5fae5d req-517bc57d-578e-4e9a-b1a2-a346210e6c45 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.312637 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a980ff3b-dea2-4863-b6c6-a63f9b5fae5d req-517bc57d-578e-4e9a-b1a2-a346210e6c45 service nova] Creating event network-changed:18735d3c-a2a7-4448-b9f6-1d0b56baaba9 for instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 on n-h2-854121-14 Oct 17 13:39:05.331802 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a980ff3b-dea2-4863-b6c6-a63f9b5fae5d req-517bc57d-578e-4e9a-b1a2-a346210e6c45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098215 Oct 17 13:39:05.332428 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2665/5316] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:05.684060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:05.693222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:05.694197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:05.694493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:05.706451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.709883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.710615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.711647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.712434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.713699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.714896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.719210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.725313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:05.726613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:05.736167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:05.737109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:06.947518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:06.956108 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a6cc9ae5-0847-4149-871a-e77ba29f728e tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1535 microversion: 2.1 time: 1.271827 Oct 17 13:39:06.961703 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2666/5317] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:05 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1535 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:06.979911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:06.993763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:06.997192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:07.027698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.028212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.028664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.029427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:07.029890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:07.041318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:07.464509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:07.480588 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de6a80c2-d855-45be-a6a5-6a70bd0e92ec tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1367 microversion: 2.1 time: 1.794259 Oct 17 13:39:07.502600 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2652/5318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:05 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1367 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:07.524267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d60b06ee-17ed-4975-9a90-42d4fa556fc9 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'create', calling method: .version_select at 0x7f419cb54dc0>, body: {"pool": "0b535e39-028e-47fc-8e15-34be2f69795d"} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:08.241710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:08.260559 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a3c8094-b253-4534-afc2-e2594aea8914 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1507 microversion: 2.1 time: 1.294597 Oct 17 13:39:08.274296 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2667/5319] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:06 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1507 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:08.523593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:08.535491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:08.575850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.576355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.576802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:08.577561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:08.581420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:08.581809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.458465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:09.477454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80624c09-8d6c-4cd4-b2f9-95e0da39f2b3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1367 microversion: 2.1 time: 0.960201 Oct 17 13:39:09.494087 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2668/5320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:08 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1367 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:09.512339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:09.514863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:09.534570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.542555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.543156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:09.544013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:09.548637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:09.549304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.308696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:11.320103 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8510272c-8828-4cb4-97cf-9f305f175fc2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1507 microversion: 2.1 time: 1.824646 Oct 17 13:39:11.326312 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2669/5321] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:09 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1507 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:11.339522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-dc5367c1-9f20-408f-9fe9-7509933e2cd6 req-70cd46af-9ca5-4358-b0b5-550f44c7e871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f661374-0ad9-401b-9177-c62128ff2257", "name": "network-vif-unplugged", "status": "completed", "tag": "c6ae6435-3d70-4d00-b3c1-16bd9e719a88"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:11.372860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dc5367c1-9f20-408f-9fe9-7509933e2cd6 req-70cd46af-9ca5-4358-b0b5-550f44c7e871 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.373494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dc5367c1-9f20-408f-9fe9-7509933e2cd6 req-70cd46af-9ca5-4358-b0b5-550f44c7e871 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.374003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-dc5367c1-9f20-408f-9fe9-7509933e2cd6 req-70cd46af-9ca5-4358-b0b5-550f44c7e871 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.420273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-dc5367c1-9f20-408f-9fe9-7509933e2cd6 req-70cd46af-9ca5-4358-b0b5-550f44c7e871 service nova] Creating event network-vif-unplugged:c6ae6435-3d70-4d00-b3c1-16bd9e719a88 for instance 3f661374-0ad9-401b-9177-c62128ff2257 on n-h1-854121-14 Oct 17 13:39:11.435194 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-dc5367c1-9f20-408f-9fe9-7509933e2cd6 req-70cd46af-9ca5-4358-b0b5-550f44c7e871 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106140 Oct 17 13:39:11.437586 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2670/5322] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:11.461933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.464680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.482862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.485819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.486527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.489179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.491016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.493864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.542817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] HTTP exception thrown: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Request method failure captured: Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f HTTP/1.1 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVjCBw7h_P3mKvp4spFDrMI71PuzaggJm7GSLgDW4OXVahCJakLHyMKheEuK3bYu4Of_GU7waQid8nNtGlg89P4cITe9Ji_mH72LxbO8bYB_8prp9zWqR53l9o_25u1wlslgJ7JBvnLDZgPiI2fr-rdjJwJCdS3QqJ7lMeB6snj86xY Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fa21bb7cfd2244a3ba5f0d3bdc41e437 Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '82e45827-89b8-402f-befe-a8cb5d7d1e7f'} Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:11.548649 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:11.557258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:11.563924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Returning 404 to user: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:11.567218 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3cec4942-5662-4a10-8bda-a4e1fa3fb2a9 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 404 len: 111 microversion: 2.20 time: 0.125336 Oct 17 13:39:11.573098 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2671/5323] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:39:11 2022] DELETE /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:11.611854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:11.612943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:11.640438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.643015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.644216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:11.646902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:11.647891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:11.649717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.017372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:13.032107 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d24b4978-9e5b-4cf0-ba32-8977afeb8cf7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1367 microversion: 2.1 time: 1.455160 Oct 17 13:39:13.036777 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2672/5324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:11 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1367 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:13.051356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:13.053636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] [instance: 82e45827-89b8-402f-befe-a8cb5d7d1e7f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:13.073705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.074681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.077037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.079004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.081273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.081815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.118337 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] HTTP exception thrown: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Request method failure captured: Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f HTTP/1.1 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVjCBw7h_P3mKvp4spFDrMI71PuzaggJm7GSLgDW4OXVahCJakLHyMKheEuK3bYu4Of_GU7waQid8nNtGlg89P4cITe9Ji_mH72LxbO8bYB_8prp9zWqR53l9o_25u1wlslgJ7JBvnLDZgPiI2fr-rdjJwJCdS3QqJ7lMeB6snj86xY Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_f1c551f3219d4f78a100f1c60213c87a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: f1c551f3219d4f78a100f1c60213c87a Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-930620232 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: fa21bb7cfd2244a3ba5f0d3bdc41e437 Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-930620232-project Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '82e45827-89b8-402f-befe-a8cb5d7d1e7f'} Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:13.122955 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] Returning 404 to user: Instance 82e45827-89b8-402f-befe-a8cb5d7d1e7f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:13.127602 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90fe4637-7456-4b55-bb07-61c512285ba0 tempest-AttachVolumeShelveTestJSON-930620232 tempest-AttachVolumeShelveTestJSON-930620232-project] 10.222.0.65 "GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f" status: 404 len: 111 microversion: 2.20 time: 0.086568 Oct 17 13:39:13.135923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2673/5325] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:39:13 2022] GET /compute/v2.1/servers/82e45827-89b8-402f-befe-a8cb5d7d1e7f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:13.148437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:13.150991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:13.185500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.186185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.186958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:13.188716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:13.189913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:13.192310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:14.022035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:14.052286 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-255ecf79-faa6-4afa-af32-a967a21d5c58 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 200 len: 1450 microversion: 2.1 time: 0.914261 Oct 17 13:39:14.054444 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2674/5326] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:13 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 1450 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:14.068209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-640770210-access_point-1738841043", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "05243c23-52a7-4a27-9e28-d1f36b6724be"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2145980120", "security_groups": [{"name": "tempest-secgroup_access--1926132972"}, {"name": "tempest-secgroup_general--2129047322"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:14.608231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] validate_networks() for [('05243c23-52a7-4a27-9e28-d1f36b6724be', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:15.230834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d60b06ee-17ed-4975-9a90-42d4fa556fc9 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.726059 Oct 17 13:39:15.233294 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2653/5327] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:39:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:15.247235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:15.249303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:15.274911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.280265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.280265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:15.280265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:15.280265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:15.284100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.414959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:16.430035 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-20ea160b-4fa6-4981-9cd1-abdfc57d4031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1367 microversion: 2.1 time: 1.194988 Oct 17 13:39:16.430676 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2654/5328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:15 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1367 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:16.445328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:16.445328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:16.463546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.464035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.464469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.465223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.465684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.466114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.533250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:39:16.543451 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Working on deleting snapshot 711ed0c7-a9d3-4302-909f-3c1cf0da60ce from shelved instance... Oct 17 13:39:16.550852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:16.551384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:16.552492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:16.553101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:16.553707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:16.567272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.572798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.576167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.577365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.577997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.578723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:16.624289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Getting quotas for project 2f41ab167b724769806eab69c5e944bf. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:16.668580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Getting quotas for user f32f2340dcd144efb568e55679e758eb and project 2f41ab167b724769806eab69c5e944bf. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:16.720458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:16.726065 n-d-854121-14 devstack@n-api.service[120698]: WARNING nova.utils [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-640770210-access_point-1738841043 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-640770210-acc Oct 17 13:39:16.729247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:16.915105 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcfdd25a-66de-45bf-b063-b312d192cc6c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 2.852556 Oct 17 13:39:16.919490 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2675/5329] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:14 2022] POST /compute/v2.1/servers => generated 458 bytes in 2862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:16.949585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-bfafc9e0-5a1d-40ca-ad1f-ccf64e3fbcb9 req-ec6e43d2-0ba0-432f-8833-1d91b54dee51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888adf9b-f81d-46a5-8539-c89ff12a8eb5", "name": "network-vif-plugged", "status": "completed", "tag": "18735d3c-a2a7-4448-b9f6-1d0b56baaba9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:16.992708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bfafc9e0-5a1d-40ca-ad1f-ccf64e3fbcb9 req-ec6e43d2-0ba0-432f-8833-1d91b54dee51 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:16.995979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bfafc9e0-5a1d-40ca-ad1f-ccf64e3fbcb9 req-ec6e43d2-0ba0-432f-8833-1d91b54dee51 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:16.997191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bfafc9e0-5a1d-40ca-ad1f-ccf64e3fbcb9 req-ec6e43d2-0ba0-432f-8833-1d91b54dee51 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.029458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-bfafc9e0-5a1d-40ca-ad1f-ccf64e3fbcb9 req-ec6e43d2-0ba0-432f-8833-1d91b54dee51 service nova] Creating event network-vif-plugged:18735d3c-a2a7-4448-b9f6-1d0b56baaba9 for instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 on n-h2-854121-14 Oct 17 13:39:17.064250 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-bfafc9e0-5a1d-40ca-ad1f-ccf64e3fbcb9 req-ec6e43d2-0ba0-432f-8833-1d91b54dee51 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141883 Oct 17 13:39:17.068668 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2676/5330] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:17.103126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.194"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:17.113790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:17.151259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.152150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.153027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.154424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:17.155206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:17.156525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:17.208601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:39:17.210072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquired lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:39:18.227126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:18.232096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Doing local delete in cell 2dc2c531-2286-43dc-a2ad-63efe0ce97b9(cell1) {{(pid=120697) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 17 13:39:18.233569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:18.234851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:18.235651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:18.236673 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 17 13:39:18.243364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] deallocate_for_instance() {{(pid=120697) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 17 13:39:21.810902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Updating instance_info_cache with network_info: [] {{(pid=120697) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:39:22.029522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:22.096124 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d844f14-c335-4d3c-9a60-5016add1f05f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 204 len: 0 microversion: 2.1 time: 5.660495 Oct 17 13:39:22.096933 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2655/5331] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:16 2022] DELETE /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 0 bytes in 5666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:39:22.105418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.106395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.116593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.117405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.118625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.119993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.120199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.122007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.364904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:22.378504 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-710a56e9-80f1-4d1e-9776-943c09711279 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1352 microversion: 2.1 time: 0.278720 Oct 17 13:39:22.380646 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2656/5332] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:22.385604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:22.386267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:22.395406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.395958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.396425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.397128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:22.397629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:22.398060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:22.812940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:39:23.539419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:23.547706 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8915b125-3faa-43ba-81c2-a4e1d32284f5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1558 microversion: 2.1 time: 1.165901 Oct 17 13:39:23.551154 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2657/5333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:22 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1558 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:23.564251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2da6574c-d239-4eb5-88c8-68a7f3719308 req-3f587057-df19-49f8-bfd5-e3c362fc59f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f661374-0ad9-401b-9177-c62128ff2257", "name": "network-vif-deleted", "tag": "c6ae6435-3d70-4d00-b3c1-16bd9e719a88"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:23.615138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2da6574c-d239-4eb5-88c8-68a7f3719308 req-3f587057-df19-49f8-bfd5-e3c362fc59f7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.618071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2da6574c-d239-4eb5-88c8-68a7f3719308 req-3f587057-df19-49f8-bfd5-e3c362fc59f7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.619290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2da6574c-d239-4eb5-88c8-68a7f3719308 req-3f587057-df19-49f8-bfd5-e3c362fc59f7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.661325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_external_events [req-2da6574c-d239-4eb5-88c8-68a7f3719308 req-3f587057-df19-49f8-bfd5-e3c362fc59f7 service nova] Unable to find a host for instance 3f661374-0ad9-401b-9177-c62128ff2257. Dropping event network-vif-deleted {{(pid=120697) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 13:39:23.671245 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2da6574c-d239-4eb5-88c8-68a7f3719308 req-3f587057-df19-49f8-bfd5-e3c362fc59f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.114838 Oct 17 13:39:23.671950 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2658/5334] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 116 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 13:39:23.689948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:23.691025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:23.709727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.710236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.710683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.711406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.711862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.712281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.758868 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 HTTP/1.1 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3f661374-0ad9-401b-9177-c62128ff2257'} Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:23.762584 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:39:23.767845 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:23.772420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:23.776264 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9bcc900-f053-44db-a3df-798de1ab8aa8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 404 len: 111 microversion: 2.1 time: 0.098480 Oct 17 13:39:23.782093 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2659/5335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:23 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:23.796783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:23.797691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:23.815497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.819477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.820116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:23.823305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:23.829358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:23.830049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:24.994954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:25.007691 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f767e29-94a9-475a-959a-aef4a03728e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 1.224247 Oct 17 13:39:25.008540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2660/5336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:23 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:25.031189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:25.031699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:25.061084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:25.061647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:25.062277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.063033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:25.065442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:25.071156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:25.675105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fcea870-3cf5-4ab3-a959-db41b726867a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.652356 Oct 17 13:39:25.684837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2661/5337] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:39:25 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-interface => generated 285 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:25.695421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1342382345", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:25.793674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:39:26.592032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:26.699278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:26.941082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Updating instance_info_cache with network_info: [{"id": "86098d82-0b66-4c32-b459-7b085d5cd7d6", "address": "fa:16:3e:e4:c4:3f", "network": {"id": "2c6fbf12-cb67-49a8-836c-8925cccb331f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-553049400-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "851c954f637d4d48b9122fd813a1a54f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap86098d82-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:39:26.944602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=92 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:26.965032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Releasing lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:39:26.965971 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d5464bc-2cab-4b23-b7b2-9239ff53556f tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action" status: 202 len: 0 microversion: 2.1 time: 9.886548 Oct 17 13:39:26.966572 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2677/5338] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:17 2022] POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action => generated 0 bytes in 9897 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:39:26.972451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a2ffc27a-f7fc-4f21-a4b9-de641911682d req-63d00a91-01c4-4746-a1f0-0d16feba8ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06966ba-ff77-4aca-af73-ef0c7f82fa7d", "tag": "86098d82-0b66-4c32-b459-7b085d5cd7d6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:26.998502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a2ffc27a-f7fc-4f21-a4b9-de641911682d req-63d00a91-01c4-4746-a1f0-0d16feba8ede service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.000921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a2ffc27a-f7fc-4f21-a4b9-de641911682d req-63d00a91-01c4-4746-a1f0-0d16feba8ede service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.001679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a2ffc27a-f7fc-4f21-a4b9-de641911682d req-63d00a91-01c4-4746-a1f0-0d16feba8ede service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.034387 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a2ffc27a-f7fc-4f21-a4b9-de641911682d req-63d00a91-01c4-4746-a1f0-0d16feba8ede service nova] Creating event network-changed:86098d82-0b66-4c32-b459-7b085d5cd7d6 for instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d on n-h1-854121-14 Oct 17 13:39:27.039804 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a2ffc27a-f7fc-4f21-a4b9-de641911682d req-63d00a91-01c4-4746-a1f0-0d16feba8ede service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072002 Oct 17 13:39:27.040706 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2678/5339] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:27.046009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:27.046949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:27.067733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.068493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.069316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.070199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:27.070851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:27.071555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:27.698952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:27.708865 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ea6f282-ed14-4b96-9ff6-be412fa9ea81 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 0.666750 Oct 17 13:39:27.711987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2679/5340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:27 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:27.719145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f247e30e-1c65-4409-9fad-0c6a293537c1 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'create', calling method: .version_select at 0x7f419cf02280>, body: {"pool": "0b535e39-028e-47fc-8e15-34be2f69795d"} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:28.922477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:39:28.923075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:39:28.923863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:39:28.924398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:39:28.924709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:39:28.946376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.946877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.947315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:28.948064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:28.948538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:28.948942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.011746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:39:29.028329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:39:29.066330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:39:29.074982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:39:29.205875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cde2bd28-181c-43d6-942f-7fa4d1613d89 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.519471 Oct 17 13:39:29.206555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2662/5341] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:39:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:39:29.230015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:29.233327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:29.247308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.260245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.261188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:29.262854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:29.265932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:29.266662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.650157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.667929 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ec082a8-cc3a-4433-9fba-b013a23f678b tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 1.459846 Oct 17 13:39:30.668878 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2663/5342] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:29 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:30.673800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:30.685232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:30.692532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.693039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.693511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.694254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:30.694721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:30.695158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:30.941865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:30.953512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fbf48a8-bbd3-4448-8b59-2c5bd8a3e106 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1267 microversion: 2.1 time: 0.280896 Oct 17 13:39:30.969600 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2664/5343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:30 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:30.980439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9d87aa22-cd98-4c60-838d-a7c71d0b106f req-7c89412f-fd5e-46a3-b5aa-0cfa02efdced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fa5eb4-a737-49a1-98e2-228316235bee", "tag": "e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:31.008467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9d87aa22-cd98-4c60-838d-a7c71d0b106f req-7c89412f-fd5e-46a3-b5aa-0cfa02efdced service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.010001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9d87aa22-cd98-4c60-838d-a7c71d0b106f req-7c89412f-fd5e-46a3-b5aa-0cfa02efdced service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.017925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9d87aa22-cd98-4c60-838d-a7c71d0b106f req-7c89412f-fd5e-46a3-b5aa-0cfa02efdced service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.050780 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9d87aa22-cd98-4c60-838d-a7c71d0b106f req-7c89412f-fd5e-46a3-b5aa-0cfa02efdced service nova] Creating event network-changed:e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af for instance 20fa5eb4-a737-49a1-98e2-228316235bee on n-h1-854121-14 Oct 17 13:39:31.060316 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9d87aa22-cd98-4c60-838d-a7c71d0b106f req-7c89412f-fd5e-46a3-b5aa-0cfa02efdced service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088619 Oct 17 13:39:31.061409 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2665/5344] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:31.691891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:31.694317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:31.706509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.716087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.716917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:31.718025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:31.718746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:31.719404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.820411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:32.829572 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-226f29a4-5296-46a4-81e1-3020c38c4c0f tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 1.142358 Oct 17 13:39:32.838563 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2666/5345] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:31 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:32.849742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:32.850612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:32.857304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.857718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.858160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:32.858878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:32.869542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:32.870107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.358403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:33.374023 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00adb257-42c7-4d4f-8f8c-f68a2d3c4ba1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1273 microversion: 2.1 time: 0.533978 Oct 17 13:39:33.374895 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2667/5346] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:32 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1273 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:33.397413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-276638a7-4dbd-424d-81ff-25f75d46f35b req-de604150-3547-4953-8a9f-7bb801aea08e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888adf9b-f81d-46a5-8539-c89ff12a8eb5", "tag": "18735d3c-a2a7-4448-b9f6-1d0b56baaba9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:33.407508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-276638a7-4dbd-424d-81ff-25f75d46f35b req-de604150-3547-4953-8a9f-7bb801aea08e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.408334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-276638a7-4dbd-424d-81ff-25f75d46f35b req-de604150-3547-4953-8a9f-7bb801aea08e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.408983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-276638a7-4dbd-424d-81ff-25f75d46f35b req-de604150-3547-4953-8a9f-7bb801aea08e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.425436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-276638a7-4dbd-424d-81ff-25f75d46f35b req-de604150-3547-4953-8a9f-7bb801aea08e service nova] Creating event network-changed:18735d3c-a2a7-4448-b9f6-1d0b56baaba9 for instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 on n-h2-854121-14 Oct 17 13:39:33.431890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-276638a7-4dbd-424d-81ff-25f75d46f35b req-de604150-3547-4953-8a9f-7bb801aea08e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040049 Oct 17 13:39:33.432971 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2668/5347] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:33.867715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:33.869140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:33.883067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.883616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.887215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:33.888209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:33.890345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:33.890975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.790843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:34.816963 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aba2365a-f7ff-4e3e-b3e3-8a69e491a740 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 0.957296 Oct 17 13:39:34.821682 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2669/5348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:33 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:34.838404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:34.840718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:34.856470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.858423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.860774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:34.862632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:34.877423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:34.880578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.394843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:35.414283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-02e6605c-0ee4-4f1c-9fe0-5ed93acc0157 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1273 microversion: 2.1 time: 0.590639 Oct 17 13:39:35.421748 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2670/5349] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:34 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1273 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:35.854420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:35.855045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:35.868380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.869463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.870078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:35.871094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:35.871719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:35.872305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.008973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:37.028242 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-852cdc23-3d53-478f-a46d-0bba3d7c9958 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 1.176599 Oct 17 13:39:37.028920 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2671/5350] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:35 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:37.040336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:37.041339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:37.053432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.054623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.055262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.064813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:37.069679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.070241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.070710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.519279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f247e30e-1c65-4409-9fad-0c6a293537c1 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.804396 Oct 17 13:39:37.529826 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2680/5351] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:39:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:37.537664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.239"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:37.554715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:37.574705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.575693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.577670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.578787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:37.579942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:37.581135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:37.615158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:39:37.615999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquired lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:39:37.903633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:37.930176 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e32ac0f-d0d2-4c10-9b71-bfbed05ebf01 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 0.898113 Oct 17 13:39:37.931529 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2672/5352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:37 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:38.059913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:38.061398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:38.071634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:38.080596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:38.081365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:38.082833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:38.083596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:38.084200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:38.802193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:38.812440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2865c2ff-c206-483f-914c-57383a696799 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 0.758160 Oct 17 13:39:38.829751 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2673/5353] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:38 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:38.837886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f8812f29-4a32-4427-8c30-206981768c87 req-b0798abd-ba6b-4bfe-bcbb-bfc9807385e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fa5eb4-a737-49a1-98e2-228316235bee", "name": "network-vif-plugged", "status": "completed", "tag": "e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:38.861931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8812f29-4a32-4427-8c30-206981768c87 req-b0798abd-ba6b-4bfe-bcbb-bfc9807385e0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:38.862328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8812f29-4a32-4427-8c30-206981768c87 req-b0798abd-ba6b-4bfe-bcbb-bfc9807385e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:38.862760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8812f29-4a32-4427-8c30-206981768c87 req-b0798abd-ba6b-4bfe-bcbb-bfc9807385e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:38.868197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=87 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:38.891865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f8812f29-4a32-4427-8c30-206981768c87 req-b0798abd-ba6b-4bfe-bcbb-bfc9807385e0 service nova] Creating event network-vif-plugged:e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af for instance 20fa5eb4-a737-49a1-98e2-228316235bee on n-h1-854121-14 Oct 17 13:39:38.912489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f8812f29-4a32-4427-8c30-206981768c87 req-b0798abd-ba6b-4bfe-bcbb-bfc9807385e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084501 Oct 17 13:39:38.916278 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2674/5354] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:38.960864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:38.961720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:38.993738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:38.997324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:39.002361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:39.005325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:39.006999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:39.008241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:39.008874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:39.059125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:39.533790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d.", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:39:39.534494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Releasing lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:39:39.534954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.534954 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Request method failure captured: Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action HTTP/1.1 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 46 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVrWc16HAqHzA_mgaDHV2z_OidOTTQjvdkXo917ksWc2wbRKqEL4wSzTiUKOCarUsngxC032l9W22RBcx9MNBbiM6GKD1N759xe9xWYlMVJAf-8M5viBsZ8PaHd3lKMAZ6YRqoX_hZO2wiKH3uWbKvdyUI5LUTYbIHJq0Rd_QkGUv00 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: da15f84d135f4d339445770b44e9578b Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: {"addFloatingIp": {"address": "172.25.9.239"}} Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: exception: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a06966ba-ff77-4aca-af73-ef0c7f82fa7d', 'body': {'addFloatingIp': {'address': '172.25.9.239'}}} Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:39:39.537295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] Oct 17 13:39:39.543070 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:39.548189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Returning 400 to user: Cannot associate floating IP 172.25.9.239 (d8ef0555-458e-408c-a918-3c82285cfe57) with port 86098d82-0b66-4c32-b459-7b085d5cd7d6 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 0b535e39-028e-47fc-8e15-34be2f69795d. Oct 17 13:39:39.548189 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-5ba2ff11-7f56-4984-b42c-71db0dff19a7'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:39.548189 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-923a82bc-dafe-41c5-a118-fbd884f03844 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action" status: 400 len: 381 microversion: 2.1 time: 2.007165 Oct 17 13:39:39.548189 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2681/5355] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:37 2022] POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action => generated 381 bytes in 2008 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:39.554276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54b6dc3a-6151-48fa-a4e8-bb11f255bb9a tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '.version_select at 0x7f419cc485e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:39.847711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:39.886518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64e7ead2-768a-42ea-8bc6-a02168807215 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 0.928101 Oct 17 13:39:39.891744 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2675/5356] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:38 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:39.917547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:39.920312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:39.954820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:39.962249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:39.965250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:39.966188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:39.967965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:39.970831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.481490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:40.508956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94ff967a-0177-413b-9a93-479149a8bd5c tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1472 microversion: 2.1 time: 0.614801 Oct 17 13:39:40.512465 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2676/5357] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:39 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1472 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:40.846857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0cebab39-a0c8-4cf6-be4c-9b358056f48c req-c763feb9-45dc-4cf3-ada7-7d1be73b265a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afff062c-c8a2-4974-bed5-6ee07db0b1b7", "tag": "f00763bb-975a-4d60-a4c6-fec88795a153"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:40.868789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0cebab39-a0c8-4cf6-be4c-9b358056f48c req-c763feb9-45dc-4cf3-ada7-7d1be73b265a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.872732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0cebab39-a0c8-4cf6-be4c-9b358056f48c req-c763feb9-45dc-4cf3-ada7-7d1be73b265a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.873494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0cebab39-a0c8-4cf6-be4c-9b358056f48c req-c763feb9-45dc-4cf3-ada7-7d1be73b265a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.909908 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0cebab39-a0c8-4cf6-be4c-9b358056f48c req-c763feb9-45dc-4cf3-ada7-7d1be73b265a service nova] Creating event network-changed:f00763bb-975a-4d60-a4c6-fec88795a153 for instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 on n-h2-854121-14 Oct 17 13:39:40.921183 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0cebab39-a0c8-4cf6-be4c-9b358056f48c req-c763feb9-45dc-4cf3-ada7-7d1be73b265a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078789 Oct 17 13:39:40.930158 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2677/5358] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:40.949539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:40.950809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:40.962604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.963616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.964830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:40.965846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:40.969042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:40.970224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.294778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:41.309202 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ebcdb7f-0745-4b43-bd7b-a2ac4d6df6dc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 0.377243 Oct 17 13:39:41.330290 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2678/5359] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:40 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:41.539928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:41.540550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:41.553119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.555262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.556017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:41.556988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:41.561340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:41.564215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.148864 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54b6dc3a-6151-48fa-a4e8-bb11f255bb9a tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/d8ef0555-458e-408c-a918-3c82285cfe57" status: 202 len: 0 microversion: 2.1 time: 2.598936 Oct 17 13:39:42.150119 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2682/5360] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:39:39 2022] DELETE /compute/v2.1/os-floating-ips/d8ef0555-458e-408c-a918-3c82285cfe57 => generated 0 bytes in 2601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:39:42.162907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'action', calling method: .version_select at 0x7f41a04878b0>, body: {"removeFloatingIp": {"address": "172.25.9.194"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:42.319405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:42.334620 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87e0f3a0-9cbd-47cc-b839-faddf68bd707 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1643 microversion: 2.1 time: 0.797410 Oct 17 13:39:42.337130 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2679/5361] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:41 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1643 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:42.361985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:42.363140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:42.391434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.392342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.393029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.393874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.394475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.395745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.655697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:42.678688 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0608c4a4-5559-43c1-b1a7-fed5b00b5fab tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 0.321899 Oct 17 13:39:42.680273 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2680/5362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:42 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:42.690654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:42.692216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:42.709551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.710043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.710691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.712382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.713980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.716402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.803410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:42.816346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.828170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.829017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:42.831129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:42.831959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:42.834016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.287142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:43.299992 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34415225-44a0-4959-88ec-889f342c61b3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1643 microversion: 2.1 time: 0.617462 Oct 17 13:39:43.324055 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2681/5363] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:42 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1643 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:43.331550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:43.335064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:43.353540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.354337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.355018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.356051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:43.356847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:43.357594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:43.473146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:39:43.473805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquired lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:39:44.601513 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3587d6fd-4fb7-4810-8773-956a462f50ce tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1796 microversion: 2.1 time: 1.269085 Oct 17 13:39:44.602555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2682/5364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:43 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1796 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:45.158360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:45.159119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:45.175028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:45.177044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:45.178317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:45.180157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:45.182949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:45.183770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:45.732658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:39:46.118396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:46.135547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df70bc79-4bf1-4eb1-9bf8-fb57d4def239 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 1.531007 Oct 17 13:39:46.153190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2683/5365] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:44 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:46.153190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-26943330-71ee-466d-becd-b1ca76bd5277 req-3d3c99d8-31b6-4f67-9e4b-91030b6630a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a06966ba-ff77-4aca-af73-ef0c7f82fa7d", "tag": "86098d82-0b66-4c32-b459-7b085d5cd7d6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:46.183992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-26943330-71ee-466d-becd-b1ca76bd5277 req-3d3c99d8-31b6-4f67-9e4b-91030b6630a9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:46.184678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-26943330-71ee-466d-becd-b1ca76bd5277 req-3d3c99d8-31b6-4f67-9e4b-91030b6630a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:46.185234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-26943330-71ee-466d-becd-b1ca76bd5277 req-3d3c99d8-31b6-4f67-9e4b-91030b6630a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:46.200942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-26943330-71ee-466d-becd-b1ca76bd5277 req-3d3c99d8-31b6-4f67-9e4b-91030b6630a9 service nova] Creating event network-changed:86098d82-0b66-4c32-b459-7b085d5cd7d6 for instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d on n-h1-854121-14 Oct 17 13:39:46.207240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-26943330-71ee-466d-becd-b1ca76bd5277 req-3d3c99d8-31b6-4f67-9e4b-91030b6630a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067086 Oct 17 13:39:46.208346 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2684/5366] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:47.163768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:47.165383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:47.181473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.182354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.182972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.185964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.187133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.187768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.796875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:47.818707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd893a02-f97a-43b7-9d24-80381a9ec73c tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 0.656758 Oct 17 13:39:47.850725 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2685/5367] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:47 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:47.857430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-96078447-2179-4e30-9783-64906c0bf1fb req-435ce688-7fef-4643-bed6-197385732e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afff062c-c8a2-4974-bed5-6ee07db0b1b7", "name": "network-vif-plugged", "status": "completed", "tag": "f00763bb-975a-4d60-a4c6-fec88795a153"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:47.871884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-96078447-2179-4e30-9783-64906c0bf1fb req-435ce688-7fef-4643-bed6-197385732e16 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:47.872673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-96078447-2179-4e30-9783-64906c0bf1fb req-435ce688-7fef-4643-bed6-197385732e16 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:47.873355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-96078447-2179-4e30-9783-64906c0bf1fb req-435ce688-7fef-4643-bed6-197385732e16 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:47.891563 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-96078447-2179-4e30-9783-64906c0bf1fb req-435ce688-7fef-4643-bed6-197385732e16 service nova] Creating event network-vif-plugged:f00763bb-975a-4d60-a4c6-fec88795a153 for instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 on n-h2-854121-14 Oct 17 13:39:47.898659 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-96078447-2179-4e30-9783-64906c0bf1fb req-435ce688-7fef-4643-bed6-197385732e16 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046287 Oct 17 13:39:47.899887 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2686/5368] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:48.555405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Updating instance_info_cache with network_info: [{"id": "86098d82-0b66-4c32-b459-7b085d5cd7d6", "address": "fa:16:3e:e4:c4:3f", "network": {"id": "2c6fbf12-cb67-49a8-836c-8925cccb331f", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-553049400-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "851c954f637d4d48b9122fd813a1a54f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap86098d82-0b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:39:48.572854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Releasing lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:39:48.575266 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0da75607-f29b-4eda-a172-7184801ca281 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action" status: 202 len: 0 microversion: 2.1 time: 6.419101 Oct 17 13:39:48.590890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0995c8b5-7961-41fb-b5f8-d452228aa081 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '.version_select at 0x7f419cc0de50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:48.595268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2683/5369] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:42 2022] POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action => generated 0 bytes in 6422 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:39:48.845721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:48.846347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:48.859095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.862429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.864648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:48.868986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:48.870898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:48.873725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:49.464251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:49.482803 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c35d30b-f0ca-4664-be68-b0bea3ddc725 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1315 microversion: 2.1 time: 0.641499 Oct 17 13:39:49.483647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2684/5370] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:48 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:50.508966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:50.509717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:50.516582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.517406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.517835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.518783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.519446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.520116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.673045 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0995c8b5-7961-41fb-b5f8-d452228aa081 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/0fa62815-595c-424a-91a9-b63b5470beea" status: 202 len: 0 microversion: 2.1 time: 2.091318 Oct 17 13:39:50.679208 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2687/5371] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:39:48 2022] DELETE /compute/v2.1/os-floating-ips/0fa62815-595c-424a-91a9-b63b5470beea => generated 0 bytes in 2098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:39:50.686551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6089f766-54a5-4539-8a5e-09db7dd646e6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'action', calling method: .version_select at 0x7f41a0476b80>, body: {"addFloatingIp": {"address": ""}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6089f766-54a5-4539-8a5e-09db7dd646e6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Request method failure captured: Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action HTTP/1.1 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 34 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVrWc16HAqHzA_mgaDHV2z_OidOTTQjvdkXo917ksWc2wbRKqEL4wSzTiUKOCarUsngxC032l9W22RBcx9MNBbiM6GKD1N759xe9xWYlMVJAf-8M5viBsZ8PaHd3lKMAZ6YRqoX_hZO2wiKH3uWbKvdyUI5LUTYbIHJq0Rd_QkGUv00 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: da15f84d135f4d339445770b44e9578b Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: {"addFloatingIp": {"address": ""}} Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a06966ba-ff77-4aca-af73-ef0c7f82fa7d', 'body': {'addFloatingIp': {'address': ''}}} Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '' Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:39:50.696609 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 17 13:39:50.702270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:50.706790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6089f766-54a5-4539-8a5e-09db7dd646e6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:50.708480 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6089f766-54a5-4539-8a5e-09db7dd646e6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action" status: 400 len: 142 microversion: 2.1 time: 0.026745 Oct 17 13:39:50.709451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2688/5372] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:50 2022] POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action => generated 142 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:39:50.739334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:50.742461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:50.745781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:50.752321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.752912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.753466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.754769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:50.755287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:50.755842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:50.790219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:39:50.790895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquired lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:39:51.088307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:51.102587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dffb0da1-3b9b-4a84-a808-6103b2dd3de7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1502 microversion: 2.1 time: 0.594884 Oct 17 13:39:51.104864 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2685/5373] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:50 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1502 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:39:51.124056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Releasing lock "refresh_cache-a06966ba-ff77-4aca-af73-ef0c7f82fa7d" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:39:51.124802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] HTTP exception thrown: floating IP not found Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Request method failure captured: Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action HTTP/1.1 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 41 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVrWc16HAqHzA_mgaDHV2z_OidOTTQjvdkXo917ksWc2wbRKqEL4wSzTiUKOCarUsngxC032l9W22RBcx9MNBbiM6GKD1N759xe9xWYlMVJAf-8M5viBsZ8PaHd3lKMAZ6YRqoX_hZO2wiKH3uWbKvdyUI5LUTYbIHJq0Rd_QkGUv00 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: da15f84d135f4d339445770b44e9578b Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: exception: floating IP not found Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a06966ba-ff77-4aca-af73-ef0c7f82fa7d', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 17 13:39:51.127349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 17 13:39:51.131905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.139966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Returning 404 to user: floating IP not found {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:51.140739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7edd599a-b867-4ebc-9c0f-d0b72695c096 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:51.144086 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b99b62f1-8208-4e92-99a3-3217c9a9f9ca tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action" status: 404 len: 67 microversion: 2.1 time: 0.422390 Oct 17 13:39:51.147691 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2689/5374] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:50 2022] POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action => generated 67 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:39:51.164568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7edd599a-b867-4ebc-9c0f-d0b72695c096 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.165859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a169f8e7-cb8f-44ee-b24e-7a7509022a48 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:51.168892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7edd599a-b867-4ebc-9c0f-d0b72695c096 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.170183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7edd599a-b867-4ebc-9c0f-d0b72695c096 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.232887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7edd599a-b867-4ebc-9c0f-d0b72695c096 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:39:51.316941 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7edd599a-b867-4ebc-9c0f-d0b72695c096 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7/action" status: 202 len: 0 microversion: 2.1 time: 0.181360 Oct 17 13:39:51.318211 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2686/5375] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:51 2022] POST /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:39:51.339931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:51.340639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:51.353812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.355016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a169f8e7-cb8f-44ee-b24e-7a7509022a48 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 17 13:39:51.355270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.356150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a169f8e7-cb8f-44ee-b24e-7a7509022a48 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Request method failure captured: Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action HTTP/1.1 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 44 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVrWc16HAqHzA_mgaDHV2z_OidOTTQjvdkXo917ksWc2wbRKqEL4wSzTiUKOCarUsngxC032l9W22RBcx9MNBbiM6GKD1N759xe9xWYlMVJAf-8M5viBsZ8PaHd3lKMAZ6YRqoX_hZO2wiKH3uWbKvdyUI5LUTYbIHJq0Rd_QkGUv00 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: da15f84d135f4d339445770b44e9578b Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: exception: Floating IP not found for address 0.0.0.0. Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a06966ba-ff77-4aca-af73-ef0c7f82fa7d', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 17 13:39:51.356804 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a169f8e7-cb8f-44ee-b24e-7a7509022a48 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a169f8e7-cb8f-44ee-b24e-7a7509022a48 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action" status: 404 len: 88 microversion: 2.1 time: 0.205018 Oct 17 13:39:51.367640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2690/5376] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:39:51 2022] POST /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d/action => generated 88 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:39:51.369300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:51.369300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:51.371062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.371823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.372501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.389881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.390395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.390847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.391571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.392582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.393026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.486273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:39:51.727364 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78406b76-0c13-46a0-a8de-270677b76ce6 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "DELETE /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 204 len: 0 microversion: 2.1 time: 0.362072 Oct 17 13:39:51.728091 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2691/5377] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:39:51 2022] DELETE /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:39:51.738463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d6621fb9-1ff6-409f-97f8-9df03c93aa27 req-5f5fb3e3-0d46-4479-bc3e-9a3ebde4694c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fa5eb4-a737-49a1-98e2-228316235bee", "tag": "e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:51.763544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d6621fb9-1ff6-409f-97f8-9df03c93aa27 req-5f5fb3e3-0d46-4479-bc3e-9a3ebde4694c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.764314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d6621fb9-1ff6-409f-97f8-9df03c93aa27 req-5f5fb3e3-0d46-4479-bc3e-9a3ebde4694c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.765075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d6621fb9-1ff6-409f-97f8-9df03c93aa27 req-5f5fb3e3-0d46-4479-bc3e-9a3ebde4694c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.784196 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d6621fb9-1ff6-409f-97f8-9df03c93aa27 req-5f5fb3e3-0d46-4479-bc3e-9a3ebde4694c service nova] Creating event network-changed:e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af for instance 20fa5eb4-a737-49a1-98e2-228316235bee on n-h1-854121-14 Oct 17 13:39:51.791514 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d6621fb9-1ff6-409f-97f8-9df03c93aa27 req-5f5fb3e3-0d46-4479-bc3e-9a3ebde4694c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061837 Oct 17 13:39:51.792984 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2692/5378] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:51.803119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:51.804115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:51.813101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.814273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.817032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:51.818301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:51.819148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:51.820057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:52.182153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:52.208534 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac6e5501-e7c0-4211-bbbb-7ff91838ee5a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.876364 Oct 17 13:39:52.215388 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2687/5379] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:51 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:52.700943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:52.715063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fc91d13-1fe6-4449-b5d0-495ee8ecbfe5 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1541 microversion: 2.1 time: 0.919422 Oct 17 13:39:52.716140 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2693/5380] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:51 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1541 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:53.245087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:53.247658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:53.275648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:53.276505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:53.280401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:53.283873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:53.284948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:53.291659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:53.750724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:53.752181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:53.759327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:53.767190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:53.771513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:53.774147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:53.776893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:53.779534 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cfb6ca02-0276-45f1-86bb-06c44bc19d27 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.544080 Oct 17 13:39:53.780760 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2688/5381] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:53 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:53.781875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:53.782563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.365152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da15f84d135f4d339445770b44e9578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851c954f637d4d48b9122fd813a1a54f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:54.378046 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1be90bb-802f-4cef-a761-fd318ebe6dbd tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 200 len: 1541 microversion: 2.1 time: 0.636526 Oct 17 13:39:54.393919 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2694/5382] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:53 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 1541 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:54.534787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-46342b35-28c5-441b-a144-8e66cf11cc63 req-5e8eec9c-f75c-48e1-92a6-ab723c207dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a06966ba-ff77-4aca-af73-ef0c7f82fa7d", "name": "network-vif-deleted", "tag": "86098d82-0b66-4c32-b459-7b085d5cd7d6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:39:54.559720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-46342b35-28c5-441b-a144-8e66cf11cc63 req-5e8eec9c-f75c-48e1-92a6-ab723c207dd9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.575426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-46342b35-28c5-441b-a144-8e66cf11cc63 req-5e8eec9c-f75c-48e1-92a6-ab723c207dd9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.576841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-46342b35-28c5-441b-a144-8e66cf11cc63 req-5e8eec9c-f75c-48e1-92a6-ab723c207dd9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.627609 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-46342b35-28c5-441b-a144-8e66cf11cc63 req-5e8eec9c-f75c-48e1-92a6-ab723c207dd9 service nova] Creating event network-vif-deleted:86098d82-0b66-4c32-b459-7b085d5cd7d6 for instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d on n-h1-854121-14 Oct 17 13:39:54.643229 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-46342b35-28c5-441b-a144-8e66cf11cc63 req-5e8eec9c-f75c-48e1-92a6-ab723c207dd9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130471 Oct 17 13:39:54.659386 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2689/5383] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:39:54.804691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:54.805454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:54.819990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.821290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.822940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:54.825721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:54.826390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:54.829198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.413963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:55.415020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] [instance: a06966ba-ff77-4aca-af73-ef0c7f82fa7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:55.424569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.425405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.426284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.427427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:55.428200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:55.430411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:55.458217 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] HTTP exception thrown: Instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d could not be found. Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Request method failure captured: Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d HTTP/1.1 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVrWc16HAqHzA_mgaDHV2z_OidOTTQjvdkXo917ksWc2wbRKqEL4wSzTiUKOCarUsngxC032l9W22RBcx9MNBbiM6GKD1N759xe9xWYlMVJAf-8M5viBsZ8PaHd3lKMAZ6YRqoX_hZO2wiKH3uWbKvdyUI5LUTYbIHJq0Rd_QkGUv00 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_851c954f637d4d48b9122fd813a1a54f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 851c954f637d4d48b9122fd813a1a54f Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045 Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: da15f84d135f4d339445770b44e9578b Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d could not be found. Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a06966ba-ff77-4aca-af73-ef0c7f82fa7d'} Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d could not be found. Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d could not be found. Oct 17 13:39:55.461515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d could not be found. Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:39:55.467023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] Returning 404 to user: Instance a06966ba-ff77-4aca-af73-ef0c7f82fa7d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:39:55.468586 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89de9122-0742-4c86-936e-6d9a7ed8a5f2 tempest-FloatingIPsAssociationNegativeTestJSON-789078045 tempest-FloatingIPsAssociationNegativeTestJSON-789078045-project] 10.222.0.65 "GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d" status: 404 len: 111 microversion: 2.1 time: 0.062388 Oct 17 13:39:55.469781 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2690/5384] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:55 2022] GET /compute/v2.1/servers/a06966ba-ff77-4aca-af73-ef0c7f82fa7d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:39:55.692251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:55.695061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:55.703980 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af36fedf-28f5-43d2-b11e-e6d1533f89e2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.904743 Oct 17 13:39:55.722188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2695/5385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:54 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:56.728439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:56.729040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:56.738055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.751287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.752417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:56.765820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:56.766637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:56.769504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:57.519721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:57.522660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=64,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:39:57.549835 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6f0aaa9-cc1c-4203-b07d-0679a3c5e0a8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.812112 Oct 17 13:39:57.553314 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2691/5386] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:56 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:39:58.584481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:39:58.585283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:39:58.604097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.604777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.608547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:58.610886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:39:58.612583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:39:58.615354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:39:59.118995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:39:59.130095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6dfbdb8d-6428-4694-9b2f-9e118d219765 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.551159 Oct 17 13:39:59.131467 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2696/5387] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:39:58 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:00.154960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:00.156601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:00.181219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.189757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.190802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.198059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:00.199108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:00.200141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:00.769790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:00.795625 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba491b6e-6d45-4cef-865e-2e2e7858bff0 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.645121 Oct 17 13:40:00.800595 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2692/5388] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:00 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:01.828986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:01.829658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:01.854587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.855218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.855674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:01.856410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:01.856865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:01.857321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:02.685220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:02.699439 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91c6b5ea-7423-4e9a-87dd-40b085b14f44 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.875984 Oct 17 13:40:02.700046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2697/5389] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:01 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:03.731495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:03.732910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:03.773756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:03.786919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:03.787846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:03.790077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:03.796911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:03.797758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:04.344895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:04.359773 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abfcea8a-1e67-4dbb-8ef5-291da2654fe6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.634187 Oct 17 13:40:04.365024 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2693/5390] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:03 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:05.390610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:05.391730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:05.408694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:05.411050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:05.411700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.415700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:05.417787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:05.419927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:05.933255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:05.942313 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c4e3a8c-ea5b-4bb0-9427-65cfdee47a1d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.556709 Oct 17 13:40:05.946054 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2698/5391] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:05 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:06.973955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:06.977006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:06.992918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.993541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.993982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:06.994687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:06.995141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:06.995591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:07.654816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69ed4963-7275-46b4-bbe0-697dc15a33e0 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419cbde310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:07.990003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:08.011879 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-554e3d4a-daef-40af-8e7b-f4290dd8e9bc tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 1.048692 Oct 17 13:40:08.013098 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2694/5392] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:06 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:08.119817 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69ed4963-7275-46b4-bbe0-697dc15a33e0 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4" status: 200 len: 636 microversion: 2.1 time: 0.468730 Oct 17 13:40:08.124698 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2699/5393] 10.222.0.65 () {58 vars in 1233 bytes} [Mon Oct 17 13:40:07 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4 => generated 636 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:08.149589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7be5e79e-c276-4a9c-bf1f-2286f5a4a98e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419dea94c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:08.216502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=27 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:08.240297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7be5e79e-c276-4a9c-bf1f-2286f5a4a98e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:08.260730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7be5e79e-c276-4a9c-bf1f-2286f5a4a98e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:08.760429 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7be5e79e-c276-4a9c-bf1f-2286f5a4a98e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.616067 Oct 17 13:40:08.762833 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2695/5394] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:08 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:08.772887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-55fc6c83-0897-4fc8-94e5-60ab2eaa6c73 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419cbdedc0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.046085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.047509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:09.058470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.059999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.067285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.068077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:09.069276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:09.069276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:09.244186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-55fc6c83-0897-4fc8-94e5-60ab2eaa6c73 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "DELETE /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.476512 Oct 17 13:40:09.244817 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2700/5395] 10.222.0.65 () {58 vars in 1296 bytes} [Mon Oct 17 13:40:08 2022] DELETE /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata/os_version => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:09.254084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-14524988-2633-40ad-9ae5-370af6d91b7d tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f41a1ff5c10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:09.318630 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-14524988-2633-40ad-9ae5-370af6d91b7d tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 37 microversion: 2.1 time: 0.069437 Oct 17 13:40:09.319434 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2701/5396] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:09 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 37 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:09.335336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e70b1c50-c4f2-48b6-9f80-5a4ba87b27d4 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419ca249d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:09.510536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e70b1c50-c4f2-48b6-9f80-5a4ba87b27d4 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:09.540267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e70b1c50-c4f2-48b6-9f80-5a4ba87b27d4 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:09.684983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:09.695778 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1654aea8-9140-4719-bc3c-d27e78e83b93 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.663116 Oct 17 13:40:09.718952 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2696/5397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:09 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:10.039698 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e70b1c50-c4f2-48b6-9f80-5a4ba87b27d4 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.712339 Oct 17 13:40:10.040835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2702/5398] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:09 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:10.053986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f44d40c-5ff1-451e-8d08-583f67a8592b tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419cfd00d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:10.136577 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f44d40c-5ff1-451e-8d08-583f67a8592b tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.088353 Oct 17 13:40:10.136932 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2697/5399] 10.222.0.65 () {58 vars in 1290 bytes} [Mon Oct 17 13:40:10 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata/os_distro => generated 33 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:10.154988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83755610-49f2-4abb-a0c3-8725d340b683 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419ca24820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:10.271356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-83755610-49f2-4abb-a0c3-8725d340b683 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:10.280176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-83755610-49f2-4abb-a0c3-8725d340b683 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:10.577142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83755610-49f2-4abb-a0c3-8725d340b683 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.428406 Oct 17 13:40:10.578176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2703/5400] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:10 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:10.588778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3e3d825-5d3b-467f-83aa-774dbee3f655 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419df33e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:10.664223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3e3d825-5d3b-467f-83aa-774dbee3f655 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.079556 Oct 17 13:40:10.665606 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2698/5401] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:10 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:10.679216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e64b62c3-e6f0-47a7-8274-e98302096788 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419c9bf040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:10.728605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:10.730322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:10.753939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.755152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.758108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.761674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:10.763001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:10.765099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:10.775597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e64b62c3-e6f0-47a7-8274-e98302096788 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:10.790063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e64b62c3-e6f0-47a7-8274-e98302096788 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:11.044772 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e64b62c3-e6f0-47a7-8274-e98302096788 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.372625 Oct 17 13:40:11.045500 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2704/5402] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:10 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:40:11.055226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c6862a3-2302-402a-a4a3-02e449498c39 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419c9c53a0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:11.079172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:11.088178 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2c10ffe-f3ea-4ce8-957d-15205f233ed3 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.368085 Oct 17 13:40:11.088779 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2699/5403] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:10 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:11.135424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4c6862a3-2302-402a-a4a3-02e449498c39 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:11.147092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4c6862a3-2302-402a-a4a3-02e449498c39 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:11.783220 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c6862a3-2302-402a-a4a3-02e449498c39 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 64 microversion: 2.1 time: 0.732125 Oct 17 13:40:11.784065 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2705/5404] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:11 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 64 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:11.796229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ddf624f8-55c7-4c80-a92f-3ea7643d2a3c tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419cd4f550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:11.866893 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ddf624f8-55c7-4c80-a92f-3ea7643d2a3c tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 64 microversion: 2.1 time: 0.076952 Oct 17 13:40:11.867336 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2700/5405] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:11 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 64 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:11.879580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-afa9bf23-630d-4fe4-9537-2963c3f18ec2 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419cc0d160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:11.970480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-afa9bf23-630d-4fe4-9537-2963c3f18ec2 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:11.977879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-afa9bf23-630d-4fe4-9537-2963c3f18ec2 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:12.116177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:12.116770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:12.152741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.165985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.171358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.172398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:12.173065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:12.173678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:12.512951 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-afa9bf23-630d-4fe4-9537-2963c3f18ec2 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.638964 Oct 17 13:40:12.514553 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2706/5406] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:11 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:12.524670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e542832-77f5-4187-84eb-a233141a45f1 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update', calling method: .version_select at 0x7f419c9c5790>, body: {"meta": {"os_version": "alt"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:12.607476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-2e542832-77f5-4187-84eb-a233141a45f1 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:12.618481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-2e542832-77f5-4187-84eb-a233141a45f1 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:13.082950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e542832-77f5-4187-84eb-a233141a45f1 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.562372 Oct 17 13:40:13.083674 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2707/5407] 10.222.0.65 () {60 vars in 1313 bytes} [Mon Oct 17 13:40:12 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata/os_version => generated 31 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:40:13.094366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c11d476f-a2f5-4a10-940e-b7089bdcc912 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419c9fcc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:13.156269 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c11d476f-a2f5-4a10-940e-b7089bdcc912 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 58 microversion: 2.1 time: 0.065548 Oct 17 13:40:13.157780 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2708/5408] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:13 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 58 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:40:13.169725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b2491c1-9fed-4820-a672-e3a6e01ae305 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'update_all', calling method: .version_select at 0x7f419c9c5c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:13.186527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:13.198491 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55641d81-3dc1-4d24-acb1-69d4e0cb8261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 1.087494 Oct 17 13:40:13.214868 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2701/5409] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:12 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:13.254960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9b2491c1-9fed-4820-a672-e3a6e01ae305 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:13.261908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9b2491c1-9fed-4820-a672-e3a6e01ae305 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:13.565446 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b2491c1-9fed-4820-a672-e3a6e01ae305 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 61 microversion: 2.1 time: 0.400808 Oct 17 13:40:13.566450 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2709/5410] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:40:13 2022] PUT /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 61 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:13.577059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aca2185c-4616-4517-8c7c-6747d2ed929e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Action: 'create', calling method: .version_select at 0x7f419cf5b670>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:13.665106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-aca2185c-4616-4517-8c7c-6747d2ed929e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:13.673305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-aca2185c-4616-4517-8c7c-6747d2ed929e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Getting quotas for user 54bcaf5005e54bd280bf6054f2cffc5b and project a0c266c5405c4aae8d75c086c8bf1192. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:14.182481 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aca2185c-4616-4517-8c7c-6747d2ed929e tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "POST /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 85 microversion: 2.1 time: 0.608971 Oct 17 13:40:14.183757 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2702/5411] 10.222.0.65 () {60 vars in 1281 bytes} [Mon Oct 17 13:40:13 2022] POST /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 85 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:14.196822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4eee28b9-2c2c-4462-896a-dd0d7fb91443 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] Calling method '.version_select at 0x7f419c9df820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:14.227668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:14.229017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:14.242946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:14.246744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:14.247430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:14.248385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:14.249037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:14.250044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:14.279683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4eee28b9-2c2c-4462-896a-dd0d7fb91443 tempest-ImagesMetadataTestJSON-1058896842 tempest-ImagesMetadataTestJSON-1058896842-project] 10.222.0.65 "GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata" status: 200 len: 85 microversion: 2.1 time: 0.089421 Oct 17 13:40:14.289638 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2710/5412] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 13:40:14 2022] GET /compute/v2.1/images/0e1b042a-d509-409e-b815-21b29c1346f4/metadata => generated 85 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:40:14.856594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:14.866094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6701bf72-c9b6-49f0-94af-53b08966e49a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.643958 Oct 17 13:40:14.882042 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2703/5413] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:14 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:15.909575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:15.910874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:15.924872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:15.928818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:15.929667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:15.930702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:15.933102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:15.933830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:15.995964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=19 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:16.472729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:16.489542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b07f1ea5-a613-427f-a9c0-ce7e2fb472cf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1512 microversion: 2.1 time: 0.584563 Oct 17 13:40:16.494269 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2711/5414] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:15 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:17.520960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:17.524581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:17.560630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.560794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.561246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:17.561967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:17.563076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:17.563905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.650971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:18.654995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Calling method '.version_select at 0x7f419d073790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:18.661307 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e2eff35-92b0-4da9-8099-f5f10228f9d1 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1489 microversion: 2.1 time: 1.145374 Oct 17 13:40:18.673849 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2704/5415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:17 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1489 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:18.684154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.685075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.685733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.686807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:18.688039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:18.688559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.689029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.689488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.699809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.701434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.702779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.703999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.704685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.707791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.746127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:18.753098 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-158003d8-ddea-46a2-8e5e-740ca36ca070 tempest-AbsoluteLimitsTestJSON-2032530185 tempest-AbsoluteLimitsTestJSON-2032530185-project] 10.222.0.65 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.273461 Oct 17 13:40:18.755150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2712/5416] 10.222.0.65 () {58 vars in 1122 bytes} [Mon Oct 17 13:40:18 2022] GET /compute/v2.1/limits => generated 511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:40:18.944808 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e7e5bc7-fc2a-4fac-87bf-b91dfca6ef40 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 204 len: 0 microversion: 2.1 time: 0.262406 Oct 17 13:40:18.945748 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2705/5417] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:18 2022] DELETE /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:18.961374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:18.961927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:18.968889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.969426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.969888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:18.970615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:18.989009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:18.989958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:19.446227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:19.459255 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-948ea197-befa-4fe3-a9dc-1c0f975e5159 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1495 microversion: 2.1 time: 0.506125 Oct 17 13:40:19.459959 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2713/5418] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:18 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1495 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:20.497016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:20.499069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:20.524272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.530915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.532240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:20.538123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:20.538625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:20.539074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.829087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:21.842754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b763bb6-e543-4ad6-b056-7bf9bc29d078 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 200 len: 1495 microversion: 2.1 time: 1.360380 Oct 17 13:40:21.845053 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2706/5419] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:20 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 1495 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:21.864032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-82ff9638-ea8b-4240-998e-45b525757b66 req-d322b1f9-e48f-483f-936a-0fa81acadcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afff062c-c8a2-4974-bed5-6ee07db0b1b7", "name": "network-vif-deleted", "tag": "f00763bb-975a-4d60-a4c6-fec88795a153"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:21.886036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:21.891665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-82ff9638-ea8b-4240-998e-45b525757b66 req-d322b1f9-e48f-483f-936a-0fa81acadcf5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:21.892175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-82ff9638-ea8b-4240-998e-45b525757b66 req-d322b1f9-e48f-483f-936a-0fa81acadcf5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:21.892622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-82ff9638-ea8b-4240-998e-45b525757b66 req-d322b1f9-e48f-483f-936a-0fa81acadcf5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:21.913198 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-82ff9638-ea8b-4240-998e-45b525757b66 req-d322b1f9-e48f-483f-936a-0fa81acadcf5 service nova] Creating event network-vif-deleted:f00763bb-975a-4d60-a4c6-fec88795a153 for instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 on n-h2-854121-14 Oct 17 13:40:21.919726 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-82ff9638-ea8b-4240-998e-45b525757b66 req-d322b1f9-e48f-483f-936a-0fa81acadcf5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062285 Oct 17 13:40:21.921893 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2714/5420] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:22.868317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:22.868967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:22.881819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.882321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.882762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.883489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:22.883946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:22.884370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:22.920134 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 HTTP/1.1 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'afff062c-c8a2-4974-bed5-6ee07db0b1b7'} Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:40:22.922001 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:40:22.927803 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2da8d1e4-3a1a-45d9-b9fa-0663aadafad7 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 404 len: 111 microversion: 2.1 time: 0.062681 Oct 17 13:40:22.929389 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2707/5421] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:22 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:40:23.150542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1148265683", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "94199c41-6402-4ac0-b41f-c3805157456f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:23.273986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] validate_networks() for [('94199c41-6402-4ac0-b41f-c3805157456f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:24.317036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:24.317889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:24.318366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:24.318773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:24.319362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:24.339351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.340151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.340765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.341761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:24.342365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:24.342952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:24.395994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:24.416965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Getting quotas for user 119a4990e7724385ba4578c27f59e8ae and project 3995f968396b48b0be0966bf98a2a0f0. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:24.459819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:24.468371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:24.587010 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa942dff-5145-4876-a27d-19c7d7192221 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446531 Oct 17 13:40:24.605444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a9aec46-43ba-4afb-b2e9-b947617d8cbf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:24.606150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a9aec46-43ba-4afb-b2e9-b947617d8cbf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:24.608416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:24.611945 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2715/5422] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:40:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:24.929547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2a9aec46-43ba-4afb-b2e9-b947617d8cbf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:24.943489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a9aec46-43ba-4afb-b2e9-b947617d8cbf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1215 microversion: 2.1 time: 0.342101 Oct 17 13:40:24.957858 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2708/5423] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:24 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:25.973424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:25.974257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:25.986611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:25.987108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:25.987576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:25.989549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:26.000910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:26.003807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:26.285963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:26.295446 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5865eab5-96c3-4c86-9645-eb56d26927d9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1211 microversion: 2.1 time: 0.328565 Oct 17 13:40:26.297482 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2716/5424] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:25 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1211 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:27.325770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:27.326442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:27.351151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.351671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.352122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.355235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:27.357200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:27.357668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:27.587222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:27.596421 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e0bca43-edc7-46d7-bb66-9464a0af7130 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1273 microversion: 2.1 time: 0.275710 Oct 17 13:40:27.601367 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2709/5425] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:27 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:28.626510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:28.627139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:28.638476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.639437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.651153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.652229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:28.652898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:28.653529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:28.867295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:28.916712 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64dd64af-f32a-4af8-a818-106eca534068 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1273 microversion: 2.1 time: 0.272830 Oct 17 13:40:28.921046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2717/5426] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:28 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:29.950711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:29.951380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:29.959814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.960314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.960760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:29.961519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:29.961987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:29.962418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:31.324035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:31.331297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:31.361016 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d5fcf1d-6129-4762-bf8b-69bb0d8494da tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 1.414161 Oct 17 13:40:31.368182 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2710/5427] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:29 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:32.395353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:32.396147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:32.410289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.418708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.419466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:32.421801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:32.425686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:32.426558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:33.472694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:33.511063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0343fe1-9d4d-42ff-aec4-ce37b2ee7cbd tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 1.120505 Oct 17 13:40:33.513250 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2718/5428] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:32 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:34.538313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:34.539193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:34.560621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.561124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.564006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.564789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:34.565295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:34.565783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:34.934773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:35.990926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:36.002362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98b6e3e3-9d15-4352-b423-dd27bfae0703 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 1.468513 Oct 17 13:40:36.009070 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2711/5429] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:34 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:37.035704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:37.036338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:37.044457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:37.047811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:37.066613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.067835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.069064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.070110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.071025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.071784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.143507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8475b247-a360-4c47-bf0b-94d5a34ae1bd req-a1f961a3-782c-43fd-9fdb-9eb641c60671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2496c38c-b9a8-4651-8957-2d8953bcda7d", "tag": "2266a84a-21f4-4fad-a7e4-879eaa33e036"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:37.182500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8475b247-a360-4c47-bf0b-94d5a34ae1bd req-a1f961a3-782c-43fd-9fdb-9eb641c60671 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:37.187992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8475b247-a360-4c47-bf0b-94d5a34ae1bd req-a1f961a3-782c-43fd-9fdb-9eb641c60671 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:37.188703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8475b247-a360-4c47-bf0b-94d5a34ae1bd req-a1f961a3-782c-43fd-9fdb-9eb641c60671 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:37.224498 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8475b247-a360-4c47-bf0b-94d5a34ae1bd req-a1f961a3-782c-43fd-9fdb-9eb641c60671 service nova] Creating event network-changed:2266a84a-21f4-4fad-a7e4-879eaa33e036 for instance 2496c38c-b9a8-4651-8957-2d8953bcda7d on n-h1-854121-14 Oct 17 13:40:37.232130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8475b247-a360-4c47-bf0b-94d5a34ae1bd req-a1f961a3-782c-43fd-9fdb-9eb641c60671 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094606 Oct 17 13:40:37.233619 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2712/5430] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:39.005825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:39.030697 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61d3641e-bf62-4a25-8211-c331a2cbd644 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 2.002765 Oct 17 13:40:39.037338 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2719/5431] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:37 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:40.069107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:40.070703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:40.084279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:40.088620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.089153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.089628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.091240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:40.092234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:40.092870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:40.739868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:40.751338 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33f995b1-8794-44e2-94c1-b70896719bb2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 0.690310 Oct 17 13:40:40.752033 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2713/5432] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:40 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:41.776845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:41.777483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:41.795182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.796938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.807580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:41.809397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:41.810333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:41.810973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:42.897099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-181856625", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "914493e0-5879-4e6a-a391-b4c90cb4312d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2145980120", "security_groups": []}, "os:scheduler_hints": {"different_host": ["20fa5eb4-a737-49a1-98e2-228316235bee"]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:42.999864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] validate_networks() for [('914493e0-5879-4e6a-a391-b4c90cb4312d', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:43.218183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:43.235384 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fe64851-eb1e-464e-84df-fb3fe9c2d475 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 1.463452 Oct 17 13:40:43.251518 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2720/5433] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:41 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:44.261194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:44.261871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:44.286563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.289317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.289894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:44.291614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:44.293637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:44.294223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.591208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:45.603637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7237e69-4baf-4007-b70f-20ff4a2c7b0f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 1.348024 Oct 17 13:40:45.620780 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2721/5434] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:44 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:45.631809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:45.632818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:45.633532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:45.634132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:45.635328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:45.639595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:45.641970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:45.649386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.650084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.650531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.651981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.652463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.652902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.662542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.664286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.664834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.667232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:45.669362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:45.672936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:45.676169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Getting quotas for project 2f41ab167b724769806eab69c5e944bf. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:45.684784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Getting quotas for user f32f2340dcd144efb568e55679e758eb and project 2f41ab167b724769806eab69c5e944bf. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:45.700364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:45.703266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:45.805929 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3176be5c-3d2a-4faf-b15b-21ac9bd35310 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/ips" status: 200 len: 150 microversion: 2.1 time: 0.182219 Oct 17 13:40:45.811337 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2722/5435] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:40:45 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/ips => generated 150 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:45.825199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58a1b0fe-42d8-4ade-ad16-2421a1fb34b6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 2.932769 Oct 17 13:40:45.825886 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2714/5436] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:40:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:45.872390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e324548-ddf4-4fff-b21e-707f2e0178e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:45.873197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e324548-ddf4-4fff-b21e-707f2e0178e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:46.131024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e324548-ddf4-4fff-b21e-707f2e0178e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:46.140252 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e324548-ddf4-4fff-b21e-707f2e0178e5 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1241 microversion: 2.1 time: 0.304335 Oct 17 13:40:46.157202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2723/5437] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:45 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1241 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:46.510740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5b956aac-41d0-44e0-8036-8b3f8f0a8b79 req-8111c19a-5a76-4a32-9670-42270a4779d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2496c38c-b9a8-4651-8957-2d8953bcda7d", "name": "network-vif-plugged", "status": "completed", "tag": "2266a84a-21f4-4fad-a7e4-879eaa33e036"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:46.568836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5b956aac-41d0-44e0-8036-8b3f8f0a8b79 req-8111c19a-5a76-4a32-9670-42270a4779d0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.569753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5b956aac-41d0-44e0-8036-8b3f8f0a8b79 req-8111c19a-5a76-4a32-9670-42270a4779d0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.571341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5b956aac-41d0-44e0-8036-8b3f8f0a8b79 req-8111c19a-5a76-4a32-9670-42270a4779d0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.625140 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5b956aac-41d0-44e0-8036-8b3f8f0a8b79 req-8111c19a-5a76-4a32-9670-42270a4779d0 service nova] Creating event network-vif-plugged:2266a84a-21f4-4fad-a7e4-879eaa33e036 for instance 2496c38c-b9a8-4651-8957-2d8953bcda7d on n-h1-854121-14 Oct 17 13:40:46.646963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:46.647601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:46.667701 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5b956aac-41d0-44e0-8036-8b3f8f0a8b79 req-8111c19a-5a76-4a32-9670-42270a4779d0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160868 Oct 17 13:40:46.671513 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2715/5438] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:46.672571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.673089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.673568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.674292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:46.674919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:46.675448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:46.691167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=59 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:47.165552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:47.166297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:47.179868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.180372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.180821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.185440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:47.190929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:47.191484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:47.493509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.526660 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e15e9f16-1b7d-47ac-926c-546020dba404 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1245 microversion: 2.1 time: 0.365796 Oct 17 13:40:47.553522 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2716/5439] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:47 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1245 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:47.804489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:47.816628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4396d48f-8247-4d66-870d-9539a7e7873f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1315 microversion: 2.1 time: 1.177550 Oct 17 13:40:47.818675 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2724/5440] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:46 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1315 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:48.553434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:48.556318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:48.686181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.689049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.689679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.693042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.706229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.712593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.757667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92cf451f-e7d0-4a82-a1e7-543f547cfd46"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:48.760934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:48.781255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.781758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.785704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:48.790773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:48.791515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:48.794907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:49.221043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:49.240946 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b36a336-1f81-4577-af19-e0a1acd2c30e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.689488 Oct 17 13:40:49.241641 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2717/5441] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:48 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:49.257338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:49.258021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:49.271621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:49.272114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:49.272547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:49.273288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:49.275436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:49.276051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:49.332153 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e5c79924-6e86-48e8-bbd4-185ee748906d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578365 Oct 17 13:40:49.333118 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2725/5442] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:40:48 2022] POST /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:40:50.858130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d4fa60c-5a3c-45b0-b28c-8d77538a8d0f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419c9cb160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1778012277", "description": "tempest-description-392913147"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:50.878144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:50.898046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29fce793-d5ba-4f77-a7fd-e3b5ee35fa28 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1503 microversion: 2.1 time: 1.651879 Oct 17 13:40:50.898922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2718/5443] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:49 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1503 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:50.921010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:50.922844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:50.954818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.956207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.957750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:50.960047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:50.961797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:50.962233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.046267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:51.068418 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c03a522f-85a5-4812-81cb-e1339688a366 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.157752 Oct 17 13:40:51.069729 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2719/5444] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:50 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:51.085063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:51.086146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:51.107618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.109381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.111159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.113872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.115224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.116252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.172839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lazy-loading 'flavor' on Instance uuid 2496c38c-b9a8-4651-8957-2d8953bcda7d {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:40:51.298146 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86d25bd6-a1b5-4148-9527-983e133fd98d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "POST /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d/action" status: 202 len: 0 microversion: 2.1 time: 0.225634 Oct 17 13:40:51.306018 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2720/5445] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:40:51 2022] POST /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:40:51.313277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:51.313999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:51.338556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.339065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.339517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.342600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:51.343095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:51.344100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:51.936491 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d4fa60c-5a3c-45b0-b28c-8d77538a8d0f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.779736 Oct 17 13:40:51.937943 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2726/5446] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:40:50 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:51.959720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4022dfb2-a3ba-49b3-b5be-f6e6ba0207d0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419cd2cca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2088957561", "description": "tempest-description-259282083"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:52.199430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.209481 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c708925-9e16-4cb9-91c8-fc8899ecd261 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1511 microversion: 2.1 time: 0.902214 Oct 17 13:40:52.210143 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2721/5447] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:51 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1511 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:52.234229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:52.234864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:52.279502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.280378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.281178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.286984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:52.290108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:52.291219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:52.709690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:52.717994 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dbec3429-68c0-420f-bdb2-020a8d90e3d1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.506824 Oct 17 13:40:52.718585 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2722/5448] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:52 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:52.889727 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4022dfb2-a3ba-49b3-b5be-f6e6ba0207d0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.941093 Oct 17 13:40:52.891296 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2727/5449] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:40:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:53.183805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-525842042", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "44a17d60-db8f-4fea-a9e0-b21b7134969b"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:53.242151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:53.243885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:53.266095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:53.277451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.280295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.283152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.285517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:53.287144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:53.289367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:53.293748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] validate_networks() for [('44a17d60-db8f-4fea-a9e0-b21b7134969b', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:40:53.973403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:53.997775 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9771bcc8-ec89-42cc-bcda-8a504733f2c9 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1494 microversion: 2.1 time: 0.761330 Oct 17 13:40:54.004151 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2728/5450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:53 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1494 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:54.016914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.030621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:54.038458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.048565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.056089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.060261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.061433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.062149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.293119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:54.305261 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-586793b9-b1e5-4bad-8bfa-da7f4d3a77c9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.299495 Oct 17 13:40:54.310994 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2729/5451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:54 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:54.327831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.328347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:54.357280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.358109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.359900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.361834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.363985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.364434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.442581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:40:54.623381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-976bef12-956d-414d-ab80-e93b31d75467 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 204 len: 0 microversion: 2.1 time: 0.306674 Oct 17 13:40:54.633683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2730/5452] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:40:54 2022] DELETE /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:40:54.656203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:54.657052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:54.682153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.684731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.685305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:54.686158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:54.689642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:54.691368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.405986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:40:55.406711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:40:55.407115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:40:55.407844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:40:55.408489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:40:55.432015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.433090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.437978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.439047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.439760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.441697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.506304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:55.515371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a066946f-aa74-4900-b879-8e58d695db5e tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1500 microversion: 2.1 time: 0.871273 Oct 17 13:40:55.520317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Getting quotas for project 1ef1ff3328ba43d1a001194efc77b279. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:40:55.522665 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2731/5453] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:54 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1500 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:55.533213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:55.540830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Getting quotas for user cad6c700cddf4c1a8e505bca59de2354 and project 1ef1ff3328ba43d1a001194efc77b279. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:40:55.547880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:55.579407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.580305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.581106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.583039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:55.585635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:55.587019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:55.599377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:40:55.611645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:40:55.710901 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15879eb4-73e2-4cec-b37d-05fe7cc9caa9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.531928 Oct 17 13:40:55.712232 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2723/5454] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:40:55.724619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5d88d56-52b4-4249-b9d1-28e5f392cd70 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:55.729851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5d88d56-52b4-4249-b9d1-28e5f392cd70 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:56.085461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d5d88d56-52b4-4249-b9d1-28e5f392cd70 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:56.100828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5d88d56-52b4-4249-b9d1-28e5f392cd70 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1215 microversion: 2.1 time: 0.372971 Oct 17 13:40:56.101607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2724/5455] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:55 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1215 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:56.137934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:40:56.295322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:56.306521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a889819-3ad2-4460-80b8-0df74b1469a6 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.782429 Oct 17 13:40:56.308942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2732/5456] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:55 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:56.551652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:56.552924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:56.571066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:56.571592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:56.572078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:56.572852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:56.585772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:56.595744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.131032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:57.131839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:57.150060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.155070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.155692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.156593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:57.157391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:57.158011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:57.982522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:57.999408 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-952c57a0-c6ab-462b-b822-db73147e0d24 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1211 microversion: 2.1 time: 0.875227 Oct 17 13:40:58.006462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2733/5457] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:57 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1211 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:58.035881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5ff80753-bacc-4ce1-9832-c003e2aa3d7a req-ad85706c-e5dd-46d4-bafd-75f468bc9318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20029a31-eab6-4839-b66c-f28104df53df", "tag": "4979b993-baf0-4657-86a4-fc63e77b59a2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:40:58.057072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:58.075906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-083ca12b-584a-4b4f-9f64-7e86bb495f7a tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1500 microversion: 2.1 time: 1.526741 Oct 17 13:40:58.081018 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2725/5458] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:56 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1500 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:58.101514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5ff80753-bacc-4ce1-9832-c003e2aa3d7a req-ad85706c-e5dd-46d4-bafd-75f468bc9318 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:58.102451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5ff80753-bacc-4ce1-9832-c003e2aa3d7a req-ad85706c-e5dd-46d4-bafd-75f468bc9318 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:58.104356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5ff80753-bacc-4ce1-9832-c003e2aa3d7a req-ad85706c-e5dd-46d4-bafd-75f468bc9318 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:58.109072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:58.110155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:58.143807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:58.144895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:58.147273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:58.151240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:58.155919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:58.157083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:58.158094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5ff80753-bacc-4ce1-9832-c003e2aa3d7a req-ad85706c-e5dd-46d4-bafd-75f468bc9318 service nova] Creating event network-changed:4979b993-baf0-4657-86a4-fc63e77b59a2 for instance 20029a31-eab6-4839-b66c-f28104df53df on n-h2-854121-14 Oct 17 13:40:58.203868 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5ff80753-bacc-4ce1-9832-c003e2aa3d7a req-ad85706c-e5dd-46d4-bafd-75f468bc9318 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190395 Oct 17 13:40:58.206859 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2734/5459] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:40:58.579927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:58.597841 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c90c6f50-2085-4a66-ae3a-1853c355e5ed tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.513777 Oct 17 13:40:58.601869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2726/5460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:58 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:59.036706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:59.037845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:59.047889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.048805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.050170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.051225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.051948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.052642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.110412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:59.111687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:59.123104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.124180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.124786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.126029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.126844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.128228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.159777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:59.179116 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e2cacca-b1b9-4e93-96b5-07e2a32e693e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1273 microversion: 2.1 time: 0.149596 Oct 17 13:40:59.179740 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2735/5461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:59 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:40:59.468241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119a4990e7724385ba4578c27f59e8ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3995f968396b48b0be0966bf98a2a0f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:59.509005 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af2c3c4c-2d15-49ec-a400-73a60d15224f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 200 len: 1500 microversion: 2.1 time: 0.405610 Oct 17 13:40:59.529152 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2727/5462] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:59 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 1500 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:40:59.626625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:40:59.627541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:40:59.643492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.645935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.652671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.655749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:40:59.657296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:40:59.658580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:40:59.836297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:40:59.854400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98c6e388-0ce2-4c41-84e2-a10b1e556305 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.232057 Oct 17 13:40:59.855194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2736/5463] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:40:59 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:00.203552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.204240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.211730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.212224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.212660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.213388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.213843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.214266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.240210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-da8f7a40-8ab2-4eed-85eb-1854bdb52bab req-049a8e28-2cba-4119-ab95-ec8755c90164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2496c38c-b9a8-4651-8957-2d8953bcda7d", "name": "network-vif-deleted", "tag": "2266a84a-21f4-4fad-a7e4-879eaa33e036"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:00.261024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-da8f7a40-8ab2-4eed-85eb-1854bdb52bab req-049a8e28-2cba-4119-ab95-ec8755c90164 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.261927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-da8f7a40-8ab2-4eed-85eb-1854bdb52bab req-049a8e28-2cba-4119-ab95-ec8755c90164 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.262423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-da8f7a40-8ab2-4eed-85eb-1854bdb52bab req-049a8e28-2cba-4119-ab95-ec8755c90164 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.292201 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-da8f7a40-8ab2-4eed-85eb-1854bdb52bab req-049a8e28-2cba-4119-ab95-ec8755c90164 service nova] Creating event network-vif-deleted:2266a84a-21f4-4fad-a7e4-879eaa33e036 for instance 2496c38c-b9a8-4651-8957-2d8953bcda7d on n-h1-854121-14 Oct 17 13:41:00.297797 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-da8f7a40-8ab2-4eed-85eb-1854bdb52bab req-049a8e28-2cba-4119-ab95-ec8755c90164 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061614 Oct 17 13:41:00.298741 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2737/5464] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:00.309378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:00.321046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7968fb59-afab-43c4-b4f3-dc5cca87e29c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1273 microversion: 2.1 time: 0.121531 Oct 17 13:41:00.322845 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2728/5465] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:00 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:00.537921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.538549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.545511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.546452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.547132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.549004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.550503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.551356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.567535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d HTTP/1.1 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2496c38c-b9a8-4651-8957-2d8953bcda7d'} Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.570189 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.575194 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.580397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:00.582782 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eaaca748-1973-40f3-a4bf-57dd0cab9931 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 404 len: 111 microversion: 2.1 time: 0.050144 Oct 17 13:41:00.584713 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2738/5466] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:00 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:00.605838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.606724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.617260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.619299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.620558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.622055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.624551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.625269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.647897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d HTTP/1.1 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '2496c38c-b9a8-4651-8957-2d8953bcda7d'} Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:00.650068 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.657017 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.662536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:00.663797 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b138872-4e49-42fc-a824-5751d41762e5 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 404 len: 111 microversion: 2.1 time: 0.071914 Oct 17 13:41:00.664987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2729/5467] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:00 2022] DELETE /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:00.675840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.676463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 2496c38c-b9a8-4651-8957-2d8953bcda7d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.684356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.685034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.697620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.698725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.700256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.701561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.754049 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d HTTP/1.1 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2496c38c-b9a8-4651-8957-2d8953bcda7d'} Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.756981 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. Oct 17 13:41:00.762425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.766806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 2496c38c-b9a8-4651-8957-2d8953bcda7d could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:00.772097 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9cd3f676-00b6-4d6a-af22-98f7d3637aae tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d" status: 404 len: 111 microversion: 2.1 time: 0.098296 Oct 17 13:41:00.781419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.781926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.790307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.790716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.790936 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2739/5468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:00 2022] GET /compute/v2.1/servers/2496c38c-b9a8-4651-8957-2d8953bcda7d => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:41:00.794845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.795849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.797285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.797726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.803497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:00.855112 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 HTTP/1.1 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'afff062c-c8a2-4974-bed5-6ee07db0b1b7'} Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:00.861655 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.869187 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.873658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:00.874891 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-869ea903-ffbe-4257-9a6b-ee2f87b76cc6 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 404 len: 111 microversion: 2.1 time: 0.097710 Oct 17 13:41:00.875970 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2730/5469] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:00 2022] DELETE /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:00.883527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.884344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.889466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.891784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: afff062c-c8a2-4974-bed5-6ee07db0b1b7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:00.899863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.901439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.903308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.905479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.911014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.911839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.912807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.913683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.913965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:00.914555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.914956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:00.915551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:00.946636 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 HTTP/1.1 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'afff062c-c8a2-4974-bed5-6ee07db0b1b7'} Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:00.948635 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. Oct 17 13:41:00.954183 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:00.955738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance afff062c-c8a2-4974-bed5-6ee07db0b1b7 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:00.958274 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79219753-41bf-42cf-9d95-20192c2577c2 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7" status: 404 len: 111 microversion: 2.1 time: 0.077083 Oct 17 13:41:00.963206 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2731/5470] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:00 2022] GET /compute/v2.1/servers/afff062c-c8a2-4974-bed5-6ee07db0b1b7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:00.976519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:00.977919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.005586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.006228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.006863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.007803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.008425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.008991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.042696 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 HTTP/1.1 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3f661374-0ad9-401b-9177-c62128ff2257'} Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:01.047683 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:01.054812 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3cb40a5-653c-4d3c-9608-596d6c9c2a92 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 404 len: 111 microversion: 2.1 time: 0.085807 Oct 17 13:41:01.059626 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2732/5471] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:00 2022] DELETE /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:41:01.068552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.069233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 3f661374-0ad9-401b-9177-c62128ff2257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.083171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.083685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.086794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.087582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.089317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.089790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.141403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 HTTP/1.1 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3f661374-0ad9-401b-9177-c62128ff2257'} Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.143121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 3f661374-0ad9-401b-9177-c62128ff2257 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:01.147746 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca9b6f00-7373-4ab1-8bb1-5e7b7c456757 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257" status: 404 len: 111 microversion: 2.1 time: 0.087920 Oct 17 13:41:01.152486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2733/5472] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/3f661374-0ad9-401b-9177-c62128ff2257 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:01.163824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.165479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.180814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.185805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.186743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.187762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.188465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.189088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.228127 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 HTTP/1.1 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '79d0faf4-32af-4016-8ee2-4f25d49ba895'} Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:01.229818 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:01.235423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73f86cd3-1b45-497c-8724-63aab2d86430 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 404 len: 111 microversion: 2.1 time: 0.076944 Oct 17 13:41:01.250322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2734/5473] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:01 2022] DELETE /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:41:01.263190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.264199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 79d0faf4-32af-4016-8ee2-4f25d49ba895] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.288743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.289707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.292061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.294544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.295227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.296977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.350799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:01.353946 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 HTTP/1.1 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '79d0faf4-32af-4016-8ee2-4f25d49ba895'} Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.360744 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 79d0faf4-32af-4016-8ee2-4f25d49ba895 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:01.369262 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0381bfe7-315a-4f39-953f-075f9b7b663d tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895" status: 404 len: 111 microversion: 2.1 time: 0.113680 Oct 17 13:41:01.371273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2735/5474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/79d0faf4-32af-4016-8ee2-4f25d49ba895 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:01.378728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-050debb8-2431-4ada-ac6f-cd1c6f0f900e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.501242 Oct 17 13:41:01.379111 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2740/5475] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:00 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:01.391914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.392450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.396458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.397342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.410222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.411090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.412510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.413175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.413434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.413777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.414858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.415966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.416536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.416723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.417430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.417954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.442511 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 HTTP/1.1 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0d7d5302-650f-4027-88db-33a3f2552f21'} Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:01.444881 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8969a1d1-fc0f-4e9c-8dd0-162c168259f8 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21" status: 404 len: 111 microversion: 2.1 time: 0.066592 Oct 17 13:41:01.450064 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2741/5476] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:01 2022] DELETE /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:01.458418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:01.459142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 0d7d5302-650f-4027-88db-33a3f2552f21] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:01.471002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.476113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.479052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.482816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:01.485579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:01.488354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:01.546470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 HTTP/1.1 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0d7d5302-650f-4027-88db-33a3f2552f21'} Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:01.555992 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. Oct 17 13:41:01.562483 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:01.567772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 0d7d5302-650f-4027-88db-33a3f2552f21 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:01.575362 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-680d7e76-bd08-44a8-8563-ab4fe4d61225 tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21" status: 404 len: 111 microversion: 2.1 time: 0.118350 Oct 17 13:41:01.578498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2742/5477] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/0d7d5302-650f-4027-88db-33a3f2552f21 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:01.927449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:01.942894 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75b96cc6-96ba-4611-8f58-31f53701d4e4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.559997 Oct 17 13:41:01.943522 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2736/5478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:01 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:02.402818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:02.404100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:02.415275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.417412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.419587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.420624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.436565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.437916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.671671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:02.675023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:02.692725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16fcdc2d-3f79-4452-b6c7-b5627fe66ce1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.293983 Oct 17 13:41:02.703494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2743/5479] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:02 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:02.970847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:02.972306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:02.983041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.983651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.984187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:02.984991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:02.985572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:02.986114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.231229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:03.244820 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c85570e-9350-4264-8080-a0f4d9dac82b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.280706 Oct 17 13:41:03.248416 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2737/5480] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:02 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:03.724555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:03.725423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:03.736140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:03.736815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:03.749136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.750029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:03.750516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:03.750955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:03.943930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:03.963528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98e4c259-6120-44bf-b685-75b93c4c8bd1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.243869 Oct 17 13:41:03.967222 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2744/5481] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:03 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:04.275811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:04.277135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:04.286569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.288061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.288773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.289789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.290803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.292898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.323485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7e5e5366-9601-4550-a438-77df898d7522 req-72a9c5df-6954-404d-b1d2-2e1873d062a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20029a31-eab6-4839-b66c-f28104df53df", "name": "network-vif-plugged", "status": "completed", "tag": "4979b993-baf0-4657-86a4-fc63e77b59a2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:04.337199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e5e5366-9601-4550-a438-77df898d7522 req-72a9c5df-6954-404d-b1d2-2e1873d062a7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:04.337962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e5e5366-9601-4550-a438-77df898d7522 req-72a9c5df-6954-404d-b1d2-2e1873d062a7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:04.338562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e5e5366-9601-4550-a438-77df898d7522 req-72a9c5df-6954-404d-b1d2-2e1873d062a7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:04.352748 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7e5e5366-9601-4550-a438-77df898d7522 req-72a9c5df-6954-404d-b1d2-2e1873d062a7 service nova] Creating event network-vif-plugged:4979b993-baf0-4657-86a4-fc63e77b59a2 for instance 20029a31-eab6-4839-b66c-f28104df53df on n-h2-854121-14 Oct 17 13:41:04.358613 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7e5e5366-9601-4550-a438-77df898d7522 req-72a9c5df-6954-404d-b1d2-2e1873d062a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.452307 Oct 17 13:41:04.359987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2738/5482] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:04.814155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:04.827239 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3326cfa-9c92-40ac-a754-bc12edb44b3a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.559755 Oct 17 13:41:04.830252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2745/5483] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:04 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:04.999104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:05.000022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:05.013214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:05.014166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:05.014805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:05.016252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:05.017054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:05.017991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:05.234222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:05.247017 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f418ddd-78a7-4621-ac1c-9184f0134726 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1299 microversion: 2.1 time: 0.252932 Oct 17 13:41:05.250601 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2739/5484] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:04 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:05.855348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:05.856695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:05.871237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:05.872364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:05.872968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:05.874078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:05.875618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:05.876212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.249661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.253842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:06.257601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.271772 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a406939-d2a0-4a35-8b68-7fc2fd4b105b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.422881 Oct 17 13:41:06.272373 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2746/5485] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:05 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:06.292678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:06.293406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:06.335488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.337524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.340195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.341151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.347181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.351802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.538152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.550937 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1611e4a2-6a73-4185-aa49-a1a754bb7bd3 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1472 microversion: 2.1 time: 0.276657 Oct 17 13:41:06.551550 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2747/5486] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:06 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:06.578800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:06.579473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:06.597838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.598347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.598894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.599544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.600001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.600429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.608416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2afcf46a-ba29-4c3b-95e4-db0c7df9c7ed req-43a7afc7-df10-4337-b55e-c69b18b57f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d6626c-5ca5-413d-a5ee-7d271e246f36", "tag": "533cef1f-23ab-428c-808d-2a2b2dd4074e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:06.629149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2afcf46a-ba29-4c3b-95e4-db0c7df9c7ed req-43a7afc7-df10-4337-b55e-c69b18b57f13 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.629964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2afcf46a-ba29-4c3b-95e4-db0c7df9c7ed req-43a7afc7-df10-4337-b55e-c69b18b57f13 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.640116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2afcf46a-ba29-4c3b-95e4-db0c7df9c7ed req-43a7afc7-df10-4337-b55e-c69b18b57f13 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.662690 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2afcf46a-ba29-4c3b-95e4-db0c7df9c7ed req-43a7afc7-df10-4337-b55e-c69b18b57f13 service nova] Creating event network-changed:533cef1f-23ab-428c-808d-2a2b2dd4074e for instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 on n-h1-854121-14 Oct 17 13:41:06.676645 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2afcf46a-ba29-4c3b-95e4-db0c7df9c7ed req-43a7afc7-df10-4337-b55e-c69b18b57f13 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.434162 Oct 17 13:41:06.685543 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2740/5487] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:06.910353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:06.922305 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b55b07f6-3d89-409c-b377-6baff8cd93b9 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1472 microversion: 2.1 time: 0.347556 Oct 17 13:41:06.923526 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2748/5488] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:06 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:06.948203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:06.949342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:06.962224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.963944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.967477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:06.968606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:06.971614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:06.972477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.204490 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a623de7-33f2-4068-9d89-0c60fe1b58f6 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1625 microversion: 2.1 time: 0.261632 Oct 17 13:41:07.210388 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2741/5489] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:06 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1625 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:07.235497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.236499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.250345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.256798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.257495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.263276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.264059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.264701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.319731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.320898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.343696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.348804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.350136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.357464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.359947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.360711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.627491 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-090c0c13-829f-4445-98f3-bb7c53f4d615 tempest-TestSecurityGroupsBasicOps-915181812 tempest-TestSecurityGroupsBasicOps-915181812-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1915 microversion: 2.1 time: 0.395931 Oct 17 13:41:07.631816 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2749/5490] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:07 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1915 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:07.641226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.649010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.686163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.689959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.694164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.698438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.699298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.699857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.724544 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 HTTP/1.1 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'dc5e1c49-2fc3-445d-9adc-9dc1437a2128'} Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:07.726181 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d9d4815-b271-4b69-954f-fff47be0191f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 404 len: 111 microversion: 2.1 time: 0.095843 Oct 17 13:41:07.733967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2750/5491] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:07 2022] DELETE /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:07.738942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.739577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: dc5e1c49-2fc3-445d-9adc-9dc1437a2128] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.745990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.746545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.747433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.748862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.749420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.749981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.771063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 HTTP/1.1 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'dc5e1c49-2fc3-445d-9adc-9dc1437a2128'} Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:07.772657 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance dc5e1c49-2fc3-445d-9adc-9dc1437a2128 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac199fb1-7643-435a-8c4b-b205764eca7b tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128" status: 404 len: 111 microversion: 2.1 time: 0.040159 Oct 17 13:41:07.778704 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2751/5492] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:07 2022] GET /compute/v2.1/servers/dc5e1c49-2fc3-445d-9adc-9dc1437a2128 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:07.791826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.792456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.812378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.817258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.818523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.819589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.820519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.821734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.866013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e HTTP/1.1 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '345f1c3b-cc0b-49f9-82e1-0c6481cad86e'} Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:07.871007 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:07.876499 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:07.880150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:07.882922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d89bc82-3bfe-42b7-8b63-f48cb57e4fcf tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "DELETE /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 404 len: 111 microversion: 2.1 time: 0.099512 Oct 17 13:41:07.888652 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2752/5493] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:07 2022] DELETE /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:07.897744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:07.901317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:07.916229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.920947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.921714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.925074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:07.927659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:07.928370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:07.951313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:07.968178 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21a26def-bdc1-4e67-b45e-d92b70052659 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.665696 Oct 17 13:41:07.968772 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2742/5494] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:07 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:07.989866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:08.000353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:08.001928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] [instance: 345f1c3b-cc0b-49f9-82e1-0c6481cad86e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:08.027913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:08.028420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:08.028864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:08.029611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:08.030065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:08.049814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:08.111482 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] HTTP exception thrown: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Request method failure captured: Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e HTTP/1.1 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVn0-X_gw0X6RPKEvm-Ea4Cceahhbm3HmsqbwK_rY4MF4mOtznW9Uni_EWF_jPYBB25iRX-bMZWGzO5Goig4qBdMDkD_i80D8y6DwDqQCRUgjFSDFzmJzN12qxy0wLaBvLMx9-SpahdsK4fxheM01uw0mE8JfivQ8BPzPa4PwUg6akw Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3995f968396b48b0be0966bf98a2a0f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3995f968396b48b0be0966bf98a2a0f0 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-55661488 Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 119a4990e7724385ba4578c27f59e8ae Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-55661488-project Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '345f1c3b-cc0b-49f9-82e1-0c6481cad86e'} Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:08.123180 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] Returning 404 to user: Instance 345f1c3b-cc0b-49f9-82e1-0c6481cad86e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f55a3119-e64f-4504-b5e9-9d2881f8517f tempest-DeleteServersTestJSON-55661488 tempest-DeleteServersTestJSON-55661488-project] 10.222.0.65 "GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e" status: 404 len: 111 microversion: 2.1 time: 0.142082 Oct 17 13:41:08.130393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2743/5495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:07 2022] GET /compute/v2.1/servers/345f1c3b-cc0b-49f9-82e1-0c6481cad86e => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:08.194277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a50a7e33-55d6-40dc-8c0c-6cda88bae74d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: .version_select at 0x7f419cf5bd30>, body: {"keypair": {"name": "tempest-keypair-1290023254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKqpYWbPnULpiDM9tEPEpAgvhngK0KVWJs78UttjZCdX7OhllAR+GkXWsbWSkIZnCfuVrTyMyzELh6MREGuyzj+dz/Xf4vMS3dQS32f7MB07zQKzpI4xLdjwF58nOXa1Q=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:08.209314 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9011a7f1-a31d-4ce8-8f74-00b019bc3f97 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "DELETE /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 204 len: 0 microversion: 2.1 time: 0.318806 Oct 17 13:41:08.210592 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2753/5496] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:07 2022] DELETE /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:08.220822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-a50a7e33-55d6-40dc-8c0c-6cda88bae74d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:08.221171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:08.222442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:08.227844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-a50a7e33-55d6-40dc-8c0c-6cda88bae74d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:08.234344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:08.238052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:08.239080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:08.239647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:08.240640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:08.243362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:08.244228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:08.277263 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a50a7e33-55d6-40dc-8c0c-6cda88bae74d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086553 Oct 17 13:41:08.285817 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2744/5497] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:41:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:08.513826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:08.530839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-02b11cb0-fa3b-4b50-b7ac-febfa3b4c587 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1478 microversion: 2.1 time: 0.315905 Oct 17 13:41:08.553021 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2754/5498] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:08 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1478 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:08.998287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:08.999616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:09.016967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.020655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.022140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.023131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.026559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.027578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.560369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:09.560996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:09.582223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.583848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.584579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.585581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:09.586648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:09.588145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:09.747743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:09.771938 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a33650cd-1780-48f3-be6c-45a551a150ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.775314 Oct 17 13:41:09.772778 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2745/5499] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:08 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:10.103917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:10.120232 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5583fb84-569d-4e7e-baf9-e23301b6cf95 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1478 microversion: 2.1 time: 0.560892 Oct 17 13:41:10.141281 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2755/5500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:09 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1478 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:10.796811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:10.797673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:10.811285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.813750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.814416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:10.818132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:10.818812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:10.821200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:11.150728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:11.151357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:11.165377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:11.165612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:11.169752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:11.170590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:11.171077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:11.171516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:11.538251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:11.551752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80fb73f8-f1a3-4e4e-bba3-cce4bae9ade1 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1478 microversion: 2.1 time: 0.406383 Oct 17 13:41:11.552929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2756/5501] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:11 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1478 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:11.764301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:11.779542 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1e2e980-047f-46f0-b0ed-2d6c5ba69f71 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.981869 Oct 17 13:41:11.780683 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2746/5502] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:10 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:12.582714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:12.583865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:12.625550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.626642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.627875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.628910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.629422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.638301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.808918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:12.815078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:12.834564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.835372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.839413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:12.840428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:12.840905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:12.841380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:13.532843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:13.563142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f5c8ef32-5b46-40c5-be1b-31cd5b4323e7 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1478 microversion: 2.1 time: 0.986891 Oct 17 13:41:13.566615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2757/5503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:12 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1478 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:14.205291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1389355453", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2795df-2862-45cf-a8ed-080978866cd4"}], "security_groups": [{"name": "tempest-securitygroup--1017232307"}], "key_name": "tempest-keypair-1290023254", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:14.394173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:14.412777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbc075fc-09bf-4a5e-ad5c-6f18e76d685a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 1.607611 Oct 17 13:41:14.420569 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2747/5504] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:12 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:14.429665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6c2c69a6-3ffc-40fe-b5e6-be1f9fa904e3 req-cfcda581-2149-4e3b-b85a-1e672cfd4dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d6626c-5ca5-413d-a5ee-7d271e246f36", "name": "network-vif-plugged", "status": "completed", "tag": "533cef1f-23ab-428c-808d-2a2b2dd4074e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:14.447917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6c2c69a6-3ffc-40fe-b5e6-be1f9fa904e3 req-cfcda581-2149-4e3b-b85a-1e672cfd4dcc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.455379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6c2c69a6-3ffc-40fe-b5e6-be1f9fa904e3 req-cfcda581-2149-4e3b-b85a-1e672cfd4dcc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.456017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6c2c69a6-3ffc-40fe-b5e6-be1f9fa904e3 req-cfcda581-2149-4e3b-b85a-1e672cfd4dcc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.478557 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6c2c69a6-3ffc-40fe-b5e6-be1f9fa904e3 req-cfcda581-2149-4e3b-b85a-1e672cfd4dcc service nova] Creating event network-vif-plugged:533cef1f-23ab-428c-808d-2a2b2dd4074e for instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 on n-h1-854121-14 Oct 17 13:41:14.497094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6c2c69a6-3ffc-40fe-b5e6-be1f9fa904e3 req-cfcda581-2149-4e3b-b85a-1e672cfd4dcc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074489 Oct 17 13:41:14.497755 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2748/5505] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:14.509693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-eab91515-4900-4727-9aef-1e19092e97aa req-dc3857a5-3377-4947-bccb-23adf014e5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20029a31-eab6-4839-b66c-f28104df53df", "name": "network-vif-deleted", "tag": "4979b993-baf0-4657-86a4-fc63e77b59a2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:14.530560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eab91515-4900-4727-9aef-1e19092e97aa req-dc3857a5-3377-4947-bccb-23adf014e5d5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.533773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eab91515-4900-4727-9aef-1e19092e97aa req-dc3857a5-3377-4947-bccb-23adf014e5d5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.534206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eab91515-4900-4727-9aef-1e19092e97aa req-dc3857a5-3377-4947-bccb-23adf014e5d5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.550673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] validate_networks() for [('be2795df-2862-45cf-a8ed-080978866cd4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:14.558437 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-eab91515-4900-4727-9aef-1e19092e97aa req-dc3857a5-3377-4947-bccb-23adf014e5d5 service nova] Creating event network-vif-deleted:4979b993-baf0-4657-86a4-fc63e77b59a2 for instance 20029a31-eab6-4839-b66c-f28104df53df on n-h2-854121-14 Oct 17 13:41:14.578305 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-eab91515-4900-4727-9aef-1e19092e97aa req-dc3857a5-3377-4947-bccb-23adf014e5d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078916 Oct 17 13:41:14.586320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2749/5506] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:14.593908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:14.599519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:14.619159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.619965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.623524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.624676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.625359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.628818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.773750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:14.780724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:14.784081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:14.784655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lazy-loading 'fault' on Instance uuid 20029a31-eab6-4839-b66c-f28104df53df {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:41:15.579090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:15.596272 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2c90a21-ad8f-4978-9352-e24abda69c99 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 200 len: 1331 microversion: 2.1 time: 1.006171 Oct 17 13:41:15.600567 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2750/5507] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:14 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 1331 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:15.617529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:15.618514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:15.635744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.636625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.640513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:15.645246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:15.648313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:15.650588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.279766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:16.295839 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91adb586-36ba-4bbb-a202-0a12d5e301a8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1315 microversion: 2.1 time: 0.694055 Oct 17 13:41:16.297020 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2751/5508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:15 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:16.628937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:16.629763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20029a31-eab6-4839-b66c-f28104df53df] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:16.647941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.649556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.655786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.662341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:16.664547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:16.665242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:16.727004 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] HTTP exception thrown: Instance 20029a31-eab6-4839-b66c-f28104df53df could not be found. Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Request method failure captured: Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df HTTP/1.1 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVrksH1gbEBo1CGcGkIwh9_V7XZFH8Ne8Z8Bk9_Xd_fjKSlgi0R5rN6O8DuLKzvzT09eLTD6ZUiaYjMfHp7bnCsvsg7MUeSLZPFXljjewiHZVhKvyygme5CTVJ2n-kGuZyJ4WbRc8XDnKBT1iColF8Nv84oRfpQtACqUPD2QPBX956U Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2f41ab167b724769806eab69c5e944bf Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-640770210 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f41ab167b724769806eab69c5e944bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f41ab167b724769806eab69c5e944bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f41ab167b724769806eab69c5e944bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f41ab167b724769806eab69c5e944bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestSecurityGroupsBasicOps-640770210 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2f41ab167b724769806eab69c5e944bf Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-640770210 Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestSecurityGroupsBasicOps-640770210-project Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f32f2340dcd144efb568e55679e758eb Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestSecurityGroupsBasicOps-640770210-project Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 20029a31-eab6-4839-b66c-f28104df53df could not be found. Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '20029a31-eab6-4839-b66c-f28104df53df'} Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20029a31-eab6-4839-b66c-f28104df53df could not be found. Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20029a31-eab6-4839-b66c-f28104df53df could not be found. Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:16.742231 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20029a31-eab6-4839-b66c-f28104df53df could not be found. Oct 17 13:41:16.748248 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:16.749838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Returning 404 to user: Instance 20029a31-eab6-4839-b66c-f28104df53df could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:16.750933 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-befb1f46-5aec-44b4-8153-7b382bafe87e tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df" status: 404 len: 111 microversion: 2.1 time: 0.127469 Oct 17 13:41:16.751793 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2752/5509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:16 2022] GET /compute/v2.1/servers/20029a31-eab6-4839-b66c-f28104df53df => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:41:17.326894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:17.328261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:17.342808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.343815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.344494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.345591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.347220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.347887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:17.969150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:17.970139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:17.970860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:17.971471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:17.972057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:17.997743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:17.998564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:17.999190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.000636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.001396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.002570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.032353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:18.040913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:18.056128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:18.060332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:18.160512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4971eb05-a0a5-438f-aae2-20ec8d018707 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.981038 Oct 17 13:41:18.161439 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2758/5510] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:41:18.172277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc7dd2c1-bb46-4330-8319-97a78531fea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:18.173699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc7dd2c1-bb46-4330-8319-97a78531fea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:18.210009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:18.235485 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eda27edd-6084-4223-b72f-aede82edbe57 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1502 microversion: 2.1 time: 0.914182 Oct 17 13:41:18.239856 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2753/5511] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:17 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1502 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:18.267283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1778012277"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:18.268166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:18.275112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:18.281808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.282375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.282890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.284191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:18.284660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:18.285086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:18.343684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc7dd2c1-bb46-4330-8319-97a78531fea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:18.352850 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc7dd2c1-bb46-4330-8319-97a78531fea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1242 microversion: 2.1 time: 0.184353 Oct 17 13:41:18.365635 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2759/5512] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:18 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1242 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:19.092399 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Adding security group b41026da-3c6c-4cb8-a50d-73f50cce148f to port 533cef1f-23ab-428c-808d-2a2b2dd4074e Oct 17 13:41:19.389322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:19.392234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:19.415768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:19.416271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:19.416718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:19.428497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:19.429066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:19.429557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:21.032476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:21.047074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-708001f7-b02b-407a-a108-49caa517f3e4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1238 microversion: 2.1 time: 1.662636 Oct 17 13:41:21.050805 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2760/5513] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:19 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1238 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:22.080543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:22.082542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:22.095312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.096427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.097452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.099902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.101186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.102874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.146316 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2110a54-80e5-4596-894c-c9b670d0d015 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36/action" status: 202 len: 0 microversion: 2.1 time: 3.884386 Oct 17 13:41:22.147247 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2754/5514] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:41:18 2022] POST /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36/action => generated 0 bytes in 3887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:41:22.155864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2088957561"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.156394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:22.180955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.182269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.185311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.187878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.188540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.190500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.373775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:22.390092 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d618541-afd3-47f5-8035-57a44f012a9f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1300 microversion: 2.1 time: 0.314328 Oct 17 13:41:22.390730 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2761/5515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:22 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:22.424718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-468341f8-2cdd-4db5-86d2-598ca226bba7 req-83ec9b25-ab57-4efa-874c-1b8c91f4a1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d6626c-5ca5-413d-a5ee-7d271e246f36", "tag": "533cef1f-23ab-428c-808d-2a2b2dd4074e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:22.443042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-468341f8-2cdd-4db5-86d2-598ca226bba7 req-83ec9b25-ab57-4efa-874c-1b8c91f4a1fc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:22.446517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-468341f8-2cdd-4db5-86d2-598ca226bba7 req-83ec9b25-ab57-4efa-874c-1b8c91f4a1fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:22.448655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-468341f8-2cdd-4db5-86d2-598ca226bba7 req-83ec9b25-ab57-4efa-874c-1b8c91f4a1fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:22.482430 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-468341f8-2cdd-4db5-86d2-598ca226bba7 req-83ec9b25-ab57-4efa-874c-1b8c91f4a1fc service nova] Creating event network-changed:533cef1f-23ab-428c-808d-2a2b2dd4074e for instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 on n-h1-854121-14 Oct 17 13:41:22.495045 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-468341f8-2cdd-4db5-86d2-598ca226bba7 req-83ec9b25-ab57-4efa-874c-1b8c91f4a1fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079265 Oct 17 13:41:22.495902 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2762/5516] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:23.416915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:23.418656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:23.421351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:23.432299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.435682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.437438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.439094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:23.439967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:23.441032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:23.461681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:23.721339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Adding security group 5bbf7f08-a779-4261-8eca-12dc59279bc9 to port 533cef1f-23ab-428c-808d-2a2b2dd4074e Oct 17 13:41:24.084410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:24.097971 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4bfed683-941e-413a-a24b-cab41d082568 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1300 microversion: 2.1 time: 0.686502 Oct 17 13:41:24.098825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2763/5517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:23 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1300 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:25.125147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.126562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:25.141225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.143944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.150588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.154090 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38ca6434-360d-42a2-acf7-3be410d5e1b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36/action" status: 202 len: 0 microversion: 2.1 time: 3.002636 Oct 17 13:41:25.160097 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2755/5518] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:41:22 2022] POST /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36/action => generated 0 bytes in 3009 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:41:25.169353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:25.170278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:25.173607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.174842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.175927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.189929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.190976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.194264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.195300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.198716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.199455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.257797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:25.444554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:25.454574 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b14e7479-17a1-4145-93f6-7bf8690897cc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1300 microversion: 2.1 time: 0.334232 Oct 17 13:41:25.455209 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2764/5519] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:25 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1300 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:25.476071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-608a7fc7-a5a9-4ae6-918f-91fd7e74e03f req-fcbb1402-cf65-4ecd-b7c3-8cd029a9a53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d6626c-5ca5-413d-a5ee-7d271e246f36", "tag": "533cef1f-23ab-428c-808d-2a2b2dd4074e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:25.507594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-608a7fc7-a5a9-4ae6-918f-91fd7e74e03f req-fcbb1402-cf65-4ecd-b7c3-8cd029a9a53d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:25.508340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-608a7fc7-a5a9-4ae6-918f-91fd7e74e03f req-fcbb1402-cf65-4ecd-b7c3-8cd029a9a53d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:25.509289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-608a7fc7-a5a9-4ae6-918f-91fd7e74e03f req-fcbb1402-cf65-4ecd-b7c3-8cd029a9a53d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:25.535422 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-608a7fc7-a5a9-4ae6-918f-91fd7e74e03f req-fcbb1402-cf65-4ecd-b7c3-8cd029a9a53d service nova] Creating event network-changed:533cef1f-23ab-428c-808d-2a2b2dd4074e for instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 on n-h1-854121-14 Oct 17 13:41:25.548276 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-608a7fc7-a5a9-4ae6-918f-91fd7e74e03f req-fcbb1402-cf65-4ecd-b7c3-8cd029a9a53d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084909 Oct 17 13:41:25.549755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2765/5520] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:26.081244 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c4846fe-858c-438c-af37-8d30b359d4d8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.919466 Oct 17 13:41:26.093718 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2756/5521] 10.222.0.65 () {58 vars in 1293 bytes} [Mon Oct 17 13:41:25 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36/os-security-groups => generated 1157 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:26.132459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7e4ce78-0782-4361-b6d7-7bd11a8ea314 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419c967280>, body: {"security_group": {"name": " tempest-securitygroup -823235877 ", "description": "tempest-description-1826380747"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:26.484096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:26.484726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:26.515572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.521372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.523216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:26.529382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:26.534648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:26.536252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:28.018273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:28.352476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:29.420266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:29.445737 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f1c95f3-c545-4890-82f1-cf6a0e3de6f1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 2.967181 Oct 17 13:41:29.453107 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2757/5522] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:26 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 2976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:30.489993 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7e4ce78-0782-4361-b6d7-7bd11a8ea314 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 4.394983 Oct 17 13:41:30.490920 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2766/5523] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:26 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 4398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:30.498397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:30.500558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:30.506640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6bbc7b3a-02a2-4e67-9bfe-becf47c9bed3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c9374c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:30.558976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.560276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.562756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:30.563770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:30.567334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:30.568029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:31.193661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6bbc7b3a-02a2-4e67-9bfe-becf47c9bed3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053" status: 200 len: 223 microversion: 2.1 time: 0.693434 Oct 17 13:41:31.202694 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2767/5524] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:30 2022] GET /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053 => generated 223 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:31.209761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e0c5b7a-fed1-4d73-8d7f-03c05637c50f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c9678b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:31.755591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:31.778485 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1651f892-50ba-4c29-84e7-96381601c61d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 1.298388 Oct 17 13:41:31.780353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2758/5525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:30 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:32.805200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:32.806874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:32.828970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:32.829651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:32.830312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:32.832147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:32.836131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:32.837550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:33.150934 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e0c5b7a-fed1-4d73-8d7f-03c05637c50f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053" status: 202 len: 0 microversion: 2.1 time: 1.945703 Oct 17 13:41:33.152312 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2768/5526] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:41:31 2022] DELETE /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053 => generated 0 bytes in 1948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:41:33.160225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c933e50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:33.300342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:41:33.301067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 188649c7-8214-450a-89b7-e23d6f617053 not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:41:33.301736 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.301736 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053 HTTP/1.1 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '188649c7-8214-450a-89b7-e23d6f617053'} Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:41:33.303969 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] Oct 17 13:41:33.309390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:33.319398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:41:33.319398 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-cbe4958d-b4b2-4ba4-ab31-5afaa2c2fd70'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:33.320671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2164a14-dd55-4004-8ea1-41141327ba91 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053" status: 404 len: 194 microversion: 2.1 time: 0.164169 Oct 17 13:41:33.321743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2769/5527] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:33 2022] GET /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053 => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:41:33.350483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21aa9fde-7efc-40a1-8662-ae6fb7572854 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419c967670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-426840589", "description": "tempest-description-1907963442"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:33.709016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:33.718833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c75dcc8-59ae-4cd3-aedf-45b421e170d4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 0.919002 Oct 17 13:41:33.722114 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2759/5528] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:32 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:34.751444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:34.753047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:34.764747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:34.769326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:34.769963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:34.773135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:34.775625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:34.777402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:35.291350 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21aa9fde-7efc-40a1-8662-ae6fb7572854 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.950930 Oct 17 13:41:35.292579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2770/5529] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:35.310621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66c91751-55d7-40dd-820e-a855db28b11b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419cb54ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-194010090", "description": "tempest-description-699153706"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:35.492303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=5 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:35.515542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=13 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:36.061596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:36.077940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16e8bd69-8e86-4167-bbe7-bfd6c5a39226 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 1.330544 Oct 17 13:41:36.080354 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2760/5530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:34 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:36.293956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4caea752-8475-42c9-a7b2-1cc97b186b19 req-35fa6c44-6bc7-48db-b96e-39eb56fccafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055ef0c4-201a-40d9-85ce-76df354ecd13", "tag": "10e4b360-45e3-4dcb-8b9a-d994990587a0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:36.325323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4caea752-8475-42c9-a7b2-1cc97b186b19 req-35fa6c44-6bc7-48db-b96e-39eb56fccafc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:36.325819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4caea752-8475-42c9-a7b2-1cc97b186b19 req-35fa6c44-6bc7-48db-b96e-39eb56fccafc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:36.326257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4caea752-8475-42c9-a7b2-1cc97b186b19 req-35fa6c44-6bc7-48db-b96e-39eb56fccafc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:36.367139 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4caea752-8475-42c9-a7b2-1cc97b186b19 req-35fa6c44-6bc7-48db-b96e-39eb56fccafc service nova] Creating event network-changed:10e4b360-45e3-4dcb-8b9a-d994990587a0 for instance 055ef0c4-201a-40d9-85ce-76df354ecd13 on n-h2-854121-14 Oct 17 13:41:36.382688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4caea752-8475-42c9-a7b2-1cc97b186b19 req-35fa6c44-6bc7-48db-b96e-39eb56fccafc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092176 Oct 17 13:41:36.383481 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2761/5531] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:36.568425 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66c91751-55d7-40dd-820e-a855db28b11b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.260964 Oct 17 13:41:36.570346 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2771/5532] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:35 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:36.585469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15c662f3-94ee-4edf-9327-f1103ea6bfb9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419cde8dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-739546446", "description": "tempest-description-607250405"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:37.123410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:37.124472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:37.141290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:37.143194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:37.145030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:37.150046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:37.152823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:37.154898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:37.261776 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15c662f3-94ee-4edf-9327-f1103ea6bfb9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.681673 Oct 17 13:41:37.262965 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2762/5533] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:36 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:37.276739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87d9eb1d-455c-4556-b019-bd9c999075e0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c9f13a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:38.162588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:38.175145 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-614678ba-f795-4edf-a535-ec5586bcdc2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 1.065217 Oct 17 13:41:38.176380 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2772/5534] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:37 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:38.841287 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87d9eb1d-455c-4556-b019-bd9c999075e0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.567044 Oct 17 13:41:38.856694 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2763/5535] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:41:37 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:38.860014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-310b72b5-f101-4a6a-99e8-8d0361274944 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c92d550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:39.199447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:39.200205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:39.202564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:39.211296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:39.212165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:39.212807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:39.213754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:39.215102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:39.215721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.509384 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-310b72b5-f101-4a6a-99e8-8d0361274944 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24" status: 202 len: 0 microversion: 2.1 time: 1.654294 Oct 17 13:41:40.510805 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2773/5536] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:41:38 2022] DELETE /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24 => generated 0 bytes in 1657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:41:40.521819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:40.522584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:40.559313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.564059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.564969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.566007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.570213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.573751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.708725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:41:40.759266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:40.778708 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-618dacdc-e4b7-483d-91c7-2d5486d4f70d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 1.580470 Oct 17 13:41:40.782148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2764/5537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:39 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:40.801383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1e030edf-73e6-480b-ac98-3375cc93bf6a req-78cbb023-13f6-4cbd-8a28-eace13926cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20fa5eb4-a737-49a1-98e2-228316235bee", "tag": "e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:40.836818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e030edf-73e6-480b-ac98-3375cc93bf6a req-78cbb023-13f6-4cbd-8a28-eace13926cee service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:40.840112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e030edf-73e6-480b-ac98-3375cc93bf6a req-78cbb023-13f6-4cbd-8a28-eace13926cee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:40.844780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e030edf-73e6-480b-ac98-3375cc93bf6a req-78cbb023-13f6-4cbd-8a28-eace13926cee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:40.881663 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1e030edf-73e6-480b-ac98-3375cc93bf6a req-78cbb023-13f6-4cbd-8a28-eace13926cee service nova] Creating event network-changed:e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af for instance 20fa5eb4-a737-49a1-98e2-228316235bee on n-h1-854121-14 Oct 17 13:41:40.897181 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1e030edf-73e6-480b-ac98-3375cc93bf6a req-78cbb023-13f6-4cbd-8a28-eace13926cee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105541 Oct 17 13:41:40.899045 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2765/5538] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:40.913633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ce07e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:41.060889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-991cb797-7231-4e4d-a4e7-ad08cf8d7a52 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "DELETE /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 204 len: 0 microversion: 2.1 time: 0.547105 Oct 17 13:41:41.062378 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2774/5539] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:41:40 2022] DELETE /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:41:41.078209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:41.081634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:41.103535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.104580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.106093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.109085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:41.111353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:41.112019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:41.544611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:41:41.545957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:41:41.546743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.546743 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24 HTTP/1.1 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3800dc7a-3e1b-4a17-9e77-342a04d84e24'} Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:41:41.549336 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] Oct 17 13:41:41.553874 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:41.563870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:41:41.563870 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-fa35edc6-113b-4be5-ad59-b2f22f1305ac'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:41.565670 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b9f5adc-c07e-4823-bea5-91ce4f5d11f5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24" status: 404 len: 194 microversion: 2.1 time: 0.662521 Oct 17 13:41:41.567511 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2766/5540] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:40 2022] GET /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24 => generated 194 bytes in 668 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:41.579376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1bde7b64-6f31-40ef-a0e3-d20316b74542 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419cde81f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:41.998403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:42.012564 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eae111f7-8605-4975-9017-a1ba34470d37 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1768 microversion: 2.1 time: 0.944128 Oct 17 13:41:42.013893 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2775/5541] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:41 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1768 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:42.027772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:42.028662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:42.042195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:42.042500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:42.046357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:42.052623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:42.053420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:42.054115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.155999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:43.168503 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4111a71-325b-473d-93a1-7dedaf494efd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 1.153518 Oct 17 13:41:43.177890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2776/5542] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:42 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:43.189792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:43.200993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:43.226433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.228279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.233573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.235389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:43.238730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:43.239677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:43.930679 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1bde7b64-6f31-40ef-a0e3-d20316b74542 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011" status: 202 len: 0 microversion: 2.1 time: 2.359169 Oct 17 13:41:43.934665 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2767/5543] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:41:41 2022] DELETE /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011 => generated 0 bytes in 2363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:41:43.940765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ca4d160>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.086718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:41:44.087391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group a2b7e870-c271-4229-b2e1-c6cf623aa011 not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:41:44.087975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.087975 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011 HTTP/1.1 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'a2b7e870-c271-4229-b2e1-c6cf623aa011'} Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:41:44.090737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-9d3704f6-203a-4b44-b384-f96c5e371ef5'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:44.096076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5884d551-506f-4666-9992-7b7d9c910993 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011" status: 404 len: 194 microversion: 2.1 time: 0.156296 Oct 17 13:41:44.105185 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2768/5544] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:43 2022] GET /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011 => generated 194 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:44.119303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4294cd86-70c3-4960-90a1-fdc3339171fc tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ca50940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.134330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32f2340dcd144efb568e55679e758eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f41ab167b724769806eab69c5e944bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:44.150937 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bda60ca8-7929-4357-9c51-2e765fde72fe tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 200 len: 1768 microversion: 2.1 time: 0.971701 Oct 17 13:41:44.151556 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2777/5545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:43 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 1768 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:44.206356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:44.208520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:44.228891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.234208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.235088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:44.236698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:44.238769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:44.244685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.063713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:45.081747 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc99e767-3db1-48bc-b17c-772b0afb8ad1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 0.881300 Oct 17 13:41:45.084572 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4294cd86-70c3-4960-90a1-fdc3339171fc tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d" status: 202 len: 0 microversion: 2.1 time: 0.981629 Oct 17 13:41:45.089885 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2778/5546] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:44 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:45.091693 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2769/5547] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:41:44 2022] DELETE /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:45.109955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d4162d31-b1e1-4aa6-ad61-4e5000f51e1b req-785b4267-4af4-48e3-b381-4da8d853e5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20fa5eb4-a737-49a1-98e2-228316235bee", "name": "network-vif-deleted", "tag": "e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:45.117089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8cfee240-242f-4d85-b431-4447dbc5bfbb req-0e40d2a5-c13a-434d-b372-17e23ea14ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ef0c4-201a-40d9-85ce-76df354ecd13", "name": "network-vif-plugged", "status": "completed", "tag": "10e4b360-45e3-4dcb-8b9a-d994990587a0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:45.140927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d4162d31-b1e1-4aa6-ad61-4e5000f51e1b req-785b4267-4af4-48e3-b381-4da8d853e5a1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.144754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d4162d31-b1e1-4aa6-ad61-4e5000f51e1b req-785b4267-4af4-48e3-b381-4da8d853e5a1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.145602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d4162d31-b1e1-4aa6-ad61-4e5000f51e1b req-785b4267-4af4-48e3-b381-4da8d853e5a1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.162181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8cfee240-242f-4d85-b431-4447dbc5bfbb req-0e40d2a5-c13a-434d-b372-17e23ea14ab2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.162715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8cfee240-242f-4d85-b431-4447dbc5bfbb req-0e40d2a5-c13a-434d-b372-17e23ea14ab2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.165917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8cfee240-242f-4d85-b431-4447dbc5bfbb req-0e40d2a5-c13a-434d-b372-17e23ea14ab2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.180353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d4162d31-b1e1-4aa6-ad61-4e5000f51e1b req-785b4267-4af4-48e3-b381-4da8d853e5a1 service nova] Creating event network-vif-deleted:e5e3b7a0-f1f0-4867-af6c-3b35d6bd02af for instance 20fa5eb4-a737-49a1-98e2-228316235bee on n-h1-854121-14 Oct 17 13:41:45.194614 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8cfee240-242f-4d85-b431-4447dbc5bfbb req-0e40d2a5-c13a-434d-b372-17e23ea14ab2 service nova] Creating event network-vif-plugged:10e4b360-45e3-4dcb-8b9a-d994990587a0 for instance 055ef0c4-201a-40d9-85ce-76df354ecd13 on n-h2-854121-14 Oct 17 13:41:45.201393 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d4162d31-b1e1-4aa6-ad61-4e5000f51e1b req-785b4267-4af4-48e3-b381-4da8d853e5a1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109410 Oct 17 13:41:45.204334 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2779/5548] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:45.210414 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8cfee240-242f-4d85-b431-4447dbc5bfbb req-0e40d2a5-c13a-434d-b372-17e23ea14ab2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117350 Oct 17 13:41:45.215690 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2770/5549] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:41:45.226462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:45.228795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] [instance: 20fa5eb4-a737-49a1-98e2-228316235bee] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:45.229956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c96d8b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:45.241920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.245717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.246612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.249118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:45.249784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:45.266185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:45.323157 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] HTTP exception thrown: Instance 20fa5eb4-a737-49a1-98e2-228316235bee could not be found. Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Request method failure captured: Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee HTTP/1.1 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVrksH1gbEBo1CGcGkIwh9_V7XZFH8Ne8Z8Bk9_Xd_fjKSlgi0R5rN6O8DuLKzvzT09eLTD6ZUiaYjMfHp7bnCsvsg7MUeSLZPFXljjewiHZVhKvyygme5CTVJ2n-kGuZyJ4WbRc8XDnKBT1iColF8Nv84oRfpQtACqUPD2QPBX956U Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2f41ab167b724769806eab69c5e944bf Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-640770210 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2f41ab167b724769806eab69c5e944bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f41ab167b724769806eab69c5e944bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2f41ab167b724769806eab69c5e944bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2f41ab167b724769806eab69c5e944bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestSecurityGroupsBasicOps-640770210 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2f41ab167b724769806eab69c5e944bf Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-640770210 Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestSecurityGroupsBasicOps-640770210-project Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f32f2340dcd144efb568e55679e758eb Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestSecurityGroupsBasicOps-640770210-project Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 20fa5eb4-a737-49a1-98e2-228316235bee could not be found. Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '20fa5eb4-a737-49a1-98e2-228316235bee'} Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20fa5eb4-a737-49a1-98e2-228316235bee could not be found. Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20fa5eb4-a737-49a1-98e2-228316235bee could not be found. Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:45.325890 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20fa5eb4-a737-49a1-98e2-228316235bee could not be found. Oct 17 13:41:45.332362 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:41:45.335585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Returning 404 to user: Instance 20fa5eb4-a737-49a1-98e2-228316235bee could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:45.336732 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a97695d-bc44-471a-ac21-0273392716b8 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee" status: 404 len: 111 microversion: 2.1 time: 0.119652 Oct 17 13:41:45.337610 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2771/5550] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:45 2022] GET /compute/v2.1/servers/20fa5eb4-a737-49a1-98e2-228316235bee => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:46.119553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:46.120806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:46.142600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.143247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.144860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:46.146078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:46.149345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:46.151035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:46.195208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:41:46.195669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 2f3f2c73-a248-4f94-a862-97d55d610f8d not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:41:46.196212 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.196212 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d HTTP/1.1 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2f3f2c73-a248-4f94-a862-97d55d610f8d'} Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:41:46.198206 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-835763f6-5726-4e91-8536-67feb99cbc2a'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a5ff42a-c3f3-4768-bb3e-c413a59dcda9 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d" status: 404 len: 194 microversion: 2.1 time: 0.992655 Oct 17 13:41:46.207460 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2780/5551] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:41:45 2022] GET /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d => generated 194 bytes in 995 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:41:46.216858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef32e08b-83b7-4c44-9b83-c6023c213931 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419db4b820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:46.705794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:46.723170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce8f2a09-085d-43f6-8827-d8b4607f9320 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 0.608325 Oct 17 13:41:46.724147 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2772/5552] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:46 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:47.275379 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef32e08b-83b7-4c44-9b83-c6023c213931 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.071036 Oct 17 13:41:47.275974 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2781/5553] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:41:46 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:47.295030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e23696da-3fb4-47c0-900c-106a071de7f0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419ca4d940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-188419497", "description": "tempest-description-345323839"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:47.746138 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:41:47.746397 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 13:41:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 (ip 10.222.0.65) !!! Oct 17 13:41:47.752707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:47.753607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:47.803850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.803850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.804100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:47.811884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:47.812408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:47.812840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:48.039160 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e23696da-3fb4-47c0-900c-106a071de7f0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.749646 Oct 17 13:41:48.040014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2773/5554] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:47 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:48.053865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55b00300-895b-45ed-a9c5-702fb58c79fb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419cf5bee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1160128600", "description": "tempest-description-547008618"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:48.442756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:48.456323 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82dc2d83-f1a0-4a02-9635-199e95539ea2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1368 microversion: 2.1 time: 0.711598 Oct 17 13:41:48.456925 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2782/5555] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:47 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1368 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:49.162354 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55b00300-895b-45ed-a9c5-702fb58c79fb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.112413 Oct 17 13:41:49.163267 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2774/5556] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:41:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:49.463154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-485125790", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "44a17d60-db8f-4fea-a9e0-b21b7134969b"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:49.483002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:49.483708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:49.506014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.506618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.507138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.508194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:49.508738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:49.509271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:49.578303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] validate_networks() for [('44a17d60-db8f-4fea-a9e0-b21b7134969b', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:41:50.114746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:50.123620 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f3a41b0-dfdc-4cfe-b570-c1177205537e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1558 microversion: 2.1 time: 0.644463 Oct 17 13:41:50.124203 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2775/5557] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:49 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1558 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:41:50.159091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:50.167891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:50.176087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.178329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.179298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.180283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:50.180989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:50.181694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:50.415959 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7712f912-bf21-4bb7-958f-6767c244be72 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.261625 Oct 17 13:41:50.417040 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2776/5558] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:41:50 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:51.980122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:41:51.980956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:41:51.982234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:41:51.983133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:41:51.983670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:41:52.008874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:52.013609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:52.014210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:52.015765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:52.019060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:52.023461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:52.111620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Getting quotas for project 1ef1ff3328ba43d1a001194efc77b279. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:41:52.127617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Getting quotas for user cad6c700cddf4c1a8e505bca59de2354 and project 1ef1ff3328ba43d1a001194efc77b279. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:41:52.160816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:41:52.166630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:41:52.256818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2675908e-6cb6-4011-842b-7d98fc13e7db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.798337 Oct 17 13:41:52.258604 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2783/5559] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:41:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:41:52.273966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1b44719-cbd8-4981-8d8a-1cf0b3c43870 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:52.275135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c1b44719-cbd8-4981-8d8a-1cf0b3c43870 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:53.655738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c1b44719-cbd8-4981-8d8a-1cf0b3c43870 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:53.676836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c1b44719-cbd8-4981-8d8a-1cf0b3c43870 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1215 microversion: 2.1 time: 1.410613 Oct 17 13:41:53.683607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2777/5560] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:52 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1215 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:54.709804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:54.711717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:54.724634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.727355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.727984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:54.730769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:54.732837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:54.733729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:55.343850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:55.367567 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eee444dd-b606-4be4-a390-0c4ef8b639ff tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1273 microversion: 2.1 time: 0.664555 Oct 17 13:41:55.369827 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2784/5561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:54 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1273 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:56.396985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:56.398472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:56.426953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.432738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.434976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.435739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.439492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.441060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.595901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c5ec98ba-4bf4-47be-975f-19b9c2624070 req-3ade6432-3ddc-4b38-ac6f-17b66442c9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "055ef0c4-201a-40d9-85ce-76df354ecd13", "tag": "10e4b360-45e3-4dcb-8b9a-d994990587a0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:41:56.621118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c5ec98ba-4bf4-47be-975f-19b9c2624070 req-3ade6432-3ddc-4b38-ac6f-17b66442c9b5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:56.621954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c5ec98ba-4bf4-47be-975f-19b9c2624070 req-3ade6432-3ddc-4b38-ac6f-17b66442c9b5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:56.622662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c5ec98ba-4bf4-47be-975f-19b9c2624070 req-3ade6432-3ddc-4b38-ac6f-17b66442c9b5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:56.647083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=58 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:41:56.653844 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c5ec98ba-4bf4-47be-975f-19b9c2624070 req-3ade6432-3ddc-4b38-ac6f-17b66442c9b5 service nova] Creating event network-changed:10e4b360-45e3-4dcb-8b9a-d994990587a0 for instance 055ef0c4-201a-40d9-85ce-76df354ecd13 on n-h2-854121-14 Oct 17 13:41:56.676289 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c5ec98ba-4bf4-47be-975f-19b9c2624070 req-3ade6432-3ddc-4b38-ac6f-17b66442c9b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.519454 Oct 17 13:41:56.677943 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2778/5562] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:41:56.902850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:56.916869 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0148863-1e9c-44a3-b1dd-c9bce113dc65 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1273 microversion: 2.1 time: 0.525113 Oct 17 13:41:56.930311 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2785/5563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:56 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1273 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:57.945023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:57.945849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:57.979675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.980187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.980634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:57.983926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:57.984432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:57.984891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:58.461480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:41:58.472149 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a17e60e-7e6b-41ac-a4ad-73f5bc6b3436 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1273 microversion: 2.1 time: 0.532185 Oct 17 13:41:58.488166 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2779/5564] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:57 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1273 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:41:58.734599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1abd665d-43dd-4d15-b64b-1e9dae1f5297 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] Calling method '.version_select at 0x7f419ccbf0d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:58.780763 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1abd665d-43dd-4d15-b64b-1e9dae1f5297 tempest-TestSecurityGroupsBasicOps-640770210 tempest-TestSecurityGroupsBasicOps-640770210-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2145980120" status: 202 len: 0 microversion: 2.1 time: 0.052731 Oct 17 13:41:58.789247 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2786/5565] 10.222.0.65 () {58 vars in 1278 bytes} [Mon Oct 17 13:41:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2145980120 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:41:59.515431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:41:59.516151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:41:59.535593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.536176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.536826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:41:59.540350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:41:59.541051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:41:59.541667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:01.258786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:01.280881 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb7a300d-63ee-4f4d-90c8-c92a78981d5e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 1.770949 Oct 17 13:42:01.300922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2780/5566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:41:59 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:02.309251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:02.310574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:02.325058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:02.326154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:02.329423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.336008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.336136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:02.337153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:02.338130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:02.338754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:03.007106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:03.027519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f85bcefd-857b-44f5-a7a5-97b3af23dda2 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.723054 Oct 17 13:42:03.037484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2787/5567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:02 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:04.059247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:04.060591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:04.076585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-eaef19c0-1998-4b3d-b5df-e7922186f65b req-c33a2e58-c403-4c7e-9730-09ce6f75c36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2a7771-2243-4da2-a5d3-2b5c7155fc14", "tag": "5878c1b2-fa57-4be7-a34a-52b59efc78f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:04.087992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:04.104955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.105535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.105986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.106727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.107180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.115534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.117717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-eaef19c0-1998-4b3d-b5df-e7922186f65b req-c33a2e58-c403-4c7e-9730-09ce6f75c36b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:04.123212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-eaef19c0-1998-4b3d-b5df-e7922186f65b req-c33a2e58-c403-4c7e-9730-09ce6f75c36b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:04.123949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-eaef19c0-1998-4b3d-b5df-e7922186f65b req-c33a2e58-c403-4c7e-9730-09ce6f75c36b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:04.174976 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-eaef19c0-1998-4b3d-b5df-e7922186f65b req-c33a2e58-c403-4c7e-9730-09ce6f75c36b service nova] Creating event network-changed:5878c1b2-fa57-4be7-a34a-52b59efc78f3 for instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 on n-h1-854121-14 Oct 17 13:42:04.194732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-eaef19c0-1998-4b3d-b5df-e7922186f65b req-c33a2e58-c403-4c7e-9730-09ce6f75c36b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123065 Oct 17 13:42:04.199841 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2788/5568] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:42:04.725776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:04.748308 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02ba2b7d-2307-443c-bba8-e0cdc0780f0e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.694095 Oct 17 13:42:04.761481 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2781/5569] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:04 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:05.779390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:05.780962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:05.791748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:05.808113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.809980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.814559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.816373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:05.817742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:05.818396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:05.880754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:06.091662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:06.111450 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0865b8b0-b3a5-4ef7-a474-2d5bb2b0370c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.336690 Oct 17 13:42:06.133537 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2789/5570] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:05 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:07.138038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:07.139111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:07.153660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.154160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.154692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:07.155413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:07.159214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:07.159988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:08.001796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:08.014975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8fd774a-2d6d-436e-8e66-6d42aa82d29a tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.882668 Oct 17 13:42:08.018841 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2782/5571] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:07 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:09.059107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:09.060546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:09.106580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:09.110944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:09.114989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:09.115958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:09.119680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:09.120309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:09.605805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:09.647017 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a70a971-cb71-4a0c-99d2-6c464c7369d3 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.609007 Oct 17 13:42:09.662682 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2790/5572] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:09 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:10.683280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:10.683913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:10.696485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=28 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:10.703238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:10.703738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:10.714452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:10.715322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:10.722377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:10.723828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:11.139789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:11.155493 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bda329f9-75e6-454f-8501-d9efb07fea9f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.479809 Oct 17 13:42:11.179977 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2783/5573] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:10 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:12.186786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:12.187462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:12.202726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:12.206176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:12.206688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:12.207425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:12.207892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:12.208328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:12.547587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:12.560661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9921f97d-4010-48f5-906d-46123750664f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.379005 Oct 17 13:42:12.563452 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2791/5574] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:12 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:12.744126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d653ac6d-4227-4f0a-9af8-0eb0b680c971 req-7a1f6b0e-e04c-4a7a-b2e2-a6c2041c4de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2a7771-2243-4da2-a5d3-2b5c7155fc14", "name": "network-vif-plugged", "status": "completed", "tag": "5878c1b2-fa57-4be7-a34a-52b59efc78f3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:12.762758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d653ac6d-4227-4f0a-9af8-0eb0b680c971 req-7a1f6b0e-e04c-4a7a-b2e2-a6c2041c4de6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:12.763248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d653ac6d-4227-4f0a-9af8-0eb0b680c971 req-7a1f6b0e-e04c-4a7a-b2e2-a6c2041c4de6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:12.771319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d653ac6d-4227-4f0a-9af8-0eb0b680c971 req-7a1f6b0e-e04c-4a7a-b2e2-a6c2041c4de6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:12.796053 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d653ac6d-4227-4f0a-9af8-0eb0b680c971 req-7a1f6b0e-e04c-4a7a-b2e2-a6c2041c4de6 service nova] Creating event network-vif-plugged:5878c1b2-fa57-4be7-a34a-52b59efc78f3 for instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 on n-h1-854121-14 Oct 17 13:42:12.811031 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d653ac6d-4227-4f0a-9af8-0eb0b680c971 req-7a1f6b0e-e04c-4a7a-b2e2-a6c2041c4de6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075807 Oct 17 13:42:12.823302 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2784/5575] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:13.589511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:13.590353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:13.608006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.608620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.609208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.610043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:13.611324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:13.612015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:13.964329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:13.976008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a6d7e75-2951-4364-bbf8-bf686e20fed8 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1315 microversion: 2.1 time: 0.391634 Oct 17 13:42:13.976825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2792/5576] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:13 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:15.005553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:15.007228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.024577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.028696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.035972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.037315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.037970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.039119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.433876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:15.447330 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d5e3604-badf-45aa-ba94-4d93d7cd8a03 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1502 microversion: 2.1 time: 0.445925 Oct 17 13:42:15.448412 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2785/5577] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:14 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1502 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:15.479470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-188419497"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:15.480661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:15.488401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.492641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.493322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.495051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:15.496210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:15.496838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:15.822531 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.network.security_group_api [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Adding security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 to port 5878c1b2-fa57-4be7-a34a-52b59efc78f3 Oct 17 13:42:16.825205 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-efe23c40-a909-4d82-a6f2-3f6d04ddbcf6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14/action" status: 202 len: 0 microversion: 2.1 time: 1.351554 Oct 17 13:42:16.826319 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2793/5578] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:15 2022] POST /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14/action => generated 0 bytes in 1354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:16.838592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec9c07fe-5c3d-4dcf-b0bc-03be321e9f6b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ca2df70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:16.887249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-71180c10-d910-4cdf-a935-65d788e62e1d req-e3240107-c668-4540-be2f-37f5b671ef21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2a7771-2243-4da2-a5d3-2b5c7155fc14", "tag": "5878c1b2-fa57-4be7-a34a-52b59efc78f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:16.915073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-71180c10-d910-4cdf-a935-65d788e62e1d req-e3240107-c668-4540-be2f-37f5b671ef21 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:16.917833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-71180c10-d910-4cdf-a935-65d788e62e1d req-e3240107-c668-4540-be2f-37f5b671ef21 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:16.918298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-71180c10-d910-4cdf-a935-65d788e62e1d req-e3240107-c668-4540-be2f-37f5b671ef21 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:16.955580 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-71180c10-d910-4cdf-a935-65d788e62e1d req-e3240107-c668-4540-be2f-37f5b671ef21 service nova] Creating event network-changed:5878c1b2-fa57-4be7-a34a-52b59efc78f3 for instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 on n-h1-854121-14 Oct 17 13:42:16.967434 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-71180c10-d910-4cdf-a935-65d788e62e1d req-e3240107-c668-4540-be2f-37f5b671ef21 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083582 Oct 17 13:42:16.969137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2794/5579] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:17.130586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-ec9c07fe-5c3d-4dcf-b0bc-03be321e9f6b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use.", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:17.131296 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ec9c07fe-5c3d-4dcf-b0bc-03be321e9f6b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.131296 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec9c07fe-5c3d-4dcf-b0bc-03be321e9f6b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 HTTP/1.1 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: exception: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8327b66f-bb7a-4a65-b9bb-3bf4da0a3833'} Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:17.133845 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec9c07fe-5c3d-4dcf-b0bc-03be321e9f6b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 400 to user: Security Group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 in use. Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-05e0291f-2572-4fa3-8571-ee6af519596a'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec9c07fe-5c3d-4dcf-b0bc-03be321e9f6b tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833" status: 400 len: 185 microversion: 2.1 time: 0.304456 Oct 17 13:42:17.137524 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2786/5580] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:16 2022] DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 => generated 185 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:42:17.157893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:17.157893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.169890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.170715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.171177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.171983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.172447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.173905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.345505 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65f67f22-5121-481a-95d2-96aa17052e41 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14/action" status: 202 len: 0 microversion: 2.1 time: 0.200030 Oct 17 13:42:17.346421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2795/5581] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:17 2022] POST /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:17.354625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:17.355379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:17.368697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.371350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.372121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:17.373204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:17.374946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:17.375753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:18.072799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:18.082179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7b1d246-ea9a-476a-bea3-593816ed8d16 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1572 microversion: 2.1 time: 0.731897 Oct 17 13:42:18.082765 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2787/5582] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:17 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1572 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:19.111073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:19.112047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:19.131594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.132421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.133847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.134841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:19.136258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:19.138759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:19.910532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:19.925281 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aaca49e7-28ae-4d73-a459-f7b5fde245a1 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1572 microversion: 2.1 time: 0.819680 Oct 17 13:42:19.947888 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2796/5583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:19 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1572 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:20.956487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:20.957336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:20.978799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.988191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.988961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:20.990139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:20.991136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:20.997399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:21.551361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:21.578445 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14587e22-464c-4d5d-94b5-4785401bb5ac tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1577 microversion: 2.1 time: 0.626632 Oct 17 13:42:21.579752 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2788/5584] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:20 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1577 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:22.604109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:22.604881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:22.624541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:22.625036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:22.625657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:22.626687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:22.627360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:22.628824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:22.943997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:22.952141 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d67bda82-5425-4beb-9ebd-12300b5365c5 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1570 microversion: 2.1 time: 0.352040 Oct 17 13:42:22.952733 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2797/5585] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:22 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1570 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:22.983837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1160128600"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:22.984268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:23.000075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.004596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.006329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:23.007256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:23.008066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:23.009677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:23.287412 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Adding security group 64ef2b7a-646f-4754-b077-7dedc2c83179 to port 5878c1b2-fa57-4be7-a34a-52b59efc78f3 Oct 17 13:42:24.080815 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfd3c7c0-6535-440c-8f7b-81c21c59835d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14/action" status: 202 len: 0 microversion: 2.1 time: 1.104663 Oct 17 13:42:24.082302 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2789/5586] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:42:22 2022] POST /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14/action => generated 0 bytes in 1107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:24.090566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49bea111-cc66-486f-a334-6b7111606cdb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c9cbca0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:24.115422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3a226a9b-fcf7-46b9-a716-d377e2258abe req-86c45a4d-19f7-4f0a-9be0-ee59fddd3833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d2a7771-2243-4da2-a5d3-2b5c7155fc14", "tag": "5878c1b2-fa57-4be7-a34a-52b59efc78f3"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:24.136661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3a226a9b-fcf7-46b9-a716-d377e2258abe req-86c45a4d-19f7-4f0a-9be0-ee59fddd3833 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.137144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3a226a9b-fcf7-46b9-a716-d377e2258abe req-86c45a4d-19f7-4f0a-9be0-ee59fddd3833 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.137598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3a226a9b-fcf7-46b9-a716-d377e2258abe req-86c45a4d-19f7-4f0a-9be0-ee59fddd3833 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.160970 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3a226a9b-fcf7-46b9-a716-d377e2258abe req-86c45a4d-19f7-4f0a-9be0-ee59fddd3833 service nova] Creating event network-changed:5878c1b2-fa57-4be7-a34a-52b59efc78f3 for instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 on n-h1-854121-14 Oct 17 13:42:24.175432 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3a226a9b-fcf7-46b9-a716-d377e2258abe req-86c45a4d-19f7-4f0a-9be0-ee59fddd3833 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065327 Oct 17 13:42:24.176422 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2790/5587] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:24.601924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-49bea111-cc66-486f-a334-6b7111606cdb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use.", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:24.602629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-49bea111-cc66-486f-a334-6b7111606cdb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.602629 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49bea111-cc66-486f-a334-6b7111606cdb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179 HTTP/1.1 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: exception: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '64ef2b7a-646f-4754-b077-7dedc2c83179'} Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:24.604586 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49bea111-cc66-486f-a334-6b7111606cdb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 400 to user: Security Group 64ef2b7a-646f-4754-b077-7dedc2c83179 in use. Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-342d0568-7593-4dd6-bf35-2a570142b889'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49bea111-cc66-486f-a334-6b7111606cdb tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179" status: 400 len: 185 microversion: 2.1 time: 0.519342 Oct 17 13:42:24.608211 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2798/5588] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:24 2022] DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179 => generated 185 bytes in 521 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:42:24.616190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:24.616783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:24.635289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.635790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.636229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.636999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:24.637433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:24.637855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:24.750217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:25.045847 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b10ad07f-2a17-417b-8d54-6153e8e6b6a6 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 204 len: 0 microversion: 2.1 time: 0.433453 Oct 17 13:42:25.049151 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2791/5589] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:24 2022] DELETE /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:25.060647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:25.070136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:25.076953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.077722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.078315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:25.081679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:25.082455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:25.086022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:26.034010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:26.048581 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2758da9-067b-40be-a8ba-80f74dcfb159 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1645 microversion: 2.1 time: 0.996237 Oct 17 13:42:26.069796 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2799/5590] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:25 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1645 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:42:27.082573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:27.084361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:27.103193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.105461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.106463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.107590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:27.111946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:27.112443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:27.774461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:27.791403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d3304277-3324-46ca-aabe-1227c60b8af0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1645 microversion: 2.1 time: 0.711610 Oct 17 13:42:27.792939 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2792/5591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:27 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1645 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:28.080622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8635d227-84c0-453a-b5d0-934862560a27 req-c3cc1f83-f42f-4c67-9168-796926dded8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d2a7771-2243-4da2-a5d3-2b5c7155fc14", "name": "network-vif-deleted", "tag": "5878c1b2-fa57-4be7-a34a-52b59efc78f3"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:28.117077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8635d227-84c0-453a-b5d0-934862560a27 req-c3cc1f83-f42f-4c67-9168-796926dded8c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.119093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8635d227-84c0-453a-b5d0-934862560a27 req-c3cc1f83-f42f-4c67-9168-796926dded8c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.119566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8635d227-84c0-453a-b5d0-934862560a27 req-c3cc1f83-f42f-4c67-9168-796926dded8c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.155442 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8635d227-84c0-453a-b5d0-934862560a27 req-c3cc1f83-f42f-4c67-9168-796926dded8c service nova] Creating event network-vif-deleted:5878c1b2-fa57-4be7-a34a-52b59efc78f3 for instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 on n-h1-854121-14 Oct 17 13:42:28.174256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8635d227-84c0-453a-b5d0-934862560a27 req-c3cc1f83-f42f-4c67-9168-796926dded8c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099800 Oct 17 13:42:28.182491 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2800/5592] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:28.828710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:28.829561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:28.858494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.862165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.862616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.875082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.876420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.876992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.883917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:28.995127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:28.995658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:28.996108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:28.996574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lazy-loading 'fault' on Instance uuid 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:29.059313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:29.067880 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-81fb2ac5-9193-4545-965f-63ad73e7a486 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 200 len: 1305 microversion: 2.1 time: 0.252563 Oct 17 13:42:29.069104 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2793/5593] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:28 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 1305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:30.096044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:30.097987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:30.119890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.120982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.121943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:30.123151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:30.123842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:30.125109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:30.167916 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 HTTP/1.1 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '1d2a7771-2243-4da2-a5d3-2b5c7155fc14'} Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:30.172870 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:30.176970 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:30.179262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:30.181646 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-185f0c17-d8f0-4e7b-9325-40916fc9acb4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 404 len: 111 microversion: 2.1 time: 0.093425 Oct 17 13:42:30.184198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2801/5594] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:30 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:30.194681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e13336d-8962-4b4c-b8f4-417e70b32ec4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ca29040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:30.948625 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e13336d-8962-4b4c-b8f4-417e70b32ec4 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833" status: 202 len: 0 microversion: 2.1 time: 0.761178 Oct 17 13:42:30.949461 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2794/5595] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:30 2022] DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:30.958931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e1927c6-63be-4ef0-9857-6c0e0f0942e7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419cd4dc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:31.587093 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e1927c6-63be-4ef0-9857-6c0e0f0942e7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179" status: 202 len: 0 microversion: 2.1 time: 0.633239 Oct 17 13:42:31.590648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2802/5596] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:30 2022] DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:31.603753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f70f83a5-c13a-4e9a-ac72-80c266a08ba7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'create', calling method: .version_select at 0x7f419ca39700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-877078148", "description": "tempest-description-1303317286"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:33.151501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f70f83a5-c13a-4e9a-ac72-80c266a08ba7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.553508 Oct 17 13:42:33.152874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2795/5597] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:42:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:33.173026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dffcaf27-4ded-4309-9651-c70b49a1e0b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Action: 'update', calling method: .version_select at 0x7f419c99a430>, body: {"security_group": {"name": "tempest-sg-hth-519566600", "description": "tempest-description-hth-1428759420"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:33.732789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dffcaf27-4ded-4309-9651-c70b49a1e0b7 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "PUT /compute/v2.1/os-security-groups/5efbbbb0-5a2f-4d1d-803c-b61338737dbe" status: 200 len: 217 microversion: 2.1 time: 0.566519 Oct 17 13:42:33.746645 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2803/5598] 10.222.0.65 () {60 vars in 1290 bytes} [Mon Oct 17 13:42:33 2022] PUT /compute/v2.1/os-security-groups/5efbbbb0-5a2f-4d1d-803c-b61338737dbe => generated 217 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:33.748492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69760784-f52d-4d4b-94e6-502fcd94af1e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419cde8280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:33.886652 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69760784-f52d-4d4b-94e6-502fcd94af1e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/os-security-groups/5efbbbb0-5a2f-4d1d-803c-b61338737dbe" status: 200 len: 217 microversion: 2.1 time: 0.143589 Oct 17 13:42:33.888123 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2796/5599] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:42:33 2022] GET /compute/v2.1/os-security-groups/5efbbbb0-5a2f-4d1d-803c-b61338737dbe => generated 217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:33.901747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95a07857-88ed-49c3-ab69-0c9c19f2ef2d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419db4b1f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.317327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95a07857-88ed-49c3-ab69-0c9c19f2ef2d tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/5efbbbb0-5a2f-4d1d-803c-b61338737dbe" status: 202 len: 0 microversion: 2.1 time: 0.418979 Oct 17 13:42:34.319110 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2804/5600] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:33 2022] DELETE /compute/v2.1/os-security-groups/5efbbbb0-5a2f-4d1d-803c-b61338737dbe => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:34.327176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.327695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:34.335122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.335778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.336366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.337555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.344616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.345538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.374959 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 HTTP/1.1 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '1d2a7771-2243-4da2-a5d3-2b5c7155fc14'} Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:34.378295 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.382315 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.385059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.386241 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a5b737f-0c63-42c0-bbd9-ada1fa1e869e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 404 len: 111 microversion: 2.1 time: 0.063483 Oct 17 13:42:34.386857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2797/5601] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.395851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.397276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 1d2a7771-2243-4da2-a5d3-2b5c7155fc14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:34.405494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.405989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.406451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.407830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:34.408383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:34.408814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:34.441576 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 HTTP/1.1 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '1d2a7771-2243-4da2-a5d3-2b5c7155fc14'} Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.443427 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Instance 1d2a7771-2243-4da2-a5d3-2b5c7155fc14 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eeb0e345-5320-4321-aa20-04dc56be4161 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14" status: 404 len: 111 microversion: 2.1 time: 0.053586 Oct 17 13:42:34.447541 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2805/5602] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:34 2022] GET /compute/v2.1/servers/1d2a7771-2243-4da2-a5d3-2b5c7155fc14 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.456309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ca389d0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.491826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:34.492436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 64ef2b7a-646f-4754-b077-7dedc2c83179 not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:34.493561 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.493561 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179 HTTP/1.1 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '64ef2b7a-646f-4754-b077-7dedc2c83179'} Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:34.495489 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 64ef2b7a-646f-4754-b077-7dedc2c83179 does not exist Oct 17 13:42:34.499559 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-31f4ef2d-bed7-40c3-9458-99d1d10a8992'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.502174 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e386b76c-06b3-486c-8c67-8137826cde30 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179" status: 404 len: 194 microversion: 2.1 time: 0.050628 Oct 17 13:42:34.503366 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2798/5603] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/os-security-groups/64ef2b7a-646f-4754-b077-7dedc2c83179 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.519869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419cd2cb80>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.551935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:34.552546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:34.553065 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.553065 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 HTTP/1.1 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '8327b66f-bb7a-4a65-b9bb-3bf4da0a3833'} Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:34.554919 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 does not exist Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-eeea4e0a-3e71-4788-9add-c02c0d5dde89'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebe28f13-8d80-4d1a-86cf-740a2aed1904 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833" status: 404 len: 194 microversion: 2.1 time: 0.048672 Oct 17 13:42:34.558613 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2806/5604] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/os-security-groups/8327b66f-bb7a-4a65-b9bb-3bf4da0a3833 => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.574065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419ce07040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.628641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:34.629401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 2f3f2c73-a248-4f94-a862-97d55d610f8d not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:34.638190 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.638190 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d HTTP/1.1 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '2f3f2c73-a248-4f94-a862-97d55d610f8d'} Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:34.641991 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 2f3f2c73-a248-4f94-a862-97d55d610f8d does not exist Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-d45ff0e8-81e3-4ce9-b6c3-4b7d53499374'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e826c0d1-eca9-45b3-969f-bfa0757ba9db tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d" status: 404 len: 194 microversion: 2.1 time: 0.078190 Oct 17 13:42:34.645391 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2799/5605] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/os-security-groups/2f3f2c73-a248-4f94-a862-97d55d610f8d => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.651970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c8e7940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.700186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:34.702930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group a2b7e870-c271-4229-b2e1-c6cf623aa011 not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:34.715828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.715828 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011 HTTP/1.1 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a2b7e870-c271-4229-b2e1-c6cf623aa011'} Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:34.717777 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] Oct 17 13:42:34.721770 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.724390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group a2b7e870-c271-4229-b2e1-c6cf623aa011 does not exist Oct 17 13:42:34.724390 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-1f283f9b-38af-4998-9db2-54c88efcb75a'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.725671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0cceb21-1952-4043-bb3f-5d458a16d9a0 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011" status: 404 len: 194 microversion: 2.1 time: 0.077185 Oct 17 13:42:34.729096 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2807/5606] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/os-security-groups/a2b7e870-c271-4229-b2e1-c6cf623aa011 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.736204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419df33dc0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.859437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist", "detail": ""}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:34.863318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.security_group_api [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 not found {{(pid=120698) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:34.863923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.863923 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24 HTTP/1.1 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: exception: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '3800dc7a-3e1b-4a17-9e77-342a04d84e24'} Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:34.866063 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 3800dc7a-3e1b-4a17-9e77-342a04d84e24 does not exist Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: Neutron server returns request_ids: ['req-4eeaf429-e0be-4f23-a77d-31c4452b3821'] {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.869516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ead68a4-102b-4887-b055-e07d47e9224f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24" status: 404 len: 194 microversion: 2.1 time: 0.137163 Oct 17 13:42:34.871881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2800/5607] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/os-security-groups/3800dc7a-3e1b-4a17-9e77-342a04d84e24 => generated 194 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:34.881134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f41a1ff5550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:34.983657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG neutronclient.v2_0.client [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist", "detail": ""}} {{(pid=120697) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 13:42:34.984504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.security_group_api [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Neutron security group 188649c7-8214-450a-89b7-e23d6f617053 not found {{(pid=120697) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 17 13:42:34.985933 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.985933 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053 HTTP/1.1 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: exception: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '188649c7-8214-450a-89b7-e23d6f617053'} Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 17 13:42:34.988360 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] Oct 17 13:42:34.992011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:34.997026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Security group 188649c7-8214-450a-89b7-e23d6f617053 does not exist Oct 17 13:42:34.997026 n-d-854121-14 devstack@n-api.service[120697]: Neutron server returns request_ids: ['req-9e26a9ac-6a59-4456-8d04-f81efba14f7d'] {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:34.998809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ca1c6ef-0091-4af1-934c-323cf5c45368 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053" status: 404 len: 194 microversion: 2.1 time: 0.125901 Oct 17 13:42:35.000162 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2808/5608] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:34 2022] DELETE /compute/v2.1/os-security-groups/188649c7-8214-450a-89b7-e23d6f617053 => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:35.011436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:35.012097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:35.020013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.020505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.020942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.021677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.030810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.031341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.123526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:42:35.384045 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb56c946-ade1-4a07-92c5-6da5a538683e tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 204 len: 0 microversion: 2.1 time: 0.376835 Oct 17 13:42:35.385479 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2801/5609] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:42:35 2022] DELETE /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:42:35.394062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:35.395821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:35.433393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.440395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.441048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.441895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:35.442364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:35.442801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:35.873878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:35.895254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5879588b-7836-4657-bce1-040eae1d7d93 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1646 microversion: 2.1 time: 0.501194 Oct 17 13:42:35.912678 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2809/5610] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:35 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1646 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:36.938589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:36.940295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:36.954876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:36.955974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:36.958357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:36.959329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:36.962790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:36.963509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:37.601720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:37.621671 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7fe108ac-1f5c-4e5a-bca5-43596112f0ef tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1646 microversion: 2.1 time: 0.693280 Oct 17 13:42:37.665721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2802/5611] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:36 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1646 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:38.064186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ab904089-cf28-4fb4-8679-f4e8da01340d req-9c787ebc-c32e-4267-ba1d-290eeeaa711b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d6626c-5ca5-413d-a5ee-7d271e246f36", "name": "network-vif-deleted", "tag": "533cef1f-23ab-428c-808d-2a2b2dd4074e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:42:38.075269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=28 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:38.099316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ab904089-cf28-4fb4-8679-f4e8da01340d req-9c787ebc-c32e-4267-ba1d-290eeeaa711b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:38.099861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ab904089-cf28-4fb4-8679-f4e8da01340d req-9c787ebc-c32e-4267-ba1d-290eeeaa711b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:38.114642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ab904089-cf28-4fb4-8679-f4e8da01340d req-9c787ebc-c32e-4267-ba1d-290eeeaa711b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:38.127833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:38.162039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ab904089-cf28-4fb4-8679-f4e8da01340d req-9c787ebc-c32e-4267-ba1d-290eeeaa711b service nova] Creating event network-vif-deleted:533cef1f-23ab-428c-808d-2a2b2dd4074e for instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 on n-h1-854121-14 Oct 17 13:42:38.173295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ab904089-cf28-4fb4-8679-f4e8da01340d req-9c787ebc-c32e-4267-ba1d-290eeeaa711b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112256 Oct 17 13:42:38.177714 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2810/5612] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:42:38.661491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:38.662161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:38.674758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:38.675269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:38.677129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:38.681945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:38.682671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:38.685088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:38.761790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:38.767939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:38.768854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:38.770074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lazy-loading 'fault' on Instance uuid 64d6626c-5ca5-413d-a5ee-7d271e246f36 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:42:38.872595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cad6c700cddf4c1a8e505bca59de2354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ef1ff3328ba43d1a001194efc77b279', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:42:38.884080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8facddec-20da-4913-b4ae-8785e13df17c tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 200 len: 1305 microversion: 2.1 time: 0.228784 Oct 17 13:42:38.884604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2803/5613] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:38 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:42:39.916911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:39.917554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] [instance: 64d6626c-5ca5-413d-a5ee-7d271e246f36] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:42:39.931703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:39.934598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:39.938450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:39.940395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:39.949480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:39.949942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:39.988529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] HTTP exception thrown: Instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 could not be found. Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Request method failure captured: Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 HTTP/1.1 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVth6StyJmy9bzQ57bI-wnqr8e_FVwlpjne6Wpf9KDGQBFJYPu9VaAexRBO1rNNKgOX3N0u_Qg3Pt4nH8OmKeXHQun6qwJvkq77zToboofgQQuyLqc1jRPNI6x0Ux1r9hVtMC8NYCVKWhtSFlBwGwWwUFP2fXdm28rCulM2EfolzCI8 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1ef1ff3328ba43d1a001194efc77b279"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1ef1ff3328ba43d1a001194efc77b279 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1500841767 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: cad6c700cddf4c1a8e505bca59de2354 Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-SecurityGroupsTestJSON-1500841767-project Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 could not be found. Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '64d6626c-5ca5-413d-a5ee-7d271e246f36'} Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 could not be found. Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 could not be found. Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:42:39.990533 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 could not be found. Oct 17 13:42:39.994863 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:42:39.997106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Returning 404 to user: Instance 64d6626c-5ca5-413d-a5ee-7d271e246f36 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:42:39.998308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d23b61a2-e78f-4e4c-8fc7-8c473240eb8f tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36" status: 404 len: 111 microversion: 2.1 time: 0.088829 Oct 17 13:42:39.999330 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2811/5614] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:42:39 2022] GET /compute/v2.1/servers/64d6626c-5ca5-413d-a5ee-7d271e246f36 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:42:40.012620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f35e8a00-8d94-43ca-9d92-2a3c1cfdb0ea tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419cf021f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:40.480926 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f35e8a00-8d94-43ca-9d92-2a3c1cfdb0ea tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/5bbf7f08-a779-4261-8eca-12dc59279bc9" status: 202 len: 0 microversion: 2.1 time: 0.476788 Oct 17 13:42:40.482436 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2804/5615] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:40 2022] DELETE /compute/v2.1/os-security-groups/5bbf7f08-a779-4261-8eca-12dc59279bc9 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:40.490830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c47265c-e14a-4f9b-ba40-e5c3db7a4223 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] Calling method '.version_select at 0x7f419c96dc10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:40.891010 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c47265c-e14a-4f9b-ba40-e5c3db7a4223 tempest-SecurityGroupsTestJSON-1500841767 tempest-SecurityGroupsTestJSON-1500841767-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/b41026da-3c6c-4cb8-a50d-73f50cce148f" status: 202 len: 0 microversion: 2.1 time: 0.403932 Oct 17 13:42:40.891621 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2812/5616] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:42:40 2022] DELETE /compute/v2.1/os-security-groups/b41026da-3c6c-4cb8-a50d-73f50cce148f => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:42:53.628142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:53.629398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:42:53.845184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:42:53.847480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.849364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.850339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.852534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:42:53.853615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:42:53.855866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:42:53.907692 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48926b8a-3832-4cc6-acea-0a9b8de49a7d tempest-AZV2TestJSON-1155558828 tempest-AZV2TestJSON-1155558828-project] 10.222.0.65 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.288214 Oct 17 13:42:53.908301 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2805/5617] 10.222.0.65 () {58 vars in 1164 bytes} [Mon Oct 17 13:42:53 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:00.033816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.037719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.048184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:00.049201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:00.050952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.051681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.052265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.053152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.053793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.054376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.137483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89fefcbf-10c9-4f3f-ae7d-7977d63a0951 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/ips" status: 200 len: 149 microversion: 2.1 time: 0.111537 Oct 17 13:43:00.138578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2813/5618] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:43:00 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/ips => generated 149 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:00.150452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92cf451f-e7d0-4a82-a1e7-543f547cfd46"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:00.155462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.168730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.169875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.170477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.171426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.173665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.174530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.311571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Invalid volume: volume 92cf451f-e7d0-4a82-a1e7-543f547cfd46 is already attached to instances: 888adf9b-f81d-46a5-8539-c89ff12a8eb5 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/os-volume_attachments HTTP/1.1 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 74 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: {"volumeAttachment": {"volumeId": "92cf451f-e7d0-4a82-a1e7-543f547cfd46"}} Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid volume: volume 92cf451f-e7d0-4a82-a1e7-543f547cfd46 is already attached to instances: 888adf9b-f81d-46a5-8539-c89ff12a8eb5 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': '055ef0c4-201a-40d9-85ce-76df354ecd13', 'body': {'volumeAttachment': {'volumeId': '92cf451f-e7d0-4a82-a1e7-543f547cfd46'}}} Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 92cf451f-e7d0-4a82-a1e7-543f547cfd46 is already attached to instances: 888adf9b-f81d-46a5-8539-c89ff12a8eb5 Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:00.328455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 92cf451f-e7d0-4a82-a1e7-543f547cfd46 is already attached to instances: 888adf9b-f81d-46a5-8539-c89ff12a8eb5 Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 92cf451f-e7d0-4a82-a1e7-543f547cfd46 is already attached to instances: 888adf9b-f81d-46a5-8539-c89ff12a8eb5 Oct 17 13:43:00.332106 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:00.333356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 400 to user: Invalid volume: volume 92cf451f-e7d0-4a82-a1e7-543f547cfd46 is already attached to instances: 888adf9b-f81d-46a5-8539-c89ff12a8eb5 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:00.334745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10311849-ea23-432e-92d8-9fbde84fd8ce tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.188249 Oct 17 13:43:00.337343 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2806/5619] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:43:00 2022] POST /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13/os-volume_attachments => generated 174 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:43:00.347369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.348408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.360980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.361530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.361978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.362698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.363153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.363577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.462924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:00.757632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b154a090-3af8-45b9-9e14-4ef08025336a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 204 len: 0 microversion: 2.1 time: 0.413566 Oct 17 13:43:00.761977 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2814/5620] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:00 2022] DELETE /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:00.767533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:00.768500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:00.775155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.776000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.776685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:00.777682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:00.778364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:00.779005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:02.413591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:02.428680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db6bdc85-f356-4695-973b-81a4456309bf tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1682 microversion: 2.1 time: 1.664890 Oct 17 13:43:02.450984 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2807/5621] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:00 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1682 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:03.460392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:03.461005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:03.486494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.487017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.487466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:03.494505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:03.495317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:03.495966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:04.479724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:04.496589 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6770de68-0dec-4639-b492-09875050e8de tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1682 microversion: 2.1 time: 1.041542 Oct 17 13:43:04.502100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2815/5622] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:03 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1682 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:05.520852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:05.521635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:05.525420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:05.549461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.557751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.559079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:05.560284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:05.561026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:05.561739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:05.891381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:05.914666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f1944b3-5620-48c7-b99b-b45324917a03 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1614 microversion: 2.1 time: 0.395378 Oct 17 13:43:05.915304 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2808/5623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:05 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1614 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:06.267003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0f6bb53e-6eb1-42df-9dbf-9f1c3feb9000 req-88a66b7c-ef3a-4e4a-a24f-b41b9e250bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "055ef0c4-201a-40d9-85ce-76df354ecd13", "name": "network-vif-deleted", "tag": "10e4b360-45e3-4dcb-8b9a-d994990587a0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:06.286856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f6bb53e-6eb1-42df-9dbf-9f1c3feb9000 req-88a66b7c-ef3a-4e4a-a24f-b41b9e250bf3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:06.287345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f6bb53e-6eb1-42df-9dbf-9f1c3feb9000 req-88a66b7c-ef3a-4e4a-a24f-b41b9e250bf3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:06.288959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f6bb53e-6eb1-42df-9dbf-9f1c3feb9000 req-88a66b7c-ef3a-4e4a-a24f-b41b9e250bf3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:06.350626 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0f6bb53e-6eb1-42df-9dbf-9f1c3feb9000 req-88a66b7c-ef3a-4e4a-a24f-b41b9e250bf3 service nova] Creating event network-vif-deleted:10e4b360-45e3-4dcb-8b9a-d994990587a0 for instance 055ef0c4-201a-40d9-85ce-76df354ecd13 on n-h2-854121-14 Oct 17 13:43:06.360439 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0f6bb53e-6eb1-42df-9dbf-9f1c3feb9000 req-88a66b7c-ef3a-4e4a-a24f-b41b9e250bf3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109049 Oct 17 13:43:06.361445 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2816/5624] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:06.945677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:06.946326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:06.966776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:06.967293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:06.967727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:06.968806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:06.969446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:06.969887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:07.084609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:07.085468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:07.086118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:07.086790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lazy-loading 'fault' on Instance uuid 055ef0c4-201a-40d9-85ce-76df354ecd13 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:07.235109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:07.252349 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d712a421-7aee-4fc3-8806-88ab95fb19b6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 200 len: 1332 microversion: 2.1 time: 0.311940 Oct 17 13:43:07.252983 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2809/5625] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:06 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 1332 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:08.280507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:08.282746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:08.303462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:08.304539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:08.305337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:08.307858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:08.313281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:08.315841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:08.363539 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 HTTP/1.1 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '055ef0c4-201a-40d9-85ce-76df354ecd13'} Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:08.370349 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:43:08.375453 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:08.378271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:08.379350 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-449326a4-61d5-40e5-9d4f-8592724d06a8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 404 len: 111 microversion: 2.1 time: 0.103207 Oct 17 13:43:08.389711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-507ee1f6-3fca-4ea0-90e2-75d8bf823097 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '.version_select at 0x7f419ca2df70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:08.398882 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2817/5626] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:08 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:43:08.442001 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-507ee1f6-3fca-4ea0-90e2-75d8bf823097 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290023254" status: 202 len: 0 microversion: 2.1 time: 0.056870 Oct 17 13:43:08.446281 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2810/5627] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290023254 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:43:10.175826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1342011550", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "473eb6c3-ed54-4ea8-8aeb-12461cff75b3"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:10.301096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] validate_networks() for [('473eb6c3-ed54-4ea8-8aeb-12461cff75b3', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:11.337739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:11.338364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:11.348572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.349591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.350198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.351098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.351698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.352272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.475605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lazy-loading 'services' on Instance uuid 888adf9b-f81d-46a5-8539-c89ff12a8eb5 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:11.627945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:11.628656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:11.629452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:11.642389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:11.643075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:11.661548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.662226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.662849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.663753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.665672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.671804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.715323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Getting quotas for project 23d8baaa30cc47279d88553d269243a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:11.728816 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca6ae67c-5fe3-448c-b91f-b32d4844a437 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments/92cf451f-e7d0-4a82-a1e7-543f547cfd46" status: 202 len: 0 microversion: 2.1 time: 0.395887 Oct 17 13:43:11.729564 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2811/5628] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:43:11 2022] DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments/92cf451f-e7d0-4a82-a1e7-543f547cfd46 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:11.730675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Getting quotas for user 01f605eb1cbc47228b1de034432f41f5 and project 23d8baaa30cc47279d88553d269243a4. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:11.746756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:11.753769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:11.771374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.773782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.774424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.775370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:11.776205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:11.776864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:11.777657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:11.778967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:11.858558 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74506782-f6c7-4a7c-81c1-42a6dd106098 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123360 Oct 17 13:43:11.868784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64631146-3cfc-4f95-a989-6e12f2a18479 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.955435 Oct 17 13:43:11.870402 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2818/5629] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:43:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1958 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:43:11.880457 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2812/5630] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:11 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:11.913538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-10492532-e010-4bdd-b168-ec55aa25618d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:11.917132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-10492532-e010-4bdd-b168-ec55aa25618d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:12.036896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10492532-e010-4bdd-b168-ec55aa25618d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.049225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10492532-e010-4bdd-b168-ec55aa25618d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.052072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-10492532-e010-4bdd-b168-ec55aa25618d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:12.056372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-10492532-e010-4bdd-b168-ec55aa25618d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1259 microversion: 2.21 time: 0.173157 Oct 17 13:43:12.056888 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2819/5631] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:11 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:12.245606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83f65a34-4064-4960-bd73-723934d62c9c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Action: 'create', calling method: .version_select at 0x7f419cf5b790>, body: {"keypair": {"name": "tempest-keypair-592207043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3UZzxfRbGyOkWKeNnqCgrXUfAv3UVgWmraJ67Lp2fJbTFQtFVbY+9kxR6OU7IrNO7vgOyM2ByprPT+TmkZN5B2cbfqOwTWioteXFKbZaqLsPQaz8CYTLMRxdovvLzNmg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:12.301152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-83f65a34-4064-4960-bd73-723934d62c9c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Getting quotas for project 78682401303a44378f5a04ef9042221c. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:12.315408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-83f65a34-4064-4960-bd73-723934d62c9c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Getting quotas for user 966443e3e05a475581d67d2435108449 and project 78682401303a44378f5a04ef9042221c. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:12.374110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83f65a34-4064-4960-bd73-723934d62c9c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.133223 Oct 17 13:43:12.382003 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2813/5632] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:43:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:43:12.872093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:12.875494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:12.893794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.894671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.895334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.896260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:12.897072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:12.897731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:12.970205 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8518b7d3-e861-4b9b-b01d-91b0d50fe0f9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102030 Oct 17 13:43:12.973986 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2820/5633] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:12 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:13.086753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:13.087509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:13.110860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:13.111608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:13.119251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:13.120968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:13.123464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:13.127370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:13.213973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:13.225889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:13.229778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:13.231165 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ae6af7b-81a4-46e9-bff2-f1bfb40b856e tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1263 microversion: 2.21 time: 0.149372 Oct 17 13:43:13.233347 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2814/5634] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:13 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:13.986344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:13.988413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.002244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.006394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.007085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.008023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.009740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.011597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.106547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-440cd08e-e6b6-4962-9d72-40fb4936a633 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124756 Oct 17 13:43:14.112976 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2821/5635] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:13 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:14.261412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:14.262325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:14.283737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.285713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.287922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.288844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:14.297473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:14.298152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:14.545225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.556275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.569238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:14.570873 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c479d6e0-6bcc-4e59-8b37-7201c1c31a03 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1319 microversion: 2.21 time: 0.314077 Oct 17 13:43:14.571593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2815/5636] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:14 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:15.119514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:15.121785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:15.146232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:15.149016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:15.150376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.154143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:15.154790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:15.155425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.223756 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9db697a-cf7c-44af-a33e-6950f8a9345f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107502 Oct 17 13:43:15.224804 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2822/5637] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:15 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:15.598491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:15.599264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:15.671800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:15.673058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:15.673743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.674705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:15.675376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:15.677953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:15.788392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:15.802072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:15.814092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:15.818382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53ae2336-3e25-4a39-8746-ebc399b8e5b9 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1317 microversion: 2.21 time: 0.224420 Oct 17 13:43:15.821481 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2816/5638] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:15 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:16.238907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:16.241810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:16.249093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.250150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.250862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.251674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.252124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.262508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.353537 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4d21bb02-b2c2-4b8d-b9c0-8c4ac841f400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121011 Oct 17 13:43:16.354760 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2823/5639] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:16 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:16.853233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:16.855210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:16.864047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.864981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.865834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:16.866993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:16.867729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:16.868432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.367311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:17.370396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:17.383565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.384265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.384856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.385610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:17.386068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:17.386492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:17.456430 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4922040-65ba-44c7-be01-624cce1d91dd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093716 Oct 17 13:43:17.457016 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2824/5640] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:17 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:43:17.685553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:17.704173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:17.707761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:17.709578 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70ece860-eb3e-4e62-accf-040c576f6676 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 0.862270 Oct 17 13:43:17.725657 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2817/5641] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:16 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:18.447716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1657651099", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d27a0e2a-b97a-462e-a696-6f34d17848c5"}, {"port": "1848ce9e-f330-4669-8fb2-ac7b10fb0a2d", "tag": "port-1"}, {"port": "b1159ddd-a700-459f-8fe7-872c7348c788", "tag": "port-2"}, {"uuid": "98273666-bb0e-46c3-afe4-90f9abec362c", "tag": "net-1"}, {"uuid": "98273666-bb0e-46c3-afe4-90f9abec362c"}, {"uuid": "73cc8091-3be6-44a2-b993-2bb7df7f17f2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "73cc8091-3be6-44a2-b993-2bb7df7f17f2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "001143c1-990e-4088-89ef-588639907d2d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b18bda62-478d-4094-b914-8f1df954193e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "81e1ddc3-f0aa-47ff-9d82-57cc38787879", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--251117198"}], "key_name": "tempest-keypair-592207043", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:18.469770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.472999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:18.515433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.529698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.530431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.535848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.536566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.543749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.629878 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-663191ac-6bb3-4e66-91e6-8ea6a28f5f7d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165555 Oct 17 13:43:18.636376 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2818/5642] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:18 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:18.742365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:18.742982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:18.762318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.779077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.779958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.781440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:18.783600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:18.784241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:18.932600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] validate_networks() for [('d27a0e2a-b97a-462e-a696-6f34d17848c5', None, None, None, None, None), (None, None, '1848ce9e-f330-4669-8fb2-ac7b10fb0a2d', None, None, None), (None, None, 'b1159ddd-a700-459f-8fe7-872c7348c788', None, None, None), ('98273666-bb0e-46c3-afe4-90f9abec362c', None, None, None, None, None), ('98273666-bb0e-46c3-afe4-90f9abec362c', None, None, None, None, None), ('73cc8091-3be6-44a2-b993-2bb7df7f17f2', '10.2.2.100', None, None, None, None), ('73cc8091-3be6-44a2-b993-2bb7df7f17f2', '10.2.2.200', None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:19.947381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:19.964999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:19.973095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:19.974920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-886e29ac-6a30-4e8f-bce8-d0fafa3f8fb7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 1.237322 Oct 17 13:43:20.004027 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2819/5643] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:18 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:20.022082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1c14bc39-e2ad-4a3c-b884-64956feb60e7 req-49be9a51-e4da-4b56-979c-620e174541b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64e79102-b5a8-4bad-a5c0-d1a1540fa51a", "tag": "b268cb47-c416-4e21-ab0f-56775bc6a795"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:20.039056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1c14bc39-e2ad-4a3c-b884-64956feb60e7 req-49be9a51-e4da-4b56-979c-620e174541b3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.039911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1c14bc39-e2ad-4a3c-b884-64956feb60e7 req-49be9a51-e4da-4b56-979c-620e174541b3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.045099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1c14bc39-e2ad-4a3c-b884-64956feb60e7 req-49be9a51-e4da-4b56-979c-620e174541b3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.086747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1c14bc39-e2ad-4a3c-b884-64956feb60e7 req-49be9a51-e4da-4b56-979c-620e174541b3 service nova] Creating event network-changed:b268cb47-c416-4e21-ab0f-56775bc6a795 for instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a on n-h1-854121-14 Oct 17 13:43:20.112341 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1c14bc39-e2ad-4a3c-b884-64956feb60e7 req-49be9a51-e4da-4b56-979c-620e174541b3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105844 Oct 17 13:43:20.116771 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2820/5644] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:20.126934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:20.130534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:20.144510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.145004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.145469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.149966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:20.150732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:20.152773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:20.257081 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df9d1594-50c9-4c51-a2aa-3bcf4aa63a64 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138745 Oct 17 13:43:20.261519 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2821/5645] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:20 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:21.021154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.021863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.039526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.040326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.042617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.045260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.048231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.050280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.694400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:21.758287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:21.771236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:21.773491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:21.775671 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39c2301e-6d82-42b6-a274-c296e4fcc0db tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 0.760643 Oct 17 13:43:21.776766 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2822/5646] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:21 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:21.782561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:21.786042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:21.798248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.798707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.799379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.800327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:21.800985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:21.801635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:21.894028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:21.897814 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cc32b5d-9995-4c73-ad26-3f9936e08863 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119559 Oct 17 13:43:21.899282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2823/5647] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:43:21 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:43:22.018957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:22.019213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:22.042172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:22.044602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.047954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.050262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.051365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.052931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.053831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.146510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:22.307474 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e91480e-ae7f-4e79-b00c-ddd1ffb3e185 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 204 len: 0 microversion: 2.1 time: 0.299562 Oct 17 13:43:22.311985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2824/5648] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:43:22 2022] DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:43:22.318063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:22.327739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:22.336754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:22.340808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.346552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.347271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.348893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.349399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.350024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.708306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:22.722400 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df8f3a36-51c9-4b29-a3a3-6e3388f11fc2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1682 microversion: 2.1 time: 0.408775 Oct 17 13:43:22.751469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2825/5649] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:22 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:22.804489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:22.805771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:22.837206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.838387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.838669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:22.839411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:22.839860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:22.840280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.118691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.132481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.137382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:23.139296 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aed15b59-994c-4225-890a-57bb98418f7f tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 0.340256 Oct 17 13:43:23.142197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2826/5650] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:22 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:23.753032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:23.753771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:23.762257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:23.765601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.766666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.767567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:23.768525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:23.769372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:23.770026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.116707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.129831 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-327067a0-723b-4ff9-bd07-2320b46819a0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1682 microversion: 2.1 time: 0.381647 Oct 17 13:43:24.131442 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2827/5651] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:23 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1682 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:24.169285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:24.170244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:24.188597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.191726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.192358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.200850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.202095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.204681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.473832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:24.475323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:24.476325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:24.477240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:24.478032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:24.498303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.502326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.502995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.505091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:24.507549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:24.508227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:24.552570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Getting quotas for project 78682401303a44378f5a04ef9042221c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:24.576771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Getting quotas for user 966443e3e05a475581d67d2435108449 and project 78682401303a44378f5a04ef9042221c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:24.667100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.681297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.690368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:24.692287 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe743e9a-32c7-4153-a4e4-001b07bcb20d tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 0.526569 Oct 17 13:43:24.692892 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2828/5652] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:24 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:24.944994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:24.948078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='001143c1-990e-4088-89ef-588639907d2d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b18bda62-478d-4094-b914-8f1df954193e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81e1ddc3-f0aa-47ff-9d82-57cc38787879',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:25.161344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.162144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.172326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.172846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.174227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.176921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.179547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.181585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.542240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75550c40-0a77-46bb-ab60-94bd11d19650 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.098354 Oct 17 13:43:25.544230 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2825/5653] 10.222.0.65 () {62 vars in 1189 bytes} [Mon Oct 17 13:43:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 7101 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:43:25.556868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da457714-8ecf-4f3f-9a8a-94d21c2ea45f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.557682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da457714-8ecf-4f3f-9a8a-94d21c2ea45f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.697515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da457714-8ecf-4f3f-9a8a-94d21c2ea45f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.711278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da457714-8ecf-4f3f-9a8a-94d21c2ea45f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.720034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da457714-8ecf-4f3f-9a8a-94d21c2ea45f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.721641 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da457714-8ecf-4f3f-9a8a-94d21c2ea45f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1285 microversion: 2.32 time: 0.169083 Oct 17 13:43:25.722612 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2826/5654] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:25 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:25.744492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:25.745113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:25.768811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.770582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.771481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.775412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:25.776348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:25.777989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:25.820318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:25.831913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-815dbcb4-ad94-4a51-8710-61c18a006243 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1682 microversion: 2.1 time: 0.677289 Oct 17 13:43:25.835344 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2829/5655] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:25 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1682 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:26.464579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ef354629-4650-4c97-b62d-5385b7fb47d2 req-e3bd823a-66aa-4daa-b91b-5cc9f534b628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e79102-b5a8-4bad-a5c0-d1a1540fa51a", "name": "network-vif-plugged", "status": "completed", "tag": "b268cb47-c416-4e21-ab0f-56775bc6a795"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:26.497623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ef354629-4650-4c97-b62d-5385b7fb47d2 req-e3bd823a-66aa-4daa-b91b-5cc9f534b628 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:26.498109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ef354629-4650-4c97-b62d-5385b7fb47d2 req-e3bd823a-66aa-4daa-b91b-5cc9f534b628 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:26.498784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ef354629-4650-4c97-b62d-5385b7fb47d2 req-e3bd823a-66aa-4daa-b91b-5cc9f534b628 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:26.543745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ef354629-4650-4c97-b62d-5385b7fb47d2 req-e3bd823a-66aa-4daa-b91b-5cc9f534b628 service nova] Creating event network-vif-plugged:b268cb47-c416-4e21-ab0f-56775bc6a795 for instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a on n-h1-854121-14 Oct 17 13:43:26.553049 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ef354629-4650-4c97-b62d-5385b7fb47d2 req-e3bd823a-66aa-4daa-b91b-5cc9f534b628 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095887 Oct 17 13:43:26.556463 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2830/5656] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:26.752259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b223c9a-0a97-4833-8815-a0029703111a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.752979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b223c9a-0a97-4833-8815-a0029703111a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:26.954759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b223c9a-0a97-4833-8815-a0029703111a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:26.964756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b223c9a-0a97-4833-8815-a0029703111a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:26.969851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b223c9a-0a97-4833-8815-a0029703111a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:26.972414 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b223c9a-0a97-4833-8815-a0029703111a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1285 microversion: 2.32 time: 0.227659 Oct 17 13:43:26.974109 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2831/5657] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:26.989924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:26.990905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:27.003253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.003763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.004376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.005737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.006839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.007426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.047976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:27.065352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:27.068117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:27.069811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-801debe6-6d14-48b8-b3fb-696eabc9aa28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 1.338127 Oct 17 13:43:27.079787 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2827/5658] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:25 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:27.133031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:27.152570 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1aef5c17-150d-47ab-8d38-a60a7276c0e3 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1614 microversion: 2.1 time: 0.175347 Oct 17 13:43:27.155363 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2832/5659] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:26 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1614 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:27.429644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-206f63cd-f092-408b-9b61-d536c9cdf753 req-52020900-cffa-4a8a-9028-49300200d697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888adf9b-f81d-46a5-8539-c89ff12a8eb5", "name": "network-vif-deleted", "tag": "18735d3c-a2a7-4448-b9f6-1d0b56baaba9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:27.449941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-206f63cd-f092-408b-9b61-d536c9cdf753 req-52020900-cffa-4a8a-9028-49300200d697 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:27.451608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-206f63cd-f092-408b-9b61-d536c9cdf753 req-52020900-cffa-4a8a-9028-49300200d697 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:27.453933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-206f63cd-f092-408b-9b61-d536c9cdf753 req-52020900-cffa-4a8a-9028-49300200d697 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:27.480245 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-206f63cd-f092-408b-9b61-d536c9cdf753 req-52020900-cffa-4a8a-9028-49300200d697 service nova] Creating event network-vif-deleted:18735d3c-a2a7-4448-b9f6-1d0b56baaba9 for instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 on n-h2-854121-14 Oct 17 13:43:27.505131 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-206f63cd-f092-408b-9b61-d536c9cdf753 req-52020900-cffa-4a8a-9028-49300200d697 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079139 Oct 17 13:43:27.520100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2828/5660] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:28.001995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:28.003318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:28.018101 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:43:28.018604 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 13:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 (ip 10.222.0.65) !!! Oct 17 13:43:28.021754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.024711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.025420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.029634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.030303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.031141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.105477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:28.107430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:28.145627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.146645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.149776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.150776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.155598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.156786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.179072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.205257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.207283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.212679 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22a60a3c-7439-4aa4-99c2-dbcafe84a529 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1583 microversion: 2.32 time: 0.215904 Oct 17 13:43:28.217017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2833/5661] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:27 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1583 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:28.229022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:28.230810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:28.251906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.256180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.256673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.257620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.258239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.260537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.337961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:28.341194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:28.344779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:28.345536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lazy-loading 'fault' on Instance uuid 888adf9b-f81d-46a5-8539-c89ff12a8eb5 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:28.553787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.563893 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bce64029-c6e1-4103-9aaa-a71881b6b181 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 200 len: 1331 microversion: 2.1 time: 0.345341 Oct 17 13:43:28.565750 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2834/5662] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:28 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 1331 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:28.840059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.860118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.862892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:28.869360 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a17bbb44-4918-483c-b4fc-276fa120e672 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1359 microversion: 2.21 time: 0.773645 Oct 17 13:43:28.870954 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2829/5663] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:28 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1359 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:29.246420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.247734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:29.256903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.259063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.260415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.263023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.265504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.266201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.591254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.592580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:29.606939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.618736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.620810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.623304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.625067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.626853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.705688 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 HTTP/1.1 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '888adf9b-f81d-46a5-8539-c89ff12a8eb5'} Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:29.707692 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1250a3f-2bf9-4e08-8348-2e45e1b39a3c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 404 len: 111 microversion: 2.1 time: 0.122196 Oct 17 13:43:29.712096 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2830/5664] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:43:29.722809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c17e7215-baac-4db2-8239-cb1b13fc4249 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '.version_select at 0x7f419c96d550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.752746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c17e7215-baac-4db2-8239-cb1b13fc4249 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-109968744" status: 202 len: 0 microversion: 2.1 time: 0.037117 Oct 17 13:43:29.758960 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2831/5665] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:43:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-109968744 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:43:29.900021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:29.900767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:29.922444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.923011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.929193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.930337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:29.930484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:29.931199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:29.931800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:29.961974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:29.967338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:29.979823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb1ea2a8-5623-4294-96b5-12dd75e939fa tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1593 microversion: 2.32 time: 0.737818 Oct 17 13:43:29.988517 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2835/5666] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1593 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:30.315961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.319063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:30.334381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.342949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:30.345798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d79f93bc-c343-4eda-b555-0278e1d4fea7 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1552 microversion: 2.21 time: 0.449803 Oct 17 13:43:30.350525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2832/5667] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:29 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1552 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:30.376925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.377563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:30.384554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.385044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.401804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.402624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.403112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.403559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.498394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:43:30.653598 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19e28455-46d7-469f-b09c-294cf50c9899 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 204 len: 0 microversion: 2.21 time: 0.277361 Oct 17 13:43:30.656570 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2836/5668] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:43:30 2022] DELETE /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:43:30.677591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:30.678618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:30.698471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:30.702305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.702973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.703648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.710996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:30.712585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:30.713040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:30.923470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ffebc01-7cda-4039-8ad2-b84b1f8b9d88 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: .version_select at 0x7f419ca65280>, body: {"keypair": {"name": "tempest-keypair-1741985788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwCL6tZl5j8SjIcL9at2hYm+fR/SPhLBSg4aKBtmaqh+mu3wCg6QDBlxtvunjVRUx+aT933CcYqcwVZui5YXbojub/R+36HoCJlPQ9VrjGBi77XiQM9ah2ZYr8FzSH6lg=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:30.962823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4ffebc01-7cda-4039-8ad2-b84b1f8b9d88 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:30.980669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4ffebc01-7cda-4039-8ad2-b84b1f8b9d88 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:31.051124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ffebc01-7cda-4039-8ad2-b84b1f8b9d88 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130782 Oct 17 13:43:31.051794 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2837/5669] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:43:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:31.075779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:31.076591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:31.098458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.100176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.102077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.103606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:31.105266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:31.105952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:31.812779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.829943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.831548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:31.837865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05499f6f-a31c-41d3-9503-fc72135fdc06 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1558 microversion: 2.21 time: 1.176725 Oct 17 13:43:31.838735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2833/5670] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:30 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1558 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:31.992756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.005333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.007419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:32.008824 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17cc00d4-b5d9-435a-b3f1-6c9cd0b70295 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1660 microversion: 2.32 time: 0.945607 Oct 17 13:43:32.009843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2838/5671] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:31 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1660 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:32.868119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:32.868951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:32.887873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.891299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.892628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:32.894253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:32.897562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:32.898998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:33.043147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:33.044412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:33.057632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:33.061031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:33.062769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:33.065209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:33.067084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:33.070328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:33.116742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:33.332047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.350176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.351666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.352894 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1c9b3c3-cbda-4d20-ac46-a5f68a3a3543 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1516 microversion: 2.21 time: 0.489119 Oct 17 13:43:33.360506 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2834/5672] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:32 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1516 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:33.375625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-60522609", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2795df-2862-45cf-a8ed-080978866cd4"}], "security_groups": [{"name": "tempest-securitygroup--1915864516"}], "key_name": "tempest-keypair-1741985788", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:33.791603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] validate_networks() for [('be2795df-2862-45cf-a8ed-080978866cd4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:43:33.862963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.882445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.886136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:33.891303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbb86a55-8016-467d-a19e-5589b3f70d6f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1660 microversion: 2.32 time: 0.851668 Oct 17 13:43:33.909679 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2839/5673] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:33 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1660 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:33.931785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e21b14a2-42ba-4d83-aae2-224ead43a447 req-9149f62b-c208-4b0f-8888-f4efcecdaef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64e79102-b5a8-4bad-a5c0-d1a1540fa51a", "name": "network-vif-deleted", "tag": "b268cb47-c416-4e21-ab0f-56775bc6a795"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:33.959294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e21b14a2-42ba-4d83-aae2-224ead43a447 req-9149f62b-c208-4b0f-8888-f4efcecdaef0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:33.960242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e21b14a2-42ba-4d83-aae2-224ead43a447 req-9149f62b-c208-4b0f-8888-f4efcecdaef0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:33.961741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e21b14a2-42ba-4d83-aae2-224ead43a447 req-9149f62b-c208-4b0f-8888-f4efcecdaef0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:33.985927 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e21b14a2-42ba-4d83-aae2-224ead43a447 req-9149f62b-c208-4b0f-8888-f4efcecdaef0 service nova] Creating event network-vif-deleted:b268cb47-c416-4e21-ab0f-56775bc6a795 for instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a on n-h1-854121-14 Oct 17 13:43:33.993786 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e21b14a2-42ba-4d83-aae2-224ead43a447 req-9149f62b-c208-4b0f-8888-f4efcecdaef0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075704 Oct 17 13:43:33.998357 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2840/5674] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:34.394394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:34.395117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:34.413630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.416313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.419208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.421022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.424623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.425499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.522769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.523273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.523719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.524199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lazy-loading 'fault' on Instance uuid 64e79102-b5a8-4bad-a5c0-d1a1540fa51a {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:43:34.534795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:34.664849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.673117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.674624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '01f605eb1cbc47228b1de034432f41f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23d8baaa30cc47279d88553d269243a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:34.675826 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ab20bf8-e676-43d1-8d24-9ec3e7ee1913 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 200 len: 1349 microversion: 2.21 time: 0.288481 Oct 17 13:43:34.681385 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2841/5675] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:34 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 1349 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:34.925752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:34.927440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:34.943278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.944940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.946487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.949619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:34.950304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:34.953522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:34.989248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:34.990042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:34.990920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:34.991632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:34.992427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:35.017030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.017908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.018582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.019579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.020274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.020938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.061350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:35.102521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:35.194362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:35.240357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:35.325435 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67ef85ad-e5c1-4f41-95a0-bc19fd7850fe tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.964644 Oct 17 13:43:35.327202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2835/5676] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:43:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:43:35.340528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7bef663-de68-43d5-b5ff-937a73144e55 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:35.341669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7bef663-de68-43d5-b5ff-937a73144e55 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:35.573769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7bef663-de68-43d5-b5ff-937a73144e55 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:35.586832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7bef663-de68-43d5-b5ff-937a73144e55 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1240 microversion: 2.1 time: 0.251788 Oct 17 13:43:35.587441 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2836/5677] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:35 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1240 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:35.604866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:35.618943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:35.620501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:35.621750 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-248ef367-edf2-419e-bc56-113c858d3156 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1706 microversion: 2.32 time: 0.702389 Oct 17 13:43:35.622315 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2842/5678] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:34 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1706 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:35.705617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:35.706849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:35.716709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.717621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.718216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.719164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.719819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.720647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.743922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] HTTP exception thrown: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Request method failure captured: Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a HTTP/1.1 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVvtWd3OMxoxDoa11shvfzsXEnuwg4FJo5DRLK86ab3KAaHNz_7s3_E9s-k3vhRBbQm4fI70MZ27cXJ8JkWf4uKWffDt5mU6fwl76fPQXG7KyLKnqop1iaPJheM3j_YuIDWB08nIaU1TZ2AGuoQJtaDoKg1Dos2D38XbKX9wQ7DIt64 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 23d8baaa30cc47279d88553d269243a4 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_23d8baaa30cc47279d88553d269243a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 23d8baaa30cc47279d88553d269243a4 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-InstanceActionsV221TestJSON-593214879-project Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 01f605eb1cbc47228b1de034432f41f5 Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-InstanceActionsV221TestJSON-593214879-project Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '64e79102-b5a8-4bad-a5c0-d1a1540fa51a'} Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:35.747150 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:35.751496 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:35.752179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Returning 404 to user: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:35.754767 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9b48f8b-21dd-4fb0-bdfc-9f64abd50142 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 404 len: 111 microversion: 2.21 time: 0.056739 Oct 17 13:43:35.758496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2837/5679] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:35 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:43:35.769065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '.version_select at 0x7f419c98c790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:35.770372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:35.799326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.801403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.803733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:35.807570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:35.811690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:35.812894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.049469 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a973010-003c-4282-b98d-636b73888b28 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.285071 Oct 17 13:43:36.052198 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2843/5680] 10.222.0.65 () {60 vars in 1337 bytes} [Mon Oct 17 13:43:35 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a/os-instance-actions => generated 611 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:43:36.072304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.077669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.110770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.110770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.110770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.110770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.110770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.110770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.153445 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] HTTP exception thrown: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Request method failure captured: Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a HTTP/1.1 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVvtWd3OMxoxDoa11shvfzsXEnuwg4FJo5DRLK86ab3KAaHNz_7s3_E9s-k3vhRBbQm4fI70MZ27cXJ8JkWf4uKWffDt5mU6fwl76fPQXG7KyLKnqop1iaPJheM3j_YuIDWB08nIaU1TZ2AGuoQJtaDoKg1Dos2D38XbKX9wQ7DIt64 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 23d8baaa30cc47279d88553d269243a4 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_23d8baaa30cc47279d88553d269243a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 23d8baaa30cc47279d88553d269243a4 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-InstanceActionsV221TestJSON-593214879-project Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 01f605eb1cbc47228b1de034432f41f5 Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-InstanceActionsV221TestJSON-593214879-project Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '64e79102-b5a8-4bad-a5c0-d1a1540fa51a'} Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:36.171958 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.176826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Returning 404 to user: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:36.181083 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba65b7a4-251d-429e-a447-09baad59a721 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "DELETE /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 404 len: 111 microversion: 2.21 time: 0.116801 Oct 17 13:43:36.191720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.192688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] [instance: 64e79102-b5a8-4bad-a5c0-d1a1540fa51a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.195132 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2838/5681] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:43:36 2022] DELETE /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:43:36.215345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.216058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.223082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.224242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.224876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.225627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.247954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] HTTP exception thrown: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Request method failure captured: Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a HTTP/1.1 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVvtWd3OMxoxDoa11shvfzsXEnuwg4FJo5DRLK86ab3KAaHNz_7s3_E9s-k3vhRBbQm4fI70MZ27cXJ8JkWf4uKWffDt5mU6fwl76fPQXG7KyLKnqop1iaPJheM3j_YuIDWB08nIaU1TZ2AGuoQJtaDoKg1Dos2D38XbKX9wQ7DIt64 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.21 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 23d8baaa30cc47279d88553d269243a4 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/23d8baaa30cc47279d88553d269243a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_23d8baaa30cc47279d88553d269243a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 23d8baaa30cc47279d88553d269243a4 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-593214879 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-InstanceActionsV221TestJSON-593214879-project Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 01f605eb1cbc47228b1de034432f41f5 Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-InstanceActionsV221TestJSON-593214879-project Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '64e79102-b5a8-4bad-a5c0-d1a1540fa51a'} Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.251055 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. Oct 17 13:43:36.254734 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:43:36.256834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] Returning 404 to user: Instance 64e79102-b5a8-4bad-a5c0-d1a1540fa51a could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:43:36.257960 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd797d98-bf9f-49b6-8d50-bb2367c0a6c6 tempest-InstanceActionsV221TestJSON-593214879 tempest-InstanceActionsV221TestJSON-593214879-project] 10.222.0.65 "GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a" status: 404 len: 111 microversion: 2.21 time: 0.071693 Oct 17 13:43:36.258769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2844/5682] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:36 2022] GET /compute/v2.1/servers/64e79102-b5a8-4bad-a5c0-d1a1540fa51a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:43:36.628984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.633593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.648415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.651007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.651897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.653198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:36.654534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:36.654680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.657364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.661025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.664518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.676914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.677766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.678617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:36.680486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:36.681019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:36.896861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:36.908601 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58ebad6b-9098-430e-9ff7-c07c494b4eaa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1292 microversion: 2.1 time: 0.301234 Oct 17 13:43:36.912109 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2839/5683] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:36 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1292 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:37.704444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.732630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.741280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:37.745733 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8bec43f8-cd5e-4c6c-80ad-8f38942704e7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1706 microversion: 2.32 time: 1.093748 Oct 17 13:43:37.748208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2845/5684] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:36 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1706 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:37.941402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:37.944093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:37.955797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.956936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.957906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:37.959365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:37.960370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:37.961800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:38.173935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:38.197231 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b5a6366-06d2-4f1a-849e-46a0b0d9c721 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1298 microversion: 2.1 time: 0.261971 Oct 17 13:43:38.201048 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2840/5685] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:37 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1298 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:38.784062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:38.785281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:38.804353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:38.808294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:38.808892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:38.815085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:38.816291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:38.816859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.238401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:39.239058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:39.250769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.251266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.251711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:39.252437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:39.252899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:39.253476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:40.020793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:40.035445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:40.040611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:40.046236 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cf632686-6df6-4250-ac96-de4b67e95da2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1752 microversion: 2.32 time: 1.267517 Oct 17 13:43:40.068767 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2846/5686] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:38 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1752 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:40.145010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:40.157765 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80a0a4c9-7e36-4d76-89a1-ce39951cac5c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1298 microversion: 2.1 time: 0.920254 Oct 17 13:43:40.173362 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2841/5687] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:39 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1298 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:41.077694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:41.078642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:41.090789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:41.097806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.097806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.100407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.104742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.105812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.106637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.182539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:41.183086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:41.202614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.203129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.203583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.204307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:41.204767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:41.226305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:41.519435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:41.528441 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d47016e-5aec-424b-b4c6-9ab48be4e178 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1298 microversion: 2.1 time: 0.349855 Oct 17 13:43:41.529535 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2842/5688] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:41 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1298 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:42.420769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:42.429598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:42.442407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:42.444106 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef03d10f-6d98-43da-86d0-4f6501ef812d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1752 microversion: 2.32 time: 1.371536 Oct 17 13:43:42.444687 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2847/5689] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:41 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1752 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:42.555777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:42.556476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:42.568373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.571707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.574111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:42.575109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:42.575828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:42.577338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.105193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:43.128297 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c71151dc-5ae7-44a4-af57-77b7f20a2122 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 0.576149 Oct 17 13:43:43.128967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2843/5690] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:42 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:43.478043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:43.478702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:43.492795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.493323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.493776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:43.494494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:43.494957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:43.495385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.104520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:44.115455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:44.123270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:44.126565 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-095d493e-b0fc-4359-b03c-17b78ac4e9be tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1798 microversion: 2.32 time: 0.652383 Oct 17 13:43:44.129399 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2848/5691] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:43 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1798 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:44.153773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:44.154987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:44.165513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.170514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.171775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:44.173315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:44.176522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:44.177211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.052556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:45.160873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:45.175741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:45.191416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.198367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.199198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.203796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:45.204656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:45.205290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:45.578748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:46.106622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:46.144321 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08dca032-4cfb-4e42-b3fc-26d1d50d3552 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 1.993175 Oct 17 13:43:46.160140 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2844/5692] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:44 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:46.281555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:46.296898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:46.298430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:46.314089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3925b09-8148-4ae0-a46a-0ebe6bfdc769 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1798 microversion: 2.32 time: 1.158853 Oct 17 13:43:46.315110 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2849/5693] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:45 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1798 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:46.960020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dd9f152c-b954-4e15-8b01-368bcc6c6a2f req-1432f665-f56d-4fb7-b85d-e05acf576d6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0455d747-01a4-4dc5-8caf-56b659221bdd", "tag": "cd8d1f32-021c-463e-8258-52c546631750"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:46.987787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd9f152c-b954-4e15-8b01-368bcc6c6a2f req-1432f665-f56d-4fb7-b85d-e05acf576d6a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:46.988569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd9f152c-b954-4e15-8b01-368bcc6c6a2f req-1432f665-f56d-4fb7-b85d-e05acf576d6a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:46.989184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd9f152c-b954-4e15-8b01-368bcc6c6a2f req-1432f665-f56d-4fb7-b85d-e05acf576d6a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.011693 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dd9f152c-b954-4e15-8b01-368bcc6c6a2f req-1432f665-f56d-4fb7-b85d-e05acf576d6a service nova] Creating event network-changed:cd8d1f32-021c-463e-8258-52c546631750 for instance 0455d747-01a4-4dc5-8caf-56b659221bdd on n-h1-854121-14 Oct 17 13:43:47.024552 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dd9f152c-b954-4e15-8b01-368bcc6c6a2f req-1432f665-f56d-4fb7-b85d-e05acf576d6a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068175 Oct 17 13:43:47.029447 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2845/5694] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:47.173610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:47.174324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:47.184202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.184706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.190627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.191822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.192487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.192947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.349651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:47.350361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:47.369333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.369848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.370299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:47.371023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:47.377626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:47.378463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:49.103343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.127288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.132559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.143470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebea13ad-d50c-4452-bc34-fabf940083c7 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1844 microversion: 2.32 time: 1.798740 Oct 17 13:43:49.144508 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2846/5695] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:47 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1844 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:49.297972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:49.313719 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5793bd9a-93dd-4739-856f-d5325e6ab2fa tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 2.145409 Oct 17 13:43:49.315144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2850/5696] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:47 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:50.172008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.172659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:50.184832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.185299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.185716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.186475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.187266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.187765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.268277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ea31a64e-e588-455c-a687-eef42cb32ee1 req-957b6f35-a3ee-4e67-a5d0-ea54a207a81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "51aab7a3-2cc6-4f52-a48c-baea0c906ed9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:50.305127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea31a64e-e588-455c-a687-eef42cb32ee1 req-957b6f35-a3ee-4e67-a5d0-ea54a207a81b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.305765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea31a64e-e588-455c-a687-eef42cb32ee1 req-957b6f35-a3ee-4e67-a5d0-ea54a207a81b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.306072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ea31a64e-e588-455c-a687-eef42cb32ee1 req-957b6f35-a3ee-4e67-a5d0-ea54a207a81b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.339591 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ea31a64e-e588-455c-a687-eef42cb32ee1 req-957b6f35-a3ee-4e67-a5d0-ea54a207a81b service nova] Creating event network-changed:51aab7a3-2cc6-4f52-a48c-baea0c906ed9 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:43:50.348450 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ea31a64e-e588-455c-a687-eef42cb32ee1 req-957b6f35-a3ee-4e67-a5d0-ea54a207a81b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084755 Oct 17 13:43:50.351439 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2851/5697] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:50.357021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:50.358742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:50.376767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.377298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.382127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:50.383209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:50.384349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:50.385299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:51.034082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:51.053486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2af094c-2c81-432e-b691-e37e30d495db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 0.692069 Oct 17 13:43:51.059091 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2852/5698] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:52.087585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:52.088756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:52.114140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:52.127196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:52.128611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.133070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.137837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:52.140453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:52.146112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:52.146343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:52.147012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:52.153304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46efdccb-008c-4304-bd46-5cd01ec4e22c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1844 microversion: 2.32 time: 1.987051 Oct 17 13:43:52.158241 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2847/5699] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:50 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1844 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:53.067381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:53.082206 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7033e896-5b8f-4039-84d1-2695820ff86b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 0.998048 Oct 17 13:43:53.089387 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2853/5700] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:52 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:43:53.188307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:53.189725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:53.206113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.207563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.208240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:53.209225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:53.209939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:53.210606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.108542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:54.109364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:54.119762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:54.121353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.122470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.124544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.126118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:54.130096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.138895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:54.141887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:54.144352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.151663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.157953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c93f192-94a8-43a1-a07e-0f04e00f7822 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1844 microversion: 2.32 time: 0.970372 Oct 17 13:43:54.160532 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2848/5701] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:53 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1844 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:54.948310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:54.959861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-767812755", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:54.966366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8dfce634-c8e3-46f4-98e4-fa5c0d578ad7 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 0.864143 Oct 17 13:43:54.974499 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2854/5702] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:54 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:55.068757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:43:55.069677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:43:55.070202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:43:55.070756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:43:55.071416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:43:55.099552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.100193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.100874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.108197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.109615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.110292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.160392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Getting quotas for project 2fc923ef5332430783c262384374fa9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:43:55.179248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Getting quotas for user 15ecd692c03f4896a0b960b77d6ed176 and project 2fc923ef5332430783c262384374fa9a. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:43:55.193283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:55.195602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:55.227437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.231388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.234106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.237383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.238233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.240572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.246549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:43:55.249786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:43:55.412498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b759a81-2740-4482-bf83-95204cf6a2b9 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.756111 Oct 17 13:43:55.413838 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2849/5703] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:43:55.431333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-df08bf77-9b5e-4ca5-8c65-678dd78eb7f6 req-41db539d-ffa1-4d42-a336-dd4e0726ebeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "1848ce9e-f330-4669-8fb2-ac7b10fb0a2d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:55.484069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-df08bf77-9b5e-4ca5-8c65-678dd78eb7f6 req-41db539d-ffa1-4d42-a336-dd4e0726ebeb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:55.485101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-df08bf77-9b5e-4ca5-8c65-678dd78eb7f6 req-41db539d-ffa1-4d42-a336-dd4e0726ebeb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:55.487816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-df08bf77-9b5e-4ca5-8c65-678dd78eb7f6 req-41db539d-ffa1-4d42-a336-dd4e0726ebeb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:55.524875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-df08bf77-9b5e-4ca5-8c65-678dd78eb7f6 req-41db539d-ffa1-4d42-a336-dd4e0726ebeb service nova] Creating event network-changed:1848ce9e-f330-4669-8fb2-ac7b10fb0a2d for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:43:55.542248 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-df08bf77-9b5e-4ca5-8c65-678dd78eb7f6 req-41db539d-ffa1-4d42-a336-dd4e0726ebeb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126733 Oct 17 13:43:55.548706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2850/5704] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:55.584276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c2c3fcf-0958-4a30-9d41-083a03356e9b tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:55.585435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c2c3fcf-0958-4a30-9d41-083a03356e9b tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:55.955545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c2c3fcf-0958-4a30-9d41-083a03356e9b tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.970377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c2c3fcf-0958-4a30-9d41-083a03356e9b tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.971845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c2c3fcf-0958-4a30-9d41-083a03356e9b tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:55.973024 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c2c3fcf-0958-4a30-9d41-083a03356e9b tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1280 microversion: 2.47 time: 0.421798 Oct 17 13:43:55.973610 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2851/5705] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1280 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:56.000946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:56.001944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:56.027991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.028734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.029356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.030460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.031137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.031831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.572473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.599078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.600562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:56.601837 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ae05cee-92a9-4ff8-86ab-ca518dd4e6ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1865 microversion: 2.32 time: 1.415537 Oct 17 13:43:56.602418 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2855/5706] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1865 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:56.694148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a7fcd820-4e08-415b-aba1-cf8743caa0c3 req-2d846985-7a39-45cf-914d-4bc0150c359a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0455d747-01a4-4dc5-8caf-56b659221bdd", "name": "network-vif-plugged", "status": "completed", "tag": "cd8d1f32-021c-463e-8258-52c546631750"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:56.713260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a7fcd820-4e08-415b-aba1-cf8743caa0c3 req-2d846985-7a39-45cf-914d-4bc0150c359a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:56.713954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a7fcd820-4e08-415b-aba1-cf8743caa0c3 req-2d846985-7a39-45cf-914d-4bc0150c359a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:56.714548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a7fcd820-4e08-415b-aba1-cf8743caa0c3 req-2d846985-7a39-45cf-914d-4bc0150c359a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:56.747604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a7fcd820-4e08-415b-aba1-cf8743caa0c3 req-2d846985-7a39-45cf-914d-4bc0150c359a service nova] Creating event network-vif-plugged:cd8d1f32-021c-463e-8258-52c546631750 for instance 0455d747-01a4-4dc5-8caf-56b659221bdd on n-h1-854121-14 Oct 17 13:43:56.775115 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a7fcd820-4e08-415b-aba1-cf8743caa0c3 req-2d846985-7a39-45cf-914d-4bc0150c359a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084569 Oct 17 13:43:56.781836 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2856/5707] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:57.004064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:57.005668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:57.018403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.023962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.024650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:57.025605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.037880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.040090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:57.664721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:57.686120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:57.691053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:57.693530 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fe2067f-83d3-45fb-9fab-c54e6533341e tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1276 microversion: 2.47 time: 0.693443 Oct 17 13:43:57.694996 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2857/5708] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:56 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1276 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:43:57.701919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:57.703021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:57.712276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:57.741057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.752727 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26f577f4-0a29-4ed0-b86d-a7965a46e867 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 1.755870 Oct 17 13:43:57.754025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.755272 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2852/5709] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:55 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:57.756457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:57.758048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:57.759099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:57.760112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:57.791629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:43:58.127229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.144075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.145666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:58.152694 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-27e222cb-c81c-42f0-82aa-38116820bfd9 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1886 microversion: 2.32 time: 0.456371 Oct 17 13:43:58.153677 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2858/5710] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:57 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1886 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:58.441556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0d6cff18-fb17-483b-9ca7-37b903c36f9f req-3ceaf299-6300-4473-9876-76d24a86cf05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "b1159ddd-a700-459f-8fe7-872c7348c788"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:43:58.469399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0d6cff18-fb17-483b-9ca7-37b903c36f9f req-3ceaf299-6300-4473-9876-76d24a86cf05 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.471308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0d6cff18-fb17-483b-9ca7-37b903c36f9f req-3ceaf299-6300-4473-9876-76d24a86cf05 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.472000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0d6cff18-fb17-483b-9ca7-37b903c36f9f req-3ceaf299-6300-4473-9876-76d24a86cf05 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.488869 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0d6cff18-fb17-483b-9ca7-37b903c36f9f req-3ceaf299-6300-4473-9876-76d24a86cf05 service nova] Creating event network-changed:b1159ddd-a700-459f-8fe7-872c7348c788 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:43:58.496399 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0d6cff18-fb17-483b-9ca7-37b903c36f9f req-3ceaf299-6300-4473-9876-76d24a86cf05 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066882 Oct 17 13:43:58.499494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2853/5711] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:43:58.726161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:58.728257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:58.742237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.743034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.743914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.745450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.746195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.746850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.780599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:58.782802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:58.807222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.811680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.814902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:58.815698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:58.816187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:58.822526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.113966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.136249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.136759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.138211 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e47c998-fe92-4d0b-88dd-d65e2ce2e600 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1338 microversion: 2.47 time: 0.417734 Oct 17 13:43:59.138864 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2859/5712] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:58 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1338 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:43:59.184300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:43:59.184999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:43:59.198903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.199667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.200271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.202936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:43:59.209469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:43:59.209851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:43:59.409953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.425915 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6b84a6e-98ea-47d7-b6a2-1712de3564a4 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1366 microversion: 2.1 time: 0.651554 Oct 17 13:43:59.437254 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2854/5713] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:43:58 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1366 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:43:59.695140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.707471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.709472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:43:59.712419 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b760f4d2-7eea-47a1-9e9c-5ef22f10ace0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1886 microversion: 2.32 time: 0.532428 Oct 17 13:43:59.713934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2860/5714] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:43:59 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1886 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:00.173361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:00.173991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:00.186928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.190406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.191017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.194205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.194867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.195461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.364653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.380492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.384407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:00.388853 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cfb8a764-45bd-4b00-8950-b7b76c2ceccf tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1338 microversion: 2.47 time: 0.219475 Oct 17 13:44:00.394378 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2855/5715] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:00 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:00.453196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:00.454014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:00.468460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.470318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.470881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.471992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.475639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.476402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.547462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-282a0f3d-2240-403d-a077-b21ad63659e7 req-1c6cfb0e-5886-4d4e-a063-48d652ecfdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "332de9c8-5e47-4233-b4b1-3b4e05d9672f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:00.573680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-282a0f3d-2240-403d-a077-b21ad63659e7 req-1c6cfb0e-5886-4d4e-a063-48d652ecfdc0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.577706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-282a0f3d-2240-403d-a077-b21ad63659e7 req-1c6cfb0e-5886-4d4e-a063-48d652ecfdc0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.578570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-282a0f3d-2240-403d-a077-b21ad63659e7 req-1c6cfb0e-5886-4d4e-a063-48d652ecfdc0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.594073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:00.596888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-282a0f3d-2240-403d-a077-b21ad63659e7 req-1c6cfb0e-5886-4d4e-a063-48d652ecfdc0 service nova] Creating event network-changed:332de9c8-5e47-4233-b4b1-3b4e05d9672f for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:00.604094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-282a0f3d-2240-403d-a077-b21ad63659e7 req-1c6cfb0e-5886-4d4e-a063-48d652ecfdc0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062081 Oct 17 13:44:00.605221 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2856/5716] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:00.746797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:00.748215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:00.761448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.761959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.764775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:00.765912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:00.766549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:00.767274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.176441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.192738 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e83bc202-67ca-410b-aaa7-1caf800fcf8f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1556 microversion: 2.1 time: 0.744657 Oct 17 13:44:01.221189 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2861/5717] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:44:00 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1556 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:44:01.227896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:01.228571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:01.236776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.238317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.239355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.241402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.242046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.242946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.646635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2b41959-cf75-48e5-a2b5-7c4ba6dfed41 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.422679 Oct 17 13:44:01.648038 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2862/5718] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:44:01 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-interface => generated 284 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:01.653592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:01.655947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:01.668797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.669610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.670872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.671841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.672661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.677912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.761210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.783451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.787001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.789939 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bff70bbb-450c-436a-a91b-306016c57332 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 1.050611 Oct 17 13:44:01.801232 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2857/5719] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:00 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:01.834831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.859747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.862862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:01.865700 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89c773ff-709e-4d2f-9661-2cbc9de50ce1 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1359 microversion: 2.47 time: 0.216071 Oct 17 13:44:01.866955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2863/5720] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:01 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:01.913581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1182707624"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:01.916967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:01.924667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:01.926921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.927515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.928086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:01.928693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:01.931099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:01.931582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.383179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60ed57d0-e258-4f67-a664-c5a3da7dc8c7 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "POST /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7/action" status: 202 len: 52 microversion: 2.47 time: 0.484663 Oct 17 13:44:02.399607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:02.400127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:02.408423 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2858/5721] 10.222.0.65 () {62 vars in 1319 bytes} [Mon Oct 17 13:44:01 2022] POST /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7/action => generated 52 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:44:02.415482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.418167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.420205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.423892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.424631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.425466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.492359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:02.697479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-805aec57-aece-4d38-be7c-c4b060f31ebd tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "DELETE /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 204 len: 0 microversion: 2.47 time: 0.304643 Oct 17 13:44:02.699237 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2864/5722] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:44:02 2022] DELETE /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:44:02.709256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:02.710346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:02.722469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.726531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.727031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.727776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.728236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.728672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.777828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-97e62d69-1014-4afd-9542-9c382ae3f398 req-4b56e798-4877-4721-8cee-c62203eba5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "382d8f99-3ffc-4832-9e7e-ff6a6ed28004"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:02.800631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-97e62d69-1014-4afd-9542-9c382ae3f398 req-4b56e798-4877-4721-8cee-c62203eba5f5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.801728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-97e62d69-1014-4afd-9542-9c382ae3f398 req-4b56e798-4877-4721-8cee-c62203eba5f5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.803377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-97e62d69-1014-4afd-9542-9c382ae3f398 req-4b56e798-4877-4721-8cee-c62203eba5f5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.836686 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-97e62d69-1014-4afd-9542-9c382ae3f398 req-4b56e798-4877-4721-8cee-c62203eba5f5 service nova] Creating event network-changed:382d8f99-3ffc-4832-9e7e-ff6a6ed28004 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:02.850749 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-97e62d69-1014-4afd-9542-9c382ae3f398 req-4b56e798-4877-4721-8cee-c62203eba5f5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077640 Oct 17 13:44:02.851906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2865/5723] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:02.864562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:02.865773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:02.882911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.885678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.886209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:02.886963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:02.887428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:02.887856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:03.129522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:03.151931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:03.154142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:03.156838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61bda2cf-68fc-49a9-ba98-8ea4b59d3cae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1365 microversion: 2.47 time: 0.452988 Oct 17 13:44:03.179267 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2859/5724] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:02 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1365 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:04.190269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:04.192514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:04.209707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.214540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.216781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.218248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.219379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.220329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.443867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.461991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.472151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.473738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.475488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.476968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:04.486319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-201bd6ce-4b8a-4d6f-9c43-cacc73b6e1ab tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1365 microversion: 2.47 time: 0.296725 Oct 17 13:44:04.486507 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3b6a295c-96e9-48b1-bcc6-959f268ee227 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 1.633175 Oct 17 13:44:04.487475 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2866/5725] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:02 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:04.489404 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2860/5726] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:04 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:04.658897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4a992033-f164-4a2c-bf23-edc302c6e95e req-f4eb3cbb-07d8-4a04-9ed1-55c3b1588cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0455d747-01a4-4dc5-8caf-56b659221bdd", "tag": "cd8d1f32-021c-463e-8258-52c546631750"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:04.682622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4a992033-f164-4a2c-bf23-edc302c6e95e req-f4eb3cbb-07d8-4a04-9ed1-55c3b1588cc6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:04.697219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4a992033-f164-4a2c-bf23-edc302c6e95e req-f4eb3cbb-07d8-4a04-9ed1-55c3b1588cc6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:04.697972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4a992033-f164-4a2c-bf23-edc302c6e95e req-f4eb3cbb-07d8-4a04-9ed1-55c3b1588cc6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:04.719447 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4a992033-f164-4a2c-bf23-edc302c6e95e req-f4eb3cbb-07d8-4a04-9ed1-55c3b1588cc6 service nova] Creating event network-changed:cd8d1f32-021c-463e-8258-52c546631750 for instance 0455d747-01a4-4dc5-8caf-56b659221bdd on n-h1-854121-14 Oct 17 13:44:04.732282 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4a992033-f164-4a2c-bf23-edc302c6e95e req-f4eb3cbb-07d8-4a04-9ed1-55c3b1588cc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077561 Oct 17 13:44:04.733924 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2867/5727] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:05.513134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:05.514024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:05.516116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:05.522766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.530114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:05.531604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:05.537994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.538491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.539507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.539977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.540915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.543674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.544523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.545679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.547358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.548316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.562743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.630399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:05.637986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:05.638705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:05.641613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lazy-loading 'fault' on Instance uuid 34a13f80-9379-4b6f-8899-8885b404e1c7 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:05.939106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:05.947049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:05.948505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15ecd692c03f4896a0b960b77d6ed176', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc923ef5332430783c262384374fa9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:05.949756 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c734347d-83ed-47f5-b3d5-ce4d4dd50085 tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 200 len: 1370 microversion: 2.47 time: 0.426052 Oct 17 13:44:05.956952 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2868/5728] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:05 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 1370 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:05.966453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:06.420262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.439959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.441252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:06.442672 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8590274c-153f-4bd1-8034-08f685aacf5b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.933470 Oct 17 13:44:06.443681 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2861/5729] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:05 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:06.960426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4ede2019-9690-4837-859b-0bea3c39420e req-d285620c-69d6-4485-ac14-13372bab798c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "65d2d84e-b320-4db0-a8b2-501d963b849d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:06.979341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:06.979959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] [instance: 34a13f80-9379-4b6f-8899-8885b404e1c7] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:06.996160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ede2019-9690-4837-859b-0bea3c39420e req-d285620c-69d6-4485-ac14-13372bab798c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:06.996654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ede2019-9690-4837-859b-0bea3c39420e req-d285620c-69d6-4485-ac14-13372bab798c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:06.997089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4ede2019-9690-4837-859b-0bea3c39420e req-d285620c-69d6-4485-ac14-13372bab798c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.005420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.006219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.006672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.007531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.008067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.008498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.039350 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4ede2019-9690-4837-859b-0bea3c39420e req-d285620c-69d6-4485-ac14-13372bab798c service nova] Creating event network-changed:65d2d84e-b320-4db0-a8b2-501d963b849d for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:07.044774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4ede2019-9690-4837-859b-0bea3c39420e req-d285620c-69d6-4485-ac14-13372bab798c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088035 Oct 17 13:44:07.051725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] HTTP exception thrown: Instance 34a13f80-9379-4b6f-8899-8885b404e1c7 could not be found. Oct 17 13:44:07.053365 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2869/5730] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Request method failure captured: Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 HTTP/1.1 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVwaU-TEf4R4x4CmdXEeQPhIMNOCpxB5Ml0p-GlnHjbC-fPSOeoFi41y_IwXnaEPxLd0MkplQGuhW6OG_fpw7QoSasGDTgJhtOZPSInf6cc5_LYZiGvNeqkhc_LJmPMt89v41Wd0sQpM8j1S_J81s7OlopxaOEcfoaLfgr59jutENDw Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.47 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2fc923ef5332430783c262384374fa9a Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAaction247Test-2068935108 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2fc923ef5332430783c262384374fa9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2fc923ef5332430783c262384374fa9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2fc923ef5332430783c262384374fa9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2fc923ef5332430783c262384374fa9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAaction247Test-2068935108 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2fc923ef5332430783c262384374fa9a Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAaction247Test-2068935108 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAaction247Test-2068935108-project Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 15ecd692c03f4896a0b960b77d6ed176 Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAaction247Test-2068935108-project Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 34a13f80-9379-4b6f-8899-8885b404e1c7 could not be found. Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '34a13f80-9379-4b6f-8899-8885b404e1c7'} Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a13f80-9379-4b6f-8899-8885b404e1c7 could not be found. Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a13f80-9379-4b6f-8899-8885b404e1c7 could not be found. Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:07.053836 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a13f80-9379-4b6f-8899-8885b404e1c7 could not be found. Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] Returning 404 to user: Instance 34a13f80-9379-4b6f-8899-8885b404e1c7 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22d3c047-e1b8-4932-99a1-7116f5d1d7ae tempest-ServersAaction247Test-2068935108 tempest-ServersAaction247Test-2068935108-project] 10.222.0.65 "GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7" status: 404 len: 111 microversion: 2.47 time: 0.081473 Oct 17 13:44:07.057747 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2862/5731] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:06 2022] GET /compute/v2.1/servers/34a13f80-9379-4b6f-8899-8885b404e1c7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:44:07.471594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:07.472987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:07.482189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.483939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.485452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:07.486469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:07.487218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:07.487894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:08.063334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:08.082661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:08.084210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:08.086403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d08b6bbe-4663-4e7f-b4e4-ebf724ecff1a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.619858 Oct 17 13:44:08.099253 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2870/5732] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:07 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:09.116021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:09.117284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:09.130674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.132910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.134572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.135583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.137431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.139598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:09.646906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.666968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.668531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:09.669827 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28c5853d-40a4-4da9-bb8e-65e2ee951c0a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.557887 Oct 17 13:44:09.671550 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2863/5733] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:09 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:09.935460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b9ebf82d-ae6c-454e-b07f-6f37fd04984b req-a216fef1-f628-424e-9ad4-6f4b5f5efdef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "ee816deb-fa90-4890-b9c4-2bb6f3ebb346"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:09.973563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9ebf82d-ae6c-454e-b07f-6f37fd04984b req-a216fef1-f628-424e-9ad4-6f4b5f5efdef service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:09.975952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9ebf82d-ae6c-454e-b07f-6f37fd04984b req-a216fef1-f628-424e-9ad4-6f4b5f5efdef service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:09.976607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9ebf82d-ae6c-454e-b07f-6f37fd04984b req-a216fef1-f628-424e-9ad4-6f4b5f5efdef service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.002516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b9ebf82d-ae6c-454e-b07f-6f37fd04984b req-a216fef1-f628-424e-9ad4-6f4b5f5efdef service nova] Creating event network-changed:ee816deb-fa90-4890-b9c4-2bb6f3ebb346 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:10.018745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b9ebf82d-ae6c-454e-b07f-6f37fd04984b req-a216fef1-f628-424e-9ad4-6f4b5f5efdef service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087295 Oct 17 13:44:10.019396 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2871/5734] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:10.538684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1022463429", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": "none"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:10.635943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:10.636297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:10.636782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:10.638071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:10.638071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:10.657216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.657751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.658204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.658961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.659429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.659867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.682456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Getting quotas for project da162737843a4cbdbd8985eb97b72c5d. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:10.689218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Getting quotas for user 202eeb81e6c8424d91221492d34827e3 and project da162737843a4cbdbd8985eb97b72c5d. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:10.699103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:10.700509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:10.704197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:44:10.706754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:44:10.711185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.711687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.712128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.712843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:10.723841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:10.724294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:10.785415 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2145aec6-2e96-459b-a295-2f54a4f2aeec tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.467528 Oct 17 13:44:10.794923 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2864/5735] 10.222.0.65 () {62 vars in 1188 bytes} [Mon Oct 17 13:44:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:44:10.828640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9921e097-5ad1-4fcc-9463-9b26d5515c63 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:10.829701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9921e097-5ad1-4fcc-9463-9b26d5515c63 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:11.044334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9921e097-5ad1-4fcc-9463-9b26d5515c63 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.122445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9921e097-5ad1-4fcc-9463-9b26d5515c63 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.129517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9921e097-5ad1-4fcc-9463-9b26d5515c63 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.132423 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9921e097-5ad1-4fcc-9463-9b26d5515c63 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1278 microversion: 2.54 time: 0.334632 Oct 17 13:44:11.139756 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2865/5736] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:10 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1278 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:11.437299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.459334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.460961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:11.468975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d9b4e563-ca12-41a7-baec-471c78866f02 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.767426 Oct 17 13:44:11.470906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2872/5737] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:10 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:12.164326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:12.166031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:12.180156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.181493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.183600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.184396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.188814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.189584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.394199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:12.410890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:12.412344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:12.413520 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45e0a4fa-2983-4f77-b747-c1f5563aad87 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1330 microversion: 2.54 time: 0.254377 Oct 17 13:44:12.414081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2866/5738] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:12 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1330 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:12.498831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:12.500295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:12.513422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.515680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.516168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:12.525384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:12.526039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:12.526480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:13.023650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.034704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.036508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.037903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d704df7-ced7-433d-aa52-7124d11a352c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.544357 Oct 17 13:44:13.038653 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2873/5739] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:12 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:13.450907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:13.459303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:13.488362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:13.488948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:13.499563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:13.500628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:13.501313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:13.504680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:13.735532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.750727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.765907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:13.767373 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-04a0259f-c91d-4e9c-8a35-e94e13803f13 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1336 microversion: 2.54 time: 0.327751 Oct 17 13:44:13.768513 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2867/5740] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:13 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1336 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:14.064672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.065627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.072947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.073513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.074018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.074748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.075219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.077448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.507321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.523832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.535142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.538022 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82fd7759-16bd-4e5d-8716-56157a70c3c0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.477990 Oct 17 13:44:14.538924 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2874/5741] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:14.796514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:14.797136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:14.807660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.808401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.809013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.810000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:14.811164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:14.811869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:14.968449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.986067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.988449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:14.990910 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-070086f9-0491-4e4b-ac74-8cea53f71dff tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1336 microversion: 2.54 time: 0.198624 Oct 17 13:44:15.001694 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2868/5742] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:14 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1336 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:15.573486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:15.574669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:15.596363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.596876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.597795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:15.602114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:15.602596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:15.603035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.022970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:16.023728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:16.034831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.038763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.039484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.040460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.043108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.044535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.073311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.088025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.093321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.095273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4661d3f2-6472-4dee-bb02-ca6fb09d6a89 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.532802 Oct 17 13:44:16.112906 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2875/5743] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:15 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:16.260678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.289873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.291974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:16.298100 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e13a8c2-e5f2-44f5-a31a-a57f0013fddc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1357 microversion: 2.54 time: 0.279361 Oct 17 13:44:16.299328 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2869/5744] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:16 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:16.329079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2de4d33-10d3-4cb3-a1e8-51d3a8e5c25e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Action: 'create', calling method: .version_select at 0x7f419cdda9d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-950429307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2L62JH2Uh8Vh9cUiS53msru8wmued4AzNDZQE2inBMH5YiZ1aI5NKzGw29eULSVkKV9y1qOqdpkBuAZG7t3DXn/AKQ2Rgvt+iLJ/ZU6eejr5itds1Mtt3ImgVfujde3w=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:16.395717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b2de4d33-10d3-4cb3-a1e8-51d3a8e5c25e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Getting quotas for project da162737843a4cbdbd8985eb97b72c5d. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:44:16.411662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b2de4d33-10d3-4cb3-a1e8-51d3a8e5c25e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Getting quotas for user 202eeb81e6c8424d91221492d34827e3 and project da162737843a4cbdbd8985eb97b72c5d. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:44:16.451355 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2de4d33-10d3-4cb3-a1e8-51d3a8e5c25e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.127066 Oct 17 13:44:16.452208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2876/5745] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:44:16 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:44:16.466386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-950429307", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:16.472256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:16.488983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.489776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.490428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.491163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.491647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.492193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.624715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:44:16.625457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:44:16.626112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:44:16.626704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:44:16.627296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:44:16.742103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:16.762970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.767149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.767824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.768738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.769393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.770917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.842488 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-459555fd-3a13-4874-8bc5-93690d064f7c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "POST /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2/action" status: 202 len: 1139 microversion: 2.54 time: 0.378634 Oct 17 13:44:16.860383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2870/5746] 10.222.0.65 () {62 vars in 1320 bytes} [Mon Oct 17 13:44:16 2022] POST /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2/action => generated 1139 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 17 13:44:16.874734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:16.877004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:16.890606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.891230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.891739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.892544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:16.893277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:16.894257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:16.942374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:17.109810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.127798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:17.129041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:17.140175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.149247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.153528 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-871d8e79-f2b3-4d23-a9e2-4a1bbde67cb0 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.288928 Oct 17 13:44:17.156123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.156681 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2877/5747] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:16 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:17.170332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.170332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.176107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:17.179957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:17.182724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:17.755212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.767354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.772156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:17.773983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dabe11e0-07ff-4238-b1d9-b6172c04231b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.651509 Oct 17 13:44:17.784852 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2871/5748] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:17 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:18.189547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.190100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:18.215015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.220243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.224399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.225368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.225996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.226756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.320018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:18.331057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:18.332789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:18.334314 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63d4f2bc-f617-4f2c-af9a-0e08eeef98c2 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.150007 Oct 17 13:44:18.335025 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2878/5749] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:18 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:18.816161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:18.817543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:18.829340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.829841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.830372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.831294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:18.854833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:18.861227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:18.904370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:19.360184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:19.361458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:19.370156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:19.371016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:19.371628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:19.372509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:19.373784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:19.374573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:19.605415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.618494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.623837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.625430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.626693 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8e3062b-ef25-4284-8226-afec8007c98f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.270591 Oct 17 13:44:19.641039 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2879/5750] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:19 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:19.657518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.663908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:19.677947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69c860d6-7ba8-47b4-8d92-e44ba4d4b9e2 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.853295 Oct 17 13:44:19.678547 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2872/5751] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:18 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:20.660190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:20.661040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:20.676152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.677195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.678450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.679431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.684421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.689474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.716032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:20.717917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:20.721742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:20.749370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.750405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.753311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.755245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:20.757936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:20.759332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:20.998854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.019051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.027847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.033251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f56b48a2-c911-4eb2-94a6-a2fe47743121 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.377705 Oct 17 13:44:21.059189 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2880/5752] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:20 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:21.078153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:21.333643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.344044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.345759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:21.347368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-914f6201-355f-4609-8ef1-f2c21d9f019f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.640351 Oct 17 13:44:21.348119 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2873/5753] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:20 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:22.071621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:22.074687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:22.091682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:22.093929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:22.094807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:22.097274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:22.098088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:22.098842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:22.252415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.274228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.280855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.282984 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dbf08137-69a5-4b09-a23b-70dc01d46c49 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.218784 Oct 17 13:44:22.302884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2881/5754] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:22 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:22.374960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:22.376923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:22.396773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:22.397669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:22.398927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:22.400801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:22.403146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:22.407237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:22.832463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.844224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.855145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:22.856674 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ad3ee4c-a7fb-49de-8e0f-52d02e8c9d21 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.486163 Oct 17 13:44:22.857817 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2874/5755] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:22 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:23.311235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:23.311917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:23.322819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.323823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.324487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.325439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.326137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.327252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.460890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:23.479606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:23.485671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:23.489801 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-612e66d0-f5bf-4108-9d45-5a51be8c7619 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.183179 Oct 17 13:44:23.491683 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2882/5756] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:23 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:23.888333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:23.890310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:23.898108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.898830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.899435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:23.900309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:23.900930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:23.901548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.167388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.234001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.236463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.242891 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1705236-f187-42f7-8e90-669adac603b5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.358965 Oct 17 13:44:24.254555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2875/5757] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:23 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:24.521173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:24.522599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:24.531222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:24.534532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.535363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.536085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.536897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:24.537633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:24.539395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:24.667882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.682893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.684999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:24.687442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10d73b2f-ee34-4d6d-9595-802b14e39b69 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.170933 Oct 17 13:44:24.688256 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2883/5758] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:24 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:25.276761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:25.277672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:25.291674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.292940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.294586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.296106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.297925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.298873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.716027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:25.717768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:25.726094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.726766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.727379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.729000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:25.729680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:25.730272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:25.760171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.776484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.790205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.791883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8b25440-5eda-4534-bd40-d636a11bb9c8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.520092 Oct 17 13:44:25.793036 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2876/5759] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:25 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:25.910427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.927900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.929418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:25.930659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a53afca7-a554-4299-bc6b-ff2a023bbe6c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.218721 Oct 17 13:44:25.936277 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2884/5760] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:25 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:26.824245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:26.825295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:26.834251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.835235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.835870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:26.836845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.837428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.837934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:26.961401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:26.963028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:26.966224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:26.974361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.974963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.975774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:26.977197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:26.978286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:26.978931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:27.142286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.159040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.160931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.165089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f8adfa0-6362-4c90-a290-12983f94ef53 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.208775 Oct 17 13:44:27.166502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.170014 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2885/5761] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:26 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:27.178861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.182581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:27.183834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ab290ae-1f50-4427-bcb4-337812f81304 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.365013 Oct 17 13:44:27.184400 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2877/5762] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:26 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:28.216273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:28.217895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:28.218362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:28.220276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:28.231824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:28.235100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:28.238699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:28.239901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:28.241445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:28.245292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:28.251968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:28.253195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:28.256673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:28.260540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:28.262204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:28.265073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:28.514974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.527307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.529736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.533185 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60d4c8a9-9a1b-43f8-8129-d60856197462 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.325191 Oct 17 13:44:28.534374 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2886/5763] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:28 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:28.749006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.762111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.764613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:28.766153 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-024b86dc-1fd2-4a06-a71d-20d80e97d254 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.554154 Oct 17 13:44:28.767873 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2878/5764] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:28 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:29.589168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:29.592500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:29.617123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.620427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.621691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.623735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.626535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.627151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.794787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:29.795563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:29.803861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.820817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.822425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.824075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:29.824926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.825546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.828496 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6355a9ac-386d-42a0-91b5-46279b48c756 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.244750 Oct 17 13:44:29.829698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:29.830329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:29.831747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:29.831952 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2887/5765] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:29 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:30.281507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:30.292727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:30.298379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:30.299851 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e7dbfdd-a4da-4c87-8c58-d4334d2cfa06 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.509297 Oct 17 13:44:30.300426 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2879/5766] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:29 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:30.865989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:30.867545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:30.883159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.884161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.884818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:30.885795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:30.886457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:30.889851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.067151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.080851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.088371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.090736 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96e27512-8f33-4476-8ae5-88075aca9922 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.229462 Oct 17 13:44:31.092260 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2888/5767] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:30 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:31.328463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:31.329135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:31.338477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.338971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.339430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.340628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:31.341314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:31.342038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:31.913746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.924417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.926529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:31.927941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2606aa20-8015-47c3-8869-10880e88fa40 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.605565 Oct 17 13:44:31.929036 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2880/5768] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:31 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:32.121592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.123543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.135313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.136054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.137668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.139318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.140062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.140688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.394934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:32.413573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:32.415397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:32.416836 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4eed7c7b-e0ea-4323-a40e-24e0d446282f tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.301261 Oct 17 13:44:32.417627 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2889/5769] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:32.960643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:32.961263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:32.967594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:32.979768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.980495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.981186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:32.982595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:32.983979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:32.985825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.448770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:33.449968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:33.469254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.470204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.470797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.472402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:33.478296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:33.478919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:33.655423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.679800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.685078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.691132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ec761a4-a911-451f-b239-62a586fffcf5 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.244966 Oct 17 13:44:33.691951 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2890/5770] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:33 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:33.713989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.733705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.735828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:33.737439 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-afed228b-b4f7-475b-ac7a-0e3132923873 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.782161 Oct 17 13:44:33.738753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2881/5771] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:32 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:34.719357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.720690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.737265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.737786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.738264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.738960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.739417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.739935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.768408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:34.769047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:34.791998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.792501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.792949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.793720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:34.794163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:34.795130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:34.974515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.991968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:34.993525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:35.004714 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4d508ba-1ffc-4bea-9349-4754ee59933b tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.279773 Oct 17 13:44:35.009416 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2891/5772] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:36.038368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:36.039072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:36.056616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.057216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.058164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.059202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:36.060351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:36.062952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:36.300571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.323652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.325153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.330611 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f7db1e6-369a-4185-b666-82c47b4221ea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 1.567070 Oct 17 13:44:36.334686 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2882/5773] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:34 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:36.358919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.376788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.384154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:36.398108 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43012c48-f506-4a32-87a0-7b0d76ee823c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.358254 Oct 17 13:44:36.398928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2892/5774] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:36 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:36.986885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:36.987685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:37.015873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.020177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.038840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.040316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.040808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.043635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.137969 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85dc9415-a53a-4866-b0f2-2c537c5d4d1f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/ips" status: 200 len: 150 microversion: 2.1 time: 0.156993 Oct 17 13:44:37.141635 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2883/5775] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:44:36 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/ips => generated 150 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:37.359766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:37.361777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:37.376584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.377512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.379925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.382518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.383190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.387602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.432105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:37.432725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:37.446965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.447942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.452536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.453750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:37.457990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:37.458627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:37.938719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:37.955334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:37.958892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:37.961779 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f182f18-e3d0-4618-9ed6-bcd4019949ad tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.532925 Oct 17 13:44:37.975845 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2884/5776] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:37 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:38.341734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.345749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:38.370054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.374165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:38.377487 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af448f00-20aa-4b02-b8d9-1d3f1f266386 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 1.021738 Oct 17 13:44:38.379743 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2893/5777] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:37 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:39.000761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.002811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.019708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.021927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.022758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.024014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.024866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.025591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.408993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:39.410809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:39.424224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.427745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.429445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.436976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:39.437754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:39.438390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:39.499424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.531156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.542437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.544348 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f7baead-3dee-4010-95d7-6decbb1d9d52 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.549146 Oct 17 13:44:39.545581 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2885/5778] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:38 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:39.885309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.910370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.912007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:39.912967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d95b7345-469d-418f-bc84-33273b15a00b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.508375 Oct 17 13:44:39.915072 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2894/5779] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:39 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:40.135674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c28f5b6-74ef-48fa-85ad-465094022311"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:40.138140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.147826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.148322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.148858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.149659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.150292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.151388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.575176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.576586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.622238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.622895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.623341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.624103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.624562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.624989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.646134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2205eb40-400c-4625-8a07-4c98c7e6b5b9 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.513867 Oct 17 13:44:40.655136 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2886/5780] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:44:40 2022] POST /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:40.949761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.955091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:40.955962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:40.974776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.980025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:40.982637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.983438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.985782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.987252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:40.987252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:40.988577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:40.994543 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d82d4036-36bf-43b9-bc63-f8da4285b2fc tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.422229 Oct 17 13:44:40.996931 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2895/5781] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:41.462422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.469058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:41.503307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.510624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:41.516485 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df1bbf3f-a25a-4fba-ba42-33ecb70be69e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.565180 Oct 17 13:44:41.517552 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2887/5782] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:40 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:42.026866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:42.028369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:42.040742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.046555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.048086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.049081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.053036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.053965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.239865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.260420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.262670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:42.264905 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15567608-d80a-4c1c-9fe7-f5ec55c88e37 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.242309 Oct 17 13:44:42.265713 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2896/5783] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:42 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:42.547961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:42.549093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:42.566997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.570417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.571571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:42.572964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:42.576661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:42.578509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.128873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.151215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.163231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.166609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e52df360-93c6-4e64-b423-052047c2257c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.623805 Oct 17 13:44:43.168379 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2888/5784] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:42 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:43.292070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:43.292699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:43.317216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.317762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.318374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.319397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:43.319898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:43.320463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:43.517533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.527531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.549918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:43.556825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e6cca9d-6720-401c-9874-b42c63550157 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1408 microversion: 2.54 time: 0.264185 Oct 17 13:44:43.559670 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2897/5785] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:43 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:44.198165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.199486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.224266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.224963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.225533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.226385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.228685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.242912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.595218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:44.595676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:44.610474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.613247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.615067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.617130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:44.627827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:44.633344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:44.944547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.961628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.977651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.978023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.984502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.988026 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8cf54be9-7c48-45a4-a943-54174b92c149 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.794750 Oct 17 13:44:44.988624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:44.990223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-010bd48f-4909-44e9-b1f7-7d6a46915beb tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1414 microversion: 2.54 time: 0.402227 Oct 17 13:44:44.997195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2889/5786] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:44.998148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2898/5787] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:44 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1414 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:45.240106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fdfa5d76-efb5-4d21-9e1d-a387bd3f979f req-92a455f5-1ae6-4ff6-9c53-1b6f99a11c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "51aab7a3-2cc6-4f52-a48c-baea0c906ed9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:45.286872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdfa5d76-efb5-4d21-9e1d-a387bd3f979f req-92a455f5-1ae6-4ff6-9c53-1b6f99a11c0d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:45.288821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdfa5d76-efb5-4d21-9e1d-a387bd3f979f req-92a455f5-1ae6-4ff6-9c53-1b6f99a11c0d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:45.289500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdfa5d76-efb5-4d21-9e1d-a387bd3f979f req-92a455f5-1ae6-4ff6-9c53-1b6f99a11c0d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:45.305995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fdfa5d76-efb5-4d21-9e1d-a387bd3f979f req-92a455f5-1ae6-4ff6-9c53-1b6f99a11c0d service nova] Creating event network-vif-plugged:51aab7a3-2cc6-4f52-a48c-baea0c906ed9 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:45.317749 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fdfa5d76-efb5-4d21-9e1d-a387bd3f979f req-92a455f5-1ae6-4ff6-9c53-1b6f99a11c0d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082889 Oct 17 13:44:45.323637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2890/5788] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:46.028295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.030314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:46.037766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:46.038966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:46.048543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.049054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.049534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.050268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.052704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.054963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.055893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.056574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.057020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.059514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:46.060282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:46.061611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:46.328459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.348178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.354345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.355636 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e58b8045-8e19-4aa0-84e2-30590cd04d9c tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1414 microversion: 2.54 time: 0.322147 Oct 17 13:44:46.358166 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2891/5789] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1414 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:46.604599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.624280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.627859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:46.633747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74702d9c-bd5f-4fc8-89fb-105eb383ff49 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.605203 Oct 17 13:44:46.636652 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2899/5790] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:46 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:47.388611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:47.389764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:47.402678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.405120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.408010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.408873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.409457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.410963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.670717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:47.675108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:47.691497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.692002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.692433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:47.693144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:47.693625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:47.698360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.153080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.168973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.184104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.188999 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0db98da7-f4d4-4870-bfee-1fd829a50ed6 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1399 microversion: 2.54 time: 0.804855 Oct 17 13:44:48.196070 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2892/5791] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:47 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1399 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:48.219601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7132cb7-0d2f-4411-85dd-a11bf5713e10 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '.version_select at 0x7f419cd5c700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.296275 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7132cb7-0d2f-4411-85dd-a11bf5713e10 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-950429307" status: 204 len: 0 microversion: 2.54 time: 0.081041 Oct 17 13:44:48.300513 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2893/5792] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:44:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-950429307 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 13:44:48.310670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.314249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.326045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.329314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.331858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.332805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.333738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.335127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.394985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:44:48.399388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.422871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.424787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:48.426420 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eef9efcb-935c-4459-a856-d9d1769a3cb4 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.760195 Oct 17 13:44:48.437509 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2900/5793] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:47 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:48.730696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9cfbf8ab-545a-4c3d-8f01-795d62750dae tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "DELETE /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 204 len: 0 microversion: 2.54 time: 0.421569 Oct 17 13:44:48.735518 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2894/5794] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:44:48 2022] DELETE /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 13:44:48.743423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:48.744581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:48.752876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.753358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.753802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:48.754520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:48.754981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:48.755411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.119828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.142105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.146092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.149729 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f6ddb76-3e62-47f7-a9ac-6fb53cb6372e tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1405 microversion: 2.54 time: 0.410189 Oct 17 13:44:49.154487 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2901/5795] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:48 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:49.470839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:49.473057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:49.485741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.487151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.487687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.488517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:49.489772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:49.490287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:49.770625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.788532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.796375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:49.799368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0566c43d-4c95-418d-8f1c-c19f63d2facf tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.338181 Oct 17 13:44:49.818801 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2895/5796] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:49 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:50.180546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:50.181331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:50.194409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.194910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.195351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.196110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.196606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.204390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.361475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:50.388587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:50.395117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:50.404956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a082168-6ba3-43ce-a84f-8817aa913d44 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1405 microversion: 2.54 time: 0.226753 Oct 17 13:44:50.408342 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2902/5797] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:50 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1405 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:50.830110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:50.830724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:50.867219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.874959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.877253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.883493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.891194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.894493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.902363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-103f70ae-ac95-4102-9fed-c095ba7a4151 req-11c578d9-9d18-43c0-8e4f-990c42a1cf88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "332de9c8-5e47-4233-b4b1-3b4e05d9672f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:50.925811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-103f70ae-ac95-4102-9fed-c095ba7a4151 req-11c578d9-9d18-43c0-8e4f-990c42a1cf88 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:50.931864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-103f70ae-ac95-4102-9fed-c095ba7a4151 req-11c578d9-9d18-43c0-8e4f-990c42a1cf88 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:50.932674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-103f70ae-ac95-4102-9fed-c095ba7a4151 req-11c578d9-9d18-43c0-8e4f-990c42a1cf88 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:50.969098 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-103f70ae-ac95-4102-9fed-c095ba7a4151 req-11c578d9-9d18-43c0-8e4f-990c42a1cf88 service nova] Creating event network-vif-plugged:332de9c8-5e47-4233-b4b1-3b4e05d9672f for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:50.983156 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-103f70ae-ac95-4102-9fed-c095ba7a4151 req-11c578d9-9d18-43c0-8e4f-990c42a1cf88 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087835 Oct 17 13:44:50.993537 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2903/5798] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:51.424568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.446221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:51.448968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:51.453372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.463635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.468862 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3de5f58e-4697-429f-8f95-a0ae3fab7a39 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.643730 Oct 17 13:44:51.469520 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2896/5799] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:50 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:51.477073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.488429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.489296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.492392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.493153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.495199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.567554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:51.567932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:51.568411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:51.568910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lazy-loading 'fault' on Instance uuid dc968e01-c2a8-49b8-8127-b231246476b2 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:51.648976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.659980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.662222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '202eeb81e6c8424d91221492d34827e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da162737843a4cbdbd8985eb97b72c5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:51.664537 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36a370c2-7a47-48a0-ae47-d36c10f837d7 tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 200 len: 1410 microversion: 2.54 time: 0.232956 Oct 17 13:44:51.665866 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2904/5800] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:51 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 1410 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:44:51.929677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdead350-d48a-4c4f-8247-359e1cd93c5a tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2141733237", "availability_zone": "foo_zone"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:51.955134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.aggregate [None req-cdead350-d48a-4c4f-8247-359e1cd93c5a tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Generated uuid 71771f37-7e9c-4841-a2dd-eae549eaeb43 for aggregate {{(pid=120697) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 17 13:44:52.036268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cdead350-d48a-4c4f-8247-359e1cd93c5a tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.345298 Oct 17 13:44:52.038875 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2897/5801] 10.222.0.65 () {60 vars in 1164 bytes} [Mon Oct 17 13:44:51 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:52.052912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-496dc0c0-d064-4998-899e-4c3727f99064 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:52.108273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-496dc0c0-d064-4998-899e-4c3727f99064 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.061732 Oct 17 13:44:52.109922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2905/5802] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:44:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:52.134325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.141292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.142163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.143074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.144351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.145061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.148025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.189215 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a6ca957-bfe3-444b-8463-6decccb416bd tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.068869 Oct 17 13:44:52.189874 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2898/5803] 10.222.0.65 () {58 vars in 1176 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:52.203231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ea4e79d-ca3e-49f9-be3d-d731b67f1938 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.212891 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ea4e79d-ca3e-49f9-be3d-d731b67f1938 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.014808 Oct 17 13:44:52.218399 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2906/5804] 10.222.0.65 () {58 vars in 1143 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:52.227743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-384eb403-1483-4e61-8ad5-5bab1d16c5de tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-854121-14"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:52.243889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-384eb403-1483-4e61-8ad5-5bab1d16c5de tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.246041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-384eb403-1483-4e61-8ad5-5bab1d16c5de tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.247902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-384eb403-1483-4e61-8ad5-5bab1d16c5de tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.501502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.502904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:52.512648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.513658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.514307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.515386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.516015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.516719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.897610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:52.915831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:52.916750 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-384eb403-1483-4e61-8ad5-5bab1d16c5de tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.693202 Oct 17 13:44:52.921683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:52.925531 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02a31e45-ca4d-44a3-a994-3dd167ec5ca8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.429475 Oct 17 13:44:52.925854 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2899/5805] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:44:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:52.926149 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2907/5806] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:52.940001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.941619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da8b68a5-7d99-4b91-bb1b-654233de5336 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:52.943785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] [instance: dc968e01-c2a8-49b8-8127-b231246476b2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:52.959181 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da8b68a5-7d99-4b91-bb1b-654233de5336 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.030384 Oct 17 13:44:52.963655 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2908/5807] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:52.968846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.971164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.971605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:52.972331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:52.974130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f15f5ce8-150b-4056-9d8e-adc42f77230c tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1360763201", "availability_zone": "foo_zone"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:52.977274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:52.977786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.002908 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] HTTP exception thrown: Instance dc968e01-c2a8-49b8-8127-b231246476b2 could not be found. Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Request method failure captured: Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 HTTP/1.1 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVwqyLVcP2n8nwkOo9TKovbXoiNF1Uf7MgiULr5iSseCy0r8aLwDN5RlMalnS2GbecnTxc1-GHJI-fKehsf1VtScyIr-BNAq0p7YSdY83fVf61OWUrOEn4MAC-K74Mk9NG9k-AN2YRXPXpsRX11jStnPT1G2qIwQDDtJqLbwCL7TVDE Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.54 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: da162737843a4cbdbd8985eb97b72c5d Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerShowV254Test-223412342 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/da162737843a4cbdbd8985eb97b72c5d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/da162737843a4cbdbd8985eb97b72c5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/da162737843a4cbdbd8985eb97b72c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_da162737843a4cbdbd8985eb97b72c5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerShowV254Test-223412342 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: da162737843a4cbdbd8985eb97b72c5d Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerShowV254Test-223412342 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerShowV254Test-223412342-project Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 202eeb81e6c8424d91221492d34827e3 Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerShowV254Test-223412342-project Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance dc968e01-c2a8-49b8-8127-b231246476b2 could not be found. Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'dc968e01-c2a8-49b8-8127-b231246476b2'} Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc968e01-c2a8-49b8-8127-b231246476b2 could not be found. Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc968e01-c2a8-49b8-8127-b231246476b2 could not be found. Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:53.005654 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc968e01-c2a8-49b8-8127-b231246476b2 could not be found. Oct 17 13:44:53.010139 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:53.013709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] Returning 404 to user: Instance dc968e01-c2a8-49b8-8127-b231246476b2 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:53.014954 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f73c928d-3dc0-4a57-a119-b2d895076b3a tempest-ServerShowV254Test-223412342 tempest-ServerShowV254Test-223412342-project] 10.222.0.65 "GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2" status: 404 len: 111 microversion: 2.54 time: 0.087557 Oct 17 13:44:53.015773 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2900/5808] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:52 2022] GET /compute/v2.1/servers/dc968e01-c2a8-49b8-8127-b231246476b2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:44:53.040914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ee4ff369-74c2-4bbe-baa9-03cac1864743 req-6e951dc4-d21c-489f-9cd3-ab858c16e5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "b1159ddd-a700-459f-8fe7-872c7348c788"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:53.068742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ee4ff369-74c2-4bbe-baa9-03cac1864743 req-6e951dc4-d21c-489f-9cd3-ab858c16e5b0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.070396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ee4ff369-74c2-4bbe-baa9-03cac1864743 req-6e951dc4-d21c-489f-9cd3-ab858c16e5b0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.070730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ee4ff369-74c2-4bbe-baa9-03cac1864743 req-6e951dc4-d21c-489f-9cd3-ab858c16e5b0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.121979 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ee4ff369-74c2-4bbe-baa9-03cac1864743 req-6e951dc4-d21c-489f-9cd3-ab858c16e5b0 service nova] Creating event network-vif-plugged:b1159ddd-a700-459f-8fe7-872c7348c788 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:53.143388 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ee4ff369-74c2-4bbe-baa9-03cac1864743 req-6e951dc4-d21c-489f-9cd3-ab858c16e5b0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111465 Oct 17 13:44:53.147802 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2901/5809] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:44:53.151807 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f15f5ce8-150b-4056-9d8e-adc42f77230c tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.182901 Oct 17 13:44:53.161223 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2909/5810] 10.222.0.65 () {60 vars in 1173 bytes} [Mon Oct 17 13:44:52 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:53.168316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f12d420-b3a7-4b9e-bbd5-d6278b84799b tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:53.238215 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f12d420-b3a7-4b9e-bbd5-d6278b84799b tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.075276 Oct 17 13:44:53.244415 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2910/5811] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:44:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:53.258296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9157fda8-c9e8-4309-8c06-2add00b9105d tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:53.272642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9157fda8-c9e8-4309-8c06-2add00b9105d tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.019434 Oct 17 13:44:53.273881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2902/5812] 10.222.0.65 () {58 vars in 1152 bytes} [Mon Oct 17 13:44:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:53.286575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e97840d0-b84d-4f13-9557-02d812caacef tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-854121-14"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:53.321413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97840d0-b84d-4f13-9557-02d812caacef tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.322265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97840d0-b84d-4f13-9557-02d812caacef tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.323389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e97840d0-b84d-4f13-9557-02d812caacef tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.954958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:53.955610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:53.974630 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e97840d0-b84d-4f13-9557-02d812caacef tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.692837 Oct 17 13:44:53.982696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.985517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.986059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:53.986822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:53.989947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:53.994113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:54.002235 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2911/5813] 10.222.0.65 () {60 vars in 1194 bytes} [Mon Oct 17 13:44:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:54.024410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cef09ec0-a080-4635-b358-268ee9a65a10 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:54.101504 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cef09ec0-a080-4635-b358-268ee9a65a10 tempest-TestAggregatesBasicOps-409534047 tempest-TestAggregatesBasicOps-409534047-project-admin] 10.222.0.65 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.097086 Oct 17 13:44:54.103183 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2912/5814] 10.222.0.65 () {58 vars in 1155 bytes} [Mon Oct 17 13:44:54 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 17 13:44:54.707818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:54.723371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:54.727685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:54.730880 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-950e7ee2-d420-4adf-8316-ccce1b01484a tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.780248 Oct 17 13:44:54.734497 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2903/5815] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:53 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:55.295497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "ee816deb-fa90-4890-b9c4-2bb6f3ebb346"}, {"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "1848ce9e-f330-4669-8fb2-ac7b10fb0a2d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:55.313773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:55.327767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.332019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.334396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.408982 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] Creating event network-vif-plugged:ee816deb-fa90-4890-b9c4-2bb6f3ebb346 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:55.410431 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] Creating event network-vif-plugged:1848ce9e-f330-4669-8fb2-ac7b10fb0a2d for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:55.433753 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8c2e309a-2fa4-43a0-aa4c-f3b99b840724 req-5ea664ab-07c6-4c32-8d56-2ced5545eb96 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.145661 Oct 17 13:44:55.441768 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2913/5816] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:55.764992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:55.766801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:55.792480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.796451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.796962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:55.798101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:55.800140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:55.803014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:56.445315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:56.457832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:56.462325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:56.464049 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cf53ef6-b455-423d-93c8-190e4a285568 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.705842 Oct 17 13:44:56.482864 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2904/5817] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:55 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:57.506282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:57.507815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:57.511610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "65d2d84e-b320-4db0-a8b2-501d963b849d"}, {"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-plugged", "status": "completed", "tag": "382d8f99-3ffc-4832-9e7e-ff6a6ed28004"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:57.527038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:57.527558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:57.527977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:57.540683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:57.542163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:57.542778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:57.543253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:57.544693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:57.550371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:57.582744 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] Creating event network-vif-plugged:65d2d84e-b320-4db0-a8b2-501d963b849d for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:57.583924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] Creating event network-vif-plugged:382d8f99-3ffc-4832-9e7e-ff6a6ed28004 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:44:57.598004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1bf908f7-d4ae-4b56-a5df-3087f2011ca1 req-f8587836-bc87-4295-9402-c393ac7bb493 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.092657 Oct 17 13:44:57.599870 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2905/5818] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:57.869103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c28f5b6-74ef-48fa-85ad-465094022311"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:44:57.871776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:57.881536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:57.882295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:57.884855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:57.885814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:57.890187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:57.890891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.079472 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Invalid volume: volume 9c28f5b6-74ef-48fa-85ad-465094022311 is already attached to instances: 0455d747-01a4-4dc5-8caf-56b659221bdd Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments HTTP/1.1 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 74 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: {"volumeAttachment": {"volumeId": "9c28f5b6-74ef-48fa-85ad-465094022311"}} Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid volume: volume 9c28f5b6-74ef-48fa-85ad-465094022311 is already attached to instances: 0455d747-01a4-4dc5-8caf-56b659221bdd Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': '0455d747-01a4-4dc5-8caf-56b659221bdd', 'body': {'volumeAttachment': {'volumeId': '9c28f5b6-74ef-48fa-85ad-465094022311'}}} Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9c28f5b6-74ef-48fa-85ad-465094022311 is already attached to instances: 0455d747-01a4-4dc5-8caf-56b659221bdd Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:58.081671 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9c28f5b6-74ef-48fa-85ad-465094022311 is already attached to instances: 0455d747-01a4-4dc5-8caf-56b659221bdd Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9c28f5b6-74ef-48fa-85ad-465094022311 is already attached to instances: 0455d747-01a4-4dc5-8caf-56b659221bdd Oct 17 13:44:58.087302 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:44:58.091377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 400 to user: Invalid volume: volume 9c28f5b6-74ef-48fa-85ad-465094022311 is already attached to instances: 0455d747-01a4-4dc5-8caf-56b659221bdd {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:44:58.092531 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b042df22-76e8-48dd-beba-2f3a3052ca30 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.228440 Oct 17 13:44:58.095060 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2906/5819] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:44:57 2022] POST /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 174 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:44:58.221980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:58.222713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:58.236788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.238035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.238419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.239255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.239997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.242068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.422561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lazy-loading 'services' on Instance uuid 0455d747-01a4-4dc5-8caf-56b659221bdd {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:44:58.607942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30e8583b-a7bc-470b-b8c3-43d01397bb87 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments/9c28f5b6-74ef-48fa-85ad-465094022311" status: 202 len: 0 microversion: 2.1 time: 0.389742 Oct 17 13:44:58.609919 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2907/5820] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:44:58 2022] DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments/9c28f5b6-74ef-48fa-85ad-465094022311 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:44:58.639137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.645510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:58.654100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:58.662779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.678256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:44:58.679534 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-120e34be-8c6f-417c-a4ce-83f39730dbdb tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 1.184672 Oct 17 13:44:58.684058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.684562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.685321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.687342 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2914/5821] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:57 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:44:58.689224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:58.690358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:58.696154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:58.742490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:44:58.764814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-190f4c82-1342-41ed-b9c6-2df5a00ee849 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149678 Oct 17 13:44:58.765462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2908/5822] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:44:58 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:44:59.713751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:59.715348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:59.740128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.748295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.753353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.754234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.755689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.757688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.778516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:44:59.781084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:44:59.807329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.813543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.814090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.814858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:44:59.815337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:44:59.815777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:44:59.883525 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5096cd24-ed9b-4270-9a19-a982a38d8063 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109936 Oct 17 13:44:59.889575 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2909/5823] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:44:59 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:00.197947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:00.208112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:00.210360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:00.212089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9a1aafd7-11cb-464e-8d62-7c81718feaed tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1874 microversion: 2.32 time: 0.504003 Oct 17 13:45:00.212744 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2915/5824] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:44:59 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1874 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:00.903270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:00.915247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:00.950153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:00.953646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:00.955718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:00.959454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:00.963048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:00.963817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:01.025299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e586472-7ee2-4f92-bde4-0ca7c88d824c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133130 Oct 17 13:45:01.030514 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2910/5825] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:00 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:01.244049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:01.245493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:01.262457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:01.264612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:01.265366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:01.266528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:01.267210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:01.268040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:02.044052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:02.051006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:02.065089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:02.065861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:02.066744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:02.067886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:02.068537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:02.069131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:02.136539 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b2ecd7f-ea3d-472d-afb4-9c316125e0a5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097415 Oct 17 13:45:02.138436 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2911/5826] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:02 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:02.392916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:02.405859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:02.415145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:02.418105 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-093ef858-4671-4ba2-bcbd-968c6b3fd308 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2826 microversion: 2.32 time: 1.179351 Oct 17 13:45:02.435204 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2916/5827] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:01 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2826 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:02.453775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:02.454525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:02.457448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:02.471093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:02.476945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:02.477692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:02.478604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:02.479753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:02.481075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:02.835782 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bc3eea4-55f1-43f8-b4fb-44d90b273dea tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.388103 Oct 17 13:45:02.836387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2912/5828] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:45:02 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413/os-interface => generated 1830 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:03.153187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:03.157176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:03.170156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:03.171002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:03.179498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:03.180700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:03.181475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:03.182105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:03.260177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:03.273855 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0c67a50-606d-4e4b-96d5-8dbc6ab31031 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127277 Oct 17 13:45:03.277408 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2917/5829] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:03 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:04.290609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:04.293456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:04.296305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:04.321149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:04.322741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:04.324911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:04.325778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:04.346816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:04.347516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:04.442546 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85421d3f-5ca2-4624-a52a-3fcc3b1c226c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159339 Oct 17 13:45:04.448357 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2913/5830] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:04 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:05.456044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:05.458949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:05.499614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:05.509789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:05.510790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:05.512851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:05.513745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:05.514411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:05.626648 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96ee21ec-7a9e-4d45-90d5-273eac707cba tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175313 Oct 17 13:45:05.643495 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2918/5831] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:05 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:06.640644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:06.643745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:06.660202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.661852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.664439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.665738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:06.670520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:06.671289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:06.770852 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f2b42a9-ea04-41cc-9b46-e0722c72885e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131354 Oct 17 13:45:06.775498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2914/5832] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:06 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:07.784212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:07.787149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:07.798201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.803111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.804639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.818694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.822796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.835233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.901544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6af706d8-88c3-4a1b-9e97-e2c7bae1cc0d req-d6708d4d-c413-4702-8cc9-4042401b4990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "tag": "51aab7a3-2cc6-4f52-a48c-baea0c906ed9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:07.923388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6af706d8-88c3-4a1b-9e97-e2c7bae1cc0d req-d6708d4d-c413-4702-8cc9-4042401b4990 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:07.924251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6af706d8-88c3-4a1b-9e97-e2c7bae1cc0d req-d6708d4d-c413-4702-8cc9-4042401b4990 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:07.927565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6af706d8-88c3-4a1b-9e97-e2c7bae1cc0d req-d6708d4d-c413-4702-8cc9-4042401b4990 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:07.947417 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9ca731a-1f3e-4411-9426-3c67d4ca87a2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.167178 Oct 17 13:45:07.952940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6af706d8-88c3-4a1b-9e97-e2c7bae1cc0d req-d6708d4d-c413-4702-8cc9-4042401b4990 service nova] Creating event network-changed:51aab7a3-2cc6-4f52-a48c-baea0c906ed9 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:45:07.959092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2919/5833] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:45:07 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd/os-volume_attachments => generated 25 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:45:07.999436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6af706d8-88c3-4a1b-9e97-e2c7bae1cc0d req-d6708d4d-c413-4702-8cc9-4042401b4990 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107832 Oct 17 13:45:08.004932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2915/5834] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:08.065897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:08.066823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:08.091271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.091971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.092457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.093228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.100444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.101089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.177972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:45:08.322377 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2cf13df-a1f6-4ba9-bb97-10ef04b6ecc5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 204 len: 0 microversion: 2.1 time: 0.259269 Oct 17 13:45:08.322780 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2920/5835] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:45:08 2022] DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:45:08.333669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:08.334652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:08.348617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.351148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.356279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:08.357872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:08.358520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:08.359129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:09.559837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:09.576113 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41dc67c9-a5e1-48a9-89bc-522466a27c71 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1681 microversion: 2.1 time: 1.248518 Oct 17 13:45:09.576732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2916/5836] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:08 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1681 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:10.607590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:10.608845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:10.633964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.634590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.635835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:10.639120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:10.640659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:10.642191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:12.161173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:12.177854 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55082c0b-4ef3-4859-8983-7f70e566d9bc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1681 microversion: 2.1 time: 1.576995 Oct 17 13:45:12.189220 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2921/5837] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:10 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1681 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:13.204501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:13.205128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:13.222520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.223521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.233412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-62ddd86e-6966-41ce-be80-f14c728204bd req-265fd570-0eb6-44a1-9dbd-4a1e99eb4336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0455d747-01a4-4dc5-8caf-56b659221bdd", "name": "network-vif-deleted", "tag": "cd8d1f32-021c-463e-8258-52c546631750"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:13.245954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.249989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.250823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.252156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.280484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-62ddd86e-6966-41ce-be80-f14c728204bd req-265fd570-0eb6-44a1-9dbd-4a1e99eb4336 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:13.290588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-62ddd86e-6966-41ce-be80-f14c728204bd req-265fd570-0eb6-44a1-9dbd-4a1e99eb4336 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:13.291298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-62ddd86e-6966-41ce-be80-f14c728204bd req-265fd570-0eb6-44a1-9dbd-4a1e99eb4336 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:13.348974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-62ddd86e-6966-41ce-be80-f14c728204bd req-265fd570-0eb6-44a1-9dbd-4a1e99eb4336 service nova] Creating event network-vif-deleted:cd8d1f32-021c-463e-8258-52c546631750 for instance 0455d747-01a4-4dc5-8caf-56b659221bdd on n-h1-854121-14 Oct 17 13:45:13.383811 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-62ddd86e-6966-41ce-be80-f14c728204bd req-265fd570-0eb6-44a1-9dbd-4a1e99eb4336 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154555 Oct 17 13:45:13.384745 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2922/5838] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:13.541346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:13.559246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b3ac41f-4cb1-4bf3-a616-a16f787d13cb tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 200 len: 1325 microversion: 2.1 time: 0.359173 Oct 17 13:45:13.561363 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2917/5839] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:13 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:14.586513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:14.587254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:14.603180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.603713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.604193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.614509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:14.614509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:14.614509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:14.644003 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd HTTP/1.1 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0455d747-01a4-4dc5-8caf-56b659221bdd'} Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:45:14.645788 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:45:14.649611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:45:14.653874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6144428d-6953-41b1-aaba-bdc88ed5654a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 404 len: 111 microversion: 2.1 time: 0.070892 Oct 17 13:45:14.654927 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2923/5840] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:14 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:45:14.664104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4f0f097-f851-4551-ae0a-68891256bf56 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '.version_select at 0x7f419c91d940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:14.705998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4f0f097-f851-4551-ae0a-68891256bf56 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741985788" status: 202 len: 0 microversion: 2.1 time: 0.046503 Oct 17 13:45:14.706941 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2918/5841] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:45:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1741985788 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:45:16.211972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11181698-3087-494c-b4ac-1f853e3a5a0d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: .version_select at 0x7f419cfdcee0>, body: {"keypair": {"name": "tempest-keypair-1298400182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtm1BF0u9V+1gVllVqrBlREqTi3qEi0ChmkPPNq6dPO2ksBxifCbhPvsm3YIpVh3bNwzeHpJo8eWo/mvabh+AMCLDINJugu0Xv0bF9Py5vlRHwwpx5PgMzB5+89wQ/v3w=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:16.232313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-11181698-3087-494c-b4ac-1f853e3a5a0d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:16.242591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-11181698-3087-494c-b4ac-1f853e3a5a0d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for user 766c87ff085742f194e4fb7782852b96 and project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:16.282995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11181698-3087-494c-b4ac-1f853e3a5a0d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.485507 Oct 17 13:45:16.290971 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2924/5842] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:16.689680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c313529f-29b2-4b2d-b65d-423adfcadcd8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: .version_select at 0x7f419c8e7ca0>, body: {"keypair": {"name": "tempest-keypair-235721290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNouUEzZZaGUR4+8vCMH7cIKULXrXIOsqHxQOqhUCSPyb7q3SakIezjOGduH10SJoX5bd5k4uxTTBk3AMZ51+rXHkuv7d53xvYknVuWHk+R+QF6WJRW/IKlfsZmm/GHhew=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:16.724289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c313529f-29b2-4b2d-b65d-423adfcadcd8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:16.739300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c313529f-29b2-4b2d-b65d-423adfcadcd8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:16.787333 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c313529f-29b2-4b2d-b65d-423adfcadcd8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101568 Oct 17 13:45:16.788276 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2919/5843] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:20.418386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1849355766", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02ebca51-614e-4b33-ab74-bdf45159403c"}], "security_groups": [{"name": "tempest-securitygroup--1070921401"}], "key_name": "tempest-keypair-1298400182", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:20.746412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] validate_networks() for [('02ebca51-614e-4b33-ab74-bdf45159403c', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:21.886662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-260005368", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be2795df-2862-45cf-a8ed-080978866cd4"}], "security_groups": [{"name": "tempest-securitygroup--549433715"}], "key_name": "tempest-keypair-235721290", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:22.032599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:22.033098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:22.033776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:22.034261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:22.035659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:22.054003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:22.054817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:22.058005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:22.060669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:22.062021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:22.062947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:22.107427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:22.125833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for user 766c87ff085742f194e4fb7782852b96 and project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:22.157333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] validate_networks() for [('be2795df-2862-45cf-a8ed-080978866cd4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:22.176437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:22.185683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:22.302935 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd5dec5a-93fe-4c93-923e-ff4d623005cb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.891031 Oct 17 13:45:22.304100 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2925/5844] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:22.322096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e078693-eb6c-44f2-912f-e0471664912c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:22.327095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e078693-eb6c-44f2-912f-e0471664912c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:22.558491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e078693-eb6c-44f2-912f-e0471664912c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:22.571479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e078693-eb6c-44f2-912f-e0471664912c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1238 microversion: 2.1 time: 0.259289 Oct 17 13:45:22.581316 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2926/5845] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:22 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1238 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:23.556455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=49 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:23.597692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:23.599212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:23.620154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:23.627726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:23.628522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.640287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:23.646740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:23.649055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.689137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:23.691128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:23.703539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:23.705971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:23.707641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:23.732204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:23.733016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:23.733700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.734685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:23.737762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:23.738445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:23.783980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:23.798460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Getting quotas for user 165f01302a7f462081231461a1f03ef8 and project c7a8fb8b6dbd4edf915f8e3e4cdd1e60. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:23.849248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:23.878074 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ed02d94-366c-47f2-a19f-5d64fcffb982 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1234 microversion: 2.1 time: 0.284498 Oct 17 13:45:23.888543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:23.891613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:23.892964 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2927/5846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:23 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1234 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:23.994090 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dda4e557-cb5d-44c0-93f3-abcebb1d6ee5 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.114175 Oct 17 13:45:23.996243 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2920/5847] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:45:24.010582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60669a9b-bc71-4e61-af5f-fb58cef1d3ee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.011592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60669a9b-bc71-4e61-af5f-fb58cef1d3ee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:24.248205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60669a9b-bc71-4e61-af5f-fb58cef1d3ee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:24.258707 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60669a9b-bc71-4e61-af5f-fb58cef1d3ee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1240 microversion: 2.1 time: 0.253157 Oct 17 13:45:24.264969 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2928/5848] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:24 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1240 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:24.908960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:24.910379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:24.931994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.932500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.932950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:24.933704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:24.934410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:24.935099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.072009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:25.093419 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bd43590-b335-4fe5-aed0-24865bf6a76c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1296 microversion: 2.1 time: 0.193128 Oct 17 13:45:25.096561 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2921/5849] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:24 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1296 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:25.287992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:25.288618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:25.306253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.313370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.314226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.315022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:25.315544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:25.315996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:25.435345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:25.447956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9e653a1e-a44f-4d1a-a64f-de204b675976 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1236 microversion: 2.1 time: 0.163913 Oct 17 13:45:25.454632 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2929/5850] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:25 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1236 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:26.121315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:26.122311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:26.142307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:26.142805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:26.149622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:26.151544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:26.154296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:26.156079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:26.477002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:26.477931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:26.493096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:26.494040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:26.494619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:26.495656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:26.496250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:26.497731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:27.001542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:27.018454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef438767-ecd5-4bf9-9653-79b7504e0ba8 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1310 microversion: 2.1 time: 0.545412 Oct 17 13:45:27.021481 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2930/5851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:26 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1310 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:27.062166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:27.077134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66e8b076-e917-4af8-aa75-c1b8fa29f4ad tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1296 microversion: 2.1 time: 0.958945 Oct 17 13:45:27.082254 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2922/5852] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:26 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1296 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:28.046692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:28.047318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:28.063887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:28.087516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:28.088055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:28.088502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:28.094863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:28.095605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:28.096864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:28.104709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:28.106488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:28.129686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:28.130021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:28.141748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:28.143024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:28.144215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:28.151153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:28.640556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:28.656985 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fb09e83-6e52-4cca-9fbd-cafd9d31b551 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1298 microversion: 2.1 time: 0.616790 Oct 17 13:45:28.660392 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2931/5853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:28 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1298 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:29.090318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:29.099616 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66c0667d-5ad2-47cc-8f5b-87d383360149 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 0.999285 Oct 17 13:45:29.108412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2923/5854] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:28 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:29.704838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:29.706237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:29.726082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.726906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.727815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.729434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:29.734276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:29.735064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:29.892299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:29.904362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-196d915e-9061-411e-b770-addece85d8b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1298 microversion: 2.1 time: 0.211350 Oct 17 13:45:29.905749 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2932/5855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:29 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:30.131924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:30.133330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:30.143541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.144395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.145051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:30.146856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.147551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.148258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:30.674267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:30.689931 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff6a50a3-fb05-44a1-b056-9037dcde78bf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 0.560326 Oct 17 13:45:30.690612 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2924/5856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:30 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:30.932578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:30.934632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:30.943588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.944455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.945101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:30.946106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:30.946798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:30.947432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.532389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:31.542065 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-125f7a87-4f4c-42cc-b997-694cb95df41e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.613890 Oct 17 13:45:31.543038 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2933/5857] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:30 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:31.715076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:31.717413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:31.724223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.724719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.725321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.726037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.726499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.726932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.774935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-50780d28-cbe2-4719-b398-379259968b3d req-88a0045e-d3f9-4985-bf80-77dd1da1fc8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3393c5-a858-4255-8eb3-9a85b1721e2c", "tag": "54ee8446-951c-4d94-9564-b8dba23bf8f4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:31.799537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50780d28-cbe2-4719-b398-379259968b3d req-88a0045e-d3f9-4985-bf80-77dd1da1fc8b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:31.800383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50780d28-cbe2-4719-b398-379259968b3d req-88a0045e-d3f9-4985-bf80-77dd1da1fc8b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:31.801037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50780d28-cbe2-4719-b398-379259968b3d req-88a0045e-d3f9-4985-bf80-77dd1da1fc8b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:31.819641 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-50780d28-cbe2-4719-b398-379259968b3d req-88a0045e-d3f9-4985-bf80-77dd1da1fc8b service nova] Creating event network-changed:54ee8446-951c-4d94-9564-b8dba23bf8f4 for instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c on n-h1-854121-14 Oct 17 13:45:31.826832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-50780d28-cbe2-4719-b398-379259968b3d req-88a0045e-d3f9-4985-bf80-77dd1da1fc8b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056121 Oct 17 13:45:31.828728 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2934/5858] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:32.404319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:32.418322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6e3096f-82b7-42ee-8008-f11af167f62a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 0.706088 Oct 17 13:45:32.420602 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2925/5859] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:31 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:32.564283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:32.570579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:32.571649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:32.581862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.584048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.585257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:32.588663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:32.591093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:32.592487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:33.208473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:33.218529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4bd3d381-c669-4587-b801-682095b3c4b1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.655880 Oct 17 13:45:33.219137 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2935/5860] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:32 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:33.445962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:33.447182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:33.455745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:33.456584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:33.457033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:33.457794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:33.458406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:33.459003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:33.759789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:33.857820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:34.181051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-29c79f80-8583-480c-a57b-6b3e68e7d53e req-8180c135-f646-47b7-82b6-d38cd7ab6a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46786203-7b4c-473f-81c9-b620803c0a2d", "tag": "49eb59fa-b819-4e66-8dc1-c6113581db58"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:34.216868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-29c79f80-8583-480c-a57b-6b3e68e7d53e req-8180c135-f646-47b7-82b6-d38cd7ab6a84 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.217780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-29c79f80-8583-480c-a57b-6b3e68e7d53e req-8180c135-f646-47b7-82b6-d38cd7ab6a84 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.218427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-29c79f80-8583-480c-a57b-6b3e68e7d53e req-8180c135-f646-47b7-82b6-d38cd7ab6a84 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.235362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-29c79f80-8583-480c-a57b-6b3e68e7d53e req-8180c135-f646-47b7-82b6-d38cd7ab6a84 service nova] Creating event network-changed:49eb59fa-b819-4e66-8dc1-c6113581db58 for instance 46786203-7b4c-473f-81c9-b620803c0a2d on n-h2-854121-14 Oct 17 13:45:34.255976 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-29c79f80-8583-480c-a57b-6b3e68e7d53e req-8180c135-f646-47b7-82b6-d38cd7ab6a84 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066923 Oct 17 13:45:34.260161 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2936/5861] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:34.274204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:34.275099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:34.293148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:34.301189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.303208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.303827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.306290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:34.308020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:34.309247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:34.422490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:34.431238 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b33675bb-2357-42ab-9b60-7a785522aeaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 0.989518 Oct 17 13:45:34.431852 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2926/5862] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:33 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:35.024952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:35.037209 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ee1740d-5cec-4001-a796-08e71dc41c2c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.775545 Oct 17 13:45:35.037825 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2937/5863] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:34 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:35.458971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:35.459952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:35.463691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:35.477074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:35.477953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:35.481869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:35.483005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:35.483592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:35.484143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.061238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:36.061891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:36.069393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.070006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.070523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.071314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:36.071847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:36.072580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:36.078367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:36.298757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:36.330083 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7003ddd1-8a58-4352-894e-b4efc6699519 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 0.877617 Oct 17 13:45:36.353425 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2927/5864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:35 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:37.085870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:37.106993 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d52105a9-e3df-4e71-aace-4d6bbbeafc61 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 1.048307 Oct 17 13:45:37.121465 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2938/5865] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:36 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:37.364531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:37.366068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:37.379541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:37.381179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:37.381980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:37.383742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:37.384462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:37.385889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:37.817830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:37.826907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22e38a35-9392-4737-9088-3ec8b31bac36 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 0.470957 Oct 17 13:45:37.827824 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2928/5866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:37 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:38.143142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:38.143790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:38.164602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.167046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.167845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.174543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.175283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.175865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.506766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:38.522110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3bc18cb8-1ade-47c9-8b2f-c878d7599051 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.381985 Oct 17 13:45:38.523698 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2939/5867] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:38 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:38.860041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:38.882150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:38.900908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.901996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.907327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:38.908398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:38.909835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:38.910289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.550570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:39.551198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:39.569451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.569993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.570912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:39.571161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:39.571617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:39.572067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:40.138296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:40.154390 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-584cd4b3-825d-4c1d-98a1-af4bd92d8a97 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 1.302131 Oct 17 13:45:40.155869 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2929/5868] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:38 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:40.411691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:40.439569 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db32fe63-1a99-450e-a43d-6a0e3e844a4f tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.890330 Oct 17 13:45:40.444105 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2940/5869] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:39 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:41.179323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:41.179936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:41.199303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.210059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.210529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.211301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.211766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.212203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.495304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:41.504475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:41.519708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.521000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.522637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:41.524401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:41.526693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:41.527102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.230356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:42.246878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f68f681-49a2-44c4-a530-22769ecddaa8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 1.072095 Oct 17 13:45:42.280329 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2930/5870] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:41 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:42.302246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e140915a-c1ad-4caf-adb0-1b4421c33f57 req-3613bb0c-c426-49ea-8402-b8083411e136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3393c5-a858-4255-8eb3-9a85b1721e2c", "name": "network-vif-plugged", "status": "completed", "tag": "54ee8446-951c-4d94-9564-b8dba23bf8f4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:42.350829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e140915a-c1ad-4caf-adb0-1b4421c33f57 req-3613bb0c-c426-49ea-8402-b8083411e136 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:42.358913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e140915a-c1ad-4caf-adb0-1b4421c33f57 req-3613bb0c-c426-49ea-8402-b8083411e136 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:42.359873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e140915a-c1ad-4caf-adb0-1b4421c33f57 req-3613bb0c-c426-49ea-8402-b8083411e136 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:42.408811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e140915a-c1ad-4caf-adb0-1b4421c33f57 req-3613bb0c-c426-49ea-8402-b8083411e136 service nova] Creating event network-vif-plugged:54ee8446-951c-4d94-9564-b8dba23bf8f4 for instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c on n-h1-854121-14 Oct 17 13:45:42.430391 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e140915a-c1ad-4caf-adb0-1b4421c33f57 req-3613bb0c-c426-49ea-8402-b8083411e136 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137921 Oct 17 13:45:42.433590 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2931/5871] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:42.531633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:42.555947 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73b885f4-5c59-484c-99c3-2d5c0838d7c2 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 1.082930 Oct 17 13:45:42.558301 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2941/5872] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:41 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:43.279201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:43.279928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:43.290795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.291306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.291754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.296253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.302885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.306781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.593083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:43.593865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:43.619958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.620574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.621036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:43.621869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:43.622337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:43.622772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:44.954743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:44.975866 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c891013-3cd1-4a9e-a193-4887db6dceb2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1364 microversion: 2.1 time: 1.702181 Oct 17 13:45:44.980313 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2932/5873] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:43 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1364 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:45.406348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:45.422859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d9c155d-2de3-43c4-97b1-5b6612e0ed0a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 1.834601 Oct 17 13:45:45.442404 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2942/5874] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:43 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 1855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:46.009673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:46.010814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:46.018887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.019646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.020442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.021593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.022244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.022842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.309684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:46.327965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a6a54b7-a308-46c1-9c4d-dc2465748007 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1549 microversion: 2.1 time: 0.322107 Oct 17 13:45:46.347865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2933/5875] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:46 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1549 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:46.360866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:46.361854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:46.372673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.373545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.374080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.375157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.375756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.376354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.455552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:46.456912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:46.466238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.466821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.467342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.468223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:46.469615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:46.471509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:46.641252 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69169b15-3d6c-44be-b02c-62a92b42e64e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285985 Oct 17 13:45:46.642863 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2943/5876] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:45:46 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:46.862611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:46.876115 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e0e44c5-1a97-4af9-bc1a-92e373b08c04 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.429777 Oct 17 13:45:46.877484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2934/5877] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:46 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:45:47.368385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-38fb9fa0-d1df-4465-8c06-feb596779288 req-8186199c-bca9-46c9-97fa-bf186e2bf445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46786203-7b4c-473f-81c9-b620803c0a2d", "name": "network-vif-plugged", "status": "completed", "tag": "49eb59fa-b819-4e66-8dc1-c6113581db58"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:47.423074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38fb9fa0-d1df-4465-8c06-feb596779288 req-8186199c-bca9-46c9-97fa-bf186e2bf445 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:47.425402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38fb9fa0-d1df-4465-8c06-feb596779288 req-8186199c-bca9-46c9-97fa-bf186e2bf445 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:47.431565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-38fb9fa0-d1df-4465-8c06-feb596779288 req-8186199c-bca9-46c9-97fa-bf186e2bf445 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:47.470825 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-38fb9fa0-d1df-4465-8c06-feb596779288 req-8186199c-bca9-46c9-97fa-bf186e2bf445 service nova] Creating event network-vif-plugged:49eb59fa-b819-4e66-8dc1-c6113581db58 for instance 46786203-7b4c-473f-81c9-b620803c0a2d on n-h2-854121-14 Oct 17 13:45:47.481091 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-38fb9fa0-d1df-4465-8c06-feb596779288 req-8186199c-bca9-46c9-97fa-bf186e2bf445 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118667 Oct 17 13:45:47.481773 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2944/5878] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:47.899508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:47.900123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:47.913974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:47.914474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:47.915011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:47.916821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:47.917349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:47.924660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:48.155592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:48.164928 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddb7b570-9014-4c30-a35f-b65654d89a94 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.269303 Oct 17 13:45:48.171163 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2935/5879] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:47 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:49.209123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:49.211263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:49.226273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:49.228698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:49.229482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:49.230808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:49.231521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:49.232163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:49.509066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:49.532701 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15a0833c-79fd-4e8f-82d4-ee19b05fbdac tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1365 microversion: 2.1 time: 0.337552 Oct 17 13:45:49.534418 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2945/5880] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:49 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:50.560569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:50.561751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:50.588612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.589289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.596854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.598283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.598872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.599439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.803162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:50.814668 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9bbf4ee4-b2dd-48d8-882d-bab3588fb400 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1555 microversion: 2.1 time: 0.261250 Oct 17 13:45:50.815418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2936/5881] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:50 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1555 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:45:50.844839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:50.846163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:50.856377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.857282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.857999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.858980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:50.859649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:50.860335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:50.959494 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f61c4eb4-1881-4f42-ba9f-b963020f6b93 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119522 Oct 17 13:45:50.968149 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2946/5882] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:45:50 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:51.279733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:51.281130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:51.296020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9d8c0491-0d37-4155-acc4-f3f5b84e8056 req-4bf85451-fd86-49ad-ba8b-02f26f5053a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d3393c5-a858-4255-8eb3-9a85b1721e2c", "tag": "54ee8446-951c-4d94-9564-b8dba23bf8f4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:51.309532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.315643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9d8c0491-0d37-4155-acc4-f3f5b84e8056 req-4bf85451-fd86-49ad-ba8b-02f26f5053a9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.316132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.316869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.317959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:51.318683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.319379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9d8c0491-0d37-4155-acc4-f3f5b84e8056 req-4bf85451-fd86-49ad-ba8b-02f26f5053a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:51.320897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9d8c0491-0d37-4155-acc4-f3f5b84e8056 req-4bf85451-fd86-49ad-ba8b-02f26f5053a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.321217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:51.361806 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9d8c0491-0d37-4155-acc4-f3f5b84e8056 req-4bf85451-fd86-49ad-ba8b-02f26f5053a9 service nova] Creating event network-changed:54ee8446-951c-4d94-9564-b8dba23bf8f4 for instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c on n-h1-854121-14 Oct 17 13:45:51.378230 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9d8c0491-0d37-4155-acc4-f3f5b84e8056 req-4bf85451-fd86-49ad-ba8b-02f26f5053a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088938 Oct 17 13:45:51.383370 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2947/5883] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:52.288087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:52.298036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:52.317582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:52.329128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:45:52.331372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69fd125f-1b2f-47aa-984e-7e9b5ff87ba0 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2943 microversion: 2.32 time: 1.058050 Oct 17 13:45:52.335509 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2937/5884] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:45:51 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2943 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:52.368386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:52.369033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:45:52.396136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.396551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.397272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.398054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:52.398497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:52.398929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:52.790055 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae5e2a89-a668-4219-ada4-64ea2c09429d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.426745 Oct 17 13:45:52.791066 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2948/5885] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:45:52 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413/os-interface => generated 1830 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:45:55.305180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ed92033d-f2a6-4129-a9cc-8943f595f908 req-366f64eb-06a4-4598-b251-07f18c7162e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46786203-7b4c-473f-81c9-b620803c0a2d", "tag": "49eb59fa-b819-4e66-8dc1-c6113581db58"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:55.342504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed92033d-f2a6-4129-a9cc-8943f595f908 req-366f64eb-06a4-4598-b251-07f18c7162e4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:55.346655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed92033d-f2a6-4129-a9cc-8943f595f908 req-366f64eb-06a4-4598-b251-07f18c7162e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:55.347782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed92033d-f2a6-4129-a9cc-8943f595f908 req-366f64eb-06a4-4598-b251-07f18c7162e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:55.380170 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ed92033d-f2a6-4129-a9cc-8943f595f908 req-366f64eb-06a4-4598-b251-07f18c7162e4 service nova] Creating event network-changed:49eb59fa-b819-4e66-8dc1-c6113581db58 for instance 46786203-7b4c-473f-81c9-b620803c0a2d on n-h2-854121-14 Oct 17 13:45:55.397293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ed92033d-f2a6-4129-a9cc-8943f595f908 req-366f64eb-06a4-4598-b251-07f18c7162e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096961 Oct 17 13:45:55.400171 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2949/5886] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:45:55.524894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff568ad1-cc78-450d-a87e-59f85772c6f8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Action: 'create', calling method: .version_select at 0x7f419cd5c1f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1906118660", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpMpFUDI5EY1KrC6fN2AcZXCk9VVQphhi1U3q/JmPmD03JhEdN7+rK1YbT9mGu8FamZddaFfPtzGNHaZ7AfaCvOt55VwZprmEenEgsKSYrRDcxYH96zeVSOWv6b34+8xg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:55.589455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ff568ad1-cc78-450d-a87e-59f85772c6f8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Getting quotas for project 57b423ee5c844b1ca55ee3995fe0bf1d. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:55.629268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ff568ad1-cc78-450d-a87e-59f85772c6f8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Getting quotas for user e768147e4f4d41d4bccd484e6c141eac and project 57b423ee5c844b1ca55ee3995fe0bf1d. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:55.693809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff568ad1-cc78-450d-a87e-59f85772c6f8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.552656 Oct 17 13:45:55.695117 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2938/5887] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:45:55 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:45:58.615666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-558297576", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1906118660", "security_groups": [{"name": "tempest-secgroup-smoke-1551328780"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "69d39ec4-aa49-44fa-ba04-cc611d1aaf2c"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:45:58.641821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=38 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:45:58.762866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] validate_networks() for [('69d39ec4-aa49-44fa-ba04-cc611d1aaf2c', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:45:59.803824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Getting quotas for project 57b423ee5c844b1ca55ee3995fe0bf1d. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:59.810757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Getting quotas for user e768147e4f4d41d4bccd484e6c141eac and project 57b423ee5c844b1ca55ee3995fe0bf1d. Resources: dict_keys(['metadata_items']) {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:59.827805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:45:59.828629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:45:59.829372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:45:59.830233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:45:59.830867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:45:59.843204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.844007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.844650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.845849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:45:59.846519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:45:59.847152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:45:59.868491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Getting quotas for project 57b423ee5c844b1ca55ee3995fe0bf1d. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:45:59.879874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Getting quotas for user e768147e4f4d41d4bccd484e6c141eac and project 57b423ee5c844b1ca55ee3995fe0bf1d. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:45:59.900175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:45:59.903251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:45:59.962917 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-67823d76-d2fd-4dc4-acc1-a5d2512826a8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.351473 Oct 17 13:45:59.963822 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2950/5888] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:45:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:45:59.984598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2086bbd2-f182-435b-900e-68ff8335988d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:45:59.985272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2086bbd2-f182-435b-900e-68ff8335988d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:00.119217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2086bbd2-f182-435b-900e-68ff8335988d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:00.131839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2086bbd2-f182-435b-900e-68ff8335988d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1302 microversion: 2.1 time: 0.160403 Oct 17 13:46:00.149468 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2939/5889] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:45:59 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1302 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:01.163896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:01.164811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:01.174131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:01.175162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:01.175825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:01.176769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:01.177505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:01.178138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:01.265950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:01.279561 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9767514b-fe57-4cb2-b915-496caf993bc2 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1298 microversion: 2.1 time: 0.120923 Oct 17 13:46:01.285351 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2951/5890] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:01 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:02.306740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:02.307385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:02.318435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.320624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.321360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.322483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:02.323116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:02.326548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:02.457002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:02.471866 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40565c6c-9173-447e-984e-a1b1a2a25b24 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1360 microversion: 2.1 time: 0.171339 Oct 17 13:46:02.477855 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2940/5891] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:02 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:03.498049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:03.498727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:03.509176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.511150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.511668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.512576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:03.513048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:03.513521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:03.862328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:03.871096 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18cd2ce6-93a2-4a37-aae2-cfe0abc69377 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.378841 Oct 17 13:46:03.875516 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2952/5892] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:03 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:04.371733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-deee34af-089a-4e27-96dc-f70f7a912e01 req-0fa23cbb-b30d-48fa-8125-f06aa853c97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29d3718-627f-47f1-a395-e92eae7b0052", "tag": "851b86de-8e93-4fd3-af4a-015d741c6c73"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:04.427223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-deee34af-089a-4e27-96dc-f70f7a912e01 req-0fa23cbb-b30d-48fa-8125-f06aa853c97f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.428190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-deee34af-089a-4e27-96dc-f70f7a912e01 req-0fa23cbb-b30d-48fa-8125-f06aa853c97f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.428790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-deee34af-089a-4e27-96dc-f70f7a912e01 req-0fa23cbb-b30d-48fa-8125-f06aa853c97f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.448770 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-deee34af-089a-4e27-96dc-f70f7a912e01 req-0fa23cbb-b30d-48fa-8125-f06aa853c97f service nova] Creating event network-changed:851b86de-8e93-4fd3-af4a-015d741c6c73 for instance c29d3718-627f-47f1-a395-e92eae7b0052 on n-h1-854121-14 Oct 17 13:46:04.455831 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-deee34af-089a-4e27-96dc-f70f7a912e01 req-0fa23cbb-b30d-48fa-8125-f06aa853c97f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096832 Oct 17 13:46:04.456870 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2941/5893] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:04.905659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:04.906455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:04.916085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.916692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.918289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:04.919798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:04.920526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:04.921126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:05.101862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:05.114906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f393e84-00da-48fa-8ff2-0a55f6145e0b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.220268 Oct 17 13:46:05.115493 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2953/5894] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:04 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:06.144848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:06.146316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:06.148350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:06.162718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:06.163627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:06.164388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:06.165321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:06.165895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:06.166449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:06.441799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:06.454474 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b33bfce6-ed80-44f8-8e3a-65693c33412c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.317112 Oct 17 13:46:06.455081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2942/5895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:06 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:07.481432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:07.482057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:07.489797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.490514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.491240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.491960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:07.492703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:07.493169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:07.496445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=74 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:07.659387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:07.668914 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-689951a9-79f2-42f6-8c39-22a692792409 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.191434 Oct 17 13:46:07.669863 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2954/5896] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:07 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:08.692293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:08.693101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:08.701549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.702056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.702848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.703752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:08.704653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:08.705528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:08.956199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:08.972456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a54ee787-780a-4753-9d8b-ff996b35e031 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.284122 Oct 17 13:46:08.988949 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2943/5897] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:08 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:46:10.001061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:10.002822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:10.007116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:10.009240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:10.015625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.016106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.016551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.017310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:10.017966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:10.018787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:10.227957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:10.237650 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0c97501-ebe3-4056-9ae6-93d05a3e5a09 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.240569 Oct 17 13:46:10.238270 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2955/5898] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:09 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:11.001038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:11.264652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:11.265387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:11.275257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6f1f427e-9cad-4ecd-ad0d-e8672bf61a24 req-956ed1e7-7417-43fd-998a-fa93963e2b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29d3718-627f-47f1-a395-e92eae7b0052", "name": "network-vif-plugged", "status": "completed", "tag": "851b86de-8e93-4fd3-af4a-015d741c6c73"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:11.291905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.294489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.294943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.295679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.297329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.298229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.301316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6f1f427e-9cad-4ecd-ad0d-e8672bf61a24 req-956ed1e7-7417-43fd-998a-fa93963e2b35 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:11.303664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6f1f427e-9cad-4ecd-ad0d-e8672bf61a24 req-956ed1e7-7417-43fd-998a-fa93963e2b35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:11.306664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6f1f427e-9cad-4ecd-ad0d-e8672bf61a24 req-956ed1e7-7417-43fd-998a-fa93963e2b35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:11.338570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6f1f427e-9cad-4ecd-ad0d-e8672bf61a24 req-956ed1e7-7417-43fd-998a-fa93963e2b35 service nova] Creating event network-vif-plugged:851b86de-8e93-4fd3-af4a-015d741c6c73 for instance c29d3718-627f-47f1-a395-e92eae7b0052 on n-h1-854121-14 Oct 17 13:46:11.351824 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6f1f427e-9cad-4ecd-ad0d-e8672bf61a24 req-956ed1e7-7417-43fd-998a-fa93963e2b35 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357438 Oct 17 13:46:11.356443 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2944/5899] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:11.556732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:11.566089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37285457-3699-44b5-9223-e00bbc2caa4a tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.308411 Oct 17 13:46:11.566873 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2956/5900] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:11 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:12.599199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:12.601108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:12.618604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:12.619549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:12.620313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:12.622001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:12.622618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:12.623255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:12.838779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:12.848830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96e5e582-740a-4e9d-9150-fa91641a176c tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1428 microversion: 2.1 time: 0.262546 Oct 17 13:46:12.849589 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2945/5901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:12 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1428 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:13.872658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:13.873293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:13.882575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:13.883916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:13.884568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:13.887060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:13.887697 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:13.888290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.043988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:14.052962 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9263fa8b-b432-41c3-8c03-0f6b0e58e3a0 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1609 microversion: 2.1 time: 0.184919 Oct 17 13:46:14.055869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2957/5902] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:13 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1609 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:14.076346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.076965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:14.084135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.084627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.085067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.085808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.086265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.086885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.228551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:14.243150 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77f945ce-a6e4-4e06-a47f-84935330dbec tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1609 microversion: 2.1 time: 0.171051 Oct 17 13:46:14.244111 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2946/5903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:14 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1609 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:14.268122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:14.268663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:14.275080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.275378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.276029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.277368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:14.277811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:14.278250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:14.423383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:14.431821 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fd16b54-2dd3-405e-8a0f-063ed6352e96 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1609 microversion: 2.1 time: 0.167876 Oct 17 13:46:14.432397 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2958/5904] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:14 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1609 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:17.324293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-232f1a19-7775-44df-ba70-5fb4aa73a7bf req-79b9bd27-007a-4e68-bb32-e36cbaaec40f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29d3718-627f-47f1-a395-e92eae7b0052", "tag": "851b86de-8e93-4fd3-af4a-015d741c6c73"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:17.336679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-232f1a19-7775-44df-ba70-5fb4aa73a7bf req-79b9bd27-007a-4e68-bb32-e36cbaaec40f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:17.337274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-232f1a19-7775-44df-ba70-5fb4aa73a7bf req-79b9bd27-007a-4e68-bb32-e36cbaaec40f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:17.337772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-232f1a19-7775-44df-ba70-5fb4aa73a7bf req-79b9bd27-007a-4e68-bb32-e36cbaaec40f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:17.350178 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-232f1a19-7775-44df-ba70-5fb4aa73a7bf req-79b9bd27-007a-4e68-bb32-e36cbaaec40f service nova] Creating event network-changed:851b86de-8e93-4fd3-af4a-015d741c6c73 for instance c29d3718-627f-47f1-a395-e92eae7b0052 on n-h1-854121-14 Oct 17 13:46:17.363130 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-232f1a19-7775-44df-ba70-5fb4aa73a7bf req-79b9bd27-007a-4e68-bb32-e36cbaaec40f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042080 Oct 17 13:46:17.376354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2947/5905] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:20.913126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:20.913901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:20.921908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.922600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.923090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:20.923817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:20.924283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:20.924716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:20.956902 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eca3d3fa-5033-4c29-8f5e-a33d43fcc4fa tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/ips" status: 200 len: 145 microversion: 2.1 time: 0.048507 Oct 17 13:46:20.958066 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2959/5906] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:46:20 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/ips => generated 145 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:23.281309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb762fda-56a0-4fbe-bbcd-f188852a2562"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:23.283822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:23.291687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.292204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.293372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.294231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:23.294692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:23.295130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:23.580621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c7eeb05-fafb-4c2b-826b-8eb2ff7ff211 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304879 Oct 17 13:46:23.586451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2948/5907] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:46:23 2022] POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:36.744944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74dcf3ae-564a-4ee1-ba8b-f904ec4131d6 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:36.750093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:36.751268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=33 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:36.755657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74dcf3ae-564a-4ee1-ba8b-f904ec4131d6 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:36.756228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74dcf3ae-564a-4ee1-ba8b-f904ec4131d6 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:36.756679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74dcf3ae-564a-4ee1-ba8b-f904ec4131d6 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:36.786275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74dcf3ae-564a-4ee1-ba8b-f904ec4131d6 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:46:36.844920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74dcf3ae-564a-4ee1-ba8b-f904ec4131d6 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.105226 Oct 17 13:46:36.845757 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2960/5908] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:36 2022] POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:46:36.861558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:36.862278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:36.883583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=13 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:36.885477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:46:36.889576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:36.890440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:36.891098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:36.892499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:36.893353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:36.894195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:37.153249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:37.165016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bbd2df64-caac-4be2-815e-509a524cda37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.312826 Oct 17 13:46:37.181361 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2949/5909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:36 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:38.190872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:38.192470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:38.202509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:38.203699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:38.204875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.205850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:38.206670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:38.207381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:38.582170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:38.593433 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64c88a2d-c010-4d65-b2db-5faaaf526981 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.407314 Oct 17 13:46:38.595392 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2961/5910] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:38 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:39.619328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:39.621368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:39.649524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:39.650308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:39.651318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:39.652298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:39.653495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:39.653589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:39.814515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:39.826425 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-271c20ef-3ea8-4123-92e0-f78017328d80 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.212110 Oct 17 13:46:39.827340 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2950/5911] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:39 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:40.851830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:40.852421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:40.859974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:40.860467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:40.860973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:40.861672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:40.863274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:40.863710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:41.012253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:41.021032 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-895f32f2-65ab-4cca-ba05-d3db63639c10 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.173669 Oct 17 13:46:41.021662 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2962/5912] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:40 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:42.045693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:42.046369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:42.053121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:42.053661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:42.054102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:42.054868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:42.055337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:42.055955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:42.216948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:42.238557 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ea63f65-3ba9-44b7-8f9a-66241b9e50b7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.197512 Oct 17 13:46:42.239164 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2951/5913] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:42 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:43.263147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:43.263766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:43.271268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:43.271763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:43.272388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:43.273293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:43.273708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:43.274137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:43.468303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:43.478952 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5313d136-9265-4078-b12e-b7e8da6eb13e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.219720 Oct 17 13:46:43.480286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2963/5914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:43 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:44.506611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:44.507220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:44.514769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:44.515135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:44.515579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:44.516282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:44.516742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:44.517201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:44.672756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:44.691552 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f626d9e6-2f54-4081-997f-2ba6bd610656 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.188875 Oct 17 13:46:44.692652 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2952/5915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:44 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:45.721123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:45.721821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:45.740568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:45.741087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:45.741552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.742263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:45.742725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:45.743158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:45.913567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:45.925093 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-56e82db6-100d-4a87-9874-7a5025e89fd5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.208197 Oct 17 13:46:45.926026 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2964/5916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:45 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:46.954187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:46.954187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:46.969636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.970589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.971228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:46.971994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:46.972514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:46.973313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:47.121694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:47.134570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d564553-5147-4227-9e95-5a46b7150bb0 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1724 microversion: 2.1 time: 0.189681 Oct 17 13:46:47.149183 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2953/5917] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:46 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:48.162779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:48.163395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:48.171612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.172109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.172569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.173357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.173818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.174250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.327791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:48.338197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-323e8a10-fe5d-47cf-bb63-b6dca268de37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1701 microversion: 2.1 time: 0.179361 Oct 17 13:46:48.357557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2965/5918] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:48 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1701 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:48.369228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b26574a-95f2-4659-9b4e-ab6efaf900e5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:46:48.378175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b26574a-95f2-4659-9b4e-ab6efaf900e5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.378639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b26574a-95f2-4659-9b4e-ab6efaf900e5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.379155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b26574a-95f2-4659-9b4e-ab6efaf900e5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.406400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b26574a-95f2-4659-9b4e-ab6efaf900e5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Going to try to start instance {{(pid=120697) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:46:48.451997 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b26574a-95f2-4659-9b4e-ab6efaf900e5 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.086493 Oct 17 13:46:48.452666 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2954/5919] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:46:48 2022] POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:46:48.461371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:48.461994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:48.472338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.472849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.473324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.477414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:48.478232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:48.478711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:48.775309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:48.786668 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-67b15571-8577-4e34-9a6a-ac17af52e719 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1710 microversion: 2.1 time: 0.329202 Oct 17 13:46:48.787881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2966/5920] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:48 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1710 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:49.814176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:49.814872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:49.829592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.830091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.830534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:49.831244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:49.831699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:49.832130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:50.008214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:46:50.019789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8824744-8986-4854-b13a-e0335257b6a1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1714 microversion: 2.1 time: 0.210715 Oct 17 13:46:50.020802 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2955/5921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:46:49 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1714 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:46:52.582912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:52.583456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:52.593274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:52.594074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:52.594519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:52.595344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:52.595945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:52.596649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:52.629885 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb39d48e-d66c-48d8-97eb-381723145bfc tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.052799 Oct 17 13:46:52.636473 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2967/5922] 10.222.0.65 () {58 vars in 1293 bytes} [Mon Oct 17 13:46:52 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052/os-server-password => generated 116 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:46:59.378137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:46:59.378707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:46:59.386328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:59.386818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:59.387264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:59.387961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:46:59.388416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:46:59.388845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:46:59.412915 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ae8e80b-0d41-4caa-afbf-a1986f94ae44 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038724 Oct 17 13:46:59.413872 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2956/5923] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:46:59 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:00.796313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1505af34-395d-4bc5-b777-f44b0c829472"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:00.798910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:00.806202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:00.806694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:00.807390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:00.807951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:00.808445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:00.808875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:01.151917 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd7d5ecd-5a92-49c6-bc4c-f417bde0041a tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "POST /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359666 Oct 17 13:47:01.152789 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2968/5924] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:47:00 2022] POST /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:16.441661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:16.442315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:16.445368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:16.446183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:16.454118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.454668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.455120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.455835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.456294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.456724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.556305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lazy-loading 'services' on Instance uuid 46786203-7b4c-473f-81c9-b620803c0a2d {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:47:16.653953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c5fa780-5eb3-4470-b236-8fca9c858efc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments/1505af34-395d-4bc5-b777-f44b0c829472" status: 202 len: 0 microversion: 2.1 time: 0.216457 Oct 17 13:47:16.654625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2957/5925] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:47:16 2022] DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments/1505af34-395d-4bc5-b777-f44b0c829472 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:16.661873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=18 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:16.667354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:16.673613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:16.677885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:16.686788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.687612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.687975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.688679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:16.689211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:16.689615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:16.750236 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c96ac350-c7ac-40a1-a401-6d0f4feef195 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090771 Oct 17 13:47:16.755427 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2969/5926] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:16 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:17.766846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:17.769420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:17.778207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.778933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.779554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.780470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:17.781110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:17.781723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:17.817837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d44b82e-d9eb-41df-b3fd-45088ec9420b tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058774 Oct 17 13:47:17.823215 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2958/5927] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:17 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:18.830275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:18.833449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:18.843514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.844326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.844989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.846034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:18.847203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:18.848795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:18.889587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54d01ffb-1192-4b75-aea2-b79021da0f79 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063180 Oct 17 13:47:18.890795 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2970/5928] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:18 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:19.902808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:19.905115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:19.920217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:19.920720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:19.921193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.921922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:19.922393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:19.922829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:19.998486 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9eb1d64b-8be1-4415-898f-fc106b568b1e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099664 Oct 17 13:47:19.999739 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2959/5929] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:19 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:21.012667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:21.014974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:21.022222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.022716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.023348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.024228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:21.024874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:21.026020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:21.068141 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25af6b21-219d-4460-a49b-41f11a0fce6e tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059792 Oct 17 13:47:21.069033 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2971/5930] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:21 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:22.083155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:22.090373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:22.098374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.098880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.099325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.100049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.100800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.101393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.142151 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6563d544-fc69-4f2e-b663-aaf2f43c0f9c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064525 Oct 17 13:47:22.142660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2960/5931] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:22 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:22.730231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:22.730761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:22.738440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.739079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.739784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.740607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:22.741194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:22.741747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:22.844084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lazy-loading 'services' on Instance uuid 7d3393c5-a858-4255-8eb3-9a85b1721e2c {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:47:22.938923 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43078610-7232-41ce-bc66-e7058ee8ba69 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-volume_attachments/bb762fda-56a0-4fbe-bbcd-f188852a2562" status: 202 len: 0 microversion: 2.1 time: 0.223199 Oct 17 13:47:22.939537 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2972/5932] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:47:22 2022] DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-volume_attachments/bb762fda-56a0-4fbe-bbcd-f188852a2562 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:23.155614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:23.157909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:23.165057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.165590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.166047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.166751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.167311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.167748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.209913 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ab321bd-1e03-4535-99e4-bdc50418b586 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058736 Oct 17 13:47:23.210548 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2961/5933] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:47:23 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:47:23.278882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:23.279462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:23.285845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.286329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.286762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.287566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.287902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.288351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.321932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:47:23.427536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-043ee7d9-67c0-4117-90d2-aa08b31fa63d tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 204 len: 0 microversion: 2.1 time: 0.151883 Oct 17 13:47:23.428267 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2973/5934] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:23 2022] DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:47:23.439283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:23.440266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:23.447551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.448548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.449256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.450678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:23.451346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:23.451987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:23.608333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:23.617795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e8a41bb-9983-44c5-9c60-90c8da33ffee tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1680 microversion: 2.1 time: 0.183661 Oct 17 13:47:23.618861 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2962/5935] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:23 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:24.648553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:24.649587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:24.657053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.657521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.657999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.658705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:24.659304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:24.659767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:24.817654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:24.826744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be635545-5e59-4ed6-9291-2c49f29ac8fd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1680 microversion: 2.1 time: 0.182418 Oct 17 13:47:24.827518 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2974/5936] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:24 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:25.858837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:25.862199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:25.872594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:25.873353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:25.874037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:25.874932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:25.875715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:25.876301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.020404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:26.031041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e2de8f5-df37-4acd-a9c6-5d4849144790 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1613 microversion: 2.1 time: 0.178454 Oct 17 13:47:26.033196 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2963/5937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:25 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1613 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:26.540719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d445b255-e889-4a27-a56d-768003163b7e req-09619592-fd21-45c2-9d46-52da07208912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46786203-7b4c-473f-81c9-b620803c0a2d", "name": "network-vif-deleted", "tag": "49eb59fa-b819-4e66-8dc1-c6113581db58"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:26.564200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d445b255-e889-4a27-a56d-768003163b7e req-09619592-fd21-45c2-9d46-52da07208912 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:26.564969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d445b255-e889-4a27-a56d-768003163b7e req-09619592-fd21-45c2-9d46-52da07208912 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:26.565643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d445b255-e889-4a27-a56d-768003163b7e req-09619592-fd21-45c2-9d46-52da07208912 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:26.580286 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d445b255-e889-4a27-a56d-768003163b7e req-09619592-fd21-45c2-9d46-52da07208912 service nova] Creating event network-vif-deleted:49eb59fa-b819-4e66-8dc1-c6113581db58 for instance 46786203-7b4c-473f-81c9-b620803c0a2d on n-h2-854121-14 Oct 17 13:47:26.586598 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d445b255-e889-4a27-a56d-768003163b7e req-09619592-fd21-45c2-9d46-52da07208912 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.315313 Oct 17 13:47:26.588053 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2975/5938] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:47:27.060158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:27.061841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:27.070548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:27.072048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:27.073731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:27.075005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:27.075696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:27.076355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:27.118190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:27.119580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:27.120237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:27.120837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lazy-loading 'fault' on Instance uuid 46786203-7b4c-473f-81c9-b620803c0a2d {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:47:27.180532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '165f01302a7f462081231461a1f03ef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7a8fb8b6dbd4edf915f8e3e4cdd1e60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:27.198371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95e4358c-bf28-467e-8cb1-2c7ce94885d1 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 200 len: 1330 microversion: 2.1 time: 0.146862 Oct 17 13:47:27.201009 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2964/5939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:27 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:28.222983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:28.223704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:28.231595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:28.232086 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:28.232528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:28.233259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:28.233730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:28.234146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:28.249870 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d HTTP/1.1 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '46786203-7b4c-473f-81c9-b620803c0a2d'} Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:28.254328 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:28.258674 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8823367d-544b-4581-8b0b-80451d97dcb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 404 len: 111 microversion: 2.1 time: 0.037385 Oct 17 13:47:28.260884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2976/5940] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:28 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:28.266000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6454f0f-8080-4d60-9a95-44a209c63893 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '.version_select at 0x7f419d073790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:28.295106 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6454f0f-8080-4d60-9a95-44a209c63893 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235721290" status: 202 len: 0 microversion: 2.1 time: 0.032945 Oct 17 13:47:28.300132 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2965/5941] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:47:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235721290 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:30.534997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f6f6158-d7a5-4b76-954d-6b8ac8844c7f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:30.542609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6f6158-d7a5-4b76-954d-6b8ac8844c7f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.543103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6f6158-d7a5-4b76-954d-6b8ac8844c7f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.543548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9f6f6158-d7a5-4b76-954d-6b8ac8844c7f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.568903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9f6f6158-d7a5-4b76-954d-6b8ac8844c7f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 13:47:30.624327 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f6f6158-d7a5-4b76-954d-6b8ac8844c7f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.093096 Oct 17 13:47:30.628139 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2977/5942] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:30 2022] POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:30.646596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:30.648107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:30.656614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.657103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.657733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.658444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:30.658907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:30.659350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:30.807370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:30.815728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7caca9a-af58-4ecf-9305-465eb09bb722 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.185940 Oct 17 13:47:30.816308 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2966/5943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:30 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:31.842065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:31.842771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:31.849408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:31.849901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:31.850343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:31.851042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:31.851496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:31.851924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:31.994047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:32.003040 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c276d93-71b6-46f3-bad8-e4e76d18a565 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.166800 Oct 17 13:47:32.003623 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2978/5944] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:31 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:33.027763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:33.028385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:33.035404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.035903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.036345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.037204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:33.037675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:33.038109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:33.190306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:33.220599 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6546bde3-5dbc-4a09-b1d8-ace346633aed tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.196903 Oct 17 13:47:33.234833 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2967/5945] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:33 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:34.248201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:34.248913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:34.256074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:34.256654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:34.257213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:34.258001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:34.258532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:34.259032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:34.406508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:34.415199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-472e8d2c-8c9d-4d40-a2ce-aefb28226a9e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.171397 Oct 17 13:47:34.416597 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2979/5946] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:34 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:35.441280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:35.443122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:35.451195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.451946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.452560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.453520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.454146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.455029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.582275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:35.583030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:35.594317 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:47:35.594767 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 13:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d (ip 10.222.0.65) !!! Oct 17 13:47:35.601412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.602184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.602877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.604565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.605262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.605940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.640392 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d HTTP/1.1 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '46786203-7b4c-473f-81c9-b620803c0a2d'} Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:35.643771 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.650720 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.657279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:35.658758 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c16a6af3-11f2-46f4-9e65-88b20b2682fc tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 404 len: 111 microversion: 2.1 time: 0.082912 Oct 17 13:47:35.660081 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2980/5947] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:35 2022] DELETE /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:35.667540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:35.679475 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c708f47a-a7d4-4f1b-81b8-f4d305b3fd7c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.243689 Oct 17 13:47:35.690417 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2968/5948] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:35 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:35.690633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:35.690633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 46786203-7b4c-473f-81c9-b620803c0a2d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:35.711824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.713503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.717865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.719111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:35.719754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:35.720352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:35.741254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d HTTP/1.1 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '46786203-7b4c-473f-81c9-b620803c0a2d'} Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:35.743545 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. Oct 17 13:47:35.749448 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:35.752640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 46786203-7b4c-473f-81c9-b620803c0a2d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:35.754061 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6bdbce51-a467-4fbb-835b-f81e53f301bd tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d" status: 404 len: 111 microversion: 2.1 time: 0.089424 Oct 17 13:47:35.757508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2981/5949] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:35 2022] GET /compute/v2.1/servers/46786203-7b4c-473f-81c9-b620803c0a2d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:36.707430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:36.708958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:36.719482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:36.720359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:36.720995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:36.722038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:36.722798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:36.723420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:36.917926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:36.927118 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0b17701-4f4a-4112-9567-964d744c5704 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.225175 Oct 17 13:47:36.929347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2969/5950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:36 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:37.954023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:37.955390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:37.969876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:37.970393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:37.970834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:37.972250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:37.973375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:37.973960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:38.172093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:38.180957 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e890a1c-a516-477f-aed9-0c26e8ac2d4a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.232301 Oct 17 13:47:38.185550 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2982/5951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:37 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:39.208493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:39.209509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:39.226029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:39.228909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:39.230821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:39.232785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:39.234441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:39.234988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:39.449919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:39.459542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8cf5023-a42f-4fe8-a96e-6fa7c7f2a628 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.255331 Oct 17 13:47:39.460153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2970/5952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:39 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:40.494513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:40.495581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:40.507722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.508214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.508838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.510039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:40.510654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:40.511263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:40.697763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:40.713046 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a87e43c5-735b-4293-bb4b-21679c60655a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1678 microversion: 2.1 time: 0.223226 Oct 17 13:47:40.718219 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2983/5953] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:40 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:41.738153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:41.738960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:41.746856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.747353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.747793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.748527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.749182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.749612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.897523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:41.906161 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72cb6c62-0a7b-4034-93d9-f8f4d4e1de58 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1655 microversion: 2.1 time: 0.171876 Oct 17 13:47:41.907657 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2971/5954] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:41 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:41.930521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42ebb0fe-fe33-4453-9de2-8fcded86d4b9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:41.938784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ebb0fe-fe33-4453-9de2-8fcded86d4b9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:41.939287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ebb0fe-fe33-4453-9de2-8fcded86d4b9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:41.939729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42ebb0fe-fe33-4453-9de2-8fcded86d4b9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:41.967137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42ebb0fe-fe33-4453-9de2-8fcded86d4b9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 13:47:41.973060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:42.020274 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42ebb0fe-fe33-4453-9de2-8fcded86d4b9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action" status: 202 len: 0 microversion: 2.1 time: 0.093513 Oct 17 13:47:42.020894 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2984/5955] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:47:41 2022] POST /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:47:42.031582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.032685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.041641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.043555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.044013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.045039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.045547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.045988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.329984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:42.340745 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4135c53-fe55-409e-9937-fea30ffecc21 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1664 microversion: 2.1 time: 0.314173 Oct 17 13:47:42.343886 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2972/5956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1664 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:42.500555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.501148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.514814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.519215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.520192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.521278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.521876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.525506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.543318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd HTTP/1.1 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0455d747-01a4-4dc5-8caf-56b659221bdd'} Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:42.545455 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.549504 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.552125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:42.553928 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16f669f3-e981-41e2-a673-14bc7b22dd47 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 404 len: 111 microversion: 2.1 time: 0.057576 Oct 17 13:47:42.558046 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2985/5957] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:42 2022] DELETE /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:42.564167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.564794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 0455d747-01a4-4dc5-8caf-56b659221bdd] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.573565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.574088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.574547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.575276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.576620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.577066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.591974 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd HTTP/1.1 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0455d747-01a4-4dc5-8caf-56b659221bdd'} Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.593740 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 0455d747-01a4-4dc5-8caf-56b659221bdd could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a1538a9-3a21-4125-bedd-c847da460c15 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd" status: 404 len: 111 microversion: 2.1 time: 0.035742 Oct 17 13:47:42.601191 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2973/5958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/0455d747-01a4-4dc5-8caf-56b659221bdd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:42.604411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.604927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.622139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.623009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.623465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.624194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.625413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.625852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.658681 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 HTTP/1.1 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '055ef0c4-201a-40d9-85ce-76df354ecd13'} Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:42.660201 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:42.664571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42dfb447-84df-4c08-875b-931eafb0ffb6 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 404 len: 111 microversion: 2.1 time: 0.061964 Oct 17 13:47:42.670705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:42.671303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 055ef0c4-201a-40d9-85ce-76df354ecd13] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:42.674273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2986/5959] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:42 2022] DELETE /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:42.677867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.678571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.679197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.680089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:42.680699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:42.681838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:42.686779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:42.699555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 HTTP/1.1 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '055ef0c4-201a-40d9-85ce-76df354ecd13'} Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:42.701506 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. Oct 17 13:47:42.706462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:42.707817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 055ef0c4-201a-40d9-85ce-76df354ecd13 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:42.722354 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ee5e8c6-31a1-404a-8107-26af39105c4c tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13" status: 404 len: 111 microversion: 2.1 time: 0.055501 Oct 17 13:47:42.726593 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2974/5960] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:42 2022] GET /compute/v2.1/servers/055ef0c4-201a-40d9-85ce-76df354ecd13 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:43.369827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:43.370463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:43.379048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:43.379569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:43.380040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:43.380748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:43.381222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:43.381648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:43.518011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:43.526680 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f20c6bb-1cac-4ca9-a7d1-c2e9ad7acac8 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1668 microversion: 2.1 time: 0.164752 Oct 17 13:47:43.527280 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2987/5961] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:43 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:47:47.102791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:47.104772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:47.108536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:47.115288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:47.115783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:47.116237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:47.116943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:47.117435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:47.117870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:47.134295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 HTTP/1.1 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '888adf9b-f81d-46a5-8539-c89ff12a8eb5'} Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:47.136135 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7cbc7130-850c-4211-9d2c-c9abf78703db tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 404 len: 111 microversion: 2.1 time: 0.040320 Oct 17 13:47:47.141309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2975/5962] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:47:47 2022] DELETE /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:47.147877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:47.148485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] [instance: 888adf9b-f81d-46a5-8539-c89ff12a8eb5] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:47.152037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:47.157736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:47.158229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:47.158665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:47.159375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:47.159824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:47.160246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:47.176975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] HTTP exception thrown: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Request method failure captured: Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 HTTP/1.1 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVre7kt_cXVLq-Nlj8b-CvzqU_tDEWA4vxoNbboRv94-ta7Z9x8ya9hwmb5ll0ddf6kY_WzrQR_HWBnNEdL37969YzTB_w6gxqV8wYA8TH3xSsnFMeBDp3-dQtvKOjRkKr5hl_tE1d1gJBn_Y1fb4pe5gQ2iufbDXVrCxNJQBF4keJY Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c7a8fb8b6dbd4edf915f8e3e4cdd1e60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: c7a8fb8b6dbd4edf915f8e3e4cdd1e60 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1274292997 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 165f01302a7f462081231461a1f03ef8 Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1274292997-project Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '888adf9b-f81d-46a5-8539-c89ff12a8eb5'} Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:47.178589 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] Returning 404 to user: Instance 888adf9b-f81d-46a5-8539-c89ff12a8eb5 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7479c111-f0fe-4b9d-a18d-10f722949fb0 tempest-AttachVolumeNegativeTest-1274292997 tempest-AttachVolumeNegativeTest-1274292997-project] 10.222.0.65 "GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5" status: 404 len: 111 microversion: 2.1 time: 0.036122 Oct 17 13:47:47.188353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2988/5963] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:47:47 2022] GET /compute/v2.1/servers/888adf9b-f81d-46a5-8539-c89ff12a8eb5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:52.420676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66394d90-d404-47fb-aad9-0f3e9e110dc8 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Action: 'create', calling method: .version_select at 0x7f41a1f94d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1059152661", "metadata": {"Type": "work"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66394d90-d404-47fb-aad9-0f3e9e110dc8 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Request method failure captured: Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 122 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV0Izrli3g-wyUw8DfeIeqY23pIoMhc89defmsrImZlghmk4Q1TgZPBOumLZw2jUAR2G9UYKLqVkO-gK_x93X9WJj0Qx8crCbk87G9Tj9RHSrYUn6W3WrOP8EAdkqFcGY4YDSgss3pw9Qbm9hTcGr2qd_QL6YLk2AdE9Lb1si50puI4 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db1adadc751644edaa7793d4db8666fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c6d44ff22033450a807adcc2fd64303a Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1059152661", "metadata": {"Type": "work"}}} Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1059152661', 'metadata': {'Type': 'work'}}}} Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '#$%' Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:47:52.426462 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 17 13:47:52.433099 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.435520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66394d90-d404-47fb-aad9-0f3e9e110dc8 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:52.436586 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66394d90-d404-47fb-aad9-0f3e9e110dc8 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.162394 Oct 17 13:47:52.437388 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2976/5964] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Oct 17 13:47:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:47:52.447682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70d7c829-7a3a-4ab3-b5c8-9c776d414b4e tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Action: 'create', calling method: .version_select at 0x7f41a1fac670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1717464528", "metadata": {"Type": "work"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70d7c829-7a3a-4ab3-b5c8-9c776d414b4e tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Request method failure captured: Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 120 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV0Izrli3g-wyUw8DfeIeqY23pIoMhc89defmsrImZlghmk4Q1TgZPBOumLZw2jUAR2G9UYKLqVkO-gK_x93X9WJj0Qx8crCbk87G9Tj9RHSrYUn6W3WrOP8EAdkqFcGY4YDSgss3pw9Qbm9hTcGr2qd_QL6YLk2AdE9Lb1si50puI4 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db1adadc751644edaa7793d4db8666fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c6d44ff22033450a807adcc2fd64303a Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1717464528", "metadata": {"Type": "work"}}} Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1717464528', 'metadata': {'Type': 'work'}}}} Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi '0' Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:47:52.452737 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70d7c829-7a3a-4ab3-b5c8-9c776d414b4e tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70d7c829-7a3a-4ab3-b5c8-9c776d414b4e tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011528 Oct 17 13:47:52.457903 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2989/5965] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Oct 17 13:47:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:47:52.466085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-310312a6-1f1e-4fe6-a7de-4fcbabee1b37 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Action: 'create', calling method: .version_select at 0x7f419cb80e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-766891991", "metadata": {"Type": "work"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-310312a6-1f1e-4fe6-a7de-4fcbabee1b37 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Request method failure captured: Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 118 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV0Izrli3g-wyUw8DfeIeqY23pIoMhc89defmsrImZlghmk4Q1TgZPBOumLZw2jUAR2G9UYKLqVkO-gK_x93X9WJj0Qx8crCbk87G9Tj9RHSrYUn6W3WrOP8EAdkqFcGY4YDSgss3pw9Qbm9hTcGr2qd_QL6YLk2AdE9Lb1si50puI4 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db1adadc751644edaa7793d4db8666fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c6d44ff22033450a807adcc2fd64303a Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-766891991", "metadata": {"Type": "work"}}} Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-766891991', 'metadata': {'Type': 'work'}}}} Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '' Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 13:47:52.474816 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-310312a6-1f1e-4fe6-a7de-4fcbabee1b37 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-310312a6-1f1e-4fe6-a7de-4fcbabee1b37 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014495 Oct 17 13:47:52.481476 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2977/5966] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Oct 17 13:47:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:47:52.488564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29bcdd09-d43e-42d2-9a60-0a3630fa99a4 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Calling method '.version_select at 0x7f41a1f17820>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:52.522885 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-29bcdd09-d43e-42d2-9a60-0a3630fa99a4 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] HTTP exception thrown: Volume tempest-invalid-930240933 could not be found. Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29bcdd09-d43e-42d2-9a60-0a3630fa99a4 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Request method failure captured: Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-930240933 HTTP/1.1 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV0Izrli3g-wyUw8DfeIeqY23pIoMhc89defmsrImZlghmk4Q1TgZPBOumLZw2jUAR2G9UYKLqVkO-gK_x93X9WJj0Qx8crCbk87G9Tj9RHSrYUn6W3WrOP8EAdkqFcGY4YDSgss3pw9Qbm9hTcGr2qd_QL6YLk2AdE9Lb1si50puI4 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db1adadc751644edaa7793d4db8666fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c6d44ff22033450a807adcc2fd64303a Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: exception: Volume tempest-invalid-930240933 could not be found. Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'tempest-invalid-930240933'} Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-930240933 could not be found. (HTTP 404) (Request-ID: req-e2f3756e-4195-4353-8d51-3d56416f2f7e) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:47:52.525285 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-930240933 could not be found. Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-930240933 could not be found. Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-930240933 could not be found. Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29bcdd09-d43e-42d2-9a60-0a3630fa99a4 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Returning 404 to user: Volume tempest-invalid-930240933 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29bcdd09-d43e-42d2-9a60-0a3630fa99a4 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-930240933" status: 404 len: 98 microversion: 2.1 time: 0.042760 Oct 17 13:47:52.529365 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2990/5967] 10.222.0.65 () {58 vars in 1215 bytes} [Mon Oct 17 13:47:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-930240933 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 17 13:47:52.537720 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae1aaa54-d551-4881-b91e-a8625bbda772 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004080 Oct 17 13:47:52.538393 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2978/5968] 10.222.0.65 () {58 vars in 1140 bytes} [Mon Oct 17 13:47:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:47:52.548678 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-074c8fc1-ddcd-4d3e-a997-10bcf7024271 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003908 Oct 17 13:47:52.549377 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2991/5969] 10.222.0.65 () {58 vars in 1137 bytes} [Mon Oct 17 13:47:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 17 13:47:52.559623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66ed67b0-c55e-4af1-b214-0ba6ed62b8c3 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Calling method '.version_select at 0x7f41a2077d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:52.601388 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-66ed67b0-c55e-4af1-b214-0ba6ed62b8c3 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] HTTP exception thrown: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66ed67b0-c55e-4af1-b214-0ba6ed62b8c3 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Request method failure captured: Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-volumes/34d84023-8263-45b7-bea0-1b12c400124f HTTP/1.1 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV0Izrli3g-wyUw8DfeIeqY23pIoMhc89defmsrImZlghmk4Q1TgZPBOumLZw2jUAR2G9UYKLqVkO-gK_x93X9WJj0Qx8crCbk87G9Tj9RHSrYUn6W3WrOP8EAdkqFcGY4YDSgss3pw9Qbm9hTcGr2qd_QL6YLk2AdE9Lb1si50puI4 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db1adadc751644edaa7793d4db8666fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c6d44ff22033450a807adcc2fd64303a Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: method: Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: exception: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '34d84023-8263-45b7-bea0-1b12c400124f'} Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. (HTTP 404) (Request-ID: req-24398fcc-e6da-464d-bcdc-2697a41224f6) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:47:52.603998 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66ed67b0-c55e-4af1-b214-0ba6ed62b8c3 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Returning 404 to user: Volume 34d84023-8263-45b7-bea0-1b12c400124f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66ed67b0-c55e-4af1-b214-0ba6ed62b8c3 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/34d84023-8263-45b7-bea0-1b12c400124f" status: 404 len: 109 microversion: 2.1 time: 0.050272 Oct 17 13:47:52.610052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2979/5970] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:47:52 2022] DELETE /compute/v2.1/os-volumes/34d84023-8263-45b7-bea0-1b12c400124f => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:52.623829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f79c885-162b-497c-9bd3-72e43fe7cc20 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Calling method '.version_select at 0x7f41a1f17700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:52.664837 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-9f79c885-162b-497c-9bd3-72e43fe7cc20 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] HTTP exception thrown: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f79c885-162b-497c-9bd3-72e43fe7cc20 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Request method failure captured: Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/cec8b597-7ee7-42f9-98bc-8d7d96f0879a HTTP/1.1 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV0Izrli3g-wyUw8DfeIeqY23pIoMhc89defmsrImZlghmk4Q1TgZPBOumLZw2jUAR2G9UYKLqVkO-gK_x93X9WJj0Qx8crCbk87G9Tj9RHSrYUn6W3WrOP8EAdkqFcGY4YDSgss3pw9Qbm9hTcGr2qd_QL6YLk2AdE9Lb1si50puI4 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/db1adadc751644edaa7793d4db8666fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_db1adadc751644edaa7793d4db8666fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: db1adadc751644edaa7793d4db8666fc Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1914232274 Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: c6d44ff22033450a807adcc2fd64303a Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1914232274-project Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: exception: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'cec8b597-7ee7-42f9-98bc-8d7d96f0879a'} Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. (HTTP 404) (Request-ID: req-738cf7b9-2fd3-4aff-86d3-542f544fbcfc) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:47:52.668724 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9f79c885-162b-497c-9bd3-72e43fe7cc20 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] Returning 404 to user: Volume cec8b597-7ee7-42f9-98bc-8d7d96f0879a could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9f79c885-162b-497c-9bd3-72e43fe7cc20 tempest-VolumesNegativeTest-1914232274 tempest-VolumesNegativeTest-1914232274-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/cec8b597-7ee7-42f9-98bc-8d7d96f0879a" status: 404 len: 109 microversion: 2.1 time: 0.053150 Oct 17 13:47:52.672664 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2992/5971] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:47:52 2022] GET /compute/v2.1/os-volumes/cec8b597-7ee7-42f9-98bc-8d7d96f0879a => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:47:57.618567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:57.620408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:58.094597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:58.095203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:58.102370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.103829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.104546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.105529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.106201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.106882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.181374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:47:58.311798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-edbc4301-be35-4774-b540-7a28f40e2220 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "DELETE /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 204 len: 0 microversion: 2.32 time: 0.701564 Oct 17 13:47:58.313496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2980/5972] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:47:57 2022] DELETE /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 17 13:47:58.320139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:58.320898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:47:58.325760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:58.326574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:58.335477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.336470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.337292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.338338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:58.339015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:58.339671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:58.601269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:58.621470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:58.625974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:58.627339 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e41037ff-e4cd-4a5f-aee4-882976702677 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2949 microversion: 2.32 time: 0.309813 Oct 17 13:47:58.627948 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2993/5973] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:58 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2949 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:47:59.658196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:47:59.659606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:47:59.669098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.669935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.670935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.672495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:47:59.673149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:47:59.673632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:47:59.949207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.959892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.964419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:47:59.965940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6fc5811-db21-46a3-87ab-86cb0ec58fd6 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2949 microversion: 2.32 time: 0.313009 Oct 17 13:47:59.966951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2981/5974] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:47:59 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2949 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:01.000699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:01.001452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:01.010644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.012148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.012840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.013719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:01.014304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:01.015060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:01.309966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.326636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.328180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:01.329567 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2608f90c-ec4f-4018-9e4a-597cd2aa3727 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2949 microversion: 2.32 time: 0.333272 Oct 17 13:48:01.330140 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2994/5975] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:00 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2949 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:02.358729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:02.364433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:02.385047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:02.385580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:02.386850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:02.388625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:02.389343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:02.389948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:02.816656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:02.833566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:02.835418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:02.837031 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c2a1831-3401-4064-8657-86d4f5357b85 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2928 microversion: 2.32 time: 0.482425 Oct 17 13:48:02.838416 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2982/5976] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:02 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2928 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:03.872995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fc315c90-f40c-4962-882c-65621a1f3a7b req-0b71e638-930d-4321-a07d-9dd82e55ccd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-deleted", "tag": "382d8f99-3ffc-4832-9e7e-ff6a6ed28004"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:03.875173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:03.879824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:03.906451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc315c90-f40c-4962-882c-65621a1f3a7b req-0b71e638-930d-4321-a07d-9dd82e55ccd4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.907546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc315c90-f40c-4962-882c-65621a1f3a7b req-0b71e638-930d-4321-a07d-9dd82e55ccd4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.907834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.908378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.908814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.908934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc315c90-f40c-4962-882c-65621a1f3a7b req-0b71e638-930d-4321-a07d-9dd82e55ccd4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.909597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:03.910812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:03.911288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:03.940880 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fc315c90-f40c-4962-882c-65621a1f3a7b req-0b71e638-930d-4321-a07d-9dd82e55ccd4 service nova] Creating event network-vif-deleted:382d8f99-3ffc-4832-9e7e-ff6a6ed28004 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:03.953514 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fc315c90-f40c-4962-882c-65621a1f3a7b req-0b71e638-930d-4321-a07d-9dd82e55ccd4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090698 Oct 17 13:48:03.954520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2995/5977] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:04.282975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.299054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.302965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:04.309690 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00bc0754-7800-41dd-8b2f-ab4896abcc4f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2861 microversion: 2.32 time: 0.444202 Oct 17 13:48:04.313067 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2983/5978] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:03 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2861 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:05.095242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-af8f8b7a-6955-4b67-90f7-847d109bbe5e req-91921a83-b6e4-45e6-b5f5-47c9b304d623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-unplugged", "status": "completed", "tag": "51aab7a3-2cc6-4f52-a48c-baea0c906ed9"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:05.117707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-af8f8b7a-6955-4b67-90f7-847d109bbe5e req-91921a83-b6e4-45e6-b5f5-47c9b304d623 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:05.118683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-af8f8b7a-6955-4b67-90f7-847d109bbe5e req-91921a83-b6e4-45e6-b5f5-47c9b304d623 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:05.119215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-af8f8b7a-6955-4b67-90f7-847d109bbe5e req-91921a83-b6e4-45e6-b5f5-47c9b304d623 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:05.148617 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-af8f8b7a-6955-4b67-90f7-847d109bbe5e req-91921a83-b6e4-45e6-b5f5-47c9b304d623 service nova] Creating event network-vif-unplugged:51aab7a3-2cc6-4f52-a48c-baea0c906ed9 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:05.167656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-af8f8b7a-6955-4b67-90f7-847d109bbe5e req-91921a83-b6e4-45e6-b5f5-47c9b304d623 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077279 Oct 17 13:48:05.168746 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2996/5979] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:05.357126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:05.357789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:05.366932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:05.366932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:05.367253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:05.367883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:05.368472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:05.369548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:05.808050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:05.826794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:05.828768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:05.849745 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d956130-1b30-4ee2-8df6-d13546fa5c4c tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2656 microversion: 2.32 time: 0.508839 Oct 17 13:48:05.850740 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2984/5980] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:05 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2656 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:05.972852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-deleted", "tag": "ee816deb-fa90-4890-b9c4-2bb6f3ebb346"}, {"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-deleted", "tag": "332de9c8-5e47-4233-b4b1-3b4e05d9672f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:06.010848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.010848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.010848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.039627 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] Creating event network-vif-deleted:ee816deb-fa90-4890-b9c4-2bb6f3ebb346 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:06.039823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] Creating event network-vif-deleted:332de9c8-5e47-4233-b4b1-3b4e05d9672f for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:06.045867 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d42ed79c-bdc2-4673-b405-3e99e7f7eb2c req-27f73882-8d26-4950-94fb-972602c400dd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076722 Oct 17 13:48:06.046961 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2997/5981] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:06.884389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:06.885439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:06.909356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.910298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.910978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:06.920162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:06.921983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:06.921983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.159723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:07.174738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:07.176214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:07.184408 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1a828a3-ed2b-4508-baac-4959d5d5e8b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 2382 microversion: 2.32 time: 0.305228 Oct 17 13:48:07.185110 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2985/5982] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:06 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 2382 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:07.222949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-15413e77-13ab-4fa8-9ca5-ec3f5d213a5b req-99ab4e23-a48a-4ada-94fd-1e3abc6e56ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-unplugged", "status": "completed", "tag": "65d2d84e-b320-4db0-a8b2-501d963b849d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:07.237336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15413e77-13ab-4fa8-9ca5-ec3f5d213a5b req-99ab4e23-a48a-4ada-94fd-1e3abc6e56ca service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:07.238145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15413e77-13ab-4fa8-9ca5-ec3f5d213a5b req-99ab4e23-a48a-4ada-94fd-1e3abc6e56ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:07.238631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15413e77-13ab-4fa8-9ca5-ec3f5d213a5b req-99ab4e23-a48a-4ada-94fd-1e3abc6e56ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:07.261666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-15413e77-13ab-4fa8-9ca5-ec3f5d213a5b req-99ab4e23-a48a-4ada-94fd-1e3abc6e56ca service nova] Creating event network-vif-unplugged:65d2d84e-b320-4db0-a8b2-501d963b849d for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:07.269605 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-15413e77-13ab-4fa8-9ca5-ec3f5d213a5b req-99ab4e23-a48a-4ada-94fd-1e3abc6e56ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052693 Oct 17 13:48:07.271085 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2998/5983] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:08.071005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-deleted", "tag": "65d2d84e-b320-4db0-a8b2-501d963b849d"}, {"server_uuid": "374f6b19-76ae-4df5-8ddb-b45db983d413", "name": "network-vif-deleted", "tag": "51aab7a3-2cc6-4f52-a48c-baea0c906ed9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:08.087214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:08.087745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:08.088152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:08.105909 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] Creating event network-vif-deleted:65d2d84e-b320-4db0-a8b2-501d963b849d for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:08.106428 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] Creating event network-vif-deleted:51aab7a3-2cc6-4f52-a48c-baea0c906ed9 for instance 374f6b19-76ae-4df5-8ddb-b45db983d413 on n-h2-854121-14 Oct 17 13:48:08.112184 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c9a39f1f-05ec-41de-bc11-d722c0986fc1 req-75a4fe37-5d31-4ab0-a889-a8813f24f109 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046138 Oct 17 13:48:08.113572 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2986/5984] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:08.216045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:08.219135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:08.256067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:08.260712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:08.264374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:08.266362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:08.271034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:08.273134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:08.503724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:08.525669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:08.527511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:08.529492 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0571aee-c7f0-4171-a6f2-48dea82ec04d tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.318002 Oct 17 13:48:08.546517 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2999/5985] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:08 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:09.559524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:09.560861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:09.573180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.574102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.574820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.575756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:09.576614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:09.577289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:09.658276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.672699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.674393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:09.675651 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-315129fd-4f80-4ee4-8c47-75379b356c94 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.121642 Oct 17 13:48:09.685406 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2987/5986] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:09 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:10.706073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:10.706672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:10.715764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.717255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.718206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.719145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:10.719824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:10.720470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:10.796905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.809843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.812062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:10.813333 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46f91fc3-bd1f-4edb-b9cf-5fa9fe01b117 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.111339 Oct 17 13:48:10.814608 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3000/5987] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:10 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:11.838858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:11.839484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:11.850800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:11.851566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:11.852011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.853301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:11.853974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:11.854610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:11.940458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.953597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.956206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:11.958103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb1936d5-bfc3-4945-9acb-325444a1a500 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.122801 Oct 17 13:48:11.966277 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2988/5988] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:11 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:12.984144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:12.984761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:12.995675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.996708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.997430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:12.998298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:12.998910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:12.999657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:13.080716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.091669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.093940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:13.095755 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-685406b8-ee5c-4275-a13c-4b6ea11d0a60 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.114989 Oct 17 13:48:13.096350 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3001/5989] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:12 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:14.124168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:14.126115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:14.134499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.135758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.136412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.137359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:14.138033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:14.138610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:14.228009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.240765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.242684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:14.244295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f0ddf76-96ce-4228-823a-039b2be7d6d5 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.123978 Oct 17 13:48:14.245424 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2989/5990] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:14 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:15.276629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:15.277568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:15.285477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.286128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.286756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.287901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:15.288540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:15.289030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:15.402654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.417534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.419315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:15.420931 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46be9d8f-d832-4572-b19c-3a757542d4b1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.150845 Oct 17 13:48:15.433976 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3002/5991] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:15 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:16.130493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.133941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.144298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.145353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.146927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.147998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.148604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.149692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.198970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-588547dd-a632-4c18-85d0-a6451ff50376 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073733 Oct 17 13:48:16.205133 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2990/5992] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:48:16 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:48:16.280416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.280985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.289359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.290953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.291878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.292858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.293581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.294247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.329211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:48:16.427169 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19ac7f9e-d705-488a-8cb7-c0e994ca89eb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 204 len: 0 microversion: 2.1 time: 0.151157 Oct 17 13:48:16.430987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3003/5993] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:48:16 2022] DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:48:16.439327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.440272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.449084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:16.449832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:16.450547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.451409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.452060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.452981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.453674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.454313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.463183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.463852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.464311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.469465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:16.469979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:16.470420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:16.671536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.688693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.689747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.694730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:16.697917 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b64b248b-54b5-4cc0-89c9-e6f983415d58 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.251776 Oct 17 13:48:16.699277 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3004/5994] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:16 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:48:16.714492 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c1a00e7-6d5f-4886-838c-ec2e688bee95 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1674 microversion: 2.1 time: 0.278996 Oct 17 13:48:16.715383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2991/5995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:16 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1674 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:17.728297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:17.729422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:17.736674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.737426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.738137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.739358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.740037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.740430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:17.741056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:17.741426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.762780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.763280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.763716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.764599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:17.765243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:17.765824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:17.824928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.836026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.837925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:17.839241 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e42253a-51aa-49a8-bb61-fe630a1f157f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.115597 Oct 17 13:48:17.854682 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3005/5996] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:17 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:17.996848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:18.007494 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc5f7eac-bc6e-4d87-a52e-45bca20dbbaf tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1674 microversion: 2.1 time: 0.271022 Oct 17 13:48:18.008422 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2992/5997] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:17 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1674 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:18.866145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:18.867027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:18.877250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.877952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.878665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:18.879584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:18.880218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:18.880815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.032821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:19.033553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:19.048641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.049281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.049792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.050701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:19.051163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:19.051596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:19.191990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.201970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.203422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.204634 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6080e693-6d14-4bee-a4d5-24ec341e3e98 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.342663 Oct 17 13:48:19.217253 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3006/5998] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:18 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:48:19.362292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:19.374195 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1729465-abdd-4bb9-8406-668dd428ae1c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1674 microversion: 2.1 time: 0.345218 Oct 17 13:48:19.374866 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2993/5999] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:19 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1674 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:20.248900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:20.249828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-97f41465-6d58-48cb-a24e-2865e4f57ff5 req-4be2a6db-834b-4e89-967c-f632e4b50293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d3393c5-a858-4255-8eb3-9a85b1721e2c", "name": "network-vif-deleted", "tag": "54ee8446-951c-4d94-9564-b8dba23bf8f4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:20.250827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:20.278205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.280411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.281120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.285471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.286823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.288179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.298464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-97f41465-6d58-48cb-a24e-2865e4f57ff5 req-4be2a6db-834b-4e89-967c-f632e4b50293 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.299087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-97f41465-6d58-48cb-a24e-2865e4f57ff5 req-4be2a6db-834b-4e89-967c-f632e4b50293 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.299605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-97f41465-6d58-48cb-a24e-2865e4f57ff5 req-4be2a6db-834b-4e89-967c-f632e4b50293 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.338545 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-97f41465-6d58-48cb-a24e-2865e4f57ff5 req-4be2a6db-834b-4e89-967c-f632e4b50293 service nova] Creating event network-vif-deleted:54ee8446-951c-4d94-9564-b8dba23bf8f4 for instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c on n-h1-854121-14 Oct 17 13:48:20.349132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-97f41465-6d58-48cb-a24e-2865e4f57ff5 req-4be2a6db-834b-4e89-967c-f632e4b50293 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112396 Oct 17 13:48:20.356295 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2994/6000] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:20.404646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:20.406943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:20.408011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.418698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.420367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.420907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.422125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.422363 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fdd02d32-fb57-41a8-a2b1-40568d1cea59 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.191754 Oct 17 13:48:20.422794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.423955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.424714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.430440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.447543 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3007/6001] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:20 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:20.535381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:20.536209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:20.537024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:20.538262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lazy-loading 'fault' on Instance uuid 7d3393c5-a858-4255-8eb3-9a85b1721e2c {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:48:20.600255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:20.605468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:20.625865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c717b32-1b12-4bd0-99da-94f9fd945666 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 200 len: 1328 microversion: 2.1 time: 0.228085 Oct 17 13:48:20.647618 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2995/6002] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:20 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:21.451944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.454013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:21.468240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.469247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.469700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.470638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.471362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.474022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.590382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.600363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.603026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:21.605020 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0d96f81-c82a-44c9-a3c0-3ca8225be3d1 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.157017 Oct 17 13:48:21.608084 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3008/6003] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:21 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:21.676425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.678880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:21.695432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.696238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.696969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.697910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:21.698554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:21.699144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:21.728313 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] HTTP exception thrown: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Request method failure captured: Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c HTTP/1.1 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVxr-aL_Kn9AZHyVVPxc__0I1Lxq6WsBUvn7yGD804VH66iYPJnA3WHxvlWocb36tHMDZF2uC9AupBD1L51fs5VJxK1xhppt4v7XRs28-XBD9DlGCTJK0PJKr8HHR4H_dRFnPlrLsNADTZWFZuvdPM9CLR0yUEZ74N0gQsd8GJNKhEo Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 766c87ff085742f194e4fb7782852b96 Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7d3393c5-a858-4255-8eb3-9a85b1721e2c'} Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:21.731359 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:48:21.735710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:21.737644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Returning 404 to user: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:21.738522 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2327992-3fc7-448b-bda9-e80a52c3bce1 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 404 len: 111 microversion: 2.1 time: 0.068496 Oct 17 13:48:21.739093 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2996/6004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:21 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:48:21.748190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e7cec47-ac1f-4bf2-9ffc-6df633e32790 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '.version_select at 0x7f41a20ba790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:21.797806 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e7cec47-ac1f-4bf2-9ffc-6df633e32790 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298400182" status: 202 len: 0 microversion: 2.1 time: 0.052720 Oct 17 13:48:21.798558 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3009/6005] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 13:48:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298400182 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:48:22.646812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:22.648480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:22.662568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.663304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.665671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.666576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:22.667230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:22.668828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:22.815908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.842394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.859875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:22.861154 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba5b4e5e-7ff1-4a9b-ace8-1298cd135198 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.219594 Oct 17 13:48:22.862105 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2997/6006] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:22 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:22.942615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aca6b8a0-d593-4fa3-a3da-7dc29191a802 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: .version_select at 0x7f41a20c8e50>, body: {"keypair": {"name": "tempest-keypair-429168511", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBo25sswc+KqdglN6+FHGO9UOnNAFcsn8KWzV6WaXcg/DC1BfvWtnYipnXA0xdk2BZ1TGfdlahI9U6vR9vsagxkf5oDpJTji3Zdi3KcPjtu9GvIbAn7LVHG9ZUu8mwJcA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:22.966551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-aca6b8a0-d593-4fa3-a3da-7dc29191a802 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:22.973937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-aca6b8a0-d593-4fa3-a3da-7dc29191a802 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for user 766c87ff085742f194e4fb7782852b96 and project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:23.007648 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aca6b8a0-d593-4fa3-a3da-7dc29191a802 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.069166 Oct 17 13:48:23.008986 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3010/6007] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:48:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:23.890734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:23.892160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:23.901770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.902728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.903387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.904423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:23.905138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:23.905845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:23.997964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.010958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.012793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:24.014259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2032496-dbe5-4102-a3ed-4229dbb5dbdc tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.127647 Oct 17 13:48:24.015023 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2998/6008] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:23 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:25.049038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:25.063800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:25.078180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.079055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.082183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.083438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:25.086235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:25.087190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:25.206564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.223452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.225423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:25.237041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5a9950d-6878-45ff-8b38-cde39b774e96 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.188081 Oct 17 13:48:25.257587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3011/6009] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:25 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:25.402998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1678440206", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02ebca51-614e-4b33-ab74-bdf45159403c"}], "security_groups": [{"name": "tempest-securitygroup--1762709629"}], "key_name": "tempest-keypair-429168511", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:25.486220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8edd8879-1984-4bdf-8fa3-7719966e8d25 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Action: 'create', calling method: .version_select at 0x7f419e055700>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1624597953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMyibGhh46w/zdH1vHhZidMJAB9EFkVQHRFNe30Xx37dyW56aXKsv3nV7ifl+3aBl5st7ZrckIajbs5BpOtg9EJoachXRwBEF3R+hr6QqA7HMULFPsXG/W2SofYBIc5Iw=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:25.537486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8edd8879-1984-4bdf-8fa3-7719966e8d25 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Getting quotas for project 0981bbc4fc0d4f60be8d878061281a00. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:25.546057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-8edd8879-1984-4bdf-8fa3-7719966e8d25 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Getting quotas for user 33b08a09efbf422088e565079d5a57f7 and project 0981bbc4fc0d4f60be8d878061281a00. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:25.580536 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8edd8879-1984-4bdf-8fa3-7719966e8d25 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.099453 Oct 17 13:48:25.581306 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3012/6010] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:48:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:48:25.621858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] validate_networks() for [('02ebca51-614e-4b33-ab74-bdf45159403c', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:26.244741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:26.245093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:26.249532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:26.250317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:26.251652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:26.268023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:26.268635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:26.269151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.283348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.286056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.287099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.287758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.291444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.300926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.312464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.313685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.314646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:26.316247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:26.317719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:26.348279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:26.361136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:26.366180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Getting quotas for user 766c87ff085742f194e4fb7782852b96 and project a0e533d02cf24801ab74f5cfe7e68394. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:26.403464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:26.405893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:26.482838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.515355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.529526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:26.531008 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [134801cf-bda1-434c-b069-aa760a8b6b62] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:48:26.533271 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb4af2b2-8ef0-4cc9-a898-c39238328dc3 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.268138 Oct 17 13:48:26.558546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3013/6011] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:26 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:48:27.542199 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [134801cf-bda1-434c-b069-aa760a8b6b62] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 34268. Oct 17 13:48:27.553507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c012e7c8-2bfb-45b9-bfee-e1410e9eb175 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.158294 Oct 17 13:48:27.561721 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2999/6012] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:27.564519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:27.565924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:27.571801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88aa5aa6-3c75-4fc6-bdb8-ca3024032749 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:27.573503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88aa5aa6-3c75-4fc6-bdb8-ca3024032749 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:27.574913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:27.575762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:27.576374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:27.577303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:27.577913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:27.578549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:27.655510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88aa5aa6-3c75-4fc6-bdb8-ca3024032749 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:27.699792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88aa5aa6-3c75-4fc6-bdb8-ca3024032749 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1237 microversion: 2.1 time: 0.134723 Oct 17 13:48:27.700818 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3000/6013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:27 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:27.718210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1788263551", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ba11c487-bc73-4fdc-9f3f-d3cee8265bcd", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1624597953", "security_groups": [{"name": "tempest-secgroup-smoke-1508003000"}], "networks": [{"uuid": "46dfea93-c6b7-4618-a364-0e02fc84560e"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:27.726813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:27.742257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:27.744424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:27.745915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:27.747125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4ca188d-ca8d-438c-a690-b957cce90964 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.187208 Oct 17 13:48:27.763759 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3014/6014] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:27 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:48:27.947692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] validate_networks() for [('46dfea93-c6b7-4618-a364-0e02fc84560e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:48:28.444720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:48:28.445197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:48:28.446488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:48:28.446912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:48:28.447330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:48:28.464549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:28.465443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:28.466278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.467575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:28.468353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:28.468942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.495660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Getting quotas for project 0981bbc4fc0d4f60be8d878061281a00. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:48:28.509995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Getting quotas for user 33b08a09efbf422088e565079d5a57f7 and project 0981bbc4fc0d4f60be8d878061281a00. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:48:28.585681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:48:28.588628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba11c487-bc73-4fdc-9f3f-d3cee8265bcd',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:48:28.724181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed7bae9e-ead7-41b2-86f8-68f8549785a4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:28.725423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed7bae9e-ead7-41b2-86f8-68f8549785a4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:28.734550 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:48:28.737437 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 13:48:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 (ip 10.222.0.65) !!! Oct 17 13:48:28.739389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:28.855418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a12b3ef2-1fa8-455f-9d3d-cef8f45b21e0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.153047 Oct 17 13:48:28.856420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3001/6015] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:48:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:48:28.861906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:28.862796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:28.872714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed7bae9e-ead7-41b2-86f8-68f8549785a4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:28.872892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:28.873384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:28.874597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.876202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:28.877813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:28.878167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:28.883838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed7bae9e-ead7-41b2-86f8-68f8549785a4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1237 microversion: 2.1 time: 0.163129 Oct 17 13:48:28.897393 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3015/6016] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:28 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1237 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:28.912234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8e70006-2af0-4d0c-b993-194824b06714 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:28.912735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8e70006-2af0-4d0c-b993-194824b06714 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:29.004717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.017665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.019138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.025697 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab692743-5299-4184-99c4-3110a29927cd tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1604 microversion: 2.32 time: 0.166243 Oct 17 13:48:29.026576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3002/6017] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:28 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1604 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:29.027027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8e70006-2af0-4d0c-b993-194824b06714 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.036916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8e70006-2af0-4d0c-b993-194824b06714 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1099 microversion: 2.1 time: 0.138309 Oct 17 13:48:29.037564 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3016/6018] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:28 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1099 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:29.912940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87974dda-208f-4714-8e4d-b704b05b7259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:29.913687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87974dda-208f-4714-8e4d-b704b05b7259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:29.975550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-87974dda-208f-4714-8e4d-b704b05b7259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:29.985344 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87974dda-208f-4714-8e4d-b704b05b7259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1237 microversion: 2.1 time: 0.076777 Oct 17 13:48:29.986260 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3003/6019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:29 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:30.054990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:30.056287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:30.070169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:30.071931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:30.083597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.085467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.086108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.088420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.090339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.090645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.091332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.091943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.093874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.095182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.098616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.101353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.160305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:30.161330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:30.162036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:30.162693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lazy-loading 'fault' on Instance uuid 374f6b19-76ae-4df5-8ddb-b45db983d413 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:48:30.241190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.273071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.276313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '966443e3e05a475581d67d2435108449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78682401303a44378f5a04ef9042221c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.277622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9032dea-bf5d-4598-8813-9d16f384d14e tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 200 len: 1609 microversion: 2.32 time: 0.227639 Oct 17 13:48:30.296250 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3017/6020] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:30 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 1609 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:48:30.301882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:30.321761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f673bca9-5511-4407-bb3f-908a5d45d0d1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1149 microversion: 2.1 time: 0.253575 Oct 17 13:48:30.324594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3004/6021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:30 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1149 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:31.010842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:31.011514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:31.018221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.018710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.019144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.020517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.020980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.021430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.088450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:31.097885 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf864481-076c-4331-942d-06be0e16aff7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1289 microversion: 2.1 time: 0.092135 Oct 17 13:48:31.098724 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3018/6022] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:31 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:31.309212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:31.310462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:31.329705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.334006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.337329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.338661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.339377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.349992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:31.351013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:31.363023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.368454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.373935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.382489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.384028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:31.384610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:31.385547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:31.410130 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] HTTP exception thrown: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Request method failure captured: Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 HTTP/1.1 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVurO0d382f9AXil-dv5kij_G21uiW516Bz_NJ3WcFrFEhZiMjCMwsw09xU_w5gol5XVE-D4Obxxu905wd-IQrkax935QRlYr6CV8-wUupBG8PX_CCWcv1xJzw3VWroe5DMqwz25xKiUL7J0dvBPEWAQKhWG5ru2HWZn9A7A1g_WftY Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 78682401303a44378f5a04ef9042221c Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/78682401303a44378f5a04ef9042221c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/78682401303a44378f5a04ef9042221c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/78682401303a44378f5a04ef9042221c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_78682401303a44378f5a04ef9042221c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 78682401303a44378f5a04ef9042221c Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TaggedBootDevicesTest-2039872809-project Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 966443e3e05a475581d67d2435108449 Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TaggedBootDevicesTest-2039872809-project Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '374f6b19-76ae-4df5-8ddb-b45db983d413'} Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:31.411741 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:31.418250 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:31.420265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Returning 404 to user: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:31.421579 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-423a8130-020d-425d-a624-2edbe76fd6ae tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 404 len: 111 microversion: 2.32 time: 0.117784 Oct 17 13:48:31.422739 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3005/6023] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:31 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:48:31.441117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61ebc606-8eec-4e78-aef3-6a3fe6a1359f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '.version_select at 0x7f41a1f67430>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:31.500182 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61ebc606-8eec-4e78-aef3-6a3fe6a1359f tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-592207043" status: 204 len: 0 microversion: 2.32 time: 0.068430 Oct 17 13:48:31.501327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:31.501969 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3006/6024] 10.222.0.65 () {60 vars in 1259 bytes} [Mon Oct 17 13:48:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-592207043 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:48:31.510811 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45ba723f-06d2-4f18-a178-39bc657bbae8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1197 microversion: 2.1 time: 0.164961 Oct 17 13:48:31.531904 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3019/6025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:31 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:32.123629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:32.124709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:32.139992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.143615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.144261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.145900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.148012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.150904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.411577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:32.423996 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0277f16b-907f-4a85-95cb-29dfce078f37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1295 microversion: 2.1 time: 0.306710 Oct 17 13:48:32.425449 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3007/6026] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:32 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1295 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:32.542046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:32.543253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:32.562580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.565660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.566592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.569532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:32.570496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:32.572305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:32.752123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:32.768429 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c72782b5-9c7e-41aa-ba5b-16f9dec80e1e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1215 microversion: 2.1 time: 0.237035 Oct 17 13:48:32.769311 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3020/6027] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:32 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:33.450888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:33.457511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:33.478515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.480291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.480965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.483681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.484279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.485704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.642101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:33.657795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d960709-e740-40ee-a550-a6800806ec37 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1295 microversion: 2.1 time: 0.213412 Oct 17 13:48:33.664497 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3008/6028] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:33 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:33.794107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:33.794797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:33.804856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.805788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.806476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:33.807408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:33.808432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:33.809111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.017698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:34.033385 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47ebb6d5-38d1-4cba-bddf-67f53e5d23ed tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1215 microversion: 2.1 time: 0.243035 Oct 17 13:48:34.034789 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3021/6029] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:33 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:34.691041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:34.691667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:34.705699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.706785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.708233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:34.708958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:34.709460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:34.713652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.058467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:35.059866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:35.069798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.070597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.071276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.072166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:35.072787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:35.073441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:35.189728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:35.216709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-456c463d-387b-4cdc-8514-8d3e95b61ef7 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.529940 Oct 17 13:48:35.238459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3009/6030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:34 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:35.696856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:35.719629 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-744a750b-b836-4f35-a72d-ea7fe8db2211 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1283 microversion: 2.1 time: 0.666235 Oct 17 13:48:35.727543 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3022/6031] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:35 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1283 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:36.244000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.245351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.260644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.267601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.268483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.269467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.270128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.270737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.589046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9e498a90-ba97-4c66-bce4-d01bf825dc6c req-5c110a6f-b729-4b90-a7fc-8e545516e7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04063868-1c30-440b-973e-0e073bd334c9", "tag": "bbbf139a-7495-4959-915c-7d5217d8c0d6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:36.624766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9e498a90-ba97-4c66-bce4-d01bf825dc6c req-5c110a6f-b729-4b90-a7fc-8e545516e7ff service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.626474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9e498a90-ba97-4c66-bce4-d01bf825dc6c req-5c110a6f-b729-4b90-a7fc-8e545516e7ff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.627430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9e498a90-ba97-4c66-bce4-d01bf825dc6c req-5c110a6f-b729-4b90-a7fc-8e545516e7ff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.665922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9e498a90-ba97-4c66-bce4-d01bf825dc6c req-5c110a6f-b729-4b90-a7fc-8e545516e7ff service nova] Creating event network-changed:bbbf139a-7495-4959-915c-7d5217d8c0d6 for instance 04063868-1c30-440b-973e-0e073bd334c9 on n-h2-854121-14 Oct 17 13:48:36.682295 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9e498a90-ba97-4c66-bce4-d01bf825dc6c req-5c110a6f-b729-4b90-a7fc-8e545516e7ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101243 Oct 17 13:48:36.683109 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3023/6032] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:48:36.751296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:36.752244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:36.765427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.766324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.766986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.768314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:36.771321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:36.772211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:36.821620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:36.833727 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b279a36-01db-4c65-b63c-149442a75354 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.594061 Oct 17 13:48:36.836557 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3010/6033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:37.458200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:37.494252 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82eee698-16d6-4c76-b427-74bdd9ad6cb1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1283 microversion: 2.1 time: 0.735418 Oct 17 13:48:37.495828 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3024/6034] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:36 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1283 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:37.646447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:37.646970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:37.660976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.661555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.661973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.662676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.663144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.663576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.680397 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] HTTP exception thrown: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Request method failure captured: Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 HTTP/1.1 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVurO0d382f9AXil-dv5kij_G21uiW516Bz_NJ3WcFrFEhZiMjCMwsw09xU_w5gol5XVE-D4Obxxu905wd-IQrkax935QRlYr6CV8-wUupBG8PX_CCWcv1xJzw3VWroe5DMqwz25xKiUL7J0dvBPEWAQKhWG5ru2HWZn9A7A1g_WftY Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 78682401303a44378f5a04ef9042221c Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/78682401303a44378f5a04ef9042221c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/78682401303a44378f5a04ef9042221c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/78682401303a44378f5a04ef9042221c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_78682401303a44378f5a04ef9042221c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 78682401303a44378f5a04ef9042221c Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TaggedBootDevicesTest-2039872809-project Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 966443e3e05a475581d67d2435108449 Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TaggedBootDevicesTest-2039872809-project Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '374f6b19-76ae-4df5-8ddb-b45db983d413'} Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:37.682215 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Returning 404 to user: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fd7f51f-3652-466e-a994-a0ae4eba512b tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "DELETE /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 404 len: 111 microversion: 2.32 time: 0.041819 Oct 17 13:48:37.688621 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3011/6035] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:48:37 2022] DELETE /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:48:37.697572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:37.698487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] [instance: 374f6b19-76ae-4df5-8ddb-b45db983d413] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:37.709007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.709866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.710736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.712355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.712982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.713607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.738954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] HTTP exception thrown: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Request method failure captured: Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 HTTP/1.1 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVurO0d382f9AXil-dv5kij_G21uiW516Bz_NJ3WcFrFEhZiMjCMwsw09xU_w5gol5XVE-D4Obxxu905wd-IQrkax935QRlYr6CV8-wUupBG8PX_CCWcv1xJzw3VWroe5DMqwz25xKiUL7J0dvBPEWAQKhWG5ru2HWZn9A7A1g_WftY Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.32 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 78682401303a44378f5a04ef9042221c Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/78682401303a44378f5a04ef9042221c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/78682401303a44378f5a04ef9042221c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/78682401303a44378f5a04ef9042221c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_78682401303a44378f5a04ef9042221c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 78682401303a44378f5a04ef9042221c Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TaggedBootDevicesTest-2039872809 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TaggedBootDevicesTest-2039872809-project Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 966443e3e05a475581d67d2435108449 Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TaggedBootDevicesTest-2039872809-project Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '374f6b19-76ae-4df5-8ddb-b45db983d413'} Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.741641 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. Oct 17 13:48:37.746730 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:48:37.749068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] Returning 404 to user: Instance 374f6b19-76ae-4df5-8ddb-b45db983d413 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:48:37.750658 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60d9798f-1e94-4156-bbfc-3f4270c334e8 tempest-TaggedBootDevicesTest-2039872809 tempest-TaggedBootDevicesTest-2039872809-project] 10.222.0.65 "GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413" status: 404 len: 111 microversion: 2.32 time: 0.059443 Oct 17 13:48:37.751946 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3025/6036] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:48:37 2022] GET /compute/v2.1/servers/374f6b19-76ae-4df5-8ddb-b45db983d413 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:48:37.872619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:37.873384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:37.885624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.886100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.886550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:37.887330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:37.887993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:37.888641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.489352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:38.526965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:38.529451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:38.560455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.561252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.563253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.564294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.564855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.565423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.604112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:38.628331 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b00bbcd6-8db4-4b9e-a13f-0aae1007f36b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.762299 Oct 17 13:48:38.631190 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3012/6037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:37 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:38.737819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c34022d7-b57d-48f0-978f-343ac8b48bc7 req-d1313ac9-3683-4078-8e08-c6845c7384fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:38.750961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c34022d7-b57d-48f0-978f-343ac8b48bc7 req-d1313ac9-3683-4078-8e08-c6845c7384fb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:38.752276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c34022d7-b57d-48f0-978f-343ac8b48bc7 req-d1313ac9-3683-4078-8e08-c6845c7384fb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:38.752875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c34022d7-b57d-48f0-978f-343ac8b48bc7 req-d1313ac9-3683-4078-8e08-c6845c7384fb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:38.761246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:38.769077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c34022d7-b57d-48f0-978f-343ac8b48bc7 req-d1313ac9-3683-4078-8e08-c6845c7384fb service nova] Creating event network-changed:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:48:38.772703 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba7127d5-f794-4d43-ba57-214b249dec70 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1283 microversion: 2.1 time: 0.257569 Oct 17 13:48:38.773243 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3026/6038] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:38 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1283 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:38.787773 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c34022d7-b57d-48f0-978f-343ac8b48bc7 req-d1313ac9-3683-4078-8e08-c6845c7384fb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056004 Oct 17 13:48:38.796839 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3013/6039] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:39.658869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:39.659494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:39.661606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:39.668630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.669095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.669754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.670715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.671466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.672062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.803918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:39.806004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:39.817772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.818532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.819474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.820877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:39.821685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:39.822668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:39.894881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:39.907121 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b3686c4-d957-406e-874b-a7a0ea415ddc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.252470 Oct 17 13:48:39.909000 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3027/6040] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:39 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:39.982128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:40.024065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:40.033473 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-794fcda7-2d79-4ee9-a8e8-12771f822008 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1283 microversion: 2.1 time: 0.236989 Oct 17 13:48:40.045398 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3014/6041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:39 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1283 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:40.936135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:40.936982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:40.973180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.974898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.979352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:40.980126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:40.982650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:40.982650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.057553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:41.058185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:41.080933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.083931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.084381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.085117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:41.085593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:41.086019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:41.501634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.513216 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b8cffb4-5d7d-4659-bcfb-4877921a417e tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.583504 Oct 17 13:48:41.516390 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3028/6042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:40 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:41.717515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:41.727498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c1e65b9-9c96-47d3-94ea-79cd4d1ee1ce tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1283 microversion: 2.1 time: 0.673891 Oct 17 13:48:41.729873 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3015/6043] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:41 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1283 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:42.542949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:42.544369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:42.551902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.552775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.553153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.553884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.554337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.555605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.753725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:42.754479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:42.770190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.772180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.772734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.775464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:42.776377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:42.778476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:42.791521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.801334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1f03c7b-dec4-4332-888b-575dc6a33241 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.262969 Oct 17 13:48:42.802563 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3029/6044] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:42 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:42.971798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:42.983079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c77acaaa-ab79-46bf-8cc5-5654fc3f1678 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1283 microversion: 2.1 time: 0.233425 Oct 17 13:48:43.000609 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3016/6045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:42 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1283 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:43.829890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:43.831879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:43.840892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.842391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.843099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:43.844075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:43.844703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:43.845649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.007388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:44.009137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:44.023027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.024115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.025064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.026194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:44.026964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:44.027734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:44.113851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.129363 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08edb7a0-7bb5-47c3-a21e-83298954e24a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.304389 Oct 17 13:48:44.130118 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3030/6046] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:43 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:44.234892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:44.244452 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57f1f340-698f-4f38-9673-06cee5ab6c10 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.241400 Oct 17 13:48:44.260837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3017/6047] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:44 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:45.154535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:45.155768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.175759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.176255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.176708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.177474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.178003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.178444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.272140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:45.273651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:45.287729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.295189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.296124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.297491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.299383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.301383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.488911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:45.504321 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a531f142-7084-4387-9e9f-8191db85fb9c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.352486 Oct 17 13:48:45.506568 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3031/6048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:45 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:45.521071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-425eb3e6-c212-4058-af25-abd0ac4c1d65 req-a8966ade-efc7-4387-915a-34f5d0bea6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04063868-1c30-440b-973e-0e073bd334c9", "name": "network-vif-plugged", "status": "completed", "tag": "bbbf139a-7495-4959-915c-7d5217d8c0d6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:45.547664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-425eb3e6-c212-4058-af25-abd0ac4c1d65 req-a8966ade-efc7-4387-915a-34f5d0bea6dc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:45.548246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-425eb3e6-c212-4058-af25-abd0ac4c1d65 req-a8966ade-efc7-4387-915a-34f5d0bea6dc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:45.548909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-425eb3e6-c212-4058-af25-abd0ac4c1d65 req-a8966ade-efc7-4387-915a-34f5d0bea6dc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:45.563764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:45.575678 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a451709c-e345-4a2b-8abc-0e731396b3b1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.307843 Oct 17 13:48:45.577383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3018/6049] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:45 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:45.587354 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-425eb3e6-c212-4058-af25-abd0ac4c1d65 req-a8966ade-efc7-4387-915a-34f5d0bea6dc service nova] Creating event network-vif-plugged:bbbf139a-7495-4959-915c-7d5217d8c0d6 for instance 04063868-1c30-440b-973e-0e073bd334c9 on n-h2-854121-14 Oct 17 13:48:45.597304 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-425eb3e6-c212-4058-af25-abd0ac4c1d65 req-a8966ade-efc7-4387-915a-34f5d0bea6dc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088063 Oct 17 13:48:45.603241 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3032/6050] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:46.533015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:46.533831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:46.542314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.543325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.543996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.544930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.545630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.546399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.602575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:46.610328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:46.611678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:46.631458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.631959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.632411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.639248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:46.640095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:46.640718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:46.954414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:46.995020 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25ccc0dc-8574-43dd-a82b-c51ffc8ab8a9 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1363 microversion: 2.1 time: 0.452801 Oct 17 13:48:46.996524 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3019/6051] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:46 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:47.049524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:47.053675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:47.059968 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea2b794d-890d-4e7c-be27-f45fd4fb73a8 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.455061 Oct 17 13:48:47.069702 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3033/6052] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:46 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:48.021916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.022691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.042830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.043729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.045381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.046458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.047142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.047822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.095357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.096585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.115744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.121596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.125460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.126411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.127053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.129941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.491666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.503183 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75555e90-e114-4a73-8261-24f22b54d456 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1548 microversion: 2.1 time: 0.485147 Oct 17 13:48:48.505233 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3020/6053] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1548 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:48.531884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:48.532668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:48.546640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.551019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.557325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.558431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:48.561489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:48.562489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:48.604834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:48.614736 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7b2507c-bc92-468d-bc66-57af4c19f894 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.524529 Oct 17 13:48:48.627615 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3034/6054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:48.680214 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c46b238e-c6ef-416e-ac6d-5792d2ac69c4 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152274 Oct 17 13:48:48.681503 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3021/6055] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 13:48:48 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:48:49.659863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:49.661237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:49.675535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.679445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.681401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:49.682349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:49.687161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:49.687842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:50.358213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:50.366717 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f471a648-0c34-40f4-bd52-1c064b3e8564 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.711056 Oct 17 13:48:50.371559 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3035/6056] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:49 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:51.399496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:51.400334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:51.419149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.421391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.424163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.426532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.429001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.430449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.625391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4c169a53-abb4-4e62-bd24-7827ee14c5fe req-01914145-763d-4deb-9bce-fbd00c39c668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04063868-1c30-440b-973e-0e073bd334c9", "tag": "bbbf139a-7495-4959-915c-7d5217d8c0d6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:51.660831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4c169a53-abb4-4e62-bd24-7827ee14c5fe req-01914145-763d-4deb-9bce-fbd00c39c668 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:51.665556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4c169a53-abb4-4e62-bd24-7827ee14c5fe req-01914145-763d-4deb-9bce-fbd00c39c668 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:51.666173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4c169a53-abb4-4e62-bd24-7827ee14c5fe req-01914145-763d-4deb-9bce-fbd00c39c668 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:51.704083 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4c169a53-abb4-4e62-bd24-7827ee14c5fe req-01914145-763d-4deb-9bce-fbd00c39c668 service nova] Creating event network-changed:bbbf139a-7495-4959-915c-7d5217d8c0d6 for instance 04063868-1c30-440b-973e-0e073bd334c9 on n-h2-854121-14 Oct 17 13:48:51.718709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4c169a53-abb4-4e62-bd24-7827ee14c5fe req-01914145-763d-4deb-9bce-fbd00c39c668 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097073 Oct 17 13:48:51.718919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:51.720959 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3036/6057] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:48:51.729852 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6475ab7-b38a-4313-9a28-260f0d45e6c1 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.335974 Oct 17 13:48:51.733210 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3022/6058] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:51 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:52.759344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:52.760378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:52.793727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.795359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.800671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:52.801677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:52.802272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:52.806172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:53.034185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:53.046382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62189f49-ae3f-44e4-9843-506e4bebb141 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.293984 Oct 17 13:48:53.063792 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3037/6059] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:52 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:54.075646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:54.077214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:54.090390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.094235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.096351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.098128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:54.101186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:54.104256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:54.509260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:54.527431 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-474053f7-889a-4ab1-8278-f6b7fb6b26c5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.453345 Oct 17 13:48:54.528793 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3023/6060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:54 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:55.555820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:55.558347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:55.570912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.573941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.574799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.575964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.576646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.578314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.578670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-36f8bfe5-68fd-42f8-b6a5-62ebee164fe3 req-b40f82ab-da76-4e59-a206-ec19719e5399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "name": "network-vif-plugged", "status": "completed", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:48:55.607620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36f8bfe5-68fd-42f8-b6a5-62ebee164fe3 req-b40f82ab-da76-4e59-a206-ec19719e5399 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:55.608122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36f8bfe5-68fd-42f8-b6a5-62ebee164fe3 req-b40f82ab-da76-4e59-a206-ec19719e5399 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:55.608563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36f8bfe5-68fd-42f8-b6a5-62ebee164fe3 req-b40f82ab-da76-4e59-a206-ec19719e5399 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:55.670411 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-36f8bfe5-68fd-42f8-b6a5-62ebee164fe3 req-b40f82ab-da76-4e59-a206-ec19719e5399 service nova] Creating event network-vif-plugged:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:48:55.687132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-36f8bfe5-68fd-42f8-b6a5-62ebee164fe3 req-b40f82ab-da76-4e59-a206-ec19719e5399 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111961 Oct 17 13:48:55.688010 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3024/6061] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:48:56.007012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:56.018581 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32ee5423-56b3-4b40-95d0-42d44cf9410e tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.469844 Oct 17 13:48:56.020286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3038/6062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:55 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:57.046427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:57.047870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:57.054974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.055800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.056498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.057353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:57.058063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:57.058747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:57.260794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:57.270344 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a5414a8-5002-4108-82b2-1e49c7a6822b tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1271 microversion: 2.1 time: 0.229214 Oct 17 13:48:57.275239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3025/6063] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:57 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:48:58.302141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:58.303344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:58.310922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.311705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.312150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.312862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.320059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.320650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.644341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.667862 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f2b9d87-c2ef-4ca6-b5d8-45f53f0dabbd tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1460 microversion: 2.1 time: 0.369596 Oct 17 13:48:58.668833 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3039/6064] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:58 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1460 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:48:58.690894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:48:58.691532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:48:58.704776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:48:58.708076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.708886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.709408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.710360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:48:58.712067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:48:58.712599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:48:58.892609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:48:58.902790 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74e51563-1f49-4a01-a023-ecf12b0f3a11 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1460 microversion: 2.1 time: 0.216225 Oct 17 13:48:58.903683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3026/6065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:48:58 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1460 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:02.414824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-14761ffb-90a7-4da5-b0f2-2fd915650c1f req-4f3c24e8-3f75-4845-88c8-bcfcef861f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:02.421046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=56 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:02.437082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14761ffb-90a7-4da5-b0f2-2fd915650c1f req-4f3c24e8-3f75-4845-88c8-bcfcef861f1f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:02.437606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14761ffb-90a7-4da5-b0f2-2fd915650c1f req-4f3c24e8-3f75-4845-88c8-bcfcef861f1f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:02.438047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-14761ffb-90a7-4da5-b0f2-2fd915650c1f req-4f3c24e8-3f75-4845-88c8-bcfcef861f1f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:02.462875 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-14761ffb-90a7-4da5-b0f2-2fd915650c1f req-4f3c24e8-3f75-4845-88c8-bcfcef861f1f service nova] Creating event network-changed:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:49:02.468941 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-14761ffb-90a7-4da5-b0f2-2fd915650c1f req-4f3c24e8-3f75-4845-88c8-bcfcef861f1f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058036 Oct 17 13:49:02.470161 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3040/6066] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:04.666174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-16ee72cf-df4f-4f7a-a4cb-b9a164ce151b req-31f44234-c9c4-492d-9e59-a0385b5e96ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:04.696250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-16ee72cf-df4f-4f7a-a4cb-b9a164ce151b req-31f44234-c9c4-492d-9e59-a0385b5e96ae service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:04.696873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-16ee72cf-df4f-4f7a-a4cb-b9a164ce151b req-31f44234-c9c4-492d-9e59-a0385b5e96ae service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:04.697616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-16ee72cf-df4f-4f7a-a4cb-b9a164ce151b req-31f44234-c9c4-492d-9e59-a0385b5e96ae service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:04.719808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-16ee72cf-df4f-4f7a-a4cb-b9a164ce151b req-31f44234-c9c4-492d-9e59-a0385b5e96ae service nova] Creating event network-changed:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:49:04.729021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-16ee72cf-df4f-4f7a-a4cb-b9a164ce151b req-31f44234-c9c4-492d-9e59-a0385b5e96ae service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.390710 Oct 17 13:49:04.734309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3027/6067] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:06.756956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0d23c6ff-ee8e-4a8b-815d-1692f6cae8a4 req-d9671ea5-3946-4ac4-bb75-71cafa7ed756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:06.794050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0d23c6ff-ee8e-4a8b-815d-1692f6cae8a4 req-d9671ea5-3946-4ac4-bb75-71cafa7ed756 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:06.795014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0d23c6ff-ee8e-4a8b-815d-1692f6cae8a4 req-d9671ea5-3946-4ac4-bb75-71cafa7ed756 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:06.795665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0d23c6ff-ee8e-4a8b-815d-1692f6cae8a4 req-d9671ea5-3946-4ac4-bb75-71cafa7ed756 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:06.827900 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0d23c6ff-ee8e-4a8b-815d-1692f6cae8a4 req-d9671ea5-3946-4ac4-bb75-71cafa7ed756 service nova] Creating event network-changed:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:49:06.839602 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0d23c6ff-ee8e-4a8b-815d-1692f6cae8a4 req-d9671ea5-3946-4ac4-bb75-71cafa7ed756 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087387 Oct 17 13:49:06.842429 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3041/6068] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:49:39.055935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:39.056687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=40 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:39.060906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:39.061529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:39.072669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-31f9dc75-3fc1-4806-b81c-51db1b6a03e4 req-8591c788-f4ec-4a38-b5e4-e550b87c9668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:39.078906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:39.090343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=36 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:49:39.103787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.105388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.107183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.109467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.112188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.112822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.114894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31f9dc75-3fc1-4806-b81c-51db1b6a03e4 req-8591c788-f4ec-4a38-b5e4-e550b87c9668 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.118818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31f9dc75-3fc1-4806-b81c-51db1b6a03e4 req-8591c788-f4ec-4a38-b5e4-e550b87c9668 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.119261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31f9dc75-3fc1-4806-b81c-51db1b6a03e4 req-8591c788-f4ec-4a38-b5e4-e550b87c9668 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.159787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-31f9dc75-3fc1-4806-b81c-51db1b6a03e4 req-8591c788-f4ec-4a38-b5e4-e550b87c9668 service nova] Creating event network-changed:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:49:39.172875 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-31f9dc75-3fc1-4806-b81c-51db1b6a03e4 req-8591c788-f4ec-4a38-b5e4-e550b87c9668 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104599 Oct 17 13:49:39.176785 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3042/6069] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:39.184938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:49:39.359752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fb1a0bf-598d-448c-b46b-871f5b5c3144 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 204 len: 0 microversion: 2.1 time: 0.306391 Oct 17 13:49:39.373268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3028/6070] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:49:39 2022] DELETE /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:49:39.373832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:39.374536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:39.395630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.396511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.397044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.399187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:39.399805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:39.403774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:39.797855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:39.813347 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88a26439-e909-486e-ab3e-939b95557876 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1584 microversion: 2.1 time: 0.447210 Oct 17 13:49:39.825301 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3043/6071] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:39 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1584 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:40.859259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:40.862002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:40.880972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:40.882243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:40.883488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:40.884826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:40.885358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:40.885834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:41.530645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:41.539518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b6e3afd-0247-4d88-85d5-4d9a2c951ac5 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1584 microversion: 2.1 time: 0.695524 Oct 17 13:49:41.541912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3029/6072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:40 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1584 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:42.580808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:42.589498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:42.614278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.615840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.617468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.618282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.619856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.624107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.697188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2cbf1d17-e8cd-4c23-9a0f-8bc1ea0f4e02 req-f87427b7-36dc-4f8d-8f6c-5aaf5f233488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b257d85c-da9c-40f1-807d-ff8540843166", "name": "network-vif-deleted", "tag": "ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:49:42.712471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2cbf1d17-e8cd-4c23-9a0f-8bc1ea0f4e02 req-f87427b7-36dc-4f8d-8f6c-5aaf5f233488 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:42.713400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2cbf1d17-e8cd-4c23-9a0f-8bc1ea0f4e02 req-f87427b7-36dc-4f8d-8f6c-5aaf5f233488 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:42.714020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2cbf1d17-e8cd-4c23-9a0f-8bc1ea0f4e02 req-f87427b7-36dc-4f8d-8f6c-5aaf5f233488 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:42.766235 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2cbf1d17-e8cd-4c23-9a0f-8bc1ea0f4e02 req-f87427b7-36dc-4f8d-8f6c-5aaf5f233488 service nova] Creating event network-vif-deleted:ed5e98ab-1b6b-4ec4-8031-f18982b7d9cb for instance b257d85c-da9c-40f1-807d-ff8540843166 on n-h2-854121-14 Oct 17 13:49:42.777091 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2cbf1d17-e8cd-4c23-9a0f-8bc1ea0f4e02 req-f87427b7-36dc-4f8d-8f6c-5aaf5f233488 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083966 Oct 17 13:49:42.783640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3030/6073] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:49:42.804513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:42.818726 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-962208ea-d5bc-47e9-bdac-7b51baf315c0 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1398 microversion: 2.1 time: 0.248680 Oct 17 13:49:42.840262 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3044/6074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:42 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1398 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:43.856754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:43.866587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:43.884154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.884856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.887002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:43.890370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:43.891428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:43.894317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:44.062657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:44.076569 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6c496c3-5fb4-4096-82c3-bf16569b7f96 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1230 microversion: 2.1 time: 0.230129 Oct 17 13:49:44.081434 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3031/6075] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:43 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1230 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:45.111918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:45.113981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:45.126266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.127035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.127482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.128291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:45.128767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:45.129188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:45.278797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:45.295642 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e629f7f0-04c8-4c00-ad77-9e118db75448 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1230 microversion: 2.1 time: 0.193424 Oct 17 13:49:45.302881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3045/6076] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:45 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1230 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:46.325764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:46.326396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:46.349713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.351135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.351724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.352515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:46.361478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:46.361967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:46.479409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:46.497401 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-926d5e3a-3276-481d-beb5-55c78afb1a00 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1230 microversion: 2.1 time: 0.169672 Oct 17 13:49:46.498409 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3032/6077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:46 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1230 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:47.527712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:47.527712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:47.550167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:47.550972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:47.551610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.552523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:47.553184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:47.553855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:47.677333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:47.686778 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70b079a0-9dbe-4a9c-adc9-b6bb84b62250 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1230 microversion: 2.1 time: 0.164306 Oct 17 13:49:47.687390 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3046/6078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:47 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1230 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:48.715304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:48.715935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:48.729836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.742040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.742852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.743892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:48.744602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:48.745104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:48.865898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:48.885389 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e185c10-b061-408e-a968-3c8524e17655 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1230 microversion: 2.1 time: 0.174475 Oct 17 13:49:48.886005 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3033/6079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:48 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1230 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:49.910810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:49.911432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:49.927716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.928247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.929288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:49.930624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:49.931474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:49.937895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.010405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:50.011681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:50.012588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:50.013452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lazy-loading 'fault' on Instance uuid b257d85c-da9c-40f1-807d-ff8540843166 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:49:50.080446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33b08a09efbf422088e565079d5a57f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0981bbc4fc0d4f60be8d878061281a00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:49:50.096791 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ba51a7e-dde0-4164-a3d0-37c93d9fa007 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 200 len: 1189 microversion: 2.1 time: 0.189545 Oct 17 13:49:50.097968 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3047/6080] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:49 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 1189 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:49:51.121727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:51.122348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] [instance: b257d85c-da9c-40f1-807d-ff8540843166] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:49:51.129690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.130181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.130624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.131337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:49:51.131932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:49:51.132364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:49:51.157993 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] HTTP exception thrown: Instance b257d85c-da9c-40f1-807d-ff8540843166 could not be found. Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Request method failure captured: Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 HTTP/1.1 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVyHgpS_sY1SkDSBBdGqvyCanwp0jeugBNj-HC8mA0gh43tvgQkCNQ9XwXuqpYbe4IHB0ZSqLmaehNs5p6XMK_yDPFMFu06cDvZYOTuoJjWQNYpF-OoBHetxNDfql_Ld8mIj-_qJ2A8Y0ajX3PlgQ866PT6pXziEbPRg9w3ShobufTI Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0981bbc4fc0d4f60be8d878061281a00 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBackupRestore-1303023975 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0981bbc4fc0d4f60be8d878061281a00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0981bbc4fc0d4f60be8d878061281a00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0981bbc4fc0d4f60be8d878061281a00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0981bbc4fc0d4f60be8d878061281a00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBackupRestore-1303023975 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0981bbc4fc0d4f60be8d878061281a00 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1303023975 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBackupRestore-1303023975-project Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 33b08a09efbf422088e565079d5a57f7 Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBackupRestore-1303023975-project Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance b257d85c-da9c-40f1-807d-ff8540843166 could not be found. Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'b257d85c-da9c-40f1-807d-ff8540843166'} Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b257d85c-da9c-40f1-807d-ff8540843166 could not be found. Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b257d85c-da9c-40f1-807d-ff8540843166 could not be found. Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:49:51.161626 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b257d85c-da9c-40f1-807d-ff8540843166 could not be found. Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Returning 404 to user: Instance b257d85c-da9c-40f1-807d-ff8540843166 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:49:51.167122 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a466350-ee21-4e31-a32a-362dac8aeb91 tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166" status: 404 len: 111 microversion: 2.1 time: 0.049204 Oct 17 13:49:51.169222 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3034/6081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:49:51 2022] GET /compute/v2.1/servers/b257d85c-da9c-40f1-807d-ff8540843166 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:49:51.375925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1560b602-1ff8-41fa-b95c-89651bb3156c tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] Calling method '.version_select at 0x7f41a1f17e50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:49:51.415697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1560b602-1ff8-41fa-b95c-89651bb3156c tempest-TestVolumeBackupRestore-1303023975 tempest-TestVolumeBackupRestore-1303023975-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1624597953" status: 202 len: 0 microversion: 2.1 time: 0.043536 Oct 17 13:49:51.416496 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3048/6082] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:49:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1624597953 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:03.093965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99f43e58-4f7f-4d90-83ac-df35c66c6704 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Action: 'create', calling method: .version_select at 0x7f41a1f94d30>, body: {"keypair": {"name": "tempest-keypair-1506634072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVHzti63hlPDGLpN8KEKVLggNG7K0WdeQzuwaZRhUzldSvrNUp5FQvHKYPsJ91AhxY3t5roV1izhj3VIOvd+ymJSUf9LT56B8awdm9jBnkqPcXpa+2M0ArEPLfLKypuWA=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:03.116683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:03.124328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:03.157565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-99f43e58-4f7f-4d90-83ac-df35c66c6704 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Getting quotas for project 89798cf615704cbeb708a397dbe1cc9c. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:03.170993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-99f43e58-4f7f-4d90-83ac-df35c66c6704 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Getting quotas for user dedc9e05ac2d4637b887bac06ba94650 and project 89798cf615704cbeb708a397dbe1cc9c. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:03.224153 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99f43e58-4f7f-4d90-83ac-df35c66c6704 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.134620 Oct 17 13:50:03.226678 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3035/6083] 10.222.0.65 () {62 vars in 1200 bytes} [Mon Oct 17 13:50:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 17 13:50:06.034272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1372708954", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8f544930-ba82-46f6-8892-8c4d262b6dff"}, {"port": "26826606-d636-4794-8c4d-a80622cff163", "tag": "port-1"}, {"port": "912bc59a-4c0f-4832-a36e-83886f7b8e93", "tag": "port-2"}, {"uuid": "0e587f1f-3246-4c2a-9252-ec56183153be", "tag": "net-1"}, {"uuid": "0e587f1f-3246-4c2a-9252-ec56183153be"}, {"uuid": "7f9758d8-de26-4ab9-88a2-e5428c808642", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7f9758d8-de26-4ab9-88a2-e5428c808642", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "ba17d886-2e73-47fb-8eae-5efe64d1a7a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e77d9c89-d205-4217-a3b1-686956c915c5", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "91c09b58-ac5d-4941-9135-f0557bd43e2b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--927648183"}], "key_name": "tempest-keypair-1506634072", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:06.063213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=34 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:06.064451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:06.331696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] validate_networks() for [('8f544930-ba82-46f6-8892-8c4d262b6dff', None, None, None, None, None), (None, None, '26826606-d636-4794-8c4d-a80622cff163', None, None, None), (None, None, '912bc59a-4c0f-4832-a36e-83886f7b8e93', None, None, None), ('0e587f1f-3246-4c2a-9252-ec56183153be', None, None, None, None, None), ('0e587f1f-3246-4c2a-9252-ec56183153be', None, None, None, None, None), ('7f9758d8-de26-4ab9-88a2-e5428c808642', '10.2.2.100', None, None, None, None), ('7f9758d8-de26-4ab9-88a2-e5428c808642', '10.2.2.200', None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:50:06.720247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:06.721511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:06.737528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:06.738437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:06.739995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:06.745630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:06.746660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:06.751924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:06.862364 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7298e3be-1683-4c89-a552-015a6224c020 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/ips" status: 200 len: 145 microversion: 2.1 time: 0.148656 Oct 17 13:50:06.863836 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3036/6084] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:50:06 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/ips => generated 145 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:09.625627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:50:09.625627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:50:09.625627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:50:09.625627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:50:09.625627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:50:09.643648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.644402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.644845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.645755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.646287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.647245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.667476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Getting quotas for project 89798cf615704cbeb708a397dbe1cc9c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:50:09.675684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Getting quotas for user dedc9e05ac2d4637b887bac06ba94650 and project 89798cf615704cbeb708a397dbe1cc9c. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:50:09.710709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7bec003-87e7-404b-aa52-d34fa86618b9"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:09.713083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:09.720961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.721763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.722213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.722932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:09.723389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:09.723995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:09.925704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:50:09.929465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='ba17d886-2e73-47fb-8eae-5efe64d1a7a3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e77d9c89-d205-4217-a3b1-686956c915c5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='91c09b58-ac5d-4941-9135-f0557bd43e2b',volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:50:10.296796 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d365e31-5e67-4c62-8031-f3290e93ca65 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.591338 Oct 17 13:50:10.304999 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3037/6085] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:50:09 2022] POST /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:10.405877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d47b8477-b281-4210-a904-7df0da10802b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.375867 Oct 17 13:50:10.408686 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3049/6086] 10.222.0.65 () {62 vars in 1189 bytes} [Mon Oct 17 13:50:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 4378 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 17 13:50:10.420460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c30fdc9-3d05-4f4d-b1f7-590f732354e2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:10.421601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c30fdc9-3d05-4f4d-b1f7-590f732354e2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:10.494218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c30fdc9-3d05-4f4d-b1f7-590f732354e2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.510787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c30fdc9-3d05-4f4d-b1f7-590f732354e2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.513487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c30fdc9-3d05-4f4d-b1f7-590f732354e2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:10.517953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c30fdc9-3d05-4f4d-b1f7-590f732354e2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1286 microversion: 2.42 time: 0.099695 Oct 17 13:50:10.523898 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3038/6087] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:10 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:11.546562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47d3fea2-2baa-4109-937b-191e3ca2a414 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:11.547204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47d3fea2-2baa-4109-937b-191e3ca2a414 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:11.850870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47d3fea2-2baa-4109-937b-191e3ca2a414 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:11.860569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47d3fea2-2baa-4109-937b-191e3ca2a414 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:11.866186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47d3fea2-2baa-4109-937b-191e3ca2a414 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:11.867444 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47d3fea2-2baa-4109-937b-191e3ca2a414 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1286 microversion: 2.42 time: 0.325147 Oct 17 13:50:11.877979 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3050/6088] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:11 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1286 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:12.899728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:12.900946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:12.921209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.921970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.922615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:12.923527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:12.924173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:12.924775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:13.031453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:13.041490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:13.050023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:13.051363 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aaf19040-92b2-4e8d-bfcd-ce349f5d20fe tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1576 microversion: 2.42 time: 0.157803 Oct 17 13:50:13.054698 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3039/6089] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:12 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:14.082295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:14.083107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:14.093889 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.099174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.100415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.102293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:14.104843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:14.105875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:14.814265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.826512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.831585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:14.833604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ccf880c2-3183-4caf-b3ee-96fcef5a2e78 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1594 microversion: 2.42 time: 0.755444 Oct 17 13:50:14.867249 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3051/6090] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:14 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1594 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:15.872285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:15.873013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:15.886744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.890224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.891117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:15.892432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:15.897700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:15.898877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:16.360669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:16.377648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:16.390870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:16.393523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-460cf39f-662a-4365-ac9f-b799c900c536 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1661 microversion: 2.42 time: 0.526256 Oct 17 13:50:16.396297 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3040/6091] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:15 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1661 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:17.432638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:17.434037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:17.442812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.443836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.444586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.445858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:17.447460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:17.448419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:17.973430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:17.993321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:17.995099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:17.996656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a092b68-f922-41c3-a815-ec7504e53a17 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1707 microversion: 2.42 time: 0.570199 Oct 17 13:50:17.997820 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3052/6092] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:17 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1707 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:19.024784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:19.025796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:19.039227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.042504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.043763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.046671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:19.047427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:19.049727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:19.284098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:19.296290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:19.298170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:19.299629 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db4bb281-c99f-4090-b2ac-939005b4137e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1753 microversion: 2.42 time: 0.279446 Oct 17 13:50:19.314195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3041/6093] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:19 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1753 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:20.332001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:20.332655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:20.344107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:20.348760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:20.357593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:20.360613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:20.362361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:20.371435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:20.372926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:21.038054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:21.057817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:21.059415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:21.066705 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-04463ad3-abb4-42ff-a50c-433d4d9d8b7e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1799 microversion: 2.42 time: 0.742812 Oct 17 13:50:21.085415 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3053/6094] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:20 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1799 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:22.062987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e5698b03-f48c-48e4-9e0f-06eee10430f0 req-a76c97ec-9f3f-4d13-8b84-e6bf37b968e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "99643dd1-fc6e-48a6-9634-d8c672f748e0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:22.072705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:22.095592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e5698b03-f48c-48e4-9e0f-06eee10430f0 req-a76c97ec-9f3f-4d13-8b84-e6bf37b968e5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:22.098122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e5698b03-f48c-48e4-9e0f-06eee10430f0 req-a76c97ec-9f3f-4d13-8b84-e6bf37b968e5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:22.098911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e5698b03-f48c-48e4-9e0f-06eee10430f0 req-a76c97ec-9f3f-4d13-8b84-e6bf37b968e5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:22.099673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:22.101213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:22.108912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:22.121373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:22.122263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:22.123063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:22.124281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:22.125104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:22.125580 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e5698b03-f48c-48e4-9e0f-06eee10430f0 req-a76c97ec-9f3f-4d13-8b84-e6bf37b968e5 service nova] Creating event network-changed:99643dd1-fc6e-48a6-9634-d8c672f748e0 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:22.126149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:22.143532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e5698b03-f48c-48e4-9e0f-06eee10430f0 req-a76c97ec-9f3f-4d13-8b84-e6bf37b968e5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082816 Oct 17 13:50:22.148300 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3042/6095] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:22.658374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:22.672521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:22.675019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:22.676511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57f12963-d44e-4fd3-a5dc-b755478ce69d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1845 microversion: 2.42 time: 0.581367 Oct 17 13:50:22.701745 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3054/6096] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:22 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1845 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:23.709476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:23.711344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:23.739320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.742422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.744064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:23.751677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:23.752350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:23.754033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.186147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7b6f1f61-a2ed-4463-adec-453c8720290d req-a8d7cdf9-de66-4710-a42a-1735512262ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "26826606-d636-4794-8c4d-a80622cff163"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:24.198453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7b6f1f61-a2ed-4463-adec-453c8720290d req-a8d7cdf9-de66-4710-a42a-1735512262ff service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:24.198972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7b6f1f61-a2ed-4463-adec-453c8720290d req-a8d7cdf9-de66-4710-a42a-1735512262ff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:24.199413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7b6f1f61-a2ed-4463-adec-453c8720290d req-a8d7cdf9-de66-4710-a42a-1735512262ff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:24.207223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:24.221989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:24.223471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:24.224848 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98c41328-f49c-4043-85fe-cdff7c009f95 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1866 microversion: 2.42 time: 0.522598 Oct 17 13:50:24.229930 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7b6f1f61-a2ed-4463-adec-453c8720290d req-a8d7cdf9-de66-4710-a42a-1735512262ff service nova] Creating event network-changed:26826606-d636-4794-8c4d-a80622cff163 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:24.235143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3043/6097] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:23 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1866 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:24.237084 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7b6f1f61-a2ed-4463-adec-453c8720290d req-a8d7cdf9-de66-4710-a42a-1735512262ff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054647 Oct 17 13:50:24.237874 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3055/6098] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:25.273263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:25.274914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:25.284032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:25.285355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:25.286675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:25.288316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:25.289096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:25.290093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:25.757948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:25.768391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:25.772560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:25.776940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d72faf9-5859-434d-8a68-1c9ba14894b2 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.509879 Oct 17 13:50:25.786464 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3044/6099] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:25 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:26.304816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f7b4df78-7ac4-4294-b197-d4c660ddd225 req-e36bb87a-5819-4c55-bd42-02b814d4d30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "912bc59a-4c0f-4832-a36e-83886f7b8e93"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:26.323195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f7b4df78-7ac4-4294-b197-d4c660ddd225 req-e36bb87a-5819-4c55-bd42-02b814d4d30d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.324310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f7b4df78-7ac4-4294-b197-d4c660ddd225 req-e36bb87a-5819-4c55-bd42-02b814d4d30d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.325480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f7b4df78-7ac4-4294-b197-d4c660ddd225 req-e36bb87a-5819-4c55-bd42-02b814d4d30d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.346471 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f7b4df78-7ac4-4294-b197-d4c660ddd225 req-e36bb87a-5819-4c55-bd42-02b814d4d30d service nova] Creating event network-changed:912bc59a-4c0f-4832-a36e-83886f7b8e93 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:26.353223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f7b4df78-7ac4-4294-b197-d4c660ddd225 req-e36bb87a-5819-4c55-bd42-02b814d4d30d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053730 Oct 17 13:50:26.354515 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3056/6100] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:26.805669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:26.806278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:26.825493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.826020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.826485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:26.830455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:26.841475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:26.842021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:27.371942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:27.385666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:27.387395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:27.390519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3c9e763-0a08-4f1c-a8a9-95063d3774e8 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.589312 Oct 17 13:50:27.398564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3045/6101] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:26 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:28.403114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "9069783b-8fb3-49b9-bb71-6253888a56ec"}, {"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "d5658839-16bb-481c-9660-53c64df97628"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:28.429588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:28.430995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:28.433931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.435982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.437079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.443717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.444606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.445285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.446350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:28.446994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:28.447724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:28.480460 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] Creating event network-changed:9069783b-8fb3-49b9-bb71-6253888a56ec for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:28.480992 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] Creating event network-changed:d5658839-16bb-481c-9660-53c64df97628 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:28.496140 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-36a6a442-0202-4a39-a3ca-1a6e626a1357 req-94cb34bf-4b25-4acc-99c6-a7b762846573 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099656 Oct 17 13:50:28.499036 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3057/6102] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:29.141643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:29.158794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:29.171220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:29.172873 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92b06b8b-fd2e-4fac-a1ff-76d44b4ca52f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.750042 Oct 17 13:50:29.174067 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3046/6103] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:28 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:29.350646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:29.353681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:29.364893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.366569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.381646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.382627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.383435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.383987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.438882 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6a896f0-11f5-424c-8de5-3c612949f04d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099769 Oct 17 13:50:29.446960 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3058/6104] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:29 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:29.453244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:29.455319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:29.466964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.467873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.468553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.469763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:29.471727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:29.472461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:29.518713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-548fe5bb-8d72-4ff0-b1f6-62d87d39f09b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/e7bec003-87e7-404b-aa52-d34fa86618b9" status: 200 len: 194 microversion: 2.1 time: 0.071133 Oct 17 13:50:29.519676 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3047/6105] 10.222.0.65 () {58 vars in 1413 bytes} [Mon Oct 17 13:50:29 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/e7bec003-87e7-404b-aa52-d34fa86618b9 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:30.204301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:30.205290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:30.222863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.223808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.226620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.227918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.230243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.231736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.560432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6158f3d3-71ce-45e5-ade1-4065973d5d9c req-0ca8103c-4529-4bac-9f63-a9f6d3da1b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "fdee7579-931a-473e-b96c-29739087492b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:30.605889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6158f3d3-71ce-45e5-ade1-4065973d5d9c req-0ca8103c-4529-4bac-9f63-a9f6d3da1b2b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:30.606357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6158f3d3-71ce-45e5-ade1-4065973d5d9c req-0ca8103c-4529-4bac-9f63-a9f6d3da1b2b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:30.611885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6158f3d3-71ce-45e5-ade1-4065973d5d9c req-0ca8103c-4529-4bac-9f63-a9f6d3da1b2b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:30.643156 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6158f3d3-71ce-45e5-ade1-4065973d5d9c req-0ca8103c-4529-4bac-9f63-a9f6d3da1b2b service nova] Creating event network-changed:fdee7579-931a-473e-b96c-29739087492b for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:30.650163 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6158f3d3-71ce-45e5-ade1-4065973d5d9c req-0ca8103c-4529-4bac-9f63-a9f6d3da1b2b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093696 Oct 17 13:50:30.651175 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3048/6106] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:30.890892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:30.916627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:30.918627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:30.922640 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ecdb5b3-5793-477b-863f-642e9a935f8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.722728 Oct 17 13:50:30.926637 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3059/6107] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:30 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:50:31.955482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:31.956197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:31.973729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:31.974296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:31.974752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:31.975507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:31.976088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:31.976723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.150897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d7bb26c-001d-4e76-b0b9-c345d54e38f6"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:32.154524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:32.162520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.163433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.164106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.165232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.166202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.166835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.433513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:32.448691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:32.454759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:32.455991 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8966b846-1dfa-4187-a5a0-52fd6a3af304 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.504841 Oct 17 13:50:32.469186 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3049/6108] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:31 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:32.569133 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c8fe17b-21b2-4b37-bfaf-52d7c73a3b3c tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "POST /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.421367 Oct 17 13:50:32.570538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3060/6109] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:50:32 2022] POST /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:32.698071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-73ed2a73-8d3f-43e9-af86-0717c0d61fe2 req-2e289687-f7ad-4b2c-9699-8949984f2209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "e5a102b4-b665-4bce-9306-7587ad11f039"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:50:32.715969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-73ed2a73-8d3f-43e9-af86-0717c0d61fe2 req-2e289687-f7ad-4b2c-9699-8949984f2209 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:32.716752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-73ed2a73-8d3f-43e9-af86-0717c0d61fe2 req-2e289687-f7ad-4b2c-9699-8949984f2209 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:32.721148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-73ed2a73-8d3f-43e9-af86-0717c0d61fe2 req-2e289687-f7ad-4b2c-9699-8949984f2209 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:32.749291 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-73ed2a73-8d3f-43e9-af86-0717c0d61fe2 req-2e289687-f7ad-4b2c-9699-8949984f2209 service nova] Creating event network-changed:e5a102b4-b665-4bce-9306-7587ad11f039 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:50:32.758399 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-73ed2a73-8d3f-43e9-af86-0717c0d61fe2 req-2e289687-f7ad-4b2c-9699-8949984f2209 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063411 Oct 17 13:50:32.760389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3050/6110] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:33.486617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:33.488039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:33.496838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.497655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.498308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.499202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:33.499832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:33.500431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:33.962279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:33.973926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:33.975948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:33.978040 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b1d3bd2-fd4c-4398-a37c-4a96042ddea5 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.498035 Oct 17 13:50:33.995426 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3061/6111] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:33 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:35.008683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:35.010221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:35.012826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:35.025217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.029465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.032060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.033086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:35.035468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:35.038107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:35.091917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:35.475709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:35.490299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:35.492371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:35.494792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7dc8c75-6b82-4c24-8dd9-572ea08b2a39 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.492212 Oct 17 13:50:35.496840 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3051/6112] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:35 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:36.534572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:36.535236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:36.547843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:36.553613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:36.556650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:36.557934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:36.559703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:36.561652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:36.563657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:36.572126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:50:36.940282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:36.950820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:36.952460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:36.954088 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d78e7a0e-f588-4855-a217-889575f0c5f6 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.433336 Oct 17 13:50:36.969614 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3062/6113] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:36 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:37.983577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:37.984835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:37.995810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.996646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.997338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:37.998259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:37.998934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:37.999978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:38.227901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.238113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.240301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:38.242398 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bdf71d0-f474-4faa-bb27-6868917134d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.264094 Oct 17 13:50:38.255212 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3052/6114] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:37 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:39.269534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:39.270949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:39.278325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.279094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.279704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.280573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:39.281211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:39.281801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:39.625311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:39.638907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:39.647216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:39.650132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af0b0817-ddf1-4641-8a7f-ab1dae9635db tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.384582 Oct 17 13:50:39.652061 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3063/6115] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:39 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:40.676136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:40.676754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:40.684048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.684591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.685039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:40.685829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:40.686286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:40.686767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:41.001438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:41.013879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:41.015346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:41.016524 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2eb0a5a-26b8-4d10-85d3-80b76e9ebf80 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.344444 Oct 17 13:50:41.017099 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3053/6116] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:40 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:42.044038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:42.044815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:42.055279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.056049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.056690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.057630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:42.058302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:42.058801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:42.301843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:42.313448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:42.314980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:42.316397 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2689ca6f-6e94-4c2b-a903-2e71ec2b942e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.277519 Oct 17 13:50:42.316970 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3064/6117] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:42 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:50:43.344159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:43.345527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:43.356349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.357187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.357817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.359353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:43.359983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:43.360598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:43.570520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:43.581948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:43.585555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:43.589995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-824678df-35cc-486d-ac62-adf4e6282966 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1887 microversion: 2.42 time: 0.247252 Oct 17 13:50:43.601897 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3054/6118] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:43 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1887 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:44.619207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:44.619803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:44.635290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:44.636579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:44.637672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:44.639040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:44.639735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:44.643359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:44.892521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:44.912594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:44.914403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:44.915976 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-030ca19c-0117-4282-8808-cc2550d9c683 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.301813 Oct 17 13:50:44.916547 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3065/6119] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:44 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:45.952388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:45.953479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:45.965932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:45.967288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:45.968181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:45.969135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:45.969827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:45.970505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:46.325550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:46.350218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:46.352174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:46.355603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7546f7bc-0b78-41be-ae66-9dbe92a7a808 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.409161 Oct 17 13:50:46.370678 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3055/6120] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:45 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:47.386389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:47.386997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:47.394614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:47.395509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:47.396057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:47.397101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:47.397775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:47.398210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:48.058294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.069473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.071000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:48.072754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-584ac899-0227-4ed9-a7a2-9de20b5db20d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.690061 Oct 17 13:50:48.073172 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3066/6121] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:47 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:49.099267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:49.100485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:49.109981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.111208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.111643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.112651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:49.113107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:49.113564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:49.425636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:49.444054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:49.446142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:49.447631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3b0c282-7d85-45c2-91fa-58879bb9f759 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.352757 Oct 17 13:50:49.448973 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3056/6122] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:49 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:50.473863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:50.474964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:50.494244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.494862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.495336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.496264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:50.496855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:50.497394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:50.725528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.738896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.741371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:50.742558 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7b7a29c-304f-4722-b35c-3f55509c5e69 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.272838 Oct 17 13:50:50.743130 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3067/6123] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:50 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:51.587848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.591519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.602557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.604609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.605798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.607136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.609870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.610726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.669752 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9cfc648-4b36-4db9-a26f-f1df834c5966 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.090148 Oct 17 13:50:51.670814 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3057/6124] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:50:51 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:50:51.771131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.771731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.781493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.782292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.782935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.783873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.784527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.785186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.820557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.821395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.828109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.833416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.834425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.837044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.837663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.844149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.908912 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb5d3681-5a30-4183-b8c4-e5105efa31ef tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/e7bec003-87e7-404b-aa52-d34fa86618b9" status: 200 len: 194 microversion: 2.1 time: 0.092718 Oct 17 13:50:51.910239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3058/6125] 10.222.0.65 () {58 vars in 1413 bytes} [Mon Oct 17 13:50:51 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/e7bec003-87e7-404b-aa52-d34fa86618b9 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:51.932589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:51.934804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:51.948168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.949743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.950864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:51.952394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:51.953816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:51.959920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:52.057306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lazy-loading 'services' on Instance uuid 04063868-1c30-440b-973e-0e073bd334c9 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:50:52.090117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:52.101636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:52.105003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:52.106509 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-134c688a-3e4e-4478-b6ef-7fd01e3b58ef tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.339374 Oct 17 13:50:52.107077 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3068/6126] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:51 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:52.171953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2202f99-9e62-4fb9-82a8-79819fe5891b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/e7bec003-87e7-404b-aa52-d34fa86618b9" status: 202 len: 0 microversion: 2.1 time: 0.250577 Oct 17 13:50:52.173481 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3059/6127] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:50:51 2022] DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/e7bec003-87e7-404b-aa52-d34fa86618b9 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:53.132801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:53.133444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:53.143773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:53.144790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:53.145850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:53.147439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:53.148364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:53.149120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:53.451373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:53.470418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:53.472771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:53.474222 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce0e5a8d-3742-4cce-bf6a-c4c2cf8915d4 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.345965 Oct 17 13:50:53.476351 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3069/6128] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:53 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:54.510924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:54.511630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:54.524878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.525674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.526286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.527162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:54.527785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:54.528380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:54.770103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.780619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.782128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:54.783304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b1d1b972-271b-49f8-8461-8945b8e2aa7c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.277858 Oct 17 13:50:54.789779 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3060/6129] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:54 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:55.812515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:55.813795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:55.829933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.831618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.834868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:55.839539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:55.841670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:55.843110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.215417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:56.231598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:56.235559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:56.237633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c91be86-53f6-4cf5-ae9a-8ecae17b2f08 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.429752 Oct 17 13:50:56.239140 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3070/6130] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:55 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:56.494080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:56.494694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:56.505032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.508531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.509953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.510883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.518096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.518873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.551069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:50:56.714111 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8053403c-bb30-4920-a3f3-c6958a19e30d tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 204 len: 0 microversion: 2.1 time: 0.668167 Oct 17 13:50:56.715082 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3061/6131] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:50:56 2022] DELETE /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:50:56.726525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:56.727555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:56.739324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.742079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.742079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:56.742993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:56.743979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:56.744851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.026242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:57.040940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc23cd31-2725-4e5a-998f-2db149c2db43 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1733 microversion: 2.1 time: 0.318624 Oct 17 13:50:57.041908 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3071/6132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:56 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:57.276118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:57.277353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:57.287718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.288655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.289387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.290428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:57.291534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:57.292211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:57.676390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:57.688960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:57.690479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:57.691709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5230f73-5690-481e-9abc-4d803ba4fa8e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.424818 Oct 17 13:50:57.728648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3062/6133] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:57 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:58.070171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:58.070837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:58.085309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.085808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.089106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.089106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.089106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.089106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.573546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:58.587896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-123db631-0dce-471c-8907-b954ddb58be8 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1733 microversion: 2.1 time: 0.523620 Oct 17 13:50:58.630752 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3072/6134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:58 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1733 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:50:58.727881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:58.727881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:58.747120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.748050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.748561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.749444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.750103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.750701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.863173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:58.864291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:58.871878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.872921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.873905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.874909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.875630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.876360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.915832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-130011c7-0629-4a7e-86d4-d2c8c61bf7f2 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/4d7bb26c-001d-4e76-b0b9-c345d54e38f6" status: 200 len: 194 microversion: 2.1 time: 0.057761 Oct 17 13:50:58.918069 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3073/6135] 10.222.0.65 () {58 vars in 1413 bytes} [Mon Oct 17 13:50:58 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/4d7bb26c-001d-4e76-b0b9-c345d54e38f6 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:50:58.935387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:58.936239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:58.944893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.945804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.946415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:58.947359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:58.948029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:58.948893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.052592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lazy-loading 'services' on Instance uuid 04063868-1c30-440b-973e-0e073bd334c9 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:50:59.153646 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af8ab4c8-e78d-474b-ac1f-09bc2e30d8cc tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/4d7bb26c-001d-4e76-b0b9-c345d54e38f6" status: 202 len: 0 microversion: 2.1 time: 0.226428 Oct 17 13:50:59.155655 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3074/6136] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:50:58 2022] DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments/4d7bb26c-001d-4e76-b0b9-c345d54e38f6 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:50:59.238767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:59.250965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:59.252779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:59.254031 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74df9b91-3bac-4c78-b500-c4f367bada4b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.533190 Oct 17 13:50:59.254593 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3063/6137] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:50:58 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:50:59.627698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:50:59.630577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:50:59.643023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.644480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.645419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.653632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:50:59.654442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:50:59.654728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:50:59.857055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:50:59.873027 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d00c1a1a-2df0-4c68-93ba-19002849f559 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1665 microversion: 2.1 time: 0.251822 Oct 17 13:50:59.874516 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3075/6138] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:50:59 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1665 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:00.165010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c9588905-cb5e-45cb-a31a-6dee1723acd7 req-f6c7456c-cb80-4ea7-a633-0978099461a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29d3718-627f-47f1-a395-e92eae7b0052", "name": "network-vif-deleted", "tag": "851b86de-8e93-4fd3-af4a-015d741c6c73"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:00.201014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9588905-cb5e-45cb-a31a-6dee1723acd7 req-f6c7456c-cb80-4ea7-a633-0978099461a9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.201543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9588905-cb5e-45cb-a31a-6dee1723acd7 req-f6c7456c-cb80-4ea7-a633-0978099461a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.201988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c9588905-cb5e-45cb-a31a-6dee1723acd7 req-f6c7456c-cb80-4ea7-a633-0978099461a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.239775 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c9588905-cb5e-45cb-a31a-6dee1723acd7 req-f6c7456c-cb80-4ea7-a633-0978099461a9 service nova] Creating event network-vif-deleted:851b86de-8e93-4fd3-af4a-015d741c6c73 for instance c29d3718-627f-47f1-a395-e92eae7b0052 on n-h1-854121-14 Oct 17 13:51:00.252860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c9588905-cb5e-45cb-a31a-6dee1723acd7 req-f6c7456c-cb80-4ea7-a633-0978099461a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090816 Oct 17 13:51:00.255041 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3064/6139] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:00.281852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:00.282475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:00.309819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.314839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.323797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.330620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.331604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.332506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.744259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:00.769324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:00.772325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:00.790054 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19d32799-76a1-4dc0-af98-bb92f79f2c5f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.496438 Oct 17 13:51:00.791139 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3076/6140] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:00 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:00.900425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:00.901134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:00.911418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.922055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.922550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.923380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.923850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.924287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.990278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:00.991393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:00.992141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:00.992781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lazy-loading 'fault' on Instance uuid c29d3718-627f-47f1-a395-e92eae7b0052 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:01.118758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e768147e4f4d41d4bccd484e6c141eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57b423ee5c844b1ca55ee3995fe0bf1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:01.121407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:01.133579 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-615b6140-66a3-43b7-a69d-e3eb1c0ba50b tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 200 len: 1388 microversion: 2.1 time: 0.237414 Oct 17 13:51:01.149749 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3065/6141] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:00 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 1388 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:01.821468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:01.822743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:01.838260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.838772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.841920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:01.842807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:01.843293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:01.845796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:02.158901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:02.159633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:02.182274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:02.182785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:02.183228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:02.184112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:02.185685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:02.186149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:02.205003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:02.219744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:02.223988 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] HTTP exception thrown: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:02.227056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:02.229829 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-622f130b-6932-48c6-a359-dc5ab26d8f68 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.412957 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Request method failure captured: Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 HTTP/1.1 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVyCD-lYXIvzmSgtoK2GuYYJTr3CbosU8rB8AKmQbKJsM3ij8YPrlkg_Tm5nQBcQw6YbSaV65KsfJJPixFrd0XxLTClEvqIby2HPR5IpNPISZDRlreg5qYD9wmfW7bhQfTiak-8B9zXEdXc_J9gZBPvWn-0QlKo87CY3Tcxt4O_nHas Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 57b423ee5c844b1ca55ee3995fe0bf1d Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestServerBasicOps-619294972 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestServerBasicOps-619294972 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 57b423ee5c844b1ca55ee3995fe0bf1d Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestServerBasicOps-619294972 Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestServerBasicOps-619294972-project Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e768147e4f4d41d4bccd484e6c141eac Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestServerBasicOps-619294972-project Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c29d3718-627f-47f1-a395-e92eae7b0052'} Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:02.230208 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Returning 404 to user: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e0c5a84d-9f6d-4e72-9206-6af42ff0a5b9 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 404 len: 111 microversion: 2.1 time: 0.077552 Oct 17 13:51:02.235608 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3066/6142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:02 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:02.247891 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3077/6143] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:01 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:03.164052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.164662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:03.179896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.180408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.180854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.181820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.182454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.183051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.211250 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] HTTP exception thrown: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Request method failure captured: Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 HTTP/1.1 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVyCD-lYXIvzmSgtoK2GuYYJTr3CbosU8rB8AKmQbKJsM3ij8YPrlkg_Tm5nQBcQw6YbSaV65KsfJJPixFrd0XxLTClEvqIby2HPR5IpNPISZDRlreg5qYD9wmfW7bhQfTiak-8B9zXEdXc_J9gZBPvWn-0QlKo87CY3Tcxt4O_nHas Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 57b423ee5c844b1ca55ee3995fe0bf1d Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestServerBasicOps-619294972 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestServerBasicOps-619294972 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 57b423ee5c844b1ca55ee3995fe0bf1d Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestServerBasicOps-619294972 Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestServerBasicOps-619294972-project Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e768147e4f4d41d4bccd484e6c141eac Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestServerBasicOps-619294972-project Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c29d3718-627f-47f1-a395-e92eae7b0052'} Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:03.218277 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Returning 404 to user: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:03.223696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce51e31c-ba26-4210-b2f0-0b7c32a8c46f tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 404 len: 111 microversion: 2.1 time: 0.060360 Oct 17 13:51:03.226693 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3067/6144] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:03 2022] DELETE /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:03.231516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.232141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] [instance: c29d3718-627f-47f1-a395-e92eae7b0052] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:03.248107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.248632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.249082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.249864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.250324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.250757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.256844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:03.280142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.280933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:03.282296 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] HTTP exception thrown: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.290401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.290898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.291353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.292070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:03.292525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:03.292951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Request method failure captured: Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 HTTP/1.1 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVyCD-lYXIvzmSgtoK2GuYYJTr3CbosU8rB8AKmQbKJsM3ij8YPrlkg_Tm5nQBcQw6YbSaV65KsfJJPixFrd0XxLTClEvqIby2HPR5IpNPISZDRlreg5qYD9wmfW7bhQfTiak-8B9zXEdXc_J9gZBPvWn-0QlKo87CY3Tcxt4O_nHas Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 57b423ee5c844b1ca55ee3995fe0bf1d Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestServerBasicOps-619294972 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_57b423ee5c844b1ca55ee3995fe0bf1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestServerBasicOps-619294972 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 57b423ee5c844b1ca55ee3995fe0bf1d Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestServerBasicOps-619294972 Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestServerBasicOps-619294972-project Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: e768147e4f4d41d4bccd484e6c141eac Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestServerBasicOps-619294972-project Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'c29d3718-627f-47f1-a395-e92eae7b0052'} Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:03.293105 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. Oct 17 13:51:03.299391 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:03.304307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Returning 404 to user: Instance c29d3718-627f-47f1-a395-e92eae7b0052 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:03.305458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c9bc205f-63d9-487f-a71d-f9b4ef628737 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052" status: 404 len: 111 microversion: 2.1 time: 0.077908 Oct 17 13:51:03.310490 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3078/6145] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:03 2022] GET /compute/v2.1/servers/c29d3718-627f-47f1-a395-e92eae7b0052 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:03.618660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a8b5113-2b69-43cc-9f05-be90624c4965 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] Calling method '.version_select at 0x7f419e5bf430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:03.635993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:03.670883 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a8b5113-2b69-43cc-9f05-be90624c4965 tempest-TestServerBasicOps-619294972 tempest-TestServerBasicOps-619294972-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1906118660" status: 202 len: 0 microversion: 2.1 time: 0.054904 Oct 17 13:51:03.672454 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3079/6146] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Oct 17 13:51:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1906118660 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:03.683106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:03.692289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:03.694763 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f759c1b-0f85-4bc4-bff4-0c0134e42e35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.418773 Oct 17 13:51:03.706503 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3068/6147] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:03 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:04.728963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:04.729669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:04.763746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.764210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.764662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:04.765415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:04.790963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:04.791429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:05.481279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.495954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.497472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:05.498710 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93721387-1b63-4ad0-bd33-bceaa7af4724 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.777356 Oct 17 13:51:05.511031 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3080/6148] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:04 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:06.541718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:06.542335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:06.549872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:06.561349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.561953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.562413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:06.563220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:06.563689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:06.565501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.377995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:07.381555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:07.423312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:07.432644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:07.449822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.451784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.452594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.453602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.453734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:07.454549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.455217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.455616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:07.460955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5191cc7c-56d0-4dbf-87b5-9c8e91b1a27a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.922603 Oct 17 13:51:07.461937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3069/6149] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:06 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:07.542191 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49e24ffe-6a6d-407b-8054-2b194c4e156b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.179116 Oct 17 13:51:07.544465 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3081/6150] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:51:07 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments => generated 25 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 17 13:51:07.761557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:07.764086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:07.782624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.783126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.783572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.784283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.788435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.789393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.831559 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-895052db-b6a2-4ceb-894d-466aa0b0a878 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074049 Oct 17 13:51:07.832961 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3070/6151] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 13:51:07 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:51:07.923894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:07.924348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:07.938346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.939157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.940130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.941142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:07.941880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:07.942562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:07.982382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:51:08.123413 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-460c75c9-2998-4a6c-bf09-191ba3994259 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 204 len: 0 microversion: 2.1 time: 0.203179 Oct 17 13:51:08.127862 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3082/6152] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:07 2022] DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:51:08.133441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:08.134065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:08.154314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.154961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.155410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.156174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.156617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.157045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.497328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:08.498983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:08.518531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.522523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.526449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.529851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:08.530854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:08.533692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:08.590815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:08.600221 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d077ec9-ddcd-48b6-ab48-e69c1c921c41 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1673 microversion: 2.1 time: 0.471013 Oct 17 13:51:08.601063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3071/6153] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:08 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1673 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:09.090206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.109291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.115428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:09.123261 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-acb180c0-cfee-46b4-88b9-341a029aa57c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.634295 Oct 17 13:51:09.124320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3083/6154] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:08 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:09.629151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:09.630650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:09.648272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.649308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.651508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:09.654458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:09.657318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:09.657984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.154144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:10.155304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:10.174262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:10.175134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:10.175767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.176701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:10.177372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:10.178018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:10.606559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:10.637299 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bea7a26-fbf4-4dcf-84a4-767bc123ba15 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1673 microversion: 2.1 time: 1.011930 Oct 17 13:51:10.640132 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3072/6155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:09 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1673 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:11.043173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:11.062603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:11.064205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:11.065568 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96313e65-f159-4e30-b7c4-58734d77fa71 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.916847 Oct 17 13:51:11.085778 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3084/6156] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:10 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:51:11.665538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:11.666186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:11.677277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.678587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.679239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.679970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:11.680427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:11.680851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:11.857231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:11.883308 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53028fe8-75b5-4407-aed5-cf4f1061a1bb tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1605 microversion: 2.1 time: 0.219721 Oct 17 13:51:11.885637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3073/6157] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:11 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1605 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:12.105844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:12.106638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:12.123323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.124180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.125224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.125961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.129477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.130608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.325244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3eed9776-aa4c-4686-9de0-7596b5cf35cf req-cfb87f01-2fc4-4282-b1c4-b08b328d1bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04063868-1c30-440b-973e-0e073bd334c9", "name": "network-vif-deleted", "tag": "bbbf139a-7495-4959-915c-7d5217d8c0d6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:12.366468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3eed9776-aa4c-4686-9de0-7596b5cf35cf req-cfb87f01-2fc4-4282-b1c4-b08b328d1bc1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.367528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3eed9776-aa4c-4686-9de0-7596b5cf35cf req-cfb87f01-2fc4-4282-b1c4-b08b328d1bc1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.370916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3eed9776-aa4c-4686-9de0-7596b5cf35cf req-cfb87f01-2fc4-4282-b1c4-b08b328d1bc1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.392112 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3eed9776-aa4c-4686-9de0-7596b5cf35cf req-cfb87f01-2fc4-4282-b1c4-b08b328d1bc1 service nova] Creating event network-vif-deleted:bbbf139a-7495-4959-915c-7d5217d8c0d6 for instance 04063868-1c30-440b-973e-0e073bd334c9 on n-h2-854121-14 Oct 17 13:51:12.399768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3eed9776-aa4c-4686-9de0-7596b5cf35cf req-cfb87f01-2fc4-4282-b1c4-b08b328d1bc1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081481 Oct 17 13:51:12.401544 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3074/6158] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:12.554023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:12.566671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:12.569790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:12.571377 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4626eb79-ad0b-49e8-83b0-5eb1791498c9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.470965 Oct 17 13:51:12.572537 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3085/6159] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:12 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:12.910459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:12.911819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:12.925331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.927257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.928477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:12.929294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:12.930743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:12.931245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.019404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.020114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.022685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.023318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lazy-loading 'fault' on Instance uuid 04063868-1c30-440b-973e-0e073bd334c9 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:51:13.136921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '766c87ff085742f194e4fb7782852b96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e533d02cf24801ab74f5cfe7e68394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:13.152284 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc52bc09-1ca8-48b6-b112-20c9c635e3b3 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 200 len: 1327 microversion: 2.1 time: 0.246826 Oct 17 13:51:13.168391 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3075/6160] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:12 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 1327 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:51:13.598561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:13.599175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:13.630395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.631940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.645117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:13.647499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:13.648324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:13.648770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.136113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:14.158346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:14.160068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:14.161017 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c0f8acb-469d-49c5-acbd-e768e38f2a62 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.566434 Oct 17 13:51:14.178101 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3086/6161] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:13 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:14.199316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:14.200257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:14.232093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.232601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.233053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.238169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:14.238672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:14.239126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:14.287935 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] HTTP exception thrown: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Request method failure captured: Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 HTTP/1.1 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVxr-aL_Kn9AZHyVVPxc__0I1Lxq6WsBUvn7yGD804VH66iYPJnA3WHxvlWocb36tHMDZF2uC9AupBD1L51fs5VJxK1xhppt4v7XRs28-XBD9DlGCTJK0PJKr8HHR4H_dRFnPlrLsNADTZWFZuvdPM9CLR0yUEZ74N0gQsd8GJNKhEo Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 766c87ff085742f194e4fb7782852b96 Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '04063868-1c30-440b-973e-0e073bd334c9'} Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:14.289884 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Returning 404 to user: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e550e30e-7d91-4df9-85a1-86cde380082a tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 404 len: 111 microversion: 2.1 time: 0.100806 Oct 17 13:51:14.292833 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3076/6162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:14 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:14.301485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca42257c-7c02-4a5a-8b06-8572da0de364 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '.version_select at 0x7f419de971f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:14.330434 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca42257c-7c02-4a5a-8b06-8572da0de364 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429168511" status: 202 len: 0 microversion: 2.1 time: 0.032908 Oct 17 13:51:14.331812 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3087/6163] 10.222.0.65 () {58 vars in 1218 bytes} [Mon Oct 17 13:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429168511 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:15.167678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-557c1278-0b52-40f4-8a0c-d0e8ad071c0c req-10aebae2-443d-4461-bb98-4d5d2e22805d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "e5a102b4-b665-4bce-9306-7587ad11f039"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:15.197614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:15.198797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:15.201540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-557c1278-0b52-40f4-8a0c-d0e8ad071c0c req-10aebae2-443d-4461-bb98-4d5d2e22805d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:15.202034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-557c1278-0b52-40f4-8a0c-d0e8ad071c0c req-10aebae2-443d-4461-bb98-4d5d2e22805d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:15.202468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-557c1278-0b52-40f4-8a0c-d0e8ad071c0c req-10aebae2-443d-4461-bb98-4d5d2e22805d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.212024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:15.217496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:15.218155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.219052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:15.222515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:15.223397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:15.267278 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-557c1278-0b52-40f4-8a0c-d0e8ad071c0c req-10aebae2-443d-4461-bb98-4d5d2e22805d service nova] Creating event network-vif-plugged:e5a102b4-b665-4bce-9306-7587ad11f039 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:15.288106 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-557c1278-0b52-40f4-8a0c-d0e8ad071c0c req-10aebae2-443d-4461-bb98-4d5d2e22805d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243535 Oct 17 13:51:15.288896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3077/6164] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:15.678902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:15.700720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:15.707134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:15.712195 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c039735-ffea-4bc5-a4a0-3cab3c15c8f9 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.518399 Oct 17 13:51:15.732127 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3088/6165] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:15 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:51:16.744214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:16.744928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:16.760127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:16.760624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:16.761071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:16.761824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:16.762280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:16.762706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:17.316650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:17.334310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:17.340132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:17.343246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da17029f-0793-4d1a-9ef5-434e7b0bca8c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.601801 Oct 17 13:51:17.356450 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3078/6166] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:16 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:17.591458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "99643dd1-fc6e-48a6-9634-d8c672f748e0"}, {"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "fdee7579-931a-473e-b96c-29739087492b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:17.617481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:17.618095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:17.618543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:17.668423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] Creating event network-vif-plugged:99643dd1-fc6e-48a6-9634-d8c672f748e0 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:17.668968 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] Creating event network-vif-plugged:fdee7579-931a-473e-b96c-29739087492b for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:17.686126 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2642f221-8f22-48e8-b282-5a9c1ea6e597 req-819e5f33-a952-4472-9dca-04c3375698c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098005 Oct 17 13:51:17.688783 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3089/6167] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:18.373792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:18.374417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:18.387548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.388701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.389325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.397490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:18.398187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:18.399539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:18.969582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:18.986446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:18.988514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:18.990292 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce52604a-a071-4af5-9c0b-7d5f161e592a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.622283 Oct 17 13:51:19.011231 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3079/6168] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:18 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:51:19.916757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "d5658839-16bb-481c-9660-53c64df97628"}, {"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "912bc59a-4c0f-4832-a36e-83886f7b8e93"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:19.951195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:19.955562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:19.957970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.009205 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] Creating event network-vif-plugged:d5658839-16bb-481c-9660-53c64df97628 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:20.015247 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] Creating event network-vif-plugged:912bc59a-4c0f-4832-a36e-83886f7b8e93 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:20.020084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:20.021849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:20.025966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-61531663-630a-4003-96b3-d8ca664790e0 req-64839334-8493-4ced-9b37-37e973d14820 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115293 Oct 17 13:51:20.029639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.030556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.031197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.032111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:20.032788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:20.033436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:20.036578 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3090/6169] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:20.653502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:20.705434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:20.712077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:20.719191 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-544f6151-9090-4506-8e1b-d96fe817751c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.697713 Oct 17 13:51:20.720527 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3080/6170] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:20 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:21.750178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:21.750891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:21.761901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.762401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.763090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:21.763980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:21.764555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:21.775751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.099254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3a83205b-29d3-433a-ae00-7fe2b444b5f3 req-03e6d323-0c3c-438c-bbee-0f722a69a3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "9069783b-8fb3-49b9-bb71-6253888a56ec"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:22.126900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a83205b-29d3-433a-ae00-7fe2b444b5f3 req-03e6d323-0c3c-438c-bbee-0f722a69a3ad service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:22.138852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a83205b-29d3-433a-ae00-7fe2b444b5f3 req-03e6d323-0c3c-438c-bbee-0f722a69a3ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:22.139520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3a83205b-29d3-433a-ae00-7fe2b444b5f3 req-03e6d323-0c3c-438c-bbee-0f722a69a3ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:22.180826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3a83205b-29d3-433a-ae00-7fe2b444b5f3 req-03e6d323-0c3c-438c-bbee-0f722a69a3ad service nova] Creating event network-vif-plugged:9069783b-8fb3-49b9-bb71-6253888a56ec for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:22.199603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3a83205b-29d3-433a-ae00-7fe2b444b5f3 req-03e6d323-0c3c-438c-bbee-0f722a69a3ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105551 Oct 17 13:51:22.201106 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3081/6171] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:22.457899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.486182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.487919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:22.491873 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a921025c-0b3e-4604-9012-16faf1e87f6c tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.744399 Oct 17 13:51:22.493140 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3091/6172] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:21 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:23.522629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:23.523358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:23.548772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.549296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.549742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.550464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:23.550924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:23.551352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:23.884375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:23.900802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:23.907683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:23.908978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-304b45bd-d625-465b-854e-d9fa0f04a7eb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.391224 Oct 17 13:51:23.921984 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3082/6173] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:23 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:24.233526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d0c40aae-dea4-42ac-8834-d4cd176c4281 req-201c5116-8343-4624-9a63-ebf425f69a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-plugged", "status": "completed", "tag": "26826606-d636-4794-8c4d-a80622cff163"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:24.249208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d0c40aae-dea4-42ac-8834-d4cd176c4281 req-201c5116-8343-4624-9a63-ebf425f69a63 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.249690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d0c40aae-dea4-42ac-8834-d4cd176c4281 req-201c5116-8343-4624-9a63-ebf425f69a63 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.250128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d0c40aae-dea4-42ac-8834-d4cd176c4281 req-201c5116-8343-4624-9a63-ebf425f69a63 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.277806 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d0c40aae-dea4-42ac-8834-d4cd176c4281 req-201c5116-8343-4624-9a63-ebf425f69a63 service nova] Creating event network-vif-plugged:26826606-d636-4794-8c4d-a80622cff163 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:24.283697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d0c40aae-dea4-42ac-8834-d4cd176c4281 req-201c5116-8343-4624-9a63-ebf425f69a63 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054059 Oct 17 13:51:24.284814 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3092/6174] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:24.940137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:24.941601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:24.953643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.954530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.955745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:24.956635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:24.957269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:24.958468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:25.211734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:25.231166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:25.233047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:25.235275 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4ec5188-f69d-4969-9689-c8e74c487011 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1875 microversion: 2.42 time: 0.299827 Oct 17 13:51:25.250738 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3083/6175] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:24 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1875 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:26.266579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:26.268575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:26.281299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.282192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.282894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.284149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.284815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.285579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.549353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:26.564386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:26.567216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:51:26.569512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18256819-0d9d-4405-8fbc-209c84b84b9e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2832 microversion: 2.42 time: 0.307783 Oct 17 13:51:26.570755 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3093/6176] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:51:26 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2832 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:26.603605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:26.604270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:26.620373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.620872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.621694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.623087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:26.624163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:26.624606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:26.790340 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b875d50c-7a4f-4e7b-b5d8-6d5b221aae14 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.196318 Oct 17 13:51:26.796783 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3084/6177] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:51:26 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8/os-interface => generated 1832 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:51:27.467255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:27.468310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:27.488025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.488774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.489454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.491134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.491776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.492376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.516927 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] HTTP exception thrown: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Request method failure captured: Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 HTTP/1.1 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVxr-aL_Kn9AZHyVVPxc__0I1Lxq6WsBUvn7yGD804VH66iYPJnA3WHxvlWocb36tHMDZF2uC9AupBD1L51fs5VJxK1xhppt4v7XRs28-XBD9DlGCTJK0PJKr8HHR4H_dRFnPlrLsNADTZWFZuvdPM9CLR0yUEZ74N0gQsd8GJNKhEo Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 766c87ff085742f194e4fb7782852b96 Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '04063868-1c30-440b-973e-0e073bd334c9'} Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:27.523403 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.526515 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.530663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Returning 404 to user: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:27.537579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d5f331e-4e93-4a90-adb0-3c3d45f51a2d tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 404 len: 111 microversion: 2.1 time: 0.073714 Oct 17 13:51:27.538692 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3094/6178] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:27 2022] DELETE /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:27.546868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:27.547828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 04063868-1c30-440b-973e-0e073bd334c9] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:27.560093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.569911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.570556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.571509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:27.574453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:27.576414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:27.622170 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] HTTP exception thrown: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Request method failure captured: Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 HTTP/1.1 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVxr-aL_Kn9AZHyVVPxc__0I1Lxq6WsBUvn7yGD804VH66iYPJnA3WHxvlWocb36tHMDZF2uC9AupBD1L51fs5VJxK1xhppt4v7XRs28-XBD9DlGCTJK0PJKr8HHR4H_dRFnPlrLsNADTZWFZuvdPM9CLR0yUEZ74N0gQsd8GJNKhEo Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 766c87ff085742f194e4fb7782852b96 Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '04063868-1c30-440b-973e-0e073bd334c9'} Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:27.627221 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:27.630398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Returning 404 to user: Instance 04063868-1c30-440b-973e-0e073bd334c9 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:27.630840 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36201282-01bc-4d9a-96b1-3e5fed5a225f tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9" status: 404 len: 111 microversion: 2.1 time: 0.087894 Oct 17 13:51:27.631409 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3085/6179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:27 2022] GET /compute/v2.1/servers/04063868-1c30-440b-973e-0e073bd334c9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:28.218466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8a90ad3f-4be3-46c9-a66d-cbbed7a128b3 req-3ab1d6ef-1ca4-4a62-972c-4e781119da2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "tag": "99643dd1-fc6e-48a6-9634-d8c672f748e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:28.231405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8a90ad3f-4be3-46c9-a66d-cbbed7a128b3 req-3ab1d6ef-1ca4-4a62-972c-4e781119da2a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:28.231898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8a90ad3f-4be3-46c9-a66d-cbbed7a128b3 req-3ab1d6ef-1ca4-4a62-972c-4e781119da2a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:28.232330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8a90ad3f-4be3-46c9-a66d-cbbed7a128b3 req-3ab1d6ef-1ca4-4a62-972c-4e781119da2a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:28.259035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8a90ad3f-4be3-46c9-a66d-cbbed7a128b3 req-3ab1d6ef-1ca4-4a62-972c-4e781119da2a service nova] Creating event network-changed:99643dd1-fc6e-48a6-9634-d8c672f748e0 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:51:28.273300 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8a90ad3f-4be3-46c9-a66d-cbbed7a128b3 req-3ab1d6ef-1ca4-4a62-972c-4e781119da2a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054260 Oct 17 13:51:28.278015 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3095/6180] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:34.367834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:34.368258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:34.382636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.383387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.384816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.390200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.390200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.390200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.421131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=94 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:34.422760 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] HTTP exception thrown: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Request method failure captured: Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c HTTP/1.1 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTVxr-aL_Kn9AZHyVVPxc__0I1Lxq6WsBUvn7yGD804VH66iYPJnA3WHxvlWocb36tHMDZF2uC9AupBD1L51fs5VJxK1xhppt4v7XRs28-XBD9DlGCTJK0PJKr8HHR4H_dRFnPlrLsNADTZWFZuvdPM9CLR0yUEZ74N0gQsd8GJNKhEo Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 766c87ff085742f194e4fb7782852b96 Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '7d3393c5-a858-4255-8eb3-9a85b1721e2c'} Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:34.424270 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.428827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Returning 404 to user: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:34.437806 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da3b6876-9d3d-46cb-ad49-1997265d4f16 tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 404 len: 111 microversion: 2.1 time: 0.062474 Oct 17 13:51:34.441612 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3086/6181] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:51:34 2022] DELETE /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:34.453665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:34.455143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] [instance: 7d3393c5-a858-4255-8eb3-9a85b1721e2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:51:34.474519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.475142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.475969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.476285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:51:34.476750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:51:34.477246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:51:34.482410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:34.508938 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] HTTP exception thrown: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Request method failure captured: Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c HTTP/1.1 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTVxr-aL_Kn9AZHyVVPxc__0I1Lxq6WsBUvn7yGD804VH66iYPJnA3WHxvlWocb36tHMDZF2uC9AupBD1L51fs5VJxK1xhppt4v7XRs28-XBD9DlGCTJK0PJKr8HHR4H_dRFnPlrLsNADTZWFZuvdPM9CLR0yUEZ74N0gQsd8GJNKhEo Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_a0e533d02cf24801ab74f5cfe7e68394"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: a0e533d02cf24801ab74f5cfe7e68394 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1330816099 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 766c87ff085742f194e4fb7782852b96 Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1330816099-project Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '7d3393c5-a858-4255-8eb3-9a85b1721e2c'} Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:34.510884 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] Returning 404 to user: Instance 7d3393c5-a858-4255-8eb3-9a85b1721e2c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-587eddc9-aef1-44a0-87ca-c580cee28f7b tempest-AttachVolumeTestJSON-1330816099 tempest-AttachVolumeTestJSON-1330816099-project] 10.222.0.65 "GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c" status: 404 len: 111 microversion: 2.1 time: 0.070101 Oct 17 13:51:34.514574 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3096/6182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:51:34 2022] GET /compute/v2.1/servers/7d3393c5-a858-4255-8eb3-9a85b1721e2c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:51:41.511650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c7fa324-0c79-494c-904d-d227a01a6d35 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Action: 'create', calling method: .version_select at 0x7f419deaba60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-653544393", "metadata": {"Type": "work"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:51:41.843098 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c7fa324-0c79-494c-904d-d227a01a6d35 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.480762 Oct 17 13:51:41.843901 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3087/6183] 10.222.0.65 () {60 vars in 1156 bytes} [Mon Oct 17 13:51:41 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 482 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 17 13:51:41.856997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d424a06b-0a29-4fdf-8f35-0c588c8dce0b tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f41a20fc8b0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:41.922804 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d424a06b-0a29-4fdf-8f35-0c588c8dce0b tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 200 len: 352 microversion: 2.1 time: 0.069536 Oct 17 13:51:41.923600 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3097/6184] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:51:41 2022] GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:42.939560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ef81d41-65a4-4176-a0c1-83e7076ebde5 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f419de84820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:42.993939 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ef81d41-65a4-4176-a0c1-83e7076ebde5 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 200 len: 353 microversion: 2.1 time: 0.059727 Oct 17 13:51:42.994713 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3088/6185] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:51:42 2022] GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:43.008194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5af84bac-45b9-4a73-9f97-b5b4661784a2 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f419e18de50>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:43.061513 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5af84bac-45b9-4a73-9f97-b5b4661784a2 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 200 len: 353 microversion: 2.1 time: 0.057222 Oct 17 13:51:43.070771 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3098/6186] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:51:43 2022] GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:43.077032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07711c96-e97e-49ae-bf52-bf33626e0cb7 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f419de84a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:43.184509 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07711c96-e97e-49ae-bf52-bf33626e0cb7 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 202 len: 0 microversion: 2.1 time: 0.112149 Oct 17 13:51:43.185661 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3089/6187] 10.222.0.65 () {58 vars in 1248 bytes} [Mon Oct 17 13:51:43 2022] DELETE /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:51:43.195029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b3f8a3a-9f00-4f9f-a99a-0578d7b59b0e tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f419e12c3a0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:43.256486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b3f8a3a-9f00-4f9f-a99a-0578d7b59b0e tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 200 len: 352 microversion: 2.1 time: 0.064309 Oct 17 13:51:43.257705 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3099/6188] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:51:43 2022] GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:51:44.275109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-879eea72-946f-450f-9386-e380527c69d8 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f419d11df70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:44.341671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-879eea72-946f-450f-9386-e380527c69d8 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 200 len: 352 microversion: 2.1 time: 0.070928 Oct 17 13:51:44.350558 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3090/6189] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:51:44 2022] GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 352 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:51:45.358077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b11af6a2-167a-4bfc-af23-810ffbb66108 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Calling method '.version_select at 0x7f419e0d0af0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:51:45.366326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:51:45.400586 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b11af6a2-167a-4bfc-af23-810ffbb66108 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] HTTP exception thrown: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b11af6a2-167a-4bfc-af23-810ffbb66108 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Request method failure captured: Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 HTTP/1.1 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV3tNiEI6RN-Lz3NH_sfXNwQyeCF7BlhLfqRAOMcLfUPu-_B2Ul_-rMXpUtkyTBS38PqDfAKzZdgkcQuT_UcreQjiRevaW-Hn5IytajIGdxJV-wi8QHTGPddNN8VLOikX_jI6Ssnzre6lQ1AOw-opMqJH9RcJTKEcuwzAXz2eQbSkKc Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: dbf202955c55401f905ddbf7428b3654 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesGetTestJSON-328131623 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dbf202955c55401f905ddbf7428b3654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbf202955c55401f905ddbf7428b3654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dbf202955c55401f905ddbf7428b3654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dbf202955c55401f905ddbf7428b3654"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesGetTestJSON-328131623 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: dbf202955c55401f905ddbf7428b3654 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesGetTestJSON-328131623 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesGetTestJSON-328131623-project Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 142de6620c0346e596ae1990a920fe38 Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesGetTestJSON-328131623-project Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: method: Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: exception: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'f7672eef-fc44-4bb0-b9cc-6aa3aef53335'} Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. (HTTP 404) (Request-ID: req-55b7d219-01cc-41ec-8e11-7ceb421602ed) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 17 13:51:45.405686 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. Oct 17 13:51:45.409320 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:51:45.411220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b11af6a2-167a-4bfc-af23-810ffbb66108 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] Returning 404 to user: Volume f7672eef-fc44-4bb0-b9cc-6aa3aef53335 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:51:45.411857 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b11af6a2-167a-4bfc-af23-810ffbb66108 tempest-VolumesGetTestJSON-328131623 tempest-VolumesGetTestJSON-328131623-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335" status: 404 len: 109 microversion: 2.1 time: 0.057402 Oct 17 13:51:45.415856 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3100/6190] 10.222.0.65 () {58 vars in 1245 bytes} [Mon Oct 17 13:51:45 2022] GET /compute/v2.1/os-volumes/f7672eef-fc44-4bb0-b9cc-6aa3aef53335 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:52:12.548655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=37 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:12.552468 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 13:52:12.553279 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:52:12.553417 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 13:52:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 (ip 10.222.0.65) !!! Oct 17 13:52:12.554355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:12.560443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.560776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:12.570681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.571176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.571617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.572310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.572778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.573229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.788190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.798192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.799912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:12.801295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f861831-e211-47c0-8f5c-220504317c35 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2950 microversion: 2.42 time: 0.253397 Oct 17 13:52:12.802788 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3091/6191] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2950 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:52:12.835003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:12.839834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:12.840348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:12.847132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.847618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.848066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:12.849396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:12.849850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:12.850275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:13.000089 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf90a98a-0897-4a96-a820-38df7e5b0085 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.167724 Oct 17 13:52:13.002790 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3101/6192] 10.222.0.65 () {60 vars in 1316 bytes} [Mon Oct 17 13:52:12 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8/os-interface => generated 1832 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:52:29.509219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1687788718", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "d109dd58-2b94-4031-8c4b-dc08611388ab"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:29.520709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:29.521482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:29.571914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] validate_networks() for [('d109dd58-2b94-4031-8c4b-dc08611388ab', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:30.372923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:30.373532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:30.374131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:30.374663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:30.375189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:30.387986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.388709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.389553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.390490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:30.392301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:30.393283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:30.419386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Getting quotas for project 45a7279098d34d69b18d733665f00305. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:30.427431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Getting quotas for user 3d78e875fbe44371804c76ad70b6f89d and project 45a7279098d34d69b18d733665f00305. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:30.448863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:30.452197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:30.508688 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-313301e3-3732-4697-8c0a-3738693a91ca tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.004734 Oct 17 13:52:30.509591 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3092/6193] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:52:30.519286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:30.522704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:30.528163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70241580-fa8e-4bc6-979a-57ba71178474 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:30.528784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70241580-fa8e-4bc6-979a-57ba71178474 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:30.596062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70241580-fa8e-4bc6-979a-57ba71178474 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:30.605153 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70241580-fa8e-4bc6-979a-57ba71178474 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1214 microversion: 2.1 time: 0.087528 Oct 17 13:52:30.606498 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3102/6194] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:30 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:31.630290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:31.631570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:31.648317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.649298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.649995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.650830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:31.651465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:31.651846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:31.728748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:31.737132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed43a2c8-7f22-4e3e-8681-d241051f215a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1218 microversion: 2.1 time: 0.112071 Oct 17 13:52:31.738005 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3093/6195] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:31 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:32.764204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:32.764924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:32.783438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.783928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.784362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.785095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:32.785631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:32.786054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:32.859380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:32.868921 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16ee90e2-5865-4643-9223-22020f57e6d2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1266 microversion: 2.1 time: 0.110823 Oct 17 13:52:32.877419 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3103/6196] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:32 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:33.896084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:33.896811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:33.904681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.905478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.905989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:33.906816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:33.907446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:33.908013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:34.009090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:34.018208 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e90e35ec-0241-4f70-9fbf-c1efaa595160 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1272 microversion: 2.1 time: 0.127866 Oct 17 13:52:34.018803 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3094/6197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:33 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1272 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:35.042350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:35.042981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:35.050261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.050760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.051962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.053142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.053824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.054263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.407807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:35.416688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a6456339-9ce8-4341-aaad-bcd5515f7fea tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.378259 Oct 17 13:52:35.417309 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3104/6198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:35 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:35.898045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0d334f41-e98c-4d9c-a0c6-da537517c5bd req-01068104-b603-4429-ae49-12904307d497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd001ded-66d0-404b-b315-fc8bfba3571c", "tag": "367957c4-966f-4615-ae9a-0baf000540d1"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:35.910151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0d334f41-e98c-4d9c-a0c6-da537517c5bd req-01068104-b603-4429-ae49-12904307d497 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:35.911499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0d334f41-e98c-4d9c-a0c6-da537517c5bd req-01068104-b603-4429-ae49-12904307d497 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:35.911939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0d334f41-e98c-4d9c-a0c6-da537517c5bd req-01068104-b603-4429-ae49-12904307d497 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:35.927310 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0d334f41-e98c-4d9c-a0c6-da537517c5bd req-01068104-b603-4429-ae49-12904307d497 service nova] Creating event network-changed:367957c4-966f-4615-ae9a-0baf000540d1 for instance bd001ded-66d0-404b-b315-fc8bfba3571c on n-h2-854121-14 Oct 17 13:52:35.932795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0d334f41-e98c-4d9c-a0c6-da537517c5bd req-01068104-b603-4429-ae49-12904307d497 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278165 Oct 17 13:52:35.934280 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3095/6199] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:36.439782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:36.440400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:36.448187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.448673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.449105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.449818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:36.450273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:36.450695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:36.591049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:36.599246 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8290dbb-8a16-41fd-a11c-b4f96b266fd1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.163384 Oct 17 13:52:36.599831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3105/6200] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:36 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:37.624176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:37.625527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:37.633941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.634444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.634891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.635620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:37.636086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:37.636647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:37.788522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:37.809087 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5f39eec-f22d-4438-8fec-23d0fe9d6b2d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.189404 Oct 17 13:52:37.825594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3096/6201] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:37 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:38.834238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:38.834885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:38.844928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.845799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.846461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:38.847447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:38.848840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:38.849645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:39.100120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:39.109981 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01611277-64d4-4f3f-972a-e045cfc6cd16 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.280680 Oct 17 13:52:39.110890 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3106/6202] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:38 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:40.134753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:40.135356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:40.142982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.143478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.143934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.144687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:40.145151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:40.145602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:40.325119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:40.336219 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da96a54d-087d-4258-b13c-b95d093c9f2c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.205130 Oct 17 13:52:40.337218 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3097/6203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:40 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:52:41.361028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:41.362335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:41.379534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:41.383205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.384352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.385342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.386163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:41.386807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:41.387457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:41.538977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:41.548151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b9263b8-c6fe-4908-a553-24a425dc9587 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.191540 Oct 17 13:52:41.548798 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3107/6204] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:41 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:42.460091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a036bf3a-1eec-492e-a70d-269d108ba57e req-a4a6158d-4371-49a7-abc1-c7e73dcc270c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd001ded-66d0-404b-b315-fc8bfba3571c", "name": "network-vif-plugged", "status": "completed", "tag": "367957c4-966f-4615-ae9a-0baf000540d1"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:42.470799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:42.472014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:42.485282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a036bf3a-1eec-492e-a70d-269d108ba57e req-a4a6158d-4371-49a7-abc1-c7e73dcc270c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.486142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a036bf3a-1eec-492e-a70d-269d108ba57e req-a4a6158d-4371-49a7-abc1-c7e73dcc270c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.486749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a036bf3a-1eec-492e-a70d-269d108ba57e req-a4a6158d-4371-49a7-abc1-c7e73dcc270c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.500912 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a036bf3a-1eec-492e-a70d-269d108ba57e req-a4a6158d-4371-49a7-abc1-c7e73dcc270c service nova] Creating event network-vif-plugged:367957c4-966f-4615-ae9a-0baf000540d1 for instance bd001ded-66d0-404b-b315-fc8bfba3571c on n-h2-854121-14 Oct 17 13:52:42.507009 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a036bf3a-1eec-492e-a70d-269d108ba57e req-a4a6158d-4371-49a7-abc1-c7e73dcc270c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051548 Oct 17 13:52:42.507645 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3098/6205] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:42.572124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:42.572748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:42.580783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.581330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.582087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:42.584341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:42.585142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:42.585616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:43.217958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:43.228384 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3275a27-b2d1-43ae-9b15-1cf587902e35 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.659579 Oct 17 13:52:43.229289 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3108/6206] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:42 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:44.253805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:44.254615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:44.263734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.264575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.265079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.266423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:44.267009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:44.268311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:44.503440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:44.526473 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9c19f59-93b2-4062-b415-e43ab21e7bdf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1314 microversion: 2.1 time: 0.278708 Oct 17 13:52:44.527080 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3099/6207] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:44 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:45.551116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:45.553081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:45.560082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.560743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.561498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.562481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:45.563193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:45.563685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:45.818868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:45.828258 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-917b49f8-d790-43d1-9014-55923f33f77f tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1499 microversion: 2.1 time: 0.281224 Oct 17 13:52:45.829341 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3109/6208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:45 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1499 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:46.289529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:46.290664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:46.298292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.298789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.299277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.299954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.300411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.301034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.331875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:52:46.425954 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85e90d6b-9d86-44e8-b070-8c1024173d90 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 204 len: 0 microversion: 2.1 time: 0.140848 Oct 17 13:52:46.427177 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3100/6209] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:52:46 2022] DELETE /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:52:46.436785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:46.437546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:46.445387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.445892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.446391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.447112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:46.447573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:46.448008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:46.721149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:46.730424 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53fd4381-3500-427e-8fa8-61e08f8b3f10 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1505 microversion: 2.1 time: 0.298810 Oct 17 13:52:46.731323 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3110/6210] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:46 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:47.758281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:47.759771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:47.767355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.767974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.768613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:47.769694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:47.770873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:47.771379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.071743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:48.081494 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67cae5a6-6d87-4fac-bf4f-11fc4969b8fa tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1505 microversion: 2.1 time: 0.329458 Oct 17 13:52:48.082224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3101/6211] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:47 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:48.770934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4d3bce81-ea1f-4393-bca1-9cc351debc6e req-21327a8b-10f0-4a4e-a138-4d9cd9f8b0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd001ded-66d0-404b-b315-fc8bfba3571c", "name": "network-vif-deleted", "tag": "367957c4-966f-4615-ae9a-0baf000540d1"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:48.807111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4d3bce81-ea1f-4393-bca1-9cc351debc6e req-21327a8b-10f0-4a4e-a138-4d9cd9f8b0b6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:48.809011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4d3bce81-ea1f-4393-bca1-9cc351debc6e req-21327a8b-10f0-4a4e-a138-4d9cd9f8b0b6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:48.811317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4d3bce81-ea1f-4393-bca1-9cc351debc6e req-21327a8b-10f0-4a4e-a138-4d9cd9f8b0b6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:48.836327 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4d3bce81-ea1f-4393-bca1-9cc351debc6e req-21327a8b-10f0-4a4e-a138-4d9cd9f8b0b6 service nova] Creating event network-vif-deleted:367957c4-966f-4615-ae9a-0baf000540d1 for instance bd001ded-66d0-404b-b315-fc8bfba3571c on n-h2-854121-14 Oct 17 13:52:48.854442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4d3bce81-ea1f-4393-bca1-9cc351debc6e req-21327a8b-10f0-4a4e-a138-4d9cd9f8b0b6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089478 Oct 17 13:52:48.855871 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3111/6212] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:52:49.108786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:49.109740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:49.116381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.116736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.117201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.117889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.118348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.118767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.158752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:49.159863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:49.160312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:49.161108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lazy-loading 'fault' on Instance uuid bd001ded-66d0-404b-b315-fc8bfba3571c {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:52:49.221245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:49.238953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6ca4d74-6223-40e0-908b-1d119c59e7b1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 200 len: 1304 microversion: 2.1 time: 0.128427 Oct 17 13:52:49.241818 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3102/6213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:49 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:50.264923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:50.265941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: bd001ded-66d0-404b-b315-fc8bfba3571c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:50.274028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:50.274610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:50.275121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:50.275898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:50.276427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:50.276941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:50.291704 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] HTTP exception thrown: Instance bd001ded-66d0-404b-b315-fc8bfba3571c could not be found. Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Request method failure captured: Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c HTTP/1.1 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV4bQvfy1bi0wpV-Z1kjmXLnAaNKN9Vf2M6bjvbtnbuzUBz219t74fFf4j2ZneiHQkQCvjQg8GZlXbCMIAiG98gi2Y8rl3UgL8yz5YSY6-Fn9vZKUvS8NtBCpJptIFmfHXZSPt9Tmj_q0OEmTFto0tu-k2CobJOvOSVHGu3Mvx3H1vY Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 45a7279098d34d69b18d733665f00305 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesActionsTest-802213870 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/45a7279098d34d69b18d733665f00305"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/45a7279098d34d69b18d733665f00305"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/45a7279098d34d69b18d733665f00305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_45a7279098d34d69b18d733665f00305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesActionsTest-802213870 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 45a7279098d34d69b18d733665f00305 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesActionsTest-802213870 Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesActionsTest-802213870-project Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 3d78e875fbe44371804c76ad70b6f89d Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesActionsTest-802213870-project Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance bd001ded-66d0-404b-b315-fc8bfba3571c could not be found. Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'bd001ded-66d0-404b-b315-fc8bfba3571c'} Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd001ded-66d0-404b-b315-fc8bfba3571c could not be found. Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd001ded-66d0-404b-b315-fc8bfba3571c could not be found. Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:52:50.293411 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd001ded-66d0-404b-b315-fc8bfba3571c could not be found. Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Returning 404 to user: Instance bd001ded-66d0-404b-b315-fc8bfba3571c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cf0ad74a-e7e3-45e5-a129-b392325cc3e0 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c" status: 404 len: 111 microversion: 2.1 time: 0.034521 Oct 17 13:52:50.298131 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3112/6214] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:50 2022] GET /compute/v2.1/servers/bd001ded-66d0-404b-b315-fc8bfba3571c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:52:50.434497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1221149645", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "d109dd58-2b94-4031-8c4b-dc08611388ab"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:50.490848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] validate_networks() for [('d109dd58-2b94-4031-8c4b-dc08611388ab', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:52:51.236465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:52:51.236912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:52:51.237455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:52:51.238378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:52:51.238378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:52:51.258126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:51.258798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:51.259404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:51.260295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:51.260969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:51.261767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:51.288364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Getting quotas for project 45a7279098d34d69b18d733665f00305. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:52:51.296651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Getting quotas for user 3d78e875fbe44371804c76ad70b6f89d and project 45a7279098d34d69b18d733665f00305. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:52:51.312679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:52:51.315537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:52:51.377470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a028f10e-8a7c-4019-a5b3-41ec4fd103c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947167 Oct 17 13:52:51.381314 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3103/6215] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:52:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:52:51.392516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a5e971e-89ad-4a24-92cb-c718698d266d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:51.393144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a5e971e-89ad-4a24-92cb-c718698d266d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:51.488258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a5e971e-89ad-4a24-92cb-c718698d266d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:51.499188 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a5e971e-89ad-4a24-92cb-c718698d266d tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1214 microversion: 2.1 time: 0.110649 Oct 17 13:52:51.500440 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3113/6216] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:51 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:52.524919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2412aae3-6eaf-49ab-8fc3-e36da3100e04 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:52.525558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2412aae3-6eaf-49ab-8fc3-e36da3100e04 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:52.593366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2412aae3-6eaf-49ab-8fc3-e36da3100e04 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:52.603141 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2412aae3-6eaf-49ab-8fc3-e36da3100e04 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1214 microversion: 2.1 time: 0.083420 Oct 17 13:52:52.604405 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3104/6217] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:52 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:53.628575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5dce943c-bb4b-4150-8613-129532cbca81 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:53.631438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5dce943c-bb4b-4150-8613-129532cbca81 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:53.720784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5dce943c-bb4b-4150-8613-129532cbca81 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:53.732040 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5dce943c-bb4b-4150-8613-129532cbca81 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1214 microversion: 2.1 time: 0.108192 Oct 17 13:52:53.733053 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3114/6218] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:53 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:54.755252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1183b364-8432-45c5-896d-3ae98440fa13 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:54.756493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1183b364-8432-45c5-896d-3ae98440fa13 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:54.818503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1183b364-8432-45c5-896d-3ae98440fa13 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:54.826959 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1183b364-8432-45c5-896d-3ae98440fa13 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1214 microversion: 2.1 time: 0.075655 Oct 17 13:52:54.827560 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3105/6219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:54 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:55.851917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:55.852552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:55.867179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:55.867179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:55.867179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:55.867179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:55.867179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:55.867179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:55.934402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:55.944504 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-34b6399a-cff8-4564-83cc-ab00ac2a26c1 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1218 microversion: 2.1 time: 0.097930 Oct 17 13:52:55.945359 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3115/6220] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:55 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:56.971511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:56.972972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:56.983611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:56.984859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:56.985570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:56.986566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:56.987387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:56.988012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:57.114436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:57.124443 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-184c576d-f89d-464c-a419-3865dbe97773 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1272 microversion: 2.1 time: 0.158086 Oct 17 13:52:57.137330 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3106/6221] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:56 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:58.152978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:58.154741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:58.164404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:58.165275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:58.166688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:58.167696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:58.168345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:58.168964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:58.508993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:58.519843 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fdd62c29-780b-4b1e-911e-7e8baea7ab2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.372523 Oct 17 13:52:58.521598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3116/6222] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:58 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:59.545109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:52:59.546317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:52:59.549142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:59.555456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.555927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.556357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.557057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.557529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.557949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.562206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:52:59.800448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:52:59.800705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-37452814-10d6-4783-befa-70fe6204afbb req-7e603847-87b8-416a-ae7e-6b44675f57c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c99c2078-e490-4a3f-8f6a-0aab6b3efa68", "tag": "6c6166e4-a4ca-4222-b481-17f03fd8eadb"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:52:59.811694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-37452814-10d6-4783-befa-70fe6204afbb req-7e603847-87b8-416a-ae7e-6b44675f57c2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:52:59.812572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-37452814-10d6-4783-befa-70fe6204afbb req-7e603847-87b8-416a-ae7e-6b44675f57c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:52:59.813339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-37452814-10d6-4783-befa-70fe6204afbb req-7e603847-87b8-416a-ae7e-6b44675f57c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:52:59.818630 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e0ca39ad-6e40-448b-97ef-292feca247bd tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.277413 Oct 17 13:52:59.819571 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3107/6223] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:52:59 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:52:59.825995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-37452814-10d6-4783-befa-70fe6204afbb req-7e603847-87b8-416a-ae7e-6b44675f57c2 service nova] Creating event network-changed:6c6166e4-a4ca-4222-b481-17f03fd8eadb for instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 on n-h2-854121-14 Oct 17 13:52:59.832050 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-37452814-10d6-4783-befa-70fe6204afbb req-7e603847-87b8-416a-ae7e-6b44675f57c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034497 Oct 17 13:52:59.833831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3117/6224] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:00.842137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:00.843304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:00.851157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.851643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.852270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:00.852976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:00.853456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:00.853909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:01.013529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:01.024751 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19b55dc9-b1d4-4be5-8fdb-d0054082801c tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.186517 Oct 17 13:53:01.037722 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3108/6225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:00 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:02.051595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:02.052455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:02.054621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=39 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:02.060788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:02.063917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:02.064389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:02.065144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:02.065745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:02.066475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:02.070740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=67 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:02.280352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:02.293367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fda0aa66-5a84-4172-8039-25df374f5620 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.247359 Oct 17 13:53:02.294049 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3118/6226] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:02 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:03.316091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:03.316721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:03.318748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:03.325191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.325719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.326167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.326875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:03.327336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:03.327764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:03.466444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:03.475335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3873c2ab-94c8-4e59-9ac5-d1c1c933a070 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.163338 Oct 17 13:53:03.475924 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3109/6227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:03 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:04.498244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:04.498905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:04.501886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:04.508090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.508859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.509332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.510063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:04.510699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:04.511128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:04.746772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:04.754808 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d829e43-21aa-42ac-965e-838c89ff8868 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.260481 Oct 17 13:53:04.755405 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3119/6228] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:04 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:05.779516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:05.780130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:05.782943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:05.789303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.789918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.790423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.791225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:05.791746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:05.792236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:05.934476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:05.943410 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5128b930-3d79-44d6-8a6a-741c33ec5890 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.167917 Oct 17 13:53:05.944014 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3110/6229] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:05 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:06.531256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c0a9fa91-254a-4968-be23-42f59db81272 req-cf437b6c-2dbd-4fe0-9004-ea89bf0979eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99c2078-e490-4a3f-8f6a-0aab6b3efa68", "name": "network-vif-plugged", "status": "completed", "tag": "6c6166e4-a4ca-4222-b481-17f03fd8eadb"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:06.546663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c0a9fa91-254a-4968-be23-42f59db81272 req-cf437b6c-2dbd-4fe0-9004-ea89bf0979eb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:06.547335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c0a9fa91-254a-4968-be23-42f59db81272 req-cf437b6c-2dbd-4fe0-9004-ea89bf0979eb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:06.548007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c0a9fa91-254a-4968-be23-42f59db81272 req-cf437b6c-2dbd-4fe0-9004-ea89bf0979eb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:06.561295 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c0a9fa91-254a-4968-be23-42f59db81272 req-cf437b6c-2dbd-4fe0-9004-ea89bf0979eb service nova] Creating event network-vif-plugged:6c6166e4-a4ca-4222-b481-17f03fd8eadb for instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 on n-h2-854121-14 Oct 17 13:53:06.568781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c0a9fa91-254a-4968-be23-42f59db81272 req-cf437b6c-2dbd-4fe0-9004-ea89bf0979eb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040429 Oct 17 13:53:06.569987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3120/6230] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:06.966527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:06.967155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:06.974890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:06.975386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:06.976024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:06.976904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:06.977392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:06.978007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:07.446471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:07.455226 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebbe8c4b-f628-49f0-9359-153a1dd3f2c2 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.492572 Oct 17 13:53:07.455815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3111/6231] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:06 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:08.481915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:08.483344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:08.491671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:08.492510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:08.493475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:08.494513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:08.495312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:08.496298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:08.729938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:08.746260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b5d6e883-3f61-4e41-99c7-eaeb58f5fb2a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1314 microversion: 2.1 time: 0.269170 Oct 17 13:53:08.746865 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3121/6232] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:08 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:09.773517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:09.774135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:09.781116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:09.781637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:09.782088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:09.782788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:09.783253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:09.783679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:09.920177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:09.928981 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1b9e410-eeba-403c-92cc-6b34afa5664a tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1498 microversion: 2.1 time: 0.159607 Oct 17 13:53:09.929596 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3112/6233] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:09 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:53:10.363210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:10.363808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:10.370879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.371370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.371813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.372543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.373019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.373479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.400466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:53:10.484228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df45938e-67e6-4bf9-ade9-07cb24579bfb tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 204 len: 0 microversion: 2.1 time: 0.124617 Oct 17 13:53:10.484893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3122/6234] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:53:10 2022] DELETE /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:53:10.494484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:10.495106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:10.501714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.502132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.502571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.503503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:10.503959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:10.504533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:10.669073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:10.678802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74b07909-9a53-4fff-b2a7-6220d38daf18 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1504 microversion: 2.1 time: 0.188742 Oct 17 13:53:10.679402 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3113/6235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:10 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:11.706321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:11.707145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:11.715276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.716096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.717100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:11.718266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:11.719200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:11.719701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:12.007364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:12.020659 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cae59e0a-cfe6-4355-b0d9-f50e15951c89 tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1504 microversion: 2.1 time: 0.319458 Oct 17 13:53:12.021667 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3123/6236] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:11 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1504 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:12.631763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-62bfc173-e16f-4ed3-bc33-ebe24205ee8c req-3dbd66ad-3d7f-41a3-a69a-8223db9d4940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c99c2078-e490-4a3f-8f6a-0aab6b3efa68", "name": "network-vif-deleted", "tag": "6c6166e4-a4ca-4222-b481-17f03fd8eadb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:12.643824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62bfc173-e16f-4ed3-bc33-ebe24205ee8c req-3dbd66ad-3d7f-41a3-a69a-8223db9d4940 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:12.644466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62bfc173-e16f-4ed3-bc33-ebe24205ee8c req-3dbd66ad-3d7f-41a3-a69a-8223db9d4940 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:12.645553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-62bfc173-e16f-4ed3-bc33-ebe24205ee8c req-3dbd66ad-3d7f-41a3-a69a-8223db9d4940 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:12.658285 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-62bfc173-e16f-4ed3-bc33-ebe24205ee8c req-3dbd66ad-3d7f-41a3-a69a-8223db9d4940 service nova] Creating event network-vif-deleted:6c6166e4-a4ca-4222-b481-17f03fd8eadb for instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 on n-h2-854121-14 Oct 17 13:53:12.665013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-62bfc173-e16f-4ed3-bc33-ebe24205ee8c req-3dbd66ad-3d7f-41a3-a69a-8223db9d4940 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037893 Oct 17 13:53:12.669186 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3114/6237] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:53:13.044823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:13.045573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:13.052910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.053533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.054042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.055043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.055542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.055828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.099337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:13.100000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:13.100780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:13.101089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lazy-loading 'fault' on Instance uuid c99c2078-e490-4a3f-8f6a-0aab6b3efa68 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:53:13.178840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d78e875fbe44371804c76ad70b6f89d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a7279098d34d69b18d733665f00305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:13.190428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c9af602-4f60-4676-93fa-1e5842a225cf tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 200 len: 1304 microversion: 2.1 time: 0.149504 Oct 17 13:53:13.191671 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3124/6238] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:13 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:14.215897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:14.216592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] [instance: c99c2078-e490-4a3f-8f6a-0aab6b3efa68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:14.223811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.224533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.225127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.226047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:14.226677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:14.227257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:14.242550 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] HTTP exception thrown: Instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 could not be found. Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Request method failure captured: Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 HTTP/1.1 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV4bQvfy1bi0wpV-Z1kjmXLnAaNKN9Vf2M6bjvbtnbuzUBz219t74fFf4j2ZneiHQkQCvjQg8GZlXbCMIAiG98gi2Y8rl3UgL8yz5YSY6-Fn9vZKUvS8NtBCpJptIFmfHXZSPt9Tmj_q0OEmTFto0tu-k2CobJOvOSVHGu3Mvx3H1vY Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 45a7279098d34d69b18d733665f00305 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesActionsTest-802213870 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/45a7279098d34d69b18d733665f00305"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/45a7279098d34d69b18d733665f00305"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/45a7279098d34d69b18d733665f00305"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_45a7279098d34d69b18d733665f00305"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesActionsTest-802213870 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 45a7279098d34d69b18d733665f00305 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesActionsTest-802213870 Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesActionsTest-802213870-project Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 3d78e875fbe44371804c76ad70b6f89d Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesActionsTest-802213870-project Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 could not be found. Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c99c2078-e490-4a3f-8f6a-0aab6b3efa68'} Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 could not be found. Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 could not be found. Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:53:14.244473 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 could not be found. Oct 17 13:53:14.248611 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:53:14.250305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] Returning 404 to user: Instance c99c2078-e490-4a3f-8f6a-0aab6b3efa68 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:53:14.251341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e5d0823f-cdf9-490b-a209-fec101f712bc tempest-VolumesActionsTest-802213870 tempest-VolumesActionsTest-802213870-project] 10.222.0.65 "GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68" status: 404 len: 111 microversion: 2.1 time: 0.040756 Oct 17 13:53:14.252061 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3115/6239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:14 2022] GET /compute/v2.1/servers/c99c2078-e490-4a3f-8f6a-0aab6b3efa68 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:53:50.891382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-2072414422", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:50.899179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:50.899843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:50.951438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] validate_networks() for None {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:53:51.275981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:53:51.276392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:53:51.276921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:53:51.277314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:53:51.277733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:53:51.287746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:51.288232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:51.288671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:51.289434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:51.289888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:51.290314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:51.309723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Getting quotas for project 2c279b84b5624d61a52a3d52fd2e96ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:53:51.314973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Getting quotas for user cd8fa9f44e684b49803faad12bd50811 and project 2c279b84b5624d61a52a3d52fd2e96ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:53:51.327669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:53:51.330047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:53:51.375886 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [fc48a327-c986-49a1-8d75-720ede214e94] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:53:52.386328 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [fc48a327-c986-49a1-8d75-720ede214e94] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 41320. Oct 17 13:53:52.391081 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-918916a7-d155-4008-a3bd-71d7b45b17f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504008 Oct 17 13:53:52.393215 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3125/6240] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 13:53:52.403287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fcd5d05-aa7c-4b8b-9190-d233abc4f550 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:52.403906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fcd5d05-aa7c-4b8b-9190-d233abc4f550 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:52.406263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=17 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:52.407293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=45 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:53:52.464678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fcd5d05-aa7c-4b8b-9190-d233abc4f550 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:52.472916 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fcd5d05-aa7c-4b8b-9190-d233abc4f550 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1214 microversion: 2.1 time: 0.073528 Oct 17 13:53:52.473556 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3116/6241] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:52 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:53.498085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:53.498718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:53.507366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:53.507933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:53.508463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:53.509271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:53.509799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:53.510324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:53.583501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:53.592293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3302dc99-0c7f-460c-9db1-988ced641853 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1266 microversion: 2.1 time: 0.099492 Oct 17 13:53:53.592955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3126/6242] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:53 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:54.622297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:54.623575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:54.634881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:54.635768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:54.636583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:54.637828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:54.638708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:54.639531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:54.865771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:54.874376 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-366f4e81-cd94-4952-8da9-ed133ba8d8bf tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.256130 Oct 17 13:53:54.875343 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3117/6243] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:54 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:55.438471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7e73abc3-59cc-4060-8d01-8a94e71e0ab4 req-68ba60d1-9552-4275-83f5-c0ac21c4d848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a086f8-3190-4851-badb-e616a34e795e", "tag": "f8baa73e-a479-4f01-976a-b4f4ef053257"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:53:55.457049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e73abc3-59cc-4060-8d01-8a94e71e0ab4 req-68ba60d1-9552-4275-83f5-c0ac21c4d848 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:55.458748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e73abc3-59cc-4060-8d01-8a94e71e0ab4 req-68ba60d1-9552-4275-83f5-c0ac21c4d848 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:55.459441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7e73abc3-59cc-4060-8d01-8a94e71e0ab4 req-68ba60d1-9552-4275-83f5-c0ac21c4d848 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:55.473363 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7e73abc3-59cc-4060-8d01-8a94e71e0ab4 req-68ba60d1-9552-4275-83f5-c0ac21c4d848 service nova] Creating event network-changed:f8baa73e-a479-4f01-976a-b4f4ef053257 for instance 20a086f8-3190-4851-badb-e616a34e795e on n-h2-854121-14 Oct 17 13:53:55.480903 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7e73abc3-59cc-4060-8d01-8a94e71e0ab4 req-68ba60d1-9552-4275-83f5-c0ac21c4d848 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048032 Oct 17 13:53:55.482116 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3127/6244] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:53:55.898451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:55.899703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:55.909296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:55.909296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:55.909296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:55.910801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:55.911478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:55.912090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:56.053226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:56.061141 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d954fd58-2237-4a0d-b682-3e3c1e31beca tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.167357 Oct 17 13:53:56.061794 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3118/6245] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:55 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:57.084909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:57.085778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:57.092829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:57.093353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:57.093804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:57.094531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:57.094987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:57.095415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:57.229357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:57.237316 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-662c8e79-b28e-49de-a42e-ac9a5d3bfcb6 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.157127 Oct 17 13:53:57.238546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3128/6246] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:57 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:58.261452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:58.261850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:58.269752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:58.270373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:58.270949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:58.271760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:58.272326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:58.272857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:58.505056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:58.513748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f62b8de-db65-40bc-9c35-ac8217757f67 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.256936 Oct 17 13:53:58.519997 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3119/6247] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:58 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:53:59.538477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:53:59.539167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:53:59.546079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:59.546571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:59.547015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:59.547723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:53:59.548175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:53:59.548602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:53:59.690987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:53:59.700891 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8be751f-a6f5-45ce-abc0-e1b50f249806 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.166879 Oct 17 13:53:59.701521 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3129/6248] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:53:59 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:00.723652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:00.725019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:00.733991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:00.734174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:00.734854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:00.735908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:00.736469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:00.737069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:00.884661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:00.905992 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ebef77f-1f2f-420b-bdf9-4ec7163a5837 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.186229 Oct 17 13:54:00.916056 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3120/6249] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:00 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:01.932303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:01.932936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:01.935778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:01.936463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:01.942996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:01.943492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:01.944128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:01.944844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:01.945341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:01.945774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:02.089359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:02.098242 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d09f153a-c760-469c-992d-8bd67af92813 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.169899 Oct 17 13:54:02.098832 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3130/6250] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:01 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:02.816654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1fadaa47-470a-4643-aef3-1b164f4a9e12 req-916b8691-71a4-4799-bdee-2ec341ac6c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a086f8-3190-4851-badb-e616a34e795e", "name": "network-vif-plugged", "status": "completed", "tag": "f8baa73e-a479-4f01-976a-b4f4ef053257"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:02.823017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:02.829608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1fadaa47-470a-4643-aef3-1b164f4a9e12 req-916b8691-71a4-4799-bdee-2ec341ac6c04 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:02.830958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1fadaa47-470a-4643-aef3-1b164f4a9e12 req-916b8691-71a4-4799-bdee-2ec341ac6c04 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:02.830958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1fadaa47-470a-4643-aef3-1b164f4a9e12 req-916b8691-71a4-4799-bdee-2ec341ac6c04 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:02.850217 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1fadaa47-470a-4643-aef3-1b164f4a9e12 req-916b8691-71a4-4799-bdee-2ec341ac6c04 service nova] Creating event network-vif-plugged:f8baa73e-a479-4f01-976a-b4f4ef053257 for instance 20a086f8-3190-4851-badb-e616a34e795e on n-h2-854121-14 Oct 17 13:54:02.855620 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1fadaa47-470a-4643-aef3-1b164f4a9e12 req-916b8691-71a4-4799-bdee-2ec341ac6c04 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042907 Oct 17 13:54:02.857031 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3121/6251] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:03.120948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:03.121621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:03.128527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:03.129239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:03.129715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:03.130421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:03.130879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:03.131315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:03.275424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:03.283834 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd7f7450-1d46-4801-9650-eb4450a6a8b2 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.166824 Oct 17 13:54:03.284955 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3131/6252] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:03 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:04.309239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:04.309956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:04.316880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:04.317559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:04.318009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:04.318738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:04.319202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:04.319634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:04.465607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:04.475577 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0934bac5-2e6f-4347-af58-0de01237c005 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1314 microversion: 2.1 time: 0.171382 Oct 17 13:54:04.476174 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3122/6253] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:04 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:05.499106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:05.499621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:05.507225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:05.507722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:05.508169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:05.508882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:05.509378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:05.509807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:05.651159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:05.659147 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-513c0c11-9c56-4f9c-b34c-6899cc568c92 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1463 microversion: 2.1 time: 0.164069 Oct 17 13:54:05.665375 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3132/6254] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:54:05 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:54:05.683059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d44fef8-8c60-476f-9b7b-26c037f01631", "device": "/dev/sdb"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:05.686683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:05.695845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:05.696342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:05.696995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:05.697723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:05.698181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:05.698633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:05.985374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9bda2956-dcdd-4010-bff4-8f38c207c6f8 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "POST /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306272 Oct 17 13:54:05.986111 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3123/6255] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:54:05 2022] POST /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:16.032624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.033217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.036025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.037012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=40 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.043027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.043516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.043951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.044649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.045099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.045616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.074671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:54:16.157881 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-163eda19-855b-41d2-ac4f-d037d093a959 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 204 len: 0 microversion: 2.42 time: 0.128820 Oct 17 13:54:16.158483 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3133/6256] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:54:16 2022] DELETE /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:16.165406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=18 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.166276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:16.171328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:16.172077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:16.180899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.181425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.181867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.182571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:16.183031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:16.183459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:16.393600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.404391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.406151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:16.407664 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e5c680d-6df3-44d7-aaad-d437b3cdf68b tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2956 microversion: 2.42 time: 0.244410 Oct 17 13:54:16.408444 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3124/6257] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:16 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2956 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:17.437003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:17.437739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:17.446029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.446518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.446958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.447655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:17.448107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:17.448532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:17.642440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.652694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.654190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:17.655441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd7340f0-cd97-43da-8bdd-c08db6da18f3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2956 microversion: 2.42 time: 0.222849 Oct 17 13:54:17.656011 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3134/6258] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:17 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2956 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:18.685126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:18.685914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:18.693371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.694095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.694535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.695249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:18.695705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:18.696135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:18.920413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.931890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.933942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:18.935347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c7dfeb42-75e9-4f1a-97a7-6b028748e591 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2956 microversion: 2.42 time: 0.254642 Oct 17 13:54:18.936195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3125/6259] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:18 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2956 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:19.968597 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:19.969462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:19.995299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.009066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.009610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.010381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:20.022534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:20.023032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:20.462047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:20.481841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:20.486441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:20.489408 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc91fd7f-6665-4545-bc3d-a6e511cd9f87 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2956 microversion: 2.42 time: 0.527577 Oct 17 13:54:20.492459 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3135/6260] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:19 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2956 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:21.531091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:21.532379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:21.541479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.542459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.543331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.545409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.546676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.547387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.561217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-754dd073-ef96-4f74-9a40-73efca845f87 req-fd72d116-92de-4263-a4a5-50cdc685f610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-deleted", "tag": "9069783b-8fb3-49b9-bb71-6253888a56ec"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:21.587536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-754dd073-ef96-4f74-9a40-73efca845f87 req-fd72d116-92de-4263-a4a5-50cdc685f610 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:21.593221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-754dd073-ef96-4f74-9a40-73efca845f87 req-fd72d116-92de-4263-a4a5-50cdc685f610 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:21.593221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-754dd073-ef96-4f74-9a40-73efca845f87 req-fd72d116-92de-4263-a4a5-50cdc685f610 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:21.623425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-754dd073-ef96-4f74-9a40-73efca845f87 req-fd72d116-92de-4263-a4a5-50cdc685f610 service nova] Creating event network-vif-deleted:9069783b-8fb3-49b9-bb71-6253888a56ec for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:21.647996 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-754dd073-ef96-4f74-9a40-73efca845f87 req-fd72d116-92de-4263-a4a5-50cdc685f610 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087083 Oct 17 13:54:21.648598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3136/6261] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:54:21.975703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.994595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.996195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:21.997845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7eed71e6-8ab4-44e8-a27e-46002ad2737e tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2868 microversion: 2.42 time: 0.471300 Oct 17 13:54:21.999487 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3126/6262] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:21 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2868 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:23.014237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-718f790a-0fdc-4c08-a0e6-fb0cb1786036 req-5bdacfe6-ba13-46a0-a631-6d0137679935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-unplugged", "status": "completed", "tag": "e5a102b4-b665-4bce-9306-7587ad11f039"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:23.028354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:23.029063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:23.039982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-718f790a-0fdc-4c08-a0e6-fb0cb1786036 req-5bdacfe6-ba13-46a0-a631-6d0137679935 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.040502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-718f790a-0fdc-4c08-a0e6-fb0cb1786036 req-5bdacfe6-ba13-46a0-a631-6d0137679935 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.040948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-718f790a-0fdc-4c08-a0e6-fb0cb1786036 req-5bdacfe6-ba13-46a0-a631-6d0137679935 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.050752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.051272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.051844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.052459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.052923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.053393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.077111 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-718f790a-0fdc-4c08-a0e6-fb0cb1786036 req-5bdacfe6-ba13-46a0-a631-6d0137679935 service nova] Creating event network-vif-unplugged:e5a102b4-b665-4bce-9306-7587ad11f039 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:23.088325 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-718f790a-0fdc-4c08-a0e6-fb0cb1786036 req-5bdacfe6-ba13-46a0-a631-6d0137679935 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078166 Oct 17 13:54:23.089711 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3137/6263] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:23.489842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.516320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.520827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:23.526923 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0dd61bbb-99da-4e7f-af8b-1510ee1eed21 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2708 microversion: 2.42 time: 0.501072 Oct 17 13:54:23.533884 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3127/6264] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:23 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2708 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:23.725186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-30aeb323-cc86-45e6-8bee-06973eb6c3af req-41fcadf5-d29f-4a44-9bbb-00e8effb5d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-deleted", "tag": "99643dd1-fc6e-48a6-9634-d8c672f748e0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:23.751899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-30aeb323-cc86-45e6-8bee-06973eb6c3af req-41fcadf5-d29f-4a44-9bbb-00e8effb5d3d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:23.758716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-30aeb323-cc86-45e6-8bee-06973eb6c3af req-41fcadf5-d29f-4a44-9bbb-00e8effb5d3d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:23.759149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-30aeb323-cc86-45e6-8bee-06973eb6c3af req-41fcadf5-d29f-4a44-9bbb-00e8effb5d3d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:23.802403 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-30aeb323-cc86-45e6-8bee-06973eb6c3af req-41fcadf5-d29f-4a44-9bbb-00e8effb5d3d service nova] Creating event network-vif-deleted:99643dd1-fc6e-48a6-9634-d8c672f748e0 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:23.816780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-30aeb323-cc86-45e6-8bee-06973eb6c3af req-41fcadf5-d29f-4a44-9bbb-00e8effb5d3d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102653 Oct 17 13:54:23.817454 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3138/6265] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:25.021321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:25.021951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:25.031774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.039369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.041319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.041970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.042449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.042888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.146653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-unplugged", "status": "completed", "tag": "fdee7579-931a-473e-b96c-29739087492b"}, {"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-unplugged", "status": "completed", "tag": "d5658839-16bb-481c-9660-53c64df97628"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:25.158550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.159793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.160579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.177808 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] Creating event network-vif-unplugged:fdee7579-931a-473e-b96c-29739087492b for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:25.178549 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] Creating event network-vif-unplugged:d5658839-16bb-481c-9660-53c64df97628 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:25.190122 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1692e104-4578-4953-b0a6-c5d317274003 req-cdd02cb0-8d28-4096-b5af-169c0960816e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.048984 Oct 17 13:54:25.191494 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3139/6266] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:25.264457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.276647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.278543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:25.279650 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8993fc4f-1177-4e8d-9c06-e6b9e54d8996 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 2373 microversion: 2.42 time: 0.723938 Oct 17 13:54:25.280681 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3128/6267] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:24 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 2373 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:25.892998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-deleted", "tag": "e5a102b4-b665-4bce-9306-7587ad11f039"}, {"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-deleted", "tag": "d5658839-16bb-481c-9660-53c64df97628"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:25.907395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:25.908057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:25.908664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:25.935499 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] Creating event network-vif-deleted:e5a102b4-b665-4bce-9306-7587ad11f039 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:25.936216 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] Creating event network-vif-deleted:d5658839-16bb-481c-9660-53c64df97628 for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:25.949080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d3204048-14b9-4d42-87fd-363ccaa2af80 req-c2d8c106-d326-4400-8fbd-2bdfda5daa7a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.060956 Oct 17 13:54:25.955038 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3140/6268] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:26.311232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:26.312786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:26.332784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.333664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.339269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.344409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:26.348236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:26.348983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:26.479793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.496883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.501781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:26.504875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9d1a609-4851-4a63-a2f7-56a603105378 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.196208 Oct 17 13:54:26.509315 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3129/6269] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:26 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:27.567955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:27.569479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:27.578880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.579636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.580238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.581826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:27.582527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:27.583149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:27.698818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.710152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.711961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:27.713747 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e133fbca-63b4-49c1-85ee-d641733b5d7a tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.152041 Oct 17 13:54:27.714670 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3141/6270] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:27 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:27.996783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-de6e952c-d46b-4188-b1b3-d0317c24b5be req-f8392ea3-3f97-4dd1-b166-c9487133ac43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9d39575-4575-4756-94b0-313f21eb88e8", "name": "network-vif-deleted", "tag": "fdee7579-931a-473e-b96c-29739087492b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:54:28.035898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de6e952c-d46b-4188-b1b3-d0317c24b5be req-f8392ea3-3f97-4dd1-b166-c9487133ac43 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.036770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de6e952c-d46b-4188-b1b3-d0317c24b5be req-f8392ea3-3f97-4dd1-b166-c9487133ac43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.037442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de6e952c-d46b-4188-b1b3-d0317c24b5be req-f8392ea3-3f97-4dd1-b166-c9487133ac43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.052335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-de6e952c-d46b-4188-b1b3-d0317c24b5be req-f8392ea3-3f97-4dd1-b166-c9487133ac43 service nova] Creating event network-vif-deleted:fdee7579-931a-473e-b96c-29739087492b for instance d9d39575-4575-4756-94b0-313f21eb88e8 on n-h1-854121-14 Oct 17 13:54:28.062703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-de6e952c-d46b-4188-b1b3-d0317c24b5be req-f8392ea3-3f97-4dd1-b166-c9487133ac43 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081407 Oct 17 13:54:28.065378 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3130/6271] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:54:28.743163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:28.744618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:28.753654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.754169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.754799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.755740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:28.756213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:28.756646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:28.834473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.845504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.848213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:28.849683 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ecd6b845-f271-4c5f-85dc-7e117b171c37 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.111459 Oct 17 13:54:28.850889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3142/6272] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:28 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:29.884962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:29.891836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:29.928783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.932525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.936027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:29.938740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:29.942782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:29.945888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:30.080886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.095928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.099178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:30.100501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0feaa92a-3d3f-4846-a3b7-75d57944a315 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.225528 Oct 17 13:54:30.101081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3131/6273] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:29 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:31.127729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:31.128628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:31.136211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.137001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.137594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.138482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:31.139060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:31.139862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:31.213546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:31.224062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:31.225863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:31.227183 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5425459e-96f9-4c07-8076-9fe7eecd0338 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.103912 Oct 17 13:54:31.227850 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3143/6274] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:31 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:32.254006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:32.254871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:32.262320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.262910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.263429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.264215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:32.264748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:32.265442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:32.356666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.367824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.369335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:32.370708 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4ab9077-27d7-4fb3-8b4b-db8e17da4eaa tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.120903 Oct 17 13:54:32.381952 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3132/6275] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:32 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:33.399381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:33.400153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:33.407330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.407582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.408225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.409754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:33.410376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:33.411304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:33.485818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.496380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.498190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:33.499531 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-126455d9-25ec-4242-80e3-e0f44de08f99 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.104300 Oct 17 13:54:33.500222 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3144/6276] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:33 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 17 13:54:34.527181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:34.528066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:34.536304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.537008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.537415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.538234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:34.538899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:34.539404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:34.612782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:34.623135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:34.624697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:34.626004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d7c3d08-4c0c-4fbe-9b45-284aa47474cb tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.102943 Oct 17 13:54:34.626642 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3133/6277] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:34 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:35.657123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:35.659072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:35.665846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.666619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.667092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.667798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:35.668430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:35.668862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:35.753017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.764639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.766382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:35.768913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39d35875-5cec-4248-af3d-141c88b4e6a7 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.118887 Oct 17 13:54:35.770307 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3145/6278] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:35 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:36.796618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:36.797293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:36.805446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.805944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.806388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.807107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:36.807563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:36.807995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:36.894830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.905444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.907468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:36.908759 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d57b8286-a899-4bae-8899-2e9b05fc6e4d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.116310 Oct 17 13:54:36.909335 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3134/6279] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:36 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:37.935467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:37.936288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:37.944049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.944992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.945834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:37.946761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:37.947288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:37.947826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:38.015097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:38.025256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:38.026938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:38.028305 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92348947-19e8-46dd-ad2d-15a878a9217f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.096982 Oct 17 13:54:38.046270 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3146/6280] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:37 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:39.059737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:39.060955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:39.068965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.070082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.071036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.071036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:39.071308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:39.072756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:39.145513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.157073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.159745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:39.161152 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d78db64-9447-43ab-b719-05fe4ee367e0 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.105508 Oct 17 13:54:39.162232 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3135/6281] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:39 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:40.192878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:40.194316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:40.203226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.204318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.204997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.207004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:40.207759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:40.208660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:40.284191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:40.295079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:40.297041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:40.297916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8956c752-7584-4199-9416-0303289cd65f tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.110173 Oct 17 13:54:40.310170 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3147/6282] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:40 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:41.325039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:41.326344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:41.334347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.335160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.335844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.336795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:41.337449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:41.338118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:41.416728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.427501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.429010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:41.430404 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21cf2bc4-508e-4834-af44-66aeed8ae701 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1605 microversion: 2.42 time: 0.110029 Oct 17 13:54:41.437309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3136/6283] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:41 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1605 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:42.459314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:42.460492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:42.468176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.468661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.469217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.469960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.470408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.470831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.511590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:42.512319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:42.512786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:42.513550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lazy-loading 'fault' on Instance uuid d9d39575-4575-4756-94b0-313f21eb88e8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:54:42.559722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:42.576078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:42.577640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dedc9e05ac2d4637b887bac06ba94650', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89798cf615704cbeb708a397dbe1cc9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:54:42.578855 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-631955e0-45f6-49c1-8cdc-9faeb34e60a3 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 200 len: 1372 microversion: 2.42 time: 0.124684 Oct 17 13:54:42.582028 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3148/6284] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:42 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 17 13:54:43.606743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:43.607294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:43.615113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:43.615946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:43.616636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:43.617416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:43.617893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:43.618329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:43.635663 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] HTTP exception thrown: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Request method failure captured: Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 HTTP/1.1 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV1bVEEvggEIu7GsafqmilG1pTjDjdAizB0V9aQcRtb0MdSywYl7CeU0wjv592Fx34FvwgOVFruRacTrtAFKbE4W3L9EIDfnHBooP0wMnG9WeNMy9RyEg8Rxe1IsqQKWKCL-HIO9Ro9ljk13nrJgCOhhOAkXdXYT31IVHm2loofrGnA Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 89798cf615704cbeb708a397dbe1cc9c Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 89798cf615704cbeb708a397dbe1cc9c Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TaggedBootDevicesTest_v242-1553179540-project Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dedc9e05ac2d4637b887bac06ba94650 Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1553179540-project Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd9d39575-4575-4756-94b0-313f21eb88e8'} Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:43.640698 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Returning 404 to user: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-275335b8-a933-43b2-a851-26a37560a147 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 404 len: 111 microversion: 2.42 time: 0.039917 Oct 17 13:54:43.646720 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3137/6285] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:43 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:54:43.653426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fce62da6-59f2-4c8b-838c-0fcf07042070 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '.version_select at 0x7f419dd80280>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:43.677575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fce62da6-59f2-4c8b-838c-0fcf07042070 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506634072" status: 204 len: 0 microversion: 2.42 time: 0.028150 Oct 17 13:54:43.678274 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3149/6286] 10.222.0.65 () {60 vars in 1262 bytes} [Mon Oct 17 13:54:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506634072 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:54:47.471479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:47.472809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:47.479620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=29 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:47.481646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.482324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.482769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.483566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.484025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.484453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.488796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=77 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:47.513190 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] HTTP exception thrown: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Request method failure captured: Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 HTTP/1.1 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV1bVEEvggEIu7GsafqmilG1pTjDjdAizB0V9aQcRtb0MdSywYl7CeU0wjv592Fx34FvwgOVFruRacTrtAFKbE4W3L9EIDfnHBooP0wMnG9WeNMy9RyEg8Rxe1IsqQKWKCL-HIO9Ro9ljk13nrJgCOhhOAkXdXYT31IVHm2loofrGnA Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 89798cf615704cbeb708a397dbe1cc9c Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 89798cf615704cbeb708a397dbe1cc9c Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TaggedBootDevicesTest_v242-1553179540-project Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: dedc9e05ac2d4637b887bac06ba94650 Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1553179540-project Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd9d39575-4575-4756-94b0-313f21eb88e8'} Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:47.514831 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Returning 404 to user: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01999395-4357-4bff-b4e9-841d2194d068 tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 404 len: 111 microversion: 2.42 time: 0.052962 Oct 17 13:54:47.519935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3138/6287] 10.222.0.65 () {60 vars in 1280 bytes} [Mon Oct 17 13:54:47 2022] DELETE /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 17 13:54:47.528322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:54:47.529091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] [instance: d9d39575-4575-4756-94b0-313f21eb88e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:54:47.537114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:47.539511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.540207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.540749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.541627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:54:47.542337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:54:47.542869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:54:47.559524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:54:47.562036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] HTTP exception thrown: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Request method failure captured: Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 HTTP/1.1 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV1bVEEvggEIu7GsafqmilG1pTjDjdAizB0V9aQcRtb0MdSywYl7CeU0wjv592Fx34FvwgOVFruRacTrtAFKbE4W3L9EIDfnHBooP0wMnG9WeNMy9RyEg8Rxe1IsqQKWKCL-HIO9Ro9ljk13nrJgCOhhOAkXdXYT31IVHm2loofrGnA Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.42 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 89798cf615704cbeb708a397dbe1cc9c Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_89798cf615704cbeb708a397dbe1cc9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 89798cf615704cbeb708a397dbe1cc9c Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1553179540 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TaggedBootDevicesTest_v242-1553179540-project Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: dedc9e05ac2d4637b887bac06ba94650 Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1553179540-project Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'd9d39575-4575-4756-94b0-313f21eb88e8'} Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.565227 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. Oct 17 13:54:47.569580 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:54:47.571314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] Returning 404 to user: Instance d9d39575-4575-4756-94b0-313f21eb88e8 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:54:47.571475 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fe68afc-261f-46a6-81ef-d5842ce6718d tempest-TaggedBootDevicesTest_v242-1553179540 tempest-TaggedBootDevicesTest_v242-1553179540-project] 10.222.0.65 "GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8" status: 404 len: 111 microversion: 2.42 time: 0.048315 Oct 17 13:54:47.575570 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3150/6288] 10.222.0.65 () {60 vars in 1277 bytes} [Mon Oct 17 13:54:47 2022] GET /compute/v2.1/servers/d9d39575-4575-4756-94b0-313f21eb88e8 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:55:14.841153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:14.843126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:15.021104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Action: 'create', calling method: .version_select at 0x7f419cac4c10>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:15.047114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Getting quotas for project 9a6050ce6126486a9049c43968bd9aac. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:15.064827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Getting quotas for user 1043644fb6434c238f88d571d97e71af and project 9a6050ce6126486a9049c43968bd9aac. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:15.105805 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] [661d870a-e61f-4b3f-b903-130bd3e92676] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 13:55:16.115527 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] [661d870a-e61f-4b3f-b903-130bd3e92676] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 42804. Oct 17 13:55:16.151657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Getting quotas for project 9a6050ce6126486a9049c43968bd9aac. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:16.158978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Getting quotas for user 1043644fb6434c238f88d571d97e71af and project 9a6050ce6126486a9049c43968bd9aac. Resources: {'server_groups'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:16.200552 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad9f5c5d-854f-473b-887a-f2939cc1490a tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] 10.222.0.65 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.367018 Oct 17 13:55:16.201845 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3139/6289] 10.222.0.65 () {62 vars in 1214 bytes} [Mon Oct 17 13:55:14 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:55:16.224867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b5b34f85-ba4c-4e7c-82b3-f9c5a52b57c9 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:16.242721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b5b34f85-ba4c-4e7c-82b3-f9c5a52b57c9 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.022428 Oct 17 13:55:16.249528 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3151/6290] 10.222.0.65 () {60 vars in 1193 bytes} [Mon Oct 17 13:55:16 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:55:16.255921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-108fd8ae-2978-4a59-906d-607746ae394d tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:16.265808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-108fd8ae-2978-4a59-906d-607746ae394d tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] 10.222.0.65 "GET /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a" status: 200 len: 235 microversion: 2.64 time: 0.014704 Oct 17 13:55:16.278519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ce99488-45e4-4440-b9dc-659ee074c02e tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:16.280723 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3140/6291] 10.222.0.65 () {60 vars in 1304 bytes} [Mon Oct 17 13:55:16 2022] GET /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a => generated 235 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 13:55:16.310134 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ce99488-45e4-4440-b9dc-659ee074c02e tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a" status: 204 len: 0 microversion: 2.64 time: 0.036062 Oct 17 13:55:16.321512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36d95cbf-13b9-4805-b699-f7a724f114a4 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:16.324893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3152/6292] 10.222.0.65 () {60 vars in 1307 bytes} [Mon Oct 17 13:55:16 2022] DELETE /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 17 13:55:16.328947 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-36d95cbf-13b9-4805-b699-f7a724f114a4 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] HTTP exception thrown: Instance group a7ac871b-66dc-43c3-8edd-e9dae1bd683a could not be found. Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36d95cbf-13b9-4805-b699-f7a724f114a4 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Request method failure captured: Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a HTTP/1.1 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV7COQIEz-Wo8ymGZEW57d7cjyfwu0KMYtLNS3VH96R2zFReeDCfdwlVfDoWd6a2-mcobg8g07DHmIygbRyCfv1yaYigGPKSS9FSis_lWtmdkg8Fc3zdi1h7tlrHAXWMPfLkqGDYmKVrbK6mtwIxyDzOPkFzSDKZONQk3FQSUjCtr4Y Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.64 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9a6050ce6126486a9049c43968bd9aac Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerGroup264TestJSON-961635236 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9a6050ce6126486a9049c43968bd9aac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a6050ce6126486a9049c43968bd9aac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9a6050ce6126486a9049c43968bd9aac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9a6050ce6126486a9049c43968bd9aac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerGroup264TestJSON-961635236 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9a6050ce6126486a9049c43968bd9aac Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerGroup264TestJSON-961635236 Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerGroup264TestJSON-961635236-project Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 1043644fb6434c238f88d571d97e71af Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerGroup264TestJSON-961635236-project Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance group a7ac871b-66dc-43c3-8edd-e9dae1bd683a could not be found. Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'a7ac871b-66dc-43c3-8edd-e9dae1bd683a'} Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a7ac871b-66dc-43c3-8edd-e9dae1bd683a could not be found. Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a7ac871b-66dc-43c3-8edd-e9dae1bd683a could not be found. Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:55:16.331232 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:16.336126 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:16.336126 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:16.336126 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:16.336126 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:16.336126 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a7ac871b-66dc-43c3-8edd-e9dae1bd683a could not be found. Oct 17 13:55:16.336126 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:55:16.337944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36d95cbf-13b9-4805-b699-f7a724f114a4 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] Returning 404 to user: Instance group a7ac871b-66dc-43c3-8edd-e9dae1bd683a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:16.339207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36d95cbf-13b9-4805-b699-f7a724f114a4 tempest-ServerGroup264TestJSON-961635236 tempest-ServerGroup264TestJSON-961635236-project] 10.222.0.65 "DELETE /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a" status: 404 len: 117 microversion: 2.64 time: 0.021491 Oct 17 13:55:16.344228 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3141/6293] 10.222.0.65 () {60 vars in 1307 bytes} [Mon Oct 17 13:55:16 2022] DELETE /compute/v2.1/os-server-groups/a7ac871b-66dc-43c3-8edd-e9dae1bd683a => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 17 13:55:28.366561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:28.368116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:28.694259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1192016250", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:29.153125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] validate_networks() for [('3b6193a6-a832-4862-b0c7-8b7fc5ecc2ed', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:55:30.184115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:55:30.190215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:55:30.190724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:55:30.191148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:55:30.191577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:55:30.201830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:30.202120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:30.202553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:30.203296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:30.203756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:30.204221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:30.278279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Getting quotas for project da91b768eea74a28bd3eda50de9cb41b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:55:30.287578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Getting quotas for user 3c6dc16948fa4c81ab3b7144fd67b2c8 and project da91b768eea74a28bd3eda50de9cb41b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:55:30.317458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:55:30.319864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:55:30.411733 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea8c87d7-b4e9-4396-b919-74965e462ea2 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.047037 Oct 17 13:55:30.428584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4816ef5a-3ddc-400a-9c4a-2e7d26657df7 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:30.429875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4816ef5a-3ddc-400a-9c4a-2e7d26657df7 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:30.433582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3153/6294] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:55:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:55:30.444345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:30.446142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:31.210975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4816ef5a-3ddc-400a-9c4a-2e7d26657df7 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:31.222091 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4816ef5a-3ddc-400a-9c4a-2e7d26657df7 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1223 microversion: 2.1 time: 0.797310 Oct 17 13:55:31.223016 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3142/6295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:30 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1223 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:32.252089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:32.252723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:32.282797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.283937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.284588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.285437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.286055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.286598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.333008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:32.334807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:32.345398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.346211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.350528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.351483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:32.352147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:32.352741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:32.422040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:32.435780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a95c2cf-2f2b-4747-bdfd-a7966a486160 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1281 microversion: 2.1 time: 0.188845 Oct 17 13:55:32.436922 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3154/6296] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:32 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:32.453403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lazy-loading 'services' on Instance uuid 20a086f8-3190-4851-badb-e616a34e795e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:55:32.554557 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3719ddd-7031-4295-8690-2fe910be7a11 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "DELETE /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e/os-volume_attachments/4d44fef8-8c60-476f-9b7b-26c037f01631" status: 202 len: 0 microversion: 2.1 time: 0.211457 Oct 17 13:55:32.557939 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3143/6297] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:55:32 2022] DELETE /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e/os-volume_attachments/4d44fef8-8c60-476f-9b7b-26c037f01631 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:55:33.463906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:33.464535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:33.477178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:33.477679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:33.478116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:33.484489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:33.485428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:33.487266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:33.851938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:33.861695 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83401a1a-b5d8-4de6-9be6-a7ed3ea2c69c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.405383 Oct 17 13:55:33.862296 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3155/6298] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:33 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:34.296502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e76b8877-ba72-4e60-b490-22bc9816ff31 req-56ec0913-bf46-431b-83a2-a8bf93ccdea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:34.311905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e76b8877-ba72-4e60-b490-22bc9816ff31 req-56ec0913-bf46-431b-83a2-a8bf93ccdea9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.312623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e76b8877-ba72-4e60-b490-22bc9816ff31 req-56ec0913-bf46-431b-83a2-a8bf93ccdea9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.315386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e76b8877-ba72-4e60-b490-22bc9816ff31 req-56ec0913-bf46-431b-83a2-a8bf93ccdea9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:34.378316 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e76b8877-ba72-4e60-b490-22bc9816ff31 req-56ec0913-bf46-431b-83a2-a8bf93ccdea9 service nova] Creating event network-changed:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:55:34.389796 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e76b8877-ba72-4e60-b490-22bc9816ff31 req-56ec0913-bf46-431b-83a2-a8bf93ccdea9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098354 Oct 17 13:55:34.398079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3144/6299] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:34.884477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:34.885031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:34.892744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.893373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.893814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:34.894713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:34.895370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:34.895804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:35.099679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:35.107954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66683117-8ac9-43f4-a9cf-82c3f8e47206 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.227746 Oct 17 13:55:35.108548 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3156/6300] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:34 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:36.132154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:36.132863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:36.135226 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:55:36.135570 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 13:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c (ip 10.222.0.65) !!! Oct 17 13:55:36.147835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.148576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.149202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.150104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:36.150709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:36.151294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:36.412516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:36.421729 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d220f822-8257-4c57-bebb-b2e0aafad3d6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.293706 Oct 17 13:55:36.441762 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3145/6301] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:36 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:37.447828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:37.448480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:37.455920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:37.456419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:37.456865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:37.458063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:37.458063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:37.458504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:37.604636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:37.614000 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df3d8185-e395-4111-8ad4-b5420f74a835 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.170018 Oct 17 13:55:37.614796 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3157/6302] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:37 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:38.130379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.130944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:38.138110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.138598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.139044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.139738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.140184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.140605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.166761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:55:38.252620 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b89e33a7-d9d7-4b2f-b94e-aef272257c0a tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "DELETE /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 204 len: 0 microversion: 2.1 time: 0.125507 Oct 17 13:55:38.253387 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3146/6303] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:55:38 2022] DELETE /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:55:38.261918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.262544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:38.269405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.269896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.270335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.271037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.271495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.271947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.405923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:38.414406 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f69214fb-e9db-4da5-8ad7-530a91be6c7c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1469 microversion: 2.1 time: 0.156452 Oct 17 13:55:38.414985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3158/6304] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:38 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:38.637591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:38.638286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:38.645076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.645642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.646120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.646868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:38.647421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:38.647882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:38.799034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:38.806941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53fb76ec-7437-4720-9287-1c3f473a4142 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.173925 Oct 17 13:55:38.807514 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3147/6305] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:38 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:39.438194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:39.440184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:39.447770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:39.448387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:39.449027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:39.449831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:39.450290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:39.450930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:39.591685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:39.599754 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e25de618-9b33-42a4-a8d3-f3304cd5a0c1 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1469 microversion: 2.1 time: 0.165450 Oct 17 13:55:39.600338 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3159/6306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:39 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:39.830905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:39.831469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:39.841888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:39.842388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:39.842827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:39.843541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:39.843993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:39.844419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:39.989652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:39.999518 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0605f2ba-913e-4be3-b1dd-87c5c6492e86 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.172942 Oct 17 13:55:40.000223 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3148/6307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:39 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:40.521741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7758fa17-f0df-40b8-8abc-81e74d97d9b2 req-592ad20e-834e-421e-a1cf-34cff688017c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a086f8-3190-4851-badb-e616a34e795e", "name": "network-vif-deleted", "tag": "f8baa73e-a479-4f01-976a-b4f4ef053257"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:40.528934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:40.529638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:40.537997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7758fa17-f0df-40b8-8abc-81e74d97d9b2 req-592ad20e-834e-421e-a1cf-34cff688017c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.538742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7758fa17-f0df-40b8-8abc-81e74d97d9b2 req-592ad20e-834e-421e-a1cf-34cff688017c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.539365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7758fa17-f0df-40b8-8abc-81e74d97d9b2 req-592ad20e-834e-421e-a1cf-34cff688017c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.555095 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7758fa17-f0df-40b8-8abc-81e74d97d9b2 req-592ad20e-834e-421e-a1cf-34cff688017c service nova] Creating event network-vif-deleted:f8baa73e-a479-4f01-976a-b4f4ef053257 for instance 20a086f8-3190-4851-badb-e616a34e795e on n-h2-854121-14 Oct 17 13:55:40.560234 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7758fa17-f0df-40b8-8abc-81e74d97d9b2 req-592ad20e-834e-421e-a1cf-34cff688017c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044073 Oct 17 13:55:40.560846 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3160/6308] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:40.624912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:40.625562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:40.639463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.639941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.640381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.641091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.642679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.643234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.676883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:40.677645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:40.678079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:40.678527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lazy-loading 'fault' on Instance uuid 20a086f8-3190-4851-badb-e616a34e795e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:55:40.724356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd8fa9f44e684b49803faad12bd50811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c279b84b5624d61a52a3d52fd2e96ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:40.732254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df100317-06a0-48f4-bb40-05410b76cb5c tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 200 len: 1304 microversion: 2.1 time: 0.111291 Oct 17 13:55:40.732831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3149/6309] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:40 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:41.023379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:41.024382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:41.036768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.037678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.038511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.052740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.053496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.053983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.218456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:41.227392 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-037ce800-d82f-419d-865e-638447c98f8a tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.208185 Oct 17 13:55:41.228934 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3161/6310] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:41 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:41.427959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d0577462-4955-4e60-864b-e950229da0a8 req-68f83903-ad50-47e4-8a66-07f913873129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "name": "network-vif-plugged", "status": "completed", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:41.436293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:41.441465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d0577462-4955-4e60-864b-e950229da0a8 req-68f83903-ad50-47e4-8a66-07f913873129 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.442194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d0577462-4955-4e60-864b-e950229da0a8 req-68f83903-ad50-47e4-8a66-07f913873129 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.442966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d0577462-4955-4e60-864b-e950229da0a8 req-68f83903-ad50-47e4-8a66-07f913873129 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.456588 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d0577462-4955-4e60-864b-e950229da0a8 req-68f83903-ad50-47e4-8a66-07f913873129 service nova] Creating event network-vif-plugged:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:55:41.465065 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d0577462-4955-4e60-864b-e950229da0a8 req-68f83903-ad50-47e4-8a66-07f913873129 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040832 Oct 17 13:55:41.466043 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3150/6311] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:55:41.757136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:41.757856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] [instance: 20a086f8-3190-4851-badb-e616a34e795e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:41.765503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.765988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.766451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.767503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:41.767956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:41.768379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:41.783540 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] HTTP exception thrown: Instance 20a086f8-3190-4851-badb-e616a34e795e could not be found. Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Request method failure captured: Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e HTTP/1.1 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV5tO15WeLVOh79Ly9rFNhNqppEFpKVM7CKq7Jc5h-I2diVuP4rVXINwoas4z0cDZ7l3p_Ce8gRPWS50q2c7Y3kzs2H1DBdgw9V0zmVISrypDiYVB8djkKZlLHNozV26P32wpsMFJNMZo-gmXnzvk8esR_tQu8oVKdXYnF2hX3AVSFM Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2c279b84b5624d61a52a3d52fd2e96ac Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesBackupsTest-720108259 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c279b84b5624d61a52a3d52fd2e96ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c279b84b5624d61a52a3d52fd2e96ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c279b84b5624d61a52a3d52fd2e96ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c279b84b5624d61a52a3d52fd2e96ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesBackupsTest-720108259 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2c279b84b5624d61a52a3d52fd2e96ac Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesBackupsTest-720108259 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesBackupsTest-720108259-project Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: cd8fa9f44e684b49803faad12bd50811 Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesBackupsTest-720108259-project Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 20a086f8-3190-4851-badb-e616a34e795e could not be found. Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '20a086f8-3190-4851-badb-e616a34e795e'} Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20a086f8-3190-4851-badb-e616a34e795e could not be found. Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20a086f8-3190-4851-badb-e616a34e795e could not be found. Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:55:41.784982 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20a086f8-3190-4851-badb-e616a34e795e could not be found. Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] Returning 404 to user: Instance 20a086f8-3190-4851-badb-e616a34e795e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3490daa4-0c84-4268-a4de-1ca2eb66cd91 tempest-VolumesBackupsTest-720108259 tempest-VolumesBackupsTest-720108259-project] 10.222.0.65 "GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e" status: 404 len: 111 microversion: 2.1 time: 0.033583 Oct 17 13:55:41.790098 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3162/6312] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:41 2022] GET /compute/v2.1/servers/20a086f8-3190-4851-badb-e616a34e795e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:55:42.254597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:42.255973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:42.264097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:42.264925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:42.266112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:42.267438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:42.268108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:42.268838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:42.455537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:42.464790 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca38a644-70a6-46d2-99a6-1ed75d319575 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1323 microversion: 2.1 time: 0.216423 Oct 17 13:55:42.465615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3151/6313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:42 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:43.497595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:43.498284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:43.507015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.507734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.508342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.509256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.509865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.510460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.656620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:43.665858 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4be0ac7c-eb32-47b5-b978-99d462553c74 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1517 microversion: 2.1 time: 0.181056 Oct 17 13:55:43.682802 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3163/6314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:43 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:43.692421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:55:43.695389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:43.702983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.703502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.704725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.705677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.706354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.706936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.735757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lazy-loading 'flavor' on Instance uuid eb9b9a76-66ee-40b4-a59d-7c6b2605e08c {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:55:43.851826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8fba202d-6c29-4b54-8f70-176998255d0c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action" status: 200 len: 32 microversion: 2.1 time: 0.164463 Oct 17 13:55:43.853231 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3152/6315] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:55:43 2022] POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 13:55:43.867197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:43.868027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:43.894566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.897073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.898832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:43.903069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:43.906994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:43.909128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:44.180993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:44.193640 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-19538436-858e-405f-bdc8-e6cc3e5a39cc tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.331437 Oct 17 13:55:44.194536 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3164/6316] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:43 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:45.218630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:45.219408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:45.237021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.238212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.238870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.239790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:45.240439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:45.240975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:45.495305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:45.520567 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-acfeae93-99e9-47e9-90e8-c18de7d20c4f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.306451 Oct 17 13:55:45.534555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3153/6317] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:45 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:46.548525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:46.550238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:46.560009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:46.561134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:46.562150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:46.564596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:46.565311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:46.566434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:46.716200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:46.725429 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8018ffd-fae4-4b9b-b741-f295b5df8e52 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.182514 Oct 17 13:55:46.726425 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3165/6318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:46 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:47.752329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:47.753601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:47.760264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:47.761035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:47.761714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:47.762585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:47.763195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:47.763759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:47.932394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:47.940821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a7e0ad2-29c5-4fc0-a81f-c1b1572ca4a0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.192501 Oct 17 13:55:47.941749 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3154/6319] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:47 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:48.971196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:48.972042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:48.979084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:48.979573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:48.980014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:48.980720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:48.981185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:48.981619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:49.121616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:49.132437 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a72f746e-d559-4c70-a809-755a06b80681 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.165666 Oct 17 13:55:49.133076 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3166/6320] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:48 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:50.156160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:50.157516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:50.164704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:50.165324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:50.165842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:50.166824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:50.167290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:50.168032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:50.319226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:50.328243 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec95124d-61d9-4b34-ba00-a21cdf2b565c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.175989 Oct 17 13:55:50.329700 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3155/6321] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:50 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:51.352197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:51.352877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:51.361649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.362144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.362583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.363683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:51.364148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:51.364577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:51.520042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:51.529221 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a01ac29-6310-4e77-a06e-a425c2067fe8 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.181053 Oct 17 13:55:51.530099 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3167/6322] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:51 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:52.563041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:52.564256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:52.573467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:52.573896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:52.574343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:52.575056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:52.575517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:52.576000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:52.582238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:52.740868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:52.754547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a40fe9a6-90b2-4fd6-978a-9de2870af27d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.205895 Oct 17 13:55:52.755139 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3156/6323] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:52 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:55:53.778439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:53.779057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:53.788104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:53.788628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:53.789067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:53.789809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:53.790529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:53.790948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:53.937327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:53.946584 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4459bf81-9a7e-49c4-8c20-54d860e53412 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.172103 Oct 17 13:55:53.947756 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3168/6324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:53 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:54.970576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:54.971179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:54.978761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:54.979256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:54.979698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:54.980413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:54.980876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:54.981358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:55.135439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:55.153121 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a884859-5f7b-4baa-84a5-282b50e7b214 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.186682 Oct 17 13:55:55.153902 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3157/6325] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:54 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:56.176311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:56.177226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:56.184654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.185145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.185842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.186613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:56.187615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:56.192365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:56.337559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:56.364335 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc451ede-585b-4551-aa3c-3b3d56d77f2c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.191811 Oct 17 13:55:56.389271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3169/6326] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:56 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:57.388592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:57.389230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:57.398067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:57.398734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:57.399346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.400219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:57.400831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:57.401446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:57.549188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:57.557419 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2179ea21-8dbd-451b-be0c-d094ebc45428 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.172834 Oct 17 13:55:57.558269 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3158/6327] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:57 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:58.580924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:58.582488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:58.586695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:58.591642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:58.592237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:58.592760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:58.593723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:58.594665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:58.595148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:58.599528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=91 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:55:58.757459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:58.765402 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2b20b30-0720-4270-9f98-e9f42bda1b6f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.189389 Oct 17 13:55:58.766977 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3170/6328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:58 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:55:59.790919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:55:59.792303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:55:59.799115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.799726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.800265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.801078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:55:59.801655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:55:59.802193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:55:59.950418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:55:59.962662 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4463eb0e-aa35-4a3c-858c-9d9227256066 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.176697 Oct 17 13:55:59.963264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3159/6329] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:55:59 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:00.986684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:00.987363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:00.994392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.994801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.995430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:00.996129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:00.996579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:00.996998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:01.139541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:01.148967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-626df635-cd7e-4362-899d-6dfa2342a097 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.167056 Oct 17 13:56:01.150144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3171/6330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:00 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:02.172980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:02.173804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:02.176460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:02.182281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:02.182864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:02.183398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.184204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:02.184742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:02.185267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:02.340481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:02.350449 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-284e9ad2-d395-474e-84a6-448919b92fde tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.181706 Oct 17 13:56:02.351497 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3160/6331] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:02 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:03.375748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:03.376427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:03.384059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:03.384553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:03.384996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:03.385736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:03.386227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:03.386658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:03.528197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:03.536587 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c690072-a7a0-4bce-b143-5b38ab82f9a1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.165000 Oct 17 13:56:03.540701 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3172/6332] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:03 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:04.560712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:04.561444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:04.569689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.570284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.570805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.571596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:04.572128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:04.572629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:04.725690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:04.734194 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ce11d53-eef7-4dcd-b1a3-87a8610e79c0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.178133 Oct 17 13:56:04.735947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3161/6333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:04 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:05.759635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:05.761031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:05.769718 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.770699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.771315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.772192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:05.772793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:05.773486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:05.943559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:05.952682 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd8489d5-9e88-46cc-8e70-37f376ed17ec tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.196757 Oct 17 13:56:05.957210 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3173/6334] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:05 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:06.976234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:06.977086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:06.984962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:06.985766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:06.986319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:06.987432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:06.988068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:06.988682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:07.138146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:07.147632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3bf55539-9e3e-4c2f-9102-ca3abf6e4b14 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.175252 Oct 17 13:56:07.148170 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3162/6335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:06 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:08.172165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:08.172756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:08.180274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.180887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.181825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.182146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:08.182579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:08.183072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:08.333742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:08.342353 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9572e0bf-3c38-4e52-972a-db6754a4256c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.174117 Oct 17 13:56:08.342882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3174/6336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:08 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:09.366256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:09.366805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:09.373910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.374399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.374837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.375579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:09.376202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:09.376977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:09.520460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:09.537384 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a696e58-0a84-4d24-922b-22321ba1faa0 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.175229 Oct 17 13:56:09.538433 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3163/6337] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:09 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:10.562370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:10.566067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:10.584352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.584850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.585514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.586214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:10.587116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:10.587700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:10.745268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:10.755544 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e478b86-4432-410c-89a0-84f37b4bd96c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1523 microversion: 2.1 time: 0.199436 Oct 17 13:56:10.756339 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3175/6338] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:10 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:11.779866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:11.780593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:11.788419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.788913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.789386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.790095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:11.790556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:11.790995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:11.944206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:11.952501 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee458152-8705-4339-af83-476d1a81299d tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1503 microversion: 2.1 time: 0.176766 Oct 17 13:56:11.953274 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3164/6339] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:11 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:11.978374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18eaa6a3-2353-4af4-a764-46477973e3de tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'create', calling method: .version_select at 0x7f419db2dd30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1995106348", "description": "tempest-description-912258483"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:12.169889 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18eaa6a3-2353-4af4-a764-46477973e3de tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.195696 Oct 17 13:56:12.171490 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3176/6340] 10.222.0.65 () {60 vars in 1180 bytes} [Mon Oct 17 13:56:11 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:12.185440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1995106348"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:12.186786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:12.197281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.197778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.198216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.199285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.199897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.200474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.384055 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.network.security_group_api [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Adding security group d98fe067-dc27-48a2-b761-505554fe6e0e to port a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 Oct 17 13:56:12.764936 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c39406a-4781-48d7-9617-1d7fc253abf3 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action" status: 202 len: 0 microversion: 2.1 time: 0.583878 Oct 17 13:56:12.770359 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3165/6341] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:12 2022] POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:56:12.797779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1995106348"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:12.799202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:12.812448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-50227d3f-dab6-4544-b851-f4e1a493293f req-2f32fb7e-fadd-4e5c-8b20-5fec884dd5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:12.852342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.853977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.856580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.857623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.862284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.863459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.872292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50227d3f-dab6-4544-b851-f4e1a493293f req-2f32fb7e-fadd-4e5c-8b20-5fec884dd5c2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:12.873751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50227d3f-dab6-4544-b851-f4e1a493293f req-2f32fb7e-fadd-4e5c-8b20-5fec884dd5c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:12.874406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-50227d3f-dab6-4544-b851-f4e1a493293f req-2f32fb7e-fadd-4e5c-8b20-5fec884dd5c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:12.902213 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-50227d3f-dab6-4544-b851-f4e1a493293f req-2f32fb7e-fadd-4e5c-8b20-5fec884dd5c2 service nova] Creating event network-changed:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:56:12.911234 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-50227d3f-dab6-4544-b851-f4e1a493293f req-2f32fb7e-fadd-4e5c-8b20-5fec884dd5c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106474 Oct 17 13:56:12.915917 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3166/6342] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:13.155835 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Removing security group d98fe067-dc27-48a2-b761-505554fe6e0e from port a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 Oct 17 13:56:14.136734 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e51f7e6-eea8-4580-af9b-6f5770dd88e9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action" status: 202 len: 0 microversion: 2.1 time: 1.364554 Oct 17 13:56:14.137572 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3177/6343] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:12 2022] POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action => generated 0 bytes in 1366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:56:14.150937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62c9d71a-f94e-4335-9481-2ea005c5a4f9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'create', calling method: .version_select at 0x7f41a2166670>, body: {"pool": null} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:14.936065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2a267a35-b9ba-4869-b684-9405be59380d req-833430e4-3de9-42b1-917d-6a341e02f252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:14.947533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2a267a35-b9ba-4869-b684-9405be59380d req-833430e4-3de9-42b1-917d-6a341e02f252 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:14.948323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2a267a35-b9ba-4869-b684-9405be59380d req-833430e4-3de9-42b1-917d-6a341e02f252 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:14.948988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2a267a35-b9ba-4869-b684-9405be59380d req-833430e4-3de9-42b1-917d-6a341e02f252 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:14.964583 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2a267a35-b9ba-4869-b684-9405be59380d req-833430e4-3de9-42b1-917d-6a341e02f252 service nova] Creating event network-changed:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:56:14.971424 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2a267a35-b9ba-4869-b684-9405be59380d req-833430e4-3de9-42b1-917d-6a341e02f252 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038997 Oct 17 13:56:14.973062 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3178/6344] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:56:16.149013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62c9d71a-f94e-4335-9481-2ea005c5a4f9 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.004273 Oct 17 13:56:16.149765 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3167/6345] 10.222.0.65 () {60 vars in 1170 bytes} [Mon Oct 17 13:56:14 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:16.165331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.31"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:16.168304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:16.185239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.186040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.186429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.187258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:16.187871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:16.188569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:16.238981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "refresh_cache-eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:56:16.239479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquired lock "refresh_cache-eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:56:17.953517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Building network info cache for instance {{(pid=120698) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:56:17.976671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0694cb1b-10e1-4c4c-9cac-b4ee2e32e7a0 req-cfadc9cf-c17b-4338-9863-988980ea406e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:18.021609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0694cb1b-10e1-4c4c-9cac-b4ee2e32e7a0 req-cfadc9cf-c17b-4338-9863-988980ea406e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:18.026933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0694cb1b-10e1-4c4c-9cac-b4ee2e32e7a0 req-cfadc9cf-c17b-4338-9863-988980ea406e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:18.030326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0694cb1b-10e1-4c4c-9cac-b4ee2e32e7a0 req-cfadc9cf-c17b-4338-9863-988980ea406e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:18.049628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0694cb1b-10e1-4c4c-9cac-b4ee2e32e7a0 req-cfadc9cf-c17b-4338-9863-988980ea406e service nova] Creating event network-changed:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:56:18.068667 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0694cb1b-10e1-4c4c-9cac-b4ee2e32e7a0 req-cfadc9cf-c17b-4338-9863-988980ea406e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108030 Oct 17 13:56:18.070036 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3168/6346] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:19.042824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Updating instance_info_cache with network_info: [{"id": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6", "address": "fa:16:3e:01:61:9b", "network": {"id": "3b6193a6-a832-4862-b0c7-8b7fc5ecc2ed", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-777777219-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "da91b768eea74a28bd3eda50de9cb41b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6fdefd3-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120698) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:56:19.063783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Releasing lock "refresh_cache-eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:56:19.065351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-caa2cff3-6f37-477f-a2a6-3924cc74dc30 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action" status: 202 len: 0 microversion: 2.1 time: 2.906170 Oct 17 13:56:19.066279 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3179/6347] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:16 2022] POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action => generated 0 bytes in 2908 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 17 13:56:19.076443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.31"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:19.264568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:19.273063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:19.273630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:19.274078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:19.275828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:19.276306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:19.276741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:19.590497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "refresh_cache-eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 17 13:56:19.590901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquired lock "refresh_cache-eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 17 13:56:20.385470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Building network info cache for instance {{(pid=120697) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 17 13:56:20.404388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-25e08ef0-5ca3-4272-9f84-01f66003c78b req-7c4fee1f-ec61-4fab-97b1-92e530b1de52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:20.443242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-25e08ef0-5ca3-4272-9f84-01f66003c78b req-7c4fee1f-ec61-4fab-97b1-92e530b1de52 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:20.444105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-25e08ef0-5ca3-4272-9f84-01f66003c78b req-7c4fee1f-ec61-4fab-97b1-92e530b1de52 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:20.444763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-25e08ef0-5ca3-4272-9f84-01f66003c78b req-7c4fee1f-ec61-4fab-97b1-92e530b1de52 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:20.458187 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-25e08ef0-5ca3-4272-9f84-01f66003c78b req-7c4fee1f-ec61-4fab-97b1-92e530b1de52 service nova] Creating event network-changed:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:56:20.464684 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-25e08ef0-5ca3-4272-9f84-01f66003c78b req-7c4fee1f-ec61-4fab-97b1-92e530b1de52 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071933 Oct 17 13:56:20.465878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3180/6348] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:21.888667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Updating instance_info_cache with network_info: [{"id": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6", "address": "fa:16:3e:01:61:9b", "network": {"id": "3b6193a6-a832-4862-b0c7-8b7fc5ecc2ed", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-777777219-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "da91b768eea74a28bd3eda50de9cb41b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa6fdefd3-ce", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120697) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 17 13:56:21.907017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Releasing lock "refresh_cache-eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 17 13:56:21.908187 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7b4a28e-3e35-4829-9757-3535306bc07c tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action" status: 202 len: 0 microversion: 2.1 time: 2.837337 Oct 17 13:56:21.908834 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3169/6349] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 13:56:19 2022] POST /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c/action => generated 0 bytes in 2839 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 17 13:56:21.918784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01059cae-6d5e-48fb-82d4-80515f94a652 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '.version_select at 0x7f41a1f9a4c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:22.761625 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01059cae-6d5e-48fb-82d4-80515f94a652 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "DELETE /compute/v2.1/os-floating-ips/5f420c50-c88e-4ca2-af88-c82dbe227155" status: 202 len: 0 microversion: 2.1 time: 0.847866 Oct 17 13:56:22.767364 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3181/6350] 10.222.0.65 () {58 vars in 1263 bytes} [Mon Oct 17 13:56:21 2022] DELETE /compute/v2.1/os-floating-ips/5f420c50-c88e-4ca2-af88-c82dbe227155 => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:56:22.772680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a8c61e7-c7e4-452d-b367-ec6231372b8b tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '.version_select at 0x7f419d581310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:22.992355 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a8c61e7-c7e4-452d-b367-ec6231372b8b tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "DELETE /compute/v2.1/os-security-groups/d98fe067-dc27-48a2-b761-505554fe6e0e" status: 202 len: 0 microversion: 2.1 time: 0.222517 Oct 17 13:56:22.998681 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3170/6351] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 13:56:22 2022] DELETE /compute/v2.1/os-security-groups/d98fe067-dc27-48a2-b761-505554fe6e0e => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 13:56:23.003094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:23.004253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:23.024328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:23.025087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:23.025738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:23.026630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:23.027736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:23.028335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:23.080656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:56:23.215445 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93094c92-a1fd-41d0-b278-4b67318eda8e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 204 len: 0 microversion: 2.1 time: 0.216451 Oct 17 13:56:23.216597 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3182/6352] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:56:22 2022] DELETE /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 13:56:23.227410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:23.228302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:23.237778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:23.238443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:23.238895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:23.239611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:23.240073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:23.240506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:23.268265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=69,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:23.404317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:23.412981 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28bf8927-6890-45cb-8d0d-e2281e37884f tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1509 microversion: 2.1 time: 0.191984 Oct 17 13:56:23.413650 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3171/6353] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:23 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:24.437418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:24.438317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:24.446753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:24.447590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:24.448344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:24.449537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:24.450120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:24.450900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:24.598702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:24.610604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a86cbac5-8715-4c54-8650-6f8442b0e66e tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1509 microversion: 2.1 time: 0.175944 Oct 17 13:56:24.610604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3183/6354] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:24 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:25.637683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:25.638305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:25.646959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:25.647697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:25.648342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:25.649298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:25.651499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:25.652386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:25.840240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:25.851301 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b3892ab-8b68-416a-8327-54712d9625f6 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1509 microversion: 2.1 time: 0.217700 Oct 17 13:56:25.866235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3172/6355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:25 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:26.556356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2e19aa56-2f26-4d39-a274-29e92e6ae1fd req-60cbab2d-0c8c-4f5f-9bcc-6140467310ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9b9a76-66ee-40b4-a59d-7c6b2605e08c", "name": "network-vif-deleted", "tag": "a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:26.567035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2e19aa56-2f26-4d39-a274-29e92e6ae1fd req-60cbab2d-0c8c-4f5f-9bcc-6140467310ee service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:26.567787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2e19aa56-2f26-4d39-a274-29e92e6ae1fd req-60cbab2d-0c8c-4f5f-9bcc-6140467310ee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:26.568571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2e19aa56-2f26-4d39-a274-29e92e6ae1fd req-60cbab2d-0c8c-4f5f-9bcc-6140467310ee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:26.581579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2e19aa56-2f26-4d39-a274-29e92e6ae1fd req-60cbab2d-0c8c-4f5f-9bcc-6140467310ee service nova] Creating event network-vif-deleted:a6fdefd3-ce2d-473c-97cc-f8cbfc0236b6 for instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c on n-h1-854121-14 Oct 17 13:56:26.588143 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2e19aa56-2f26-4d39-a274-29e92e6ae1fd req-60cbab2d-0c8c-4f5f-9bcc-6140467310ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205379 Oct 17 13:56:26.589621 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3184/6356] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:26.880719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:26.881112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:26.890026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:26.891311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:26.892308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:26.893638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:26.894252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:26.895747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:26.941910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:26.942530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:26.942913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:26.943395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lazy-loading 'fault' on Instance uuid eb9b9a76-66ee-40b4-a59d-7c6b2605e08c {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:56:26.991062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6dc16948fa4c81ab3b7144fd67b2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b768eea74a28bd3eda50de9cb41b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:26.999266 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dfa730b2-5cb8-4a89-adb0-e894edd86cc1 tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 200 len: 1313 microversion: 2.1 time: 0.126147 Oct 17 13:56:26.999881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3173/6357] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:26 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 1313 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:28.023790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:28.024969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] [instance: eb9b9a76-66ee-40b4-a59d-7c6b2605e08c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:28.032567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:28.033208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:28.033953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:28.034999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:28.035668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:28.036296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:28.064404 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] HTTP exception thrown: Instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c could not be found. Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Request method failure captured: Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c HTTP/1.1 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV7Q7O3IBCZNA6cRZJ0EAmsSXifXfPqc0VMldveWdqNlVcVigxuuW4HxlWJDp0UZLYLgPs9hGcC1GYnQLPWFbySUsrW7tj68HQOZDs2IBPqzNDZYw5LI_AcJXq3zPU57m4nJ-KnFT4nkcNWdzSmhA9o7tV65nYOqQrC0ZL43AvgWkXo Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: da91b768eea74a28bd3eda50de9cb41b Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1032758073 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/da91b768eea74a28bd3eda50de9cb41b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/da91b768eea74a28bd3eda50de9cb41b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/da91b768eea74a28bd3eda50de9cb41b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_da91b768eea74a28bd3eda50de9cb41b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1032758073 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: da91b768eea74a28bd3eda50de9cb41b Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1032758073 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerRescueTestJSONUnderV235-1032758073-project Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 3c6dc16948fa4c81ab3b7144fd67b2c8 Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1032758073-project Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c could not be found. Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'eb9b9a76-66ee-40b4-a59d-7c6b2605e08c'} Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c could not be found. Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c could not be found. Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:56:28.066569 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c could not be found. Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Returning 404 to user: Instance eb9b9a76-66ee-40b4-a59d-7c6b2605e08c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c" status: 404 len: 111 microversion: 2.1 time: 0.048702 Oct 17 13:56:28.070668 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3185/6358] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:28 2022] GET /compute/v2.1/servers/eb9b9a76-66ee-40b4-a59d-7c6b2605e08c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:56:33.279095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-910500871", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "e8892a47-8ed2-4506-9e36-2469651e380d"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:33.289743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=26 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:33.350930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] validate_networks() for [('e8892a47-8ed2-4506-9e36-2469651e380d', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:56:33.433529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:33.434594 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fad55215-d8b9-4c33-b650-f972793af3da tempest-ServerRescueTestJSONUnderV235-1032758073 tempest-ServerRescueTestJSONUnderV235-1032758073-project] 10.222.0.65 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001424 Oct 17 13:56:33.441641 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3186/6359] 10.222.0.65 () {56 vars in 886 bytes} [Mon Oct 17 13:56:33 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 17 13:56:33.765974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:56:33.766430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:56:33.766884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:56:33.767290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:56:33.768137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:56:33.778371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.778851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.779291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:33.780059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:33.780582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:33.781641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:33.800249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Getting quotas for project 399e3b8d1299424086eb589527cc5f9e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:56:33.805923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Getting quotas for user 4bd0e35d7af04880b582acb49d6039d2 and project 399e3b8d1299424086eb589527cc5f9e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:56:33.820269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:56:33.823216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:56:33.876258 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-103035fa-6f62-418b-9ba4-de8367502fe1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600934 Oct 17 13:56:33.883468 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3174/6360] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:56:33.888568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ce34759c-3d66-43f7-b40e-cc852eae5b26 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:33.889205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ce34759c-3d66-43f7-b40e-cc852eae5b26 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:33.895303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:33.966176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ce34759c-3d66-43f7-b40e-cc852eae5b26 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:33.975279 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ce34759c-3d66-43f7-b40e-cc852eae5b26 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1218 microversion: 2.1 time: 0.090694 Oct 17 13:56:33.976280 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3187/6361] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:33 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:56:34.999936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:35.000627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:35.009370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:35.009863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:35.010295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:35.011168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:35.011779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:35.012621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:35.090970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:35.100336 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dfd9cd08-d291-4a01-b42a-49341399a775 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1222 microversion: 2.1 time: 0.105167 Oct 17 13:56:35.100929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3175/6362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:34 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:35.746600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d5edc3d-1762-4739-99d4-d3f6ac81bbbb tempest-ComputeTenantNetworksTest-1354924589 tempest-ComputeTenantNetworksTest-1354924589-project] Calling method '.version_select at 0x7f419e0c41f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:35.907569 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d5edc3d-1762-4739-99d4-d3f6ac81bbbb tempest-ComputeTenantNetworksTest-1354924589 tempest-ComputeTenantNetworksTest-1354924589-project] 10.222.0.65 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.301092 Oct 17 13:56:35.908161 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3188/6363] 10.222.0.65 () {58 vars in 1158 bytes} [Mon Oct 17 13:56:35 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:35.920791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ddd023f-2e38-45f7-b55b-eb2cef411813 tempest-ComputeTenantNetworksTest-1354924589 tempest-ComputeTenantNetworksTest-1354924589-project] Calling method '.version_select at 0x7f419ca241f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:36.012702 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ddd023f-2e38-45f7-b55b-eb2cef411813 tempest-ComputeTenantNetworksTest-1354924589 tempest-ComputeTenantNetworksTest-1354924589-project] 10.222.0.65 "GET /compute/v2.1/os-tenant-networks/d8826a12-3388-4554-94c4-033520a133f8" status: 200 len: 140 microversion: 2.1 time: 0.096602 Oct 17 13:56:36.013396 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3176/6364] 10.222.0.65 () {58 vars in 1269 bytes} [Mon Oct 17 13:56:35 2022] GET /compute/v2.1/os-tenant-networks/d8826a12-3388-4554-94c4-033520a133f8 => generated 140 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:56:36.124078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:36.125661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:36.132696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:36.133442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:36.134044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:36.135072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:36.135537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:36.136130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:36.142072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=76,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:36.225357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:36.237757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3733065-4647-4d69-bbd9-a856a685978f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1270 microversion: 2.1 time: 0.117521 Oct 17 13:56:36.254436 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3189/6365] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:36 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:37.269884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:37.271144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:37.285851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.286612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.287234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.288106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:37.288725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:37.289518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:37.569486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:37.577893 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b73bc0a4-9e8d-4720-ba60-7550143816ab tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.315095 Oct 17 13:56:37.586312 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3177/6366] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:37 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:38.067540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-31ff7d7f-4375-472e-a1e7-5311a6c83f11 req-ce8392cf-6d1e-4ad3-8c96-7ff727503878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5adfa4ca-87ff-40af-9415-35507a4d008d", "tag": "cfdfc6b6-5ced-4985-b7cf-71c75d2fe073"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:38.085546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31ff7d7f-4375-472e-a1e7-5311a6c83f11 req-ce8392cf-6d1e-4ad3-8c96-7ff727503878 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.086339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31ff7d7f-4375-472e-a1e7-5311a6c83f11 req-ce8392cf-6d1e-4ad3-8c96-7ff727503878 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.087096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31ff7d7f-4375-472e-a1e7-5311a6c83f11 req-ce8392cf-6d1e-4ad3-8c96-7ff727503878 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.099707 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-31ff7d7f-4375-472e-a1e7-5311a6c83f11 req-ce8392cf-6d1e-4ad3-8c96-7ff727503878 service nova] Creating event network-changed:cfdfc6b6-5ced-4985-b7cf-71c75d2fe073 for instance 5adfa4ca-87ff-40af-9415-35507a4d008d on n-h2-854121-14 Oct 17 13:56:38.105362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-31ff7d7f-4375-472e-a1e7-5311a6c83f11 req-ce8392cf-6d1e-4ad3-8c96-7ff727503878 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050300 Oct 17 13:56:38.106275 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3190/6367] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:56:38.602882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:38.603729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:38.631064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.631679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.633495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.634558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:38.637817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:38.639097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:38.801515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:38.812039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ced5338-f626-41b2-85e1-78f235b20668 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.213458 Oct 17 13:56:38.814998 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3178/6368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:38 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:39.838226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:39.838927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:39.847678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:39.848483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:39.849252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:39.849970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:39.850611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:39.851188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:40.035620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:40.043929 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-902301d4-ba49-4f65-a6a3-715fa3e08a99 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.209983 Oct 17 13:56:40.044500 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3191/6369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:39 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:41.077122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:41.081137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:41.100144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:41.100911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:41.101597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:41.102521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:41.102995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:41.103604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:41.387524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:41.398964 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c33d435-d7ce-4d3c-a858-3c6067eb18da tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.333436 Oct 17 13:56:41.414978 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3179/6370] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:41 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:42.428165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:42.428797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:42.435964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.436460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.436903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.437750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:42.438644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:42.438820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:42.602727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:42.611113 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-78730385-e361-40fe-897a-766590685c30 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.186950 Oct 17 13:56:42.611707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3192/6371] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:42 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:43.636986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:43.637629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:43.654475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.656233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.657178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.658261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:43.659467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:43.660166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:43.791202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:43.814028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:43.845025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:43.853880 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c52b9933-8c04-4bbe-aecb-ee73b047e29b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.222307 Oct 17 13:56:43.854715 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3180/6372] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:43 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:44.879626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:44.880631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:44.883823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:56:44.890270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:44.890767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:44.891238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:44.891982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:44.892439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:44.892866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:45.051349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:45.060175 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-befe4799-4589-40c7-9a1e-c92edaf28749 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.185898 Oct 17 13:56:45.060848 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3193/6373] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:44 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:45.859253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2fcd008d-bfbf-4081-aff7-3dda92a63827 req-2532932f-40d8-4264-8f85-f8c2ac5ac376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5adfa4ca-87ff-40af-9415-35507a4d008d", "name": "network-vif-plugged", "status": "completed", "tag": "cfdfc6b6-5ced-4985-b7cf-71c75d2fe073"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:56:45.869139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fcd008d-bfbf-4081-aff7-3dda92a63827 req-2532932f-40d8-4264-8f85-f8c2ac5ac376 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:45.869660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fcd008d-bfbf-4081-aff7-3dda92a63827 req-2532932f-40d8-4264-8f85-f8c2ac5ac376 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:45.870104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fcd008d-bfbf-4081-aff7-3dda92a63827 req-2532932f-40d8-4264-8f85-f8c2ac5ac376 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:45.884141 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2fcd008d-bfbf-4081-aff7-3dda92a63827 req-2532932f-40d8-4264-8f85-f8c2ac5ac376 service nova] Creating event network-vif-plugged:cfdfc6b6-5ced-4985-b7cf-71c75d2fe073 for instance 5adfa4ca-87ff-40af-9415-35507a4d008d on n-h2-854121-14 Oct 17 13:56:45.889572 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2fcd008d-bfbf-4081-aff7-3dda92a63827 req-2532932f-40d8-4264-8f85-f8c2ac5ac376 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215979 Oct 17 13:56:45.890956 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3181/6374] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:56:46.087619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:46.088920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:46.096758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.097471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.098040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.099059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:46.099581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:46.100136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:46.245036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:46.253817 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a9625b23-bfd2-45d7-a347-e4dca5824d40 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.170598 Oct 17 13:56:46.265530 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3194/6375] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:46 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:47.280704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:47.290212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:47.304410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.304917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.305404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.306125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:47.306587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:47.307021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:47.491255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:47.500777 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c738882f-bae0-4afc-8827-d0132b8c72fb tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1318 microversion: 2.1 time: 0.227166 Oct 17 13:56:47.501470 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3182/6376] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:47 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:56:48.525809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:56:48.527548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:56:48.535789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:48.536207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:48.536848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:48.537966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:56:48.538426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:56:48.538854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:56:48.694733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:56:48.703037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-583bb9e2-e211-48a4-9e22-789ce7a7bf1f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1508 microversion: 2.1 time: 0.182775 Oct 17 13:56:48.703782 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3195/6377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:56:48 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:09.724201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c058a50f-9869-4673-aaa1-463655020797", "device": "/dev/sdb"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:09.727647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:09.731786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:09.732765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=59 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:09.740482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.741398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.742063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:09.743084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:09.743830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:09.744523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:10.178529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8980bda0-a062-4443-90f6-1940ef9525fa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "POST /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459123 Oct 17 13:57:10.179753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3183/6378] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:57:09 2022] POST /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:57:39.222824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:39.223373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:39.227200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=17 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:39.227866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=37 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:39.232594 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 13:57:39.242592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:39.243092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:39.243502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:39.244220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:39.244713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:39.245213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:39.351367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lazy-loading 'services' on Instance uuid 5adfa4ca-87ff-40af-9415-35507a4d008d {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:57:39.465801 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05b91de7-072f-42d1-b524-7a37384a2efa tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d/os-volume_attachments/c058a50f-9869-4673-aaa1-463655020797" status: 202 len: 0 microversion: 2.1 time: 0.248572 Oct 17 13:57:39.471298 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3196/6379] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:57:39 2022] DELETE /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d/os-volume_attachments/c058a50f-9869-4673-aaa1-463655020797 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:57:46.132581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:46.133092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:46.141530 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 13:57:46.142777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:46.143846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:57:46.146387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.147525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.149009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.150011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.150873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.151549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.191556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:57:46.296714 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f5c75c95-031f-4162-bee7-e8f69dbd3298 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 204 len: 0 microversion: 2.1 time: 0.172462 Oct 17 13:57:46.297960 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3184/6380] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:57:46 2022] DELETE /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:57:46.312998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:46.313822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:46.321233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.321806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.322318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.323091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:46.323613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:46.324128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:46.489618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:46.501040 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-099eecfe-b7ba-4e1e-90f4-7627e7f975f9 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1514 microversion: 2.1 time: 0.197403 Oct 17 13:57:46.504794 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3197/6381] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:46 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:47.534475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:47.535645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:47.542232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:47.542796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:47.543380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:47.544306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:47.544830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:47.545678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:47.702889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:47.711316 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca60f6af-1104-435a-8042-2abcfa2f41e2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1514 microversion: 2.1 time: 0.183192 Oct 17 13:57:47.712112 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3185/6382] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:47 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:48.736399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:48.737353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:48.744396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.744998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.745580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:48.746407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:48.747336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:48.748003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.069665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:49.079786 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12539a38-69f2-43db-950a-17c5a6537fbd tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 200 len: 1514 microversion: 2.1 time: 0.346958 Oct 17 13:57:49.089032 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3198/6383] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:48 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 1514 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:49.457065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-17bedac6-2066-4ed3-90c6-1385547cb962 req-2e09cc92-4796-4322-b6ec-53a8b8144539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5adfa4ca-87ff-40af-9415-35507a4d008d", "name": "network-vif-deleted", "tag": "cfdfc6b6-5ced-4985-b7cf-71c75d2fe073"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:49.476282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-17bedac6-2066-4ed3-90c6-1385547cb962 req-2e09cc92-4796-4322-b6ec-53a8b8144539 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:49.477141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-17bedac6-2066-4ed3-90c6-1385547cb962 req-2e09cc92-4796-4322-b6ec-53a8b8144539 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:49.478262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-17bedac6-2066-4ed3-90c6-1385547cb962 req-2e09cc92-4796-4322-b6ec-53a8b8144539 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:49.495080 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-17bedac6-2066-4ed3-90c6-1385547cb962 req-2e09cc92-4796-4322-b6ec-53a8b8144539 service nova] Creating event network-vif-deleted:cfdfc6b6-5ced-4985-b7cf-71c75d2fe073 for instance 5adfa4ca-87ff-40af-9415-35507a4d008d on n-h2-854121-14 Oct 17 13:57:49.502000 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-17bedac6-2066-4ed3-90c6-1385547cb962 req-2e09cc92-4796-4322-b6ec-53a8b8144539 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.326167 Oct 17 13:57:49.502778 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3186/6384] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:57:50.104062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:50.104690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: 5adfa4ca-87ff-40af-9415-35507a4d008d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:50.113923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.114492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.114856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.115573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:50.116027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:50.116457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:50.132556 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] HTTP exception thrown: Instance 5adfa4ca-87ff-40af-9415-35507a4d008d could not be found. Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Request method failure captured: Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d HTTP/1.1 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV7Un-IbLcHM0foZMTXVoLJievqsGJD-x8yyKlPUVc-FclnSa5XCDcLwunHLMZ9hBOrdEhK_s5i0oNf2It3iuc4TXO3Gu4KGEyp-XUFGmTpXqNuXINuE8G5KqipmCKvH4tZh9u-EkiKuPlKvq1BZdaWhyg4HCf-R2FSk4haC1pgbezs Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 399e3b8d1299424086eb589527cc5f9e Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotTestJSON-249138355 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotTestJSON-249138355 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 399e3b8d1299424086eb589527cc5f9e Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-249138355 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotTestJSON-249138355-project Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4bd0e35d7af04880b582acb49d6039d2 Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotTestJSON-249138355-project Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5adfa4ca-87ff-40af-9415-35507a4d008d could not be found. Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5adfa4ca-87ff-40af-9415-35507a4d008d'} Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5adfa4ca-87ff-40af-9415-35507a4d008d could not be found. Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5adfa4ca-87ff-40af-9415-35507a4d008d could not be found. Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:57:50.134313 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5adfa4ca-87ff-40af-9415-35507a4d008d could not be found. Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Returning 404 to user: Instance 5adfa4ca-87ff-40af-9415-35507a4d008d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5905f06-1c25-4b9d-a6f2-44f1489cb3f7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d" status: 404 len: 111 microversion: 2.1 time: 0.035725 Oct 17 13:57:50.150240 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3199/6385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:50 2022] GET /compute/v2.1/servers/5adfa4ca-87ff-40af-9415-35507a4d008d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 13:57:57.202327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1824407263", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "e8892a47-8ed2-4506-9e36-2469651e380d"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:57:57.277757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] validate_networks() for [('e8892a47-8ed2-4506-9e36-2469651e380d', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:57:57.926755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:57:57.927522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:57:57.928479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:57:57.929244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:57:57.929893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:57:57.948536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:57.949601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:57.950907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:57.953042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:57:57.954191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:57:57.954940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:57:57.986678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Getting quotas for project 399e3b8d1299424086eb589527cc5f9e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:57:57.996237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Getting quotas for user 4bd0e35d7af04880b582acb49d6039d2 and project 399e3b8d1299424086eb589527cc5f9e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:57:58.019749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:57:58.022978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:57:58.100444 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9368f6af-c24a-429a-8469-fb87098107d0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902326 Oct 17 13:57:58.101930 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3187/6386] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:57:58.112708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-06a2093b-1387-41d2-b757-2d3e80697cb2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:58.113374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06a2093b-1387-41d2-b757-2d3e80697cb2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:58.204954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-06a2093b-1387-41d2-b757-2d3e80697cb2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:58.214553 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-06a2093b-1387-41d2-b757-2d3e80697cb2 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1219 microversion: 2.1 time: 0.105616 Oct 17 13:57:58.215923 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3200/6387] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:58 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:57:59.239447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d654c5e-a885-4317-b294-2bb3427afc42 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:57:59.240145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d654c5e-a885-4317-b294-2bb3427afc42 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:57:59.351671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d654c5e-a885-4317-b294-2bb3427afc42 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:57:59.360281 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d654c5e-a885-4317-b294-2bb3427afc42 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1219 microversion: 2.1 time: 0.125512 Oct 17 13:57:59.360870 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3188/6388] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:57:59 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1219 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:00.387199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0bbfa92a-4550-437b-a927-01c6ed9409f1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:00.387819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0bbfa92a-4550-437b-a927-01c6ed9409f1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:00.403742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:00.482092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0bbfa92a-4550-437b-a927-01c6ed9409f1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:00.527585 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0bbfa92a-4550-437b-a927-01c6ed9409f1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1219 microversion: 2.1 time: 0.144243 Oct 17 13:58:00.534286 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3201/6389] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:00 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:01.561791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-821bf483-7462-4cee-8c60-79068139cb6f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:01.562414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-821bf483-7462-4cee-8c60-79068139cb6f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:01.657882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-821bf483-7462-4cee-8c60-79068139cb6f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:01.665941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-821bf483-7462-4cee-8c60-79068139cb6f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1219 microversion: 2.1 time: 0.108117 Oct 17 13:58:01.666760 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3189/6390] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:01 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:02.690620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:02.691352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:02.694334 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 13:58:02.698404 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 13:58:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b (ip 10.222.0.65) !!! Oct 17 13:58:02.719574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.720323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.721071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.721979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:02.722601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:02.723197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:02.806037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:02.817774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0612da23-b573-48f7-8be7-6798278610e0 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1223 microversion: 2.1 time: 0.132156 Oct 17 13:58:02.827241 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3202/6391] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:02 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:03.843237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:03.844554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:03.862869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:03.863362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:03.863990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.864725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:03.865232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:03.865652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:03.995355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:04.005712 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38fed3ab-c7ff-4f62-bb42-3cc77291a58d tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1277 microversion: 2.1 time: 0.167392 Oct 17 13:58:04.006310 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3190/6392] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:03 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:05.037569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:05.039066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:05.050063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.051410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.051928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:05.052674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.053555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.054088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:05.290900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:05.300734 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec97cf92-9b12-41c0-bda0-b502d39ce17b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.271322 Oct 17 13:58:05.301365 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3203/6393] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:05 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:05.759239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ad4a2159-238f-4ad6-b006-d9b91f761559 req-5258e1ad-af3c-4b3f-b939-414753dc1c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d357037d-a1c2-4345-9a16-5337dd391f8b", "tag": "65563fe4-2b38-4002-8f0e-36c971fa6e72"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:05.784459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ad4a2159-238f-4ad6-b006-d9b91f761559 req-5258e1ad-af3c-4b3f-b939-414753dc1c95 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:05.784951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ad4a2159-238f-4ad6-b006-d9b91f761559 req-5258e1ad-af3c-4b3f-b939-414753dc1c95 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:05.785578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ad4a2159-238f-4ad6-b006-d9b91f761559 req-5258e1ad-af3c-4b3f-b939-414753dc1c95 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:05.804848 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ad4a2159-238f-4ad6-b006-d9b91f761559 req-5258e1ad-af3c-4b3f-b939-414753dc1c95 service nova] Creating event network-changed:65563fe4-2b38-4002-8f0e-36c971fa6e72 for instance d357037d-a1c2-4345-9a16-5337dd391f8b on n-h1-854121-14 Oct 17 13:58:05.815370 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ad4a2159-238f-4ad6-b006-d9b91f761559 req-5258e1ad-af3c-4b3f-b939-414753dc1c95 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067522 Oct 17 13:58:05.816683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3191/6394] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:06.323657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:06.324888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:06.333639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.334347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.334782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.335890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:06.345152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:06.346085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:06.693455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:06.711255 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-691c86a9-b78b-4e8d-9d4d-bd039652ffc8 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.390476 Oct 17 13:58:06.712687 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3204/6395] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:06 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:07.745234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:07.745979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:07.761152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:07.761675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:07.762230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:07.763928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:07.764475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:07.764997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:07.969717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:08.058559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:08.069004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c8aaa7d-4af0-4fff-8498-1189c73a8727 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.336280 Oct 17 13:58:08.079609 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3192/6396] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:07 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:09.092806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:09.093494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:09.100784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.101235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.101680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.102392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:09.102851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:09.103279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:09.243088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:09.251266 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0955cb3f-a718-449f-a14b-68d0db233fd7 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.162903 Oct 17 13:58:09.252011 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3205/6397] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:09 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:10.274963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:10.276284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:10.284431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:10.285178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:10.285816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:10.286704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:10.287558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:10.288157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:10.519372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:10.532306 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be63c470-1123-4683-bdad-52413a49b000 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.261086 Oct 17 13:58:10.533255 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3193/6398] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:10 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:11.563750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:11.565114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:11.572314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:11.573856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=25 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:11.577657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.578415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.579079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.580787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:11.581716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:11.582913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:11.820635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:11.832907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00a71e0d-8d31-42aa-bc88-af8626832e97 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.274354 Oct 17 13:58:11.834191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3206/6399] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:11 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:12.346915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-566b72db-c309-4bc3-b433-3f970a1bb1be req-30251442-5921-4e8b-888e-006068d2bfee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d357037d-a1c2-4345-9a16-5337dd391f8b", "name": "network-vif-plugged", "status": "completed", "tag": "65563fe4-2b38-4002-8f0e-36c971fa6e72"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:12.356109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:12.363675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-566b72db-c309-4bc3-b433-3f970a1bb1be req-30251442-5921-4e8b-888e-006068d2bfee service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.364563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-566b72db-c309-4bc3-b433-3f970a1bb1be req-30251442-5921-4e8b-888e-006068d2bfee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.365375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-566b72db-c309-4bc3-b433-3f970a1bb1be req-30251442-5921-4e8b-888e-006068d2bfee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.390380 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-566b72db-c309-4bc3-b433-3f970a1bb1be req-30251442-5921-4e8b-888e-006068d2bfee service nova] Creating event network-vif-plugged:65563fe4-2b38-4002-8f0e-36c971fa6e72 for instance d357037d-a1c2-4345-9a16-5337dd391f8b on n-h1-854121-14 Oct 17 13:58:12.402246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-566b72db-c309-4bc3-b433-3f970a1bb1be req-30251442-5921-4e8b-888e-006068d2bfee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070534 Oct 17 13:58:12.404156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3194/6400] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:12.869315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:12.869315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:12.883665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.885288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.886961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:12.889065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:12.890226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:12.894305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:13.261035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:13.274359 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f27a33c3-fcab-4269-9652-1f9a26f61dc1 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1319 microversion: 2.1 time: 0.416371 Oct 17 13:58:13.277078 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3207/6401] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:12 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.301487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:14.302829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.311484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.312272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.312886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.313803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.314406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.314989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.817464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:14.827406 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ce79e78-112a-49ed-986a-2cb817a14bf3 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1509 microversion: 2.1 time: 0.530222 Oct 17 13:58:14.828353 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3195/6402] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:14 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:14.862374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b6f66cf-bcf7-4a23-bca5-6cbd103923e6", "device": "/dev/sdb"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:14.864983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:14.880656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.881467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.882090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:14.883326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:14.885533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:14.886183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:15.216599 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d7b66b1-e98d-45ab-84c2-f03bc1e0c09c tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "POST /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364872 Oct 17 13:58:15.219085 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3208/6403] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 13:58:14 2022] POST /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:58:41.971270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:41.972903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:41.976876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:41.978028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:41.985067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:41.986043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:41.987834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:41.987834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:41.987834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:41.988962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:42.102958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lazy-loading 'services' on Instance uuid d357037d-a1c2-4345-9a16-5337dd391f8b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 13:58:42.190577 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a0d141c-95e6-4390-a46a-cbd954e2035b tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b/os-volume_attachments/4b6f66cf-bcf7-4a23-bca5-6cbd103923e6" status: 202 len: 0 microversion: 2.1 time: 0.224002 Oct 17 13:58:42.191176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3196/6404] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 13:58:41 2022] DELETE /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b/os-volume_attachments/4b6f66cf-bcf7-4a23-bca5-6cbd103923e6 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 13:58:48.967790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:48.969004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:48.977029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=5 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:48.978628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:58:48.981972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:48.982742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:48.983529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:48.984436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:48.985075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:48.985698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.033352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 13:58:49.154209 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4325481-2481-4aab-b68a-a591b3359d32 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 204 len: 0 microversion: 2.1 time: 0.190821 Oct 17 13:58:49.166850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:49.167755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:49.169193 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3209/6405] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 13:58:48 2022] DELETE /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 13:58:49.176755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.177584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.178212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.179148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:49.179770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:49.180406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:49.486654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:49.502054 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a47cb80c-cf97-41d7-87be-7d800da55301 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1515 microversion: 2.1 time: 0.342045 Oct 17 13:58:49.502979 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3197/6406] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:49 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1515 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:50.528267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:50.529341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:50.543791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:50.549609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:50.550112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:50.550886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:50.551364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:50.551797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:50.847587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:50.871433 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47071c98-5af6-4f94-b0ed-3dfde64dd220 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1515 microversion: 2.1 time: 0.347826 Oct 17 13:58:50.872251 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3210/6407] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:50 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1515 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:51.899464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:51.900079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:51.930097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.932718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.933254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:51.934033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:51.934497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:51.934927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.042950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bd0e35d7af04880b582acb49d6039d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '399e3b8d1299424086eb589527cc5f9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:58:52.046827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0a6c03ec-3ed0-4d5d-816f-f59b24516b14 req-4a9e42c7-efad-49df-aff2-2c4163ecce39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d357037d-a1c2-4345-9a16-5337dd391f8b", "name": "network-vif-deleted", "tag": "65563fe4-2b38-4002-8f0e-36c971fa6e72"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:58:52.068058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0a6c03ec-3ed0-4d5d-816f-f59b24516b14 req-4a9e42c7-efad-49df-aff2-2c4163ecce39 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:52.070043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0a6c03ec-3ed0-4d5d-816f-f59b24516b14 req-4a9e42c7-efad-49df-aff2-2c4163ecce39 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:52.071153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0a6c03ec-3ed0-4d5d-816f-f59b24516b14 req-4a9e42c7-efad-49df-aff2-2c4163ecce39 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:52.071461 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b2d655b-94c0-4c7f-b21e-5eba2f8f525f tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 200 len: 1473 microversion: 2.1 time: 0.175653 Oct 17 13:58:52.073738 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3198/6408] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:51 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:58:52.103688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0a6c03ec-3ed0-4d5d-816f-f59b24516b14 req-4a9e42c7-efad-49df-aff2-2c4163ecce39 service nova] Creating event network-vif-deleted:65563fe4-2b38-4002-8f0e-36c971fa6e72 for instance d357037d-a1c2-4345-9a16-5337dd391f8b on n-h1-854121-14 Oct 17 13:58:52.109483 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0a6c03ec-3ed0-4d5d-816f-f59b24516b14 req-4a9e42c7-efad-49df-aff2-2c4163ecce39 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068945 Oct 17 13:58:52.110625 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3211/6409] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:58:53.098207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:58:53.099988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] [instance: d357037d-a1c2-4345-9a16-5337dd391f8b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:58:53.108169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.108828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.109663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.110504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:58:53.111056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:58:53.111579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:58:53.127652 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] HTTP exception thrown: Instance d357037d-a1c2-4345-9a16-5337dd391f8b could not be found. Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Request method failure captured: Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b HTTP/1.1 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV7Un-IbLcHM0foZMTXVoLJievqsGJD-x8yyKlPUVc-FclnSa5XCDcLwunHLMZ9hBOrdEhK_s5i0oNf2It3iuc4TXO3Gu4KGEyp-XUFGmTpXqNuXINuE8G5KqipmCKvH4tZh9u-EkiKuPlKvq1BZdaWhyg4HCf-R2FSk4haC1pgbezs Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 399e3b8d1299424086eb589527cc5f9e Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotTestJSON-249138355 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_399e3b8d1299424086eb589527cc5f9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotTestJSON-249138355 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 399e3b8d1299424086eb589527cc5f9e Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-249138355 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotTestJSON-249138355-project Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4bd0e35d7af04880b582acb49d6039d2 Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotTestJSON-249138355-project Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d357037d-a1c2-4345-9a16-5337dd391f8b could not be found. Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd357037d-a1c2-4345-9a16-5337dd391f8b'} Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d357037d-a1c2-4345-9a16-5337dd391f8b could not be found. Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d357037d-a1c2-4345-9a16-5337dd391f8b could not be found. Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 13:58:53.129844 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d357037d-a1c2-4345-9a16-5337dd391f8b could not be found. Oct 17 13:58:53.135273 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 13:58:53.136862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] Returning 404 to user: Instance d357037d-a1c2-4345-9a16-5337dd391f8b could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 13:58:53.138030 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58fa4fff-7249-4444-800c-4b9c06de7715 tempest-VolumesSnapshotTestJSON-249138355 tempest-VolumesSnapshotTestJSON-249138355-project] 10.222.0.65 "GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b" status: 404 len: 111 microversion: 2.1 time: 0.043869 Oct 17 13:58:53.140193 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3199/6410] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:58:53 2022] GET /compute/v2.1/servers/d357037d-a1c2-4345-9a16-5337dd391f8b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 13:59:43.846011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:43.847944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:44.142949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2be689c9-cc7c-4815-94e2-3faf1208b680 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: .version_select at 0x7f41a2090940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1920003692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQuovChS1K4q/bX13MGDUNRZ6Yf7hf7GoS2ifdY1U4AbIZxmMhCd6jMEjmR6abBqlCk5pDUGxL8DfUqty/YAUAxd2z87IPqt0DNuql6ntRei3ns+rLanHoGwDLLyy3iFQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:44.160439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2be689c9-cc7c-4815-94e2-3faf1208b680 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:59:44.170141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2be689c9-cc7c-4815-94e2-3faf1208b680 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:59:44.201986 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2be689c9-cc7c-4815-94e2-3faf1208b680 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.361614 Oct 17 13:59:44.202972 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3212/6411] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 13:59:43 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 13:59:53.368362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:53.369664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:53.374742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1511295086", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "f7fb9d56-a50c-4237-aa41-3c1782e84b6d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1920003692", "security_groups": [{"name": "tempest-secgroup-smoke-646166261"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:53.605706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] validate_networks() for [('f7fb9d56-a50c-4237-aa41-3c1782e84b6d', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 13:59:54.544179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 13:59:54.544780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 13:59:54.545147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 13:59:54.545650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 13:59:54.546125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 13:59:54.573460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:54.574287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:54.576525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.577694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:54.581147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:54.584096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:54.632519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 13:59:54.641045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 13:59:54.669236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 13:59:54.677767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 13:59:54.764700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98c26524-ac07-48ee-9dbf-c1652aa33b34 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.397098 Oct 17 13:59:54.767227 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3200/6412] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 13:59:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 13:59:54.783225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08e8d5cd-7bba-4c98-8dd8-0295f387a706 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:54.784846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08e8d5cd-7bba-4c98-8dd8-0295f387a706 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:54.801477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:54.805810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 13:59:54.933575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-08e8d5cd-7bba-4c98-8dd8-0295f387a706 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:54.945423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08e8d5cd-7bba-4c98-8dd8-0295f387a706 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1267 microversion: 2.1 time: 0.169737 Oct 17 13:59:54.946747 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3213/6413] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:54 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:55.971650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:55.972278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:55.992015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.992569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.993022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:55.993790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:55.994409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:55.994855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:56.235493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:56.271016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1554a6c-43fe-4c6c-8f1f-fb666774ba38 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1263 microversion: 2.1 time: 0.306525 Oct 17 13:59:56.286680 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3201/6414] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:55 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1263 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 13:59:57.298167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:57.299311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:57.315579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:57.317195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:57.319299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:57.320501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:57.321306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:57.321920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:57.442898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:57.452656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b4df5840-b619-4895-97d9-0dee9e9a3995 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1325 microversion: 2.1 time: 0.159295 Oct 17 13:59:57.461034 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3214/6415] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:57 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:58.486711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:58.488677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:58.504397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:58.506534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:58.509703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:58.512782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:58.513402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:58.515711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:58.893750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 13:59:58.906792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ae0c5ef-b966-47ac-ac1f-3ece66b43a9c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1392 microversion: 2.1 time: 0.424749 Oct 17 13:59:58.922765 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3202/6416] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:58 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1392 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 13:59:59.186723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-19da1e4b-dbc7-4881-afa6-b333556645d3 req-f237bafb-72e7-40d3-9155-a2659929d0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 13:59:59.223344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-19da1e4b-dbc7-4881-afa6-b333556645d3 req-f237bafb-72e7-40d3-9155-a2659929d0c3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.225203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-19da1e4b-dbc7-4881-afa6-b333556645d3 req-f237bafb-72e7-40d3-9155-a2659929d0c3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.225819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-19da1e4b-dbc7-4881-afa6-b333556645d3 req-f237bafb-72e7-40d3-9155-a2659929d0c3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:59.248035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-19da1e4b-dbc7-4881-afa6-b333556645d3 req-f237bafb-72e7-40d3-9155-a2659929d0c3 service nova] Creating event network-changed:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h1-854121-14 Oct 17 13:59:59.261479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-19da1e4b-dbc7-4881-afa6-b333556645d3 req-f237bafb-72e7-40d3-9155-a2659929d0c3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082316 Oct 17 13:59:59.262967 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3215/6417] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 13:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 13:59:59.935288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 13:59:59.936770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 13:59:59.945487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.945997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.946659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 13:59:59.947370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 13:59:59.947835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 13:59:59.948296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:00.256770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:00.268041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-777fc487-6a41-4f74-837c-9f80de1b029b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1392 microversion: 2.1 time: 0.337891 Oct 17 14:00:00.271737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3203/6418] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 13:59:59 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1392 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:01.297017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:01.298012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:01.310794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:01.312059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:01.313401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:01.314532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:01.315297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:01.340323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:01.540039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:01.554622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-803a6ae7-0651-409b-83ad-3afdd0ece8da tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1392 microversion: 2.1 time: 0.263202 Oct 17 14:00:01.556255 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3216/6419] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:01 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:02.579766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:02.581235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:02.598107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:02.598740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:02.599750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:02.600992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:02.601706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:02.602380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:02.950181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:02.965008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0097e17d-aa5a-4b3c-a6b2-392f8038ac53 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1392 microversion: 2.1 time: 0.389958 Oct 17 14:00:02.969137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3204/6420] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:02 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1392 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:03.999294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:04.000331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:04.013127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.016390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.017189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.019764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.021121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.022400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.424906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:04.427594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.430956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.431746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.434047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.434472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.435060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.481396 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c13b68fa-2606-4f9f-a2ea-cecea81a09ff tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.265051 Oct 17 14:00:04.482193 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3205/6421] 10.222.0.65 () {58 vars in 1185 bytes} [Mon Oct 17 14:00:04 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:04.490938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:04.515156 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8630894-ad6b-4944-9049-ccaf6f6256e1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1392 microversion: 2.1 time: 0.519495 Oct 17 14:00:04.516645 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3217/6422] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:03 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1392 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:04.697836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-765227008", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "availability_zone": "nova:n-h1-854121-14", "networks": [{"uuid": "d8b988ad-2e0a-403a-99a3-dd9e2e387101"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:04.704690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:04.784602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] validate_networks() for [('d8b988ad-2e0a-403a-99a3-dd9e2e387101', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:00:04.879329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-937d0a63-162b-49e5-bde8-53c9203af8b4 req-f6e6becc-4111-46a4-823c-a3063e942fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "name": "network-vif-plugged", "status": "completed", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:04.898510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-937d0a63-162b-49e5-bde8-53c9203af8b4 req-f6e6becc-4111-46a4-823c-a3063e942fb6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:04.905766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-937d0a63-162b-49e5-bde8-53c9203af8b4 req-f6e6becc-4111-46a4-823c-a3063e942fb6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:04.906992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-937d0a63-162b-49e5-bde8-53c9203af8b4 req-f6e6becc-4111-46a4-823c-a3063e942fb6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:04.940604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-937d0a63-162b-49e5-bde8-53c9203af8b4 req-f6e6becc-4111-46a4-823c-a3063e942fb6 service nova] Creating event network-vif-plugged:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h1-854121-14 Oct 17 14:00:04.953478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:04.956872 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-937d0a63-162b-49e5-bde8-53c9203af8b4 req-f6e6becc-4111-46a4-823c-a3063e942fb6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081854 Oct 17 14:00:04.965575 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3218/6423] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:00:05.305139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:05.305592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:05.306077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:05.306618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:05.307044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:05.319616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:05.320456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:05.321113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:05.322090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:05.323020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:05.323656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:05.365232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Getting quotas for project 2c8dc7d5956949db861bd420f2d7d110. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:05.372449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Getting quotas for user 409cb4160f2747b48ef304ccd7b89453 and project 2c8dc7d5956949db861bd420f2d7d110. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:05.386885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:05.387975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:05.441462 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bba2806d-5fe4-4268-87bf-10de915c75e1 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.747470 Oct 17 14:00:05.443717 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3206/6424] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:00:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:00:05.459632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7cb29df-8e3e-4ff4-9ba8-4c58ae53f92d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:05.460529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7cb29df-8e3e-4ff4-9ba8-4c58ae53f92d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:05.535471 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7cb29df-8e3e-4ff4-9ba8-4c58ae53f92d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1328 microversion: 2.1 time: 0.084444 Oct 17 14:00:05.538158 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3219/6425] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:05 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1328 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:05.551285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:05.553040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:05.562562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:05.563683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:05.564326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:05.565267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:05.565813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:05.566247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:05.732184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:05.741822 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36809c20-bef1-47c5-83bc-ee0d56e718ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1392 microversion: 2.1 time: 0.198323 Oct 17 14:00:05.749217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3207/6426] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:05 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1392 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:06.559619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:06.560288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:06.569822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:06.570509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:06.571145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:06.572069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:06.572835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:06.573479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:06.666889 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca3fbb6d-b6f3-46bc-9742-e4ee0c91458e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1417 microversion: 2.1 time: 0.109514 Oct 17 14:00:06.673742 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3220/6427] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:06 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1417 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:06.766208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:06.767843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:06.776574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:06.778257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:06.779028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:06.780562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:06.781322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:06.781993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:06.966774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:06.982523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f07caa68-dc70-41d9-a8f4-6f73e9a80a4e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1565 microversion: 2.1 time: 0.220350 Oct 17 14:00:06.983634 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3208/6428] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:06 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1565 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:07.008124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:07.009358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:07.016152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:07.016859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:07.017401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:07.018350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:07.019017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:07.019652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:07.176538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:07.185036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4681de4-6152-4818-b141-069798afc908 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1565 microversion: 2.1 time: 0.182303 Oct 17 14:00:07.198539 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3221/6429] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:07 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1565 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:07.691151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:07.692130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:07.700336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:07.700842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:07.701530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:07.702622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:07.703234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:07.703834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:08.163341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f1bbdd5-362d-459a-8683-9d30b831ec97 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.476058 Oct 17 14:00:08.164843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3209/6430] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:07 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:08.336649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ae19e468-83fe-4b79-9af8-a4f9dc138cdc req-0a835480-0c1c-4675-9c65-21e6f3082a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9196584c-bd6a-4042-960c-239ee830011e", "tag": "85fc27f6-6cf3-4a79-8212-08756fb11626"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:08.358994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae19e468-83fe-4b79-9af8-a4f9dc138cdc req-0a835480-0c1c-4675-9c65-21e6f3082a37 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:08.359793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae19e468-83fe-4b79-9af8-a4f9dc138cdc req-0a835480-0c1c-4675-9c65-21e6f3082a37 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:08.360439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ae19e468-83fe-4b79-9af8-a4f9dc138cdc req-0a835480-0c1c-4675-9c65-21e6f3082a37 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:08.388992 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ae19e468-83fe-4b79-9af8-a4f9dc138cdc req-0a835480-0c1c-4675-9c65-21e6f3082a37 service nova] Creating event network-changed:85fc27f6-6cf3-4a79-8212-08756fb11626 for instance 9196584c-bd6a-4042-960c-239ee830011e on n-h1-854121-14 Oct 17 14:00:08.398284 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ae19e468-83fe-4b79-9af8-a4f9dc138cdc req-0a835480-0c1c-4675-9c65-21e6f3082a37 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066015 Oct 17 14:00:08.399615 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3222/6431] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:09.189400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:09.190697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:09.198343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.198837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.199281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.199985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.200618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.201052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.403737 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6befe51a-11e1-4f56-a88a-b6ded227a9a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.218855 Oct 17 14:00:09.404592 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3210/6432] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:09 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:09.445825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:09.447121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:09.454610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-4c4bd2e4-f1e8-4518-b136-67757e9847c4 req-22c882e6-372d-41cb-8082-ababbb57ee69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:09.455806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.456489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.457734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.458641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.459273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.460010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.466380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4c4bd2e4-f1e8-4518-b136-67757e9847c4 req-22c882e6-372d-41cb-8082-ababbb57ee69 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:09.467088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4c4bd2e4-f1e8-4518-b136-67757e9847c4 req-22c882e6-372d-41cb-8082-ababbb57ee69 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:09.467738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4c4bd2e4-f1e8-4518-b136-67757e9847c4 req-22c882e6-372d-41cb-8082-ababbb57ee69 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:09.480356 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-4c4bd2e4-f1e8-4518-b136-67757e9847c4 req-22c882e6-372d-41cb-8082-ababbb57ee69 service nova] Creating event network-changed:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h1-854121-14 Oct 17 14:00:09.486071 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-4c4bd2e4-f1e8-4518-b136-67757e9847c4 req-22c882e6-372d-41cb-8082-ababbb57ee69 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035493 Oct 17 14:00:09.491082 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3211/6433] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:09.614366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:09.623337 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b3c6fb6-faed-4a65-94c8-e2f6150cffd3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1565 microversion: 2.1 time: 0.184311 Oct 17 14:00:09.624246 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3223/6434] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:09 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1565 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:10.260405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1392434179", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:10.333583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:00:10.427284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:10.428133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:10.439139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:10.439890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:10.440343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:10.441072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:10.442160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:10.442600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:10.728890 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-353221fc-7187-48ef-a08f-87b85e72544c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.305420 Oct 17 14:00:10.731580 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3224/6435] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:10 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:10.742617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:10.743120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:10.743721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:10.744336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:10.744753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:10.755690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:10.756231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:10.756896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:10.757825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:10.758281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:10.758708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:10.787298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Getting quotas for project 5c46a37aa4624d66b57a0c6b04fd2a8c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:10.794987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Getting quotas for user e0c23eeabd5d4364be3b2a3b85d498b6 and project 5c46a37aa4624d66b57a0c6b04fd2a8c. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:10.810734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:10.813641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:10.883499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b60b3e3-01b5-4d6d-8022-d1a046b3bb9e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631981 Oct 17 14:00:10.890434 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3212/6436] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:00:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:00:10.896502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23201aa8-974d-4eb4-a43f-869e602e0582 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:10.897121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23201aa8-974d-4eb4-a43f-869e602e0582 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:10.984979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-23201aa8-974d-4eb4-a43f-869e602e0582 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:10.993006 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23201aa8-974d-4eb4-a43f-869e602e0582 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1215 microversion: 2.1 time: 0.100989 Oct 17 14:00:10.993885 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3225/6437] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:10 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:11.754764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:11.755369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:11.762578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:11.763052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:11.763487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:11.764173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:11.765278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:11.765426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:11.894217 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d590eeb-f513-49ad-b6b7-1cfa0da16a15 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.144551 Oct 17 14:00:11.895400 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3213/6438] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:11 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:12.016376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:12.016989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:12.025332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:12.025829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:12.026282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:12.038820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:12.039449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:12.039918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:12.146716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:12.155695 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bfe25d4e-0535-4b91-807c-e226e14484a4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1275 microversion: 2.1 time: 0.143553 Oct 17 14:00:12.156574 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3226/6439] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:12 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:12.917546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:12.918176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:12.931372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:12.932071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:12.932713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:12.933640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:12.934279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:12.935178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:13.102221 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32df1165-f1ad-49ae-8d81-e86dffd51895 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.188315 Oct 17 14:00:13.103178 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3214/6440] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:12 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:13.179784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:13.180471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:13.187636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:13.188137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:13.188587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:13.189444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:13.189906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:13.190531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:13.475209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:13.483125 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a3d8e1e-7a05-4969-ad38-73e86e5c4887 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.307311 Oct 17 14:00:13.483743 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3227/6441] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:13 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:14.128280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:14.130086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:14.137253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:14.137758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:14.138198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.138909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:14.139636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:14.140142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.328955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2451a346-9f07-4278-84dc-cfd2c4e1afdd req-ca331fe2-d6a9-49ef-b15b-5a6a4a2835b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8e3073-b350-4056-8dc4-4e48ea9b991c", "tag": "87c817f2-c6b2-4b04-a786-4b624caaadde"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:14.341262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2451a346-9f07-4278-84dc-cfd2c4e1afdd req-ca331fe2-d6a9-49ef-b15b-5a6a4a2835b7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:14.342079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2451a346-9f07-4278-84dc-cfd2c4e1afdd req-ca331fe2-d6a9-49ef-b15b-5a6a4a2835b7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:14.342748 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4cccb0d1-f365-4530-93bd-956560d617cf tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.218934 Oct 17 14:00:14.343004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2451a346-9f07-4278-84dc-cfd2c4e1afdd req-ca331fe2-d6a9-49ef-b15b-5a6a4a2835b7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.356169 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2451a346-9f07-4278-84dc-cfd2c4e1afdd req-ca331fe2-d6a9-49ef-b15b-5a6a4a2835b7 service nova] Creating event network-changed:87c817f2-c6b2-4b04-a786-4b624caaadde for instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c on n-h2-854121-14 Oct 17 14:00:14.360494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3215/6442] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:14 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:14.361715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2451a346-9f07-4278-84dc-cfd2c4e1afdd req-ca331fe2-d6a9-49ef-b15b-5a6a4a2835b7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036704 Oct 17 14:00:14.362119 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3228/6443] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:00:14.507669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:14.508293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:14.514978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:14.515474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:14.515921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.516652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:14.517119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:14.517584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.742533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f5263a4b-2340-4c75-a9e4-7e646a4900d0 req-9ca84c00-4dc6-498f-8963-7db6b25be0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9196584c-bd6a-4042-960c-239ee830011e", "name": "network-vif-plugged", "status": "completed", "tag": "85fc27f6-6cf3-4a79-8212-08756fb11626"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:14.752879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:14.755264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f5263a4b-2340-4c75-a9e4-7e646a4900d0 req-9ca84c00-4dc6-498f-8963-7db6b25be0d1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:14.755741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f5263a4b-2340-4c75-a9e4-7e646a4900d0 req-9ca84c00-4dc6-498f-8963-7db6b25be0d1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:14.756375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f5263a4b-2340-4c75-a9e4-7e646a4900d0 req-9ca84c00-4dc6-498f-8963-7db6b25be0d1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:14.765444 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3cf6989f-0d8c-4c0a-87df-751a01ed694e tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.261962 Oct 17 14:00:14.766037 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3216/6444] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:14 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:14.770087 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f5263a4b-2340-4c75-a9e4-7e646a4900d0 req-9ca84c00-4dc6-498f-8963-7db6b25be0d1 service nova] Creating event network-vif-plugged:85fc27f6-6cf3-4a79-8212-08756fb11626 for instance 9196584c-bd6a-4042-960c-239ee830011e on n-h1-854121-14 Oct 17 14:00:14.775496 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f5263a4b-2340-4c75-a9e4-7e646a4900d0 req-9ca84c00-4dc6-498f-8963-7db6b25be0d1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038582 Oct 17 14:00:14.776367 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3229/6445] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:00:15.367730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:15.368354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:15.375337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:15.375829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:15.376277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:15.376979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:15.377470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:15.377909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:15.510350 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eba2cd6c-bf57-46ed-89e2-4461187f6f29 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1465 microversion: 2.1 time: 0.147109 Oct 17 14:00:15.510935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3217/6446] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:15 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1465 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:15.793185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:15.793955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:15.800279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:15.800842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:15.801820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:15.802522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:15.802980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:15.803407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:15.940583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:15.949712 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbabc26d-ffe3-4dce-a8f9-7171890c7bb1 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.161651 Oct 17 14:00:15.950290 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3230/6447] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:15 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:16.533022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:16.533678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:16.540188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.540694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.541133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.541841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.542299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.542725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.673603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad5602c1-f77d-48bb-98db-adeb4e614764 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1651 microversion: 2.1 time: 0.144361 Oct 17 14:00:16.674194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3218/6448] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:16 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1651 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:16.696883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:16.697797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:16.704095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.704584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.705497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.705748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.706208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.706677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.837416 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24f1c35b-520c-418f-a17c-6c7e045a7a85 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1651 microversion: 2.1 time: 0.144143 Oct 17 14:00:16.838040 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3231/6449] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:16 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1651 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:16.859167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:16.859779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:16.867263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.867698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.868154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.868886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.869438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.869829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.972880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:16.973714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:16.982031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.982407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.982854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:16.983959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:16.984329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:16.984773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:17.003603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:17.010149 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e19cae7-f784-46a2-9e5d-d89b68bbb51b tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1651 microversion: 2.1 time: 0.154670 Oct 17 14:00:17.010750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3219/6450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:16 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1651 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:17.123566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:17.125756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1333856841", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "availability_zone": "nova:n-h2-854121-14", "networks": [{"uuid": "d8b988ad-2e0a-403a-99a3-dd9e2e387101"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:17.131744 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b65f7d26-362b-4254-953c-20d5cbbd98b4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.163580 Oct 17 14:00:17.132537 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3232/6451] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:16 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:17.185560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] validate_networks() for [('d8b988ad-2e0a-403a-99a3-dd9e2e387101', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:00:17.803466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:00:17.804090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:00:17.804527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:00:17.805014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:00:17.805574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:00:17.816798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:17.817504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:17.817955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:17.818698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:17.819189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:17.819623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:17.837959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Getting quotas for project 2c8dc7d5956949db861bd420f2d7d110. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:00:17.843083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Getting quotas for user 409cb4160f2747b48ef304ccd7b89453 and project 2c8dc7d5956949db861bd420f2d7d110. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:00:17.845479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:17.858178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:00:17.860407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:00:17.909555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9470ccb-33fe-40b3-b6d1-83b2525b7469 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787557 Oct 17 14:00:17.910261 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3220/6452] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:00:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:00:17.921707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a22a302f-cfe6-44f3-b0a6-3f5ec41a90f4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:17.922339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a22a302f-cfe6-44f3-b0a6-3f5ec41a90f4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:17.983417 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a22a302f-cfe6-44f3-b0a6-3f5ec41a90f4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1329 microversion: 2.1 time: 0.065363 Oct 17 14:00:17.983996 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3233/6453] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:17 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1329 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:18.156459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:18.157131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:18.164076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:18.164584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:18.165024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:18.165742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:18.166200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:18.166628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:18.311667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:18.321525 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32383651-4c42-4075-ac07-a81b9eafd3e4 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.169263 Oct 17 14:00:18.322466 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3221/6454] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:18 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:19.006779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:19.008199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:19.018413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:19.019262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:19.020008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:19.020999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:19.021686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:19.022276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:19.116894 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ecce12b1-55b5-48b7-bbd2-a2bbcf4ed6ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1426 microversion: 2.1 time: 0.107311 Oct 17 14:00:19.133787 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3234/6455] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:19 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1426 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:19.345665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:19.346293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:19.354816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:19.355312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:19.355754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:19.356518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:19.357263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:19.357761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:19.574979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:19.586689 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d60c8e41-e1d1-42be-8c61-0a7ce0907c70 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.246136 Oct 17 14:00:19.595328 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3222/6456] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:19 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:20.140397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:20.141286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:20.149931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.150596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.151348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.152146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.152558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.153647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.406818 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ee3d11d-48f0-4c96-ad2d-2c74c92e8b2c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.270587 Oct 17 14:00:20.422581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3235/6457] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:20 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:20.516271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6f68dea7-6a17-4776-8eea-28f338260f07 req-fbe1e091-496a-42f6-a32c-ac907570fa8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8e3073-b350-4056-8dc4-4e48ea9b991c", "name": "network-vif-plugged", "status": "completed", "tag": "87c817f2-c6b2-4b04-a786-4b624caaadde"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:20.542170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6f68dea7-6a17-4776-8eea-28f338260f07 req-fbe1e091-496a-42f6-a32c-ac907570fa8d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.542924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6f68dea7-6a17-4776-8eea-28f338260f07 req-fbe1e091-496a-42f6-a32c-ac907570fa8d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.543440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6f68dea7-6a17-4776-8eea-28f338260f07 req-fbe1e091-496a-42f6-a32c-ac907570fa8d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.557965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6f68dea7-6a17-4776-8eea-28f338260f07 req-fbe1e091-496a-42f6-a32c-ac907570fa8d service nova] Creating event network-vif-plugged:87c817f2-c6b2-4b04-a786-4b624caaadde for instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c on n-h2-854121-14 Oct 17 14:00:20.564009 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6f68dea7-6a17-4776-8eea-28f338260f07 req-fbe1e091-496a-42f6-a32c-ac907570fa8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056692 Oct 17 14:00:20.564625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3223/6458] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:20.568576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-12ed97e2-9fb4-4927-b017-4580a666478f req-9c9402f3-6c6e-400c-b0dc-4e5acba0e777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "297b9613-24c8-4f04-bc44-ae2c7f9f1b60", "tag": "553db6ca-d136-4205-a37c-29979f8124de"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:20.582170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12ed97e2-9fb4-4927-b017-4580a666478f req-9c9402f3-6c6e-400c-b0dc-4e5acba0e777 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.583569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12ed97e2-9fb4-4927-b017-4580a666478f req-9c9402f3-6c6e-400c-b0dc-4e5acba0e777 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.584255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12ed97e2-9fb4-4927-b017-4580a666478f req-9c9402f3-6c6e-400c-b0dc-4e5acba0e777 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.596573 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-12ed97e2-9fb4-4927-b017-4580a666478f req-9c9402f3-6c6e-400c-b0dc-4e5acba0e777 service nova] Creating event network-changed:553db6ca-d136-4205-a37c-29979f8124de for instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 on n-h2-854121-14 Oct 17 14:00:20.602401 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-12ed97e2-9fb4-4927-b017-4580a666478f req-9c9402f3-6c6e-400c-b0dc-4e5acba0e777 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038199 Oct 17 14:00:20.605437 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3236/6459] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:20.615660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:20.615660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:20.625904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.626647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.627104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.628423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:20.629809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:20.630417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:20.942171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:20.950884 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b82d8dfd-cbe1-49b7-9473-746dec03bce2 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.344696 Oct 17 14:00:20.951404 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3224/6460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:20 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:21.433872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:21.434488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:21.440826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:21.441349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:21.441795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:21.442495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:21.443814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:21.444424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:21.465052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:21.575064 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abd6dbce-3c02-4a42-b22c-1a2731508dee tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.146312 Oct 17 14:00:21.575660 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3237/6461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:21 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:21.975701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:21.976316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:21.983507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:21.983991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:21.984422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:21.985134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:21.985586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:21.986026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:22.118947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:22.126784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0ea6169-84b3-4a7c-bc78-c1e79b200db8 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.155463 Oct 17 14:00:22.127373 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3225/6462] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:21 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:22.598764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:22.599531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:22.606630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:22.607123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:22.607565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:22.608267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:22.608725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:22.609245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:22.737970 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94816ad2-f167-4224-8702-b5a941fcd700 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.143000 Oct 17 14:00:22.738563 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3238/6463] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:22 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:23.150502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:23.151217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:23.158278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.158762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.159205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.159915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.160373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.160801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.296836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:23.305386 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb6ab5e5-fa0e-4fd8-8162-851afa1afa6f tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1315 microversion: 2.1 time: 0.159099 Oct 17 14:00:23.305970 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3226/6464] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:23 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:23.762461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:23.763115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:23.773694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.774282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.775043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.776217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:23.776980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:23.777562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:23.906778 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d365f8dd-35ad-4896-8504-acb74f2e939e tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.149274 Oct 17 14:00:23.907373 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3239/6465] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:23 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:24.328001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:24.328650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:24.336768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.337287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.337736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.338443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.339103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.339538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.592281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:24.601683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c584e10-7174-46d6-88f7-21e7c3a044d3 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1464 microversion: 2.1 time: 0.277544 Oct 17 14:00:24.602281 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3227/6466] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:24 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1464 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:24.652808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:24.653363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:24.659776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.660263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.660706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.661682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.662227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.662655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.688931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:00:24.775407 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b05e74eb-d802-4c31-84c0-906bd7ec4253 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 204 len: 0 microversion: 2.1 time: 0.126326 Oct 17 14:00:24.777872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3240/6467] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:24 2022] DELETE /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:00:24.784811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:24.786035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:24.794701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.795202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.795646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.796355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.796815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.797277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.930189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:24.930645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:24.931352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:24.933534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:24.938551 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d31a09bb-283c-4380-80b0-4384ecea6616 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1470 microversion: 2.1 time: 0.157698 Oct 17 14:00:24.938804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.939142 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3228/6468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:24 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:24.941786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.941786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:24.941786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:24.941786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:24.941786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:25.076559 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20773151-c5a4-4416-8ee3-b1b6b54d96ac tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.150024 Oct 17 14:00:25.077152 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3241/6469] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:24 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:25.962279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:25.962851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:25.970882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:25.971391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:25.971839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:25.972554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:25.973018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:25.973630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.099435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:26.100043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:26.108242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.108738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.109200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.109917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.110429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.110990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.305265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:26.313486 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d25c997a-7228-4e2d-a2a9-72c6b99e08ec tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1470 microversion: 2.1 time: 0.355304 Oct 17 14:00:26.314615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3229/6470] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:25 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1470 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:26.390110 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5beec64f-bfff-49f3-8194-412ad6e0cbda tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.294352 Oct 17 14:00:26.390740 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3242/6471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:26 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:26.517739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-10d8f24c-9e45-4e74-bf4a-fb4a9162e2e0 req-cc79b101-ec13-43a4-a7ec-63a08e655773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297b9613-24c8-4f04-bc44-ae2c7f9f1b60", "name": "network-vif-plugged", "status": "completed", "tag": "553db6ca-d136-4205-a37c-29979f8124de"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:26.528556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10d8f24c-9e45-4e74-bf4a-fb4a9162e2e0 req-cc79b101-ec13-43a4-a7ec-63a08e655773 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:26.528958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10d8f24c-9e45-4e74-bf4a-fb4a9162e2e0 req-cc79b101-ec13-43a4-a7ec-63a08e655773 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:26.529401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10d8f24c-9e45-4e74-bf4a-fb4a9162e2e0 req-cc79b101-ec13-43a4-a7ec-63a08e655773 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:26.543339 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-10d8f24c-9e45-4e74-bf4a-fb4a9162e2e0 req-cc79b101-ec13-43a4-a7ec-63a08e655773 service nova] Creating event network-vif-plugged:553db6ca-d136-4205-a37c-29979f8124de for instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 on n-h2-854121-14 Oct 17 14:00:26.548644 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-10d8f24c-9e45-4e74-bf4a-fb4a9162e2e0 req-cc79b101-ec13-43a4-a7ec-63a08e655773 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035153 Oct 17 14:00:26.550103 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3230/6472] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:27.337796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:27.338396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:27.345544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:27.346038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:27.346486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:27.347198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:27.347661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:27.348099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:27.419266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:27.420619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:27.428722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:27.429541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:27.430156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:27.431086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:27.431743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:27.432328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:27.579110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:27.587564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ffbef944-6533-4818-9547-1ba55ac9dafe tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1428 microversion: 2.1 time: 0.254012 Oct 17 14:00:27.588245 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3243/6473] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:27 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1428 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:27.690469 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6398d589-dfdd-4938-b2fb-f74fddae3856 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.276490 Oct 17 14:00:27.699129 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3231/6474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:27 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:27.699371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-eb75981c-2a41-4123-b11c-2ff482db6a99 req-43607b8f-b0bf-4fc1-bd16-1b9398e0e908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8e3073-b350-4056-8dc4-4e48ea9b991c", "name": "network-vif-deleted", "tag": "87c817f2-c6b2-4b04-a786-4b624caaadde"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:27.705810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eb75981c-2a41-4123-b11c-2ff482db6a99 req-43607b8f-b0bf-4fc1-bd16-1b9398e0e908 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:27.706600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eb75981c-2a41-4123-b11c-2ff482db6a99 req-43607b8f-b0bf-4fc1-bd16-1b9398e0e908 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:27.707268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-eb75981c-2a41-4123-b11c-2ff482db6a99 req-43607b8f-b0bf-4fc1-bd16-1b9398e0e908 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:27.720278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-eb75981c-2a41-4123-b11c-2ff482db6a99 req-43607b8f-b0bf-4fc1-bd16-1b9398e0e908 service nova] Creating event network-vif-deleted:87c817f2-c6b2-4b04-a786-4b624caaadde for instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c on n-h2-854121-14 Oct 17 14:00:27.726012 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-eb75981c-2a41-4123-b11c-2ff482db6a99 req-43607b8f-b0bf-4fc1-bd16-1b9398e0e908 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Oct 17 14:00:27.726626 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3244/6475] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:00:28.611415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:28.611972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:28.614689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:28.615459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=18 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:28.622999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.623606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.624053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.624766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.625254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.625687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.666031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.666519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.666954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.667408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lazy-loading 'fault' on Instance uuid 3f8e3073-b350-4056-8dc4-4e48ea9b991c {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:00:28.712552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:28.713381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0c23eeabd5d4364be3b2a3b85d498b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c46a37aa4624d66b57a0c6b04fd2a8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:28.718025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:28.718748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:28.721653 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96ae2ba4-a582-4dc9-a911-ef55e1d8eb96 tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 200 len: 1305 microversion: 2.1 time: 0.114225 Oct 17 14:00:28.722251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3232/6476] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:28 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:28.726797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.727298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.727744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.728457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:28.728918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:28.729378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:28.866328 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a1b4782-3d34-47ed-ba95-05fe17ca08a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1466 microversion: 2.1 time: 0.154662 Oct 17 14:00:28.866832 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3245/6477] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:28 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1466 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:29.746391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:29.747003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] [instance: 3f8e3073-b350-4056-8dc4-4e48ea9b991c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:29.753956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.754451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.755547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.756414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.756878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.757401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.772251 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] HTTP exception thrown: Instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c could not be found. Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Request method failure captured: Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c HTTP/1.1 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV_ncmhEuXEhrGmrG8ODbLkNyva1XCuF_6Y-9tuiBeLZ_6OVIypm3px1QquiynKE7-4zHO30Nc_xHeWW3MIVMib78CRqWNNM2KTblGGhSx0eLEPX9lyIfI1IRllGpZ5KSeb7mYb2M_Kq6Ojc5TarJF5GSKwBcoLz-U-30HfkD1XMpOs Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 5c46a37aa4624d66b57a0c6b04fd2a8c Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-1648760459 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/5c46a37aa4624d66b57a0c6b04fd2a8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5c46a37aa4624d66b57a0c6b04fd2a8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/5c46a37aa4624d66b57a0c6b04fd2a8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_5c46a37aa4624d66b57a0c6b04fd2a8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-1648760459 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 5c46a37aa4624d66b57a0c6b04fd2a8c Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-1648760459 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-1648760459-project Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e0c23eeabd5d4364be3b2a3b85d498b6 Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-1648760459-project Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c could not be found. Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3f8e3073-b350-4056-8dc4-4e48ea9b991c'} Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c could not be found. Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c could not be found. Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:29.774397 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c could not be found. Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] Returning 404 to user: Instance 3f8e3073-b350-4056-8dc4-4e48ea9b991c could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4203b53-dce6-438d-829d-dc840a70961c tempest-VolumesNegativeTest-1648760459 tempest-VolumesNegativeTest-1648760459-project] 10.222.0.65 "GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c" status: 404 len: 111 microversion: 2.1 time: 0.033451 Oct 17 14:00:29.780585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3233/6478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:29 2022] GET /compute/v2.1/servers/3f8e3073-b350-4056-8dc4-4e48ea9b991c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:29.891146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:29.891906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:29.898673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.899152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.899585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:29.900308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:29.900881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:29.901451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.039010 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3a77ad0-561c-4bf6-841b-af240f6762c4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1651 microversion: 2.1 time: 0.152793 Oct 17 14:00:30.039622 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3246/6479] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:29 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1651 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:30.063078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:30.064082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:30.071053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.071623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.072133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.072933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.073426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.073855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.276942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57e13b62-1994-478c-9616-c30654c86d2d tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1651 microversion: 2.1 time: 0.218280 Oct 17 14:00:30.277579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3234/6480] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:30 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1651 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:30.299534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:30.300183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:30.307408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.307899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.308339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.309048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.309538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.309971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.471200 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12c3b16a-0110-4393-a9c7-e4ad78d3cccb tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1651 microversion: 2.1 time: 0.175009 Oct 17 14:00:30.471907 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3247/6481] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:30 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1651 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:30.494594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:30.495092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:30.501417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.501900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.502337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.503029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.503556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.503906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.530737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:00:30.618571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05de1d72-141f-4e7f-998f-7f7571097184 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "DELETE /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 204 len: 0 microversion: 2.1 time: 0.127369 Oct 17 14:00:30.619171 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3235/6482] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:30 2022] DELETE /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:00:30.627748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:30.628371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:30.635366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.635892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.636307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.637022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:30.637542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:30.637971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:30.776822 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd342f85-603a-4948-87cd-b6fe4b2f25a6 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1657 microversion: 2.1 time: 0.152842 Oct 17 14:00:30.777542 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3248/6483] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:30 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:31.802071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:31.803806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:31.811268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.811755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.812189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.812893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:31.813385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:31.813808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:31.953002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46e722c1-5aec-4e6c-8854-f99d7c9e3be5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1657 microversion: 2.1 time: 0.155207 Oct 17 14:00:31.953646 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3236/6484] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:31 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:32.141467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:32.143869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:32.153186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.153694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.154141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.154856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.155321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.155760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.213027 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8edf40b2-97a3-4f22-8704-46d8f9c9b070 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action" status: 200 len: 24571 microversion: 2.1 time: 0.075464 Oct 17 14:00:32.213856 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3249/6485] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:00:32 2022] POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:00:32.668367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-95f24d95-4b1a-45af-9591-cc58892eae03 req-491c3412-18b7-4202-a4a7-3837f44c7838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "297b9613-24c8-4f04-bc44-ae2c7f9f1b60", "name": "network-vif-deleted", "tag": "553db6ca-d136-4205-a37c-29979f8124de"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:32.681725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-95f24d95-4b1a-45af-9591-cc58892eae03 req-491c3412-18b7-4202-a4a7-3837f44c7838 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.682305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-95f24d95-4b1a-45af-9591-cc58892eae03 req-491c3412-18b7-4202-a4a7-3837f44c7838 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.682809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-95f24d95-4b1a-45af-9591-cc58892eae03 req-491c3412-18b7-4202-a4a7-3837f44c7838 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.702534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:32.704911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-95f24d95-4b1a-45af-9591-cc58892eae03 req-491c3412-18b7-4202-a4a7-3837f44c7838 service nova] Creating event network-vif-deleted:553db6ca-d136-4205-a37c-29979f8124de for instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 on n-h2-854121-14 Oct 17 14:00:32.721622 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-95f24d95-4b1a-45af-9591-cc58892eae03 req-491c3412-18b7-4202-a4a7-3837f44c7838 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054885 Oct 17 14:00:32.723857 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3237/6486] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:32.978156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:32.978867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:32.986187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.986680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.987118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:32.987825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:32.988283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:32.988714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:33.022281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:33.022770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:33.023213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:33.023663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lazy-loading 'fault' on Instance uuid 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:00:33.073141 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2bad26c-0acf-44f6-84c4-a9f22106f7a4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 200 len: 1456 microversion: 2.1 time: 0.099754 Oct 17 14:00:33.073758 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3250/6487] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:32 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 1456 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:34.099758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:34.100430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 297b9613-24c8-4f04-bc44-ae2c7f9f1b60] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:34.108577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.109082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.109555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.110268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.110730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.111168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.125757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] HTTP exception thrown: Instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 could not be found. Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Request method failure captured: Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 HTTP/1.1 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV_kwupeZXDsjdUUy8T5ppFlYGVMj-UxLXgIcq3dKhaRAmNGHbOS4-p5it2nmBUyZBAbgre66Gmzye1BfTcA8tfz__absRQuBsbbHsrNiWWTLjwpK5iDP20Um9UbgRqgVwLjNBxJ3Ej9uQbQUmkVHUgFocpVWamWamb-0PU9MTtYRTI Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2c8dc7d5956949db861bd420f2d7d110 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestServerMultinode-1921906087 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestServerMultinode-1921906087 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2c8dc7d5956949db861bd420f2d7d110 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestServerMultinode-1921906087 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestServerMultinode-1921906087-project-admin Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 409cb4160f2747b48ef304ccd7b89453 Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestServerMultinode-1921906087-project-admin Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 could not be found. Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '297b9613-24c8-4f04-bc44-ae2c7f9f1b60'} Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 could not be found. Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 could not be found. Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:34.127429 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 could not be found. Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Returning 404 to user: Instance 297b9613-24c8-4f04-bc44-ae2c7f9f1b60 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5490cdb7-25cd-43c1-89f8-f4824294bea4 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60" status: 404 len: 111 microversion: 2.1 time: 0.034822 Oct 17 14:00:34.133474 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3238/6488] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:34 2022] GET /compute/v2.1/servers/297b9613-24c8-4f04-bc44-ae2c7f9f1b60 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:34.139476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:34.139998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:34.148081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.148573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.149016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.149755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.150274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.150704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.177173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:00:34.227418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:34.261819 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f042ea78-ee95-4c08-ab0a-12dc09fe43a0 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "DELETE /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 204 len: 0 microversion: 2.1 time: 0.125966 Oct 17 14:00:34.262968 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3251/6489] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:00:34 2022] DELETE /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:00:34.272384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:34.273004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:34.281479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.281976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.282420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.283132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:34.283598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:34.284030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:34.418441 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33f0eb47-e682-4329-8b0f-f474bbe1751c tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1657 microversion: 2.1 time: 0.150116 Oct 17 14:00:34.419160 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3239/6490] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:34 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:35.444753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:35.445568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:35.454916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.455411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.456064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.456917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:35.457630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:35.458067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:35.620725 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d261280-112e-4f6f-a49e-b200dc1f51d5 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1657 microversion: 2.1 time: 0.181514 Oct 17 14:00:35.621700 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3252/6491] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:35 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1657 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:36.140541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8984d997-3b04-4bee-a1d3-0b898a765db9 req-9acf2b2f-c894-4733-8782-6113bc87cd8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9196584c-bd6a-4042-960c-239ee830011e", "name": "network-vif-deleted", "tag": "85fc27f6-6cf3-4a79-8212-08756fb11626"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:36.159968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8984d997-3b04-4bee-a1d3-0b898a765db9 req-9acf2b2f-c894-4733-8782-6113bc87cd8f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.160470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8984d997-3b04-4bee-a1d3-0b898a765db9 req-9acf2b2f-c894-4733-8782-6113bc87cd8f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.160913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8984d997-3b04-4bee-a1d3-0b898a765db9 req-9acf2b2f-c894-4733-8782-6113bc87cd8f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.175147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8984d997-3b04-4bee-a1d3-0b898a765db9 req-9acf2b2f-c894-4733-8782-6113bc87cd8f service nova] Creating event network-vif-deleted:85fc27f6-6cf3-4a79-8212-08756fb11626 for instance 9196584c-bd6a-4042-960c-239ee830011e on n-h1-854121-14 Oct 17 14:00:36.182846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8984d997-3b04-4bee-a1d3-0b898a765db9 req-9acf2b2f-c894-4733-8782-6113bc87cd8f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046439 Oct 17 14:00:36.183462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3240/6492] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:00:36.659831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:36.660457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:36.666771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.667454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.668061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.668761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.669233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.669650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.704646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:36.705428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:36.706027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:36.706632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lazy-loading 'fault' on Instance uuid 9196584c-bd6a-4042-960c-239ee830011e {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:00:36.764985 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-49205d1d-b0d7-4bed-af5b-245b361133e7 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 200 len: 1455 microversion: 2.1 time: 0.117909 Oct 17 14:00:36.765826 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3253/6493] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:36 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:37.790450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:37.792068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] [instance: 9196584c-bd6a-4042-960c-239ee830011e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:37.799060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.799656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.800169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.801050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:37.801543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:37.802008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:37.816483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] HTTP exception thrown: Instance 9196584c-bd6a-4042-960c-239ee830011e could not be found. Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Request method failure captured: Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e HTTP/1.1 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV_kwupeZXDsjdUUy8T5ppFlYGVMj-UxLXgIcq3dKhaRAmNGHbOS4-p5it2nmBUyZBAbgre66Gmzye1BfTcA8tfz__absRQuBsbbHsrNiWWTLjwpK5iDP20Um9UbgRqgVwLjNBxJ3Ej9uQbQUmkVHUgFocpVWamWamb-0PU9MTtYRTI Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2c8dc7d5956949db861bd420f2d7d110 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestServerMultinode-1921906087 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2c8dc7d5956949db861bd420f2d7d110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestServerMultinode-1921906087 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2c8dc7d5956949db861bd420f2d7d110 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestServerMultinode-1921906087 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestServerMultinode-1921906087-project-admin Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 409cb4160f2747b48ef304ccd7b89453 Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestServerMultinode-1921906087-project-admin Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 9196584c-bd6a-4042-960c-239ee830011e could not be found. Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '9196584c-bd6a-4042-960c-239ee830011e'} Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9196584c-bd6a-4042-960c-239ee830011e could not be found. Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9196584c-bd6a-4042-960c-239ee830011e could not be found. Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:00:37.819279 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9196584c-bd6a-4042-960c-239ee830011e could not be found. Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] Returning 404 to user: Instance 9196584c-bd6a-4042-960c-239ee830011e could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1477c322-f346-46ae-a5cd-a371f5049e79 tempest-TestServerMultinode-1921906087 tempest-TestServerMultinode-1921906087-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e" status: 404 len: 111 microversion: 2.1 time: 0.035218 Oct 17 14:00:37.824044 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3241/6494] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:37 2022] GET /compute/v2.1/servers/9196584c-bd6a-4042-960c-239ee830011e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:00:43.200403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:43.201733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:43.218290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:43.219052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:43.219679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:43.220417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:43.220890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:43.221363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:43.728124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c53186c-77af-4eea-9280-a69964a5c404 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1837 microversion: 2.1 time: 0.530454 Oct 17 14:00:43.729685 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3254/6495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:43 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1837 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:43.754719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:43.755515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:43.763198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:43.764121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:43.764679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:43.765583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:43.766181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:43.766720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.111626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:44.123180 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94b700a9-a17c-4e35-8d4c-7a2bb5bb51f5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1684 microversion: 2.1 time: 0.372283 Oct 17 14:00:44.124702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3242/6496] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:43 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1684 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:44.256181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:44.258494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:44.266243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:44.266751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:44.267200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.267921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:44.268578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:44.269213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.325519 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e875a6a1-d875-41da-aec7-5d90c81ef80a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action" status: 200 len: 32644 microversion: 2.1 time: 0.074284 Oct 17 14:00:44.326416 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3255/6497] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:00:44 2022] POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action => generated 32644 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:00:44.480282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:00:44.480282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:44.487079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:44.487266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:44.487928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.488707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:44.490068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:44.490985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:44.547819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bc384013ad884282aa26436430c0089a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f5954a6c034c6fac1916087189ab5b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:44.548617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] flavor_id is None. Assuming migration. {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 14:00:44.549271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:00:44.991325 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1094b212-0e89-433e-a7a6-1d890f50e4c6 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action" status: 202 len: 0 microversion: 2.1 time: 0.514755 Oct 17 14:00:44.993225 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3243/6498] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:00:44 2022] POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:00:45.004442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:45.006692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:45.018998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:45.019339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:45.019781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:45.025898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:45.026542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:45.027031 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:45.275020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:45.287922 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97ab9c22-d042-4ab3-99de-bfb8cd5a01fe tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1693 microversion: 2.1 time: 0.287545 Oct 17 14:00:45.288710 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3256/6499] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:44 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1693 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:46.314837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:46.315437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:46.330841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:46.331340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:46.332014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:46.333987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:46.334470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:46.334908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:46.986014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:46.997218 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2cafe5ac-00e0-43d0-84ab-bd5aa02d276e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1693 microversion: 2.1 time: 0.687136 Oct 17 14:00:46.998395 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3244/6500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:46 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1693 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:48.021405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:48.022285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:48.031044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.031646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.032296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.033093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:48.033681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:48.034819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:48.255850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:48.265980 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c220f10d-db2a-4c9d-b764-1b7e4ff3ebbb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.248658 Oct 17 14:00:48.271191 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3257/6501] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:48 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:49.297575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:49.299964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:49.310861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:49.330115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:49.331673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:49.333044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:49.334314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:49.337055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:49.338207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:49.564582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:49.575728 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed511906-1b29-4d2b-9d16-3147491a732d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.288099 Oct 17 14:00:49.576617 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3245/6502] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:49 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:50.602281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:50.603074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:50.621097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:50.626193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:50.626956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:50.627786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:50.628453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:50.628936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:50.875723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:50.892396 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-513ebad5-f3b6-40a3-a91e-a4d1077a5edb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.294026 Oct 17 14:00:50.894549 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3258/6503] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:50 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:51.927784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:51.928443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:51.935562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:51.936061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:51.936510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:51.937253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:51.937717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:51.938152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:52.177934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:52.186820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b74ca93-f929-4618-b889-134ce3727088 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.269747 Oct 17 14:00:52.187427 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3246/6504] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:51 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:53.214530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:53.215793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:53.237626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:53.238140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:53.238617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:53.239563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:53.240194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:53.243356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:53.482008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:53.490508 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd7fe1e4-a39a-49bc-b747-b11322af461e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.283787 Oct 17 14:00:53.491258 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3259/6505] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:53 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:54.515387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:54.516010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:54.529573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:54.533123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:54.533745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:54.534889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:54.535717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:54.536847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:54.743171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:54.754612 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73a0749b-629c-4eef-8d8e-e387bc6372d2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.243058 Oct 17 14:00:54.755451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3247/6506] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:54 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:55.783927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:55.785820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:55.803366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:00:55.809663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:55.811773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:55.812249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:55.813231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:55.815118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:55.823289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:56.028845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:56.042100 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f4303c8c-d383-478d-8857-558070306d20 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.263935 Oct 17 14:00:56.042729 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3260/6507] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:55 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:57.071174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:57.071858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:57.088678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:57.089934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:57.090880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:57.092362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:57.095618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:57.097207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:57.320525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:57.331132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa4acb92-a686-4526-bc71-749aed924afc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.264123 Oct 17 14:00:57.332028 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3248/6508] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:57 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:00:58.356077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:58.356879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:58.365357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:58.366050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:58.366677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:58.367464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:58.368434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:58.369297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:58.552565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:58.561314 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72365c01-a3f7-45e6-8e03-9a8bd9b82645 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.209337 Oct 17 14:00:58.562656 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3261/6509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:58 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:00:59.590269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:00:59.590878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:00:59.598924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:59.599418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:59.600066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.600778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:00:59.601563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:00:59.602099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:00:59.761657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:00:59.772562 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e75c6309-c427-46b3-b508-d576a4578bd4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1698 microversion: 2.1 time: 0.187045 Oct 17 14:00:59.773224 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3249/6510] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:00:59 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:00.235648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "name": "network-vif-unplugged", "status": "completed", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:00.247381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.247892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.248640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.263628 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] Creating event network-vif-unplugged:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h2-854121-14 Oct 17 14:01:00.270259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:01:00.282075 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cf8175ed-12dc-44b5-8ed5-5ba066e83ee7 req-3cf77b9b-21dd-4ea0-806c-18b2a578edb1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050168 Oct 17 14:01:00.282694 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3262/6511] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:00.804134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:00.804896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:00.816081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.816887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.817378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:00.818273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:00.818750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:00.819183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:01.107086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:01.115477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-749a7728-57db-4192-a2d0-867faee71cf3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1697 microversion: 2.1 time: 0.320515 Oct 17 14:01:01.116069 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3250/6512] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:00 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1697 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:02.141751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:02.142389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:02.149356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.149878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.150323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:02.151023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.151481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.151910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:02.291680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:02.300373 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8382b41d-7653-4853-bf63-23ad1262e434 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1695 microversion: 2.1 time: 0.163933 Oct 17 14:01:02.301002 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3263/6513] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:02 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:02.314708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:02.327343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:02.327849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:02.328272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:02.341715 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] Creating event network-changed:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h2-854121-14 Oct 17 14:01:02.347286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:01:02.358547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-17889506-2449-4933-a455-db272bb48215 req-4dda66bf-c381-481d-a0da-0c1a64e0f38b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047446 Oct 17 14:01:02.359418 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3251/6514] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:03.325633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:03.326168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:03.333841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:03.334322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:03.334760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:03.335457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:03.335935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:03.336360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:03.474071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:03.481920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ac6f0c5-3023-4612-a2ec-457e38401e45 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1695 microversion: 2.1 time: 0.160582 Oct 17 14:01:03.482499 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3264/6515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:03 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:04.507677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:04.508380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:04.515066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:04.515583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:04.516023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:04.516719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:04.517189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:04.517622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:04.521275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:04.754578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:04.767379 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-248adb5e-e1a2-4882-913a-e23e36e64b3e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1695 microversion: 2.1 time: 0.265186 Oct 17 14:01:04.770582 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3252/6516] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:04 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1695 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:05.793653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:05.794444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:05.803432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.804172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.805099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.806214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.807228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.807733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.813307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:05.954871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:05.963675 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-64081515-f979-4bc9-af85-05e513e1aa96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1692 microversion: 2.1 time: 0.174064 Oct 17 14:01:05.964273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3265/6517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:05 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:05.986978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:05.987554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:05.994826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.995359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.995879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:05.996461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:05.996922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:05.997408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.061927 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eaf50c6b-c58f-4814-8cf1-ed5e3e244124 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action" status: 204 len: 0 microversion: 2.1 time: 0.078622 Oct 17 14:01:06.062577 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3253/6518] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:01:05 2022] POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:01:06.072572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:06.073579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:06.081058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.082770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.083626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.084711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.086453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.087229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.380403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:06.390150 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cb10747-6f0e-4363-8e42-68466adeb335 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1692 microversion: 2.1 time: 0.322284 Oct 17 14:01:06.391271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3266/6519] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:06 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1692 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:06.930675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "name": "network-vif-plugged", "status": "completed", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:06.944900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:06.945795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:06.946468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:06.961132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] Creating event network-vif-plugged:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h2-854121-14 Oct 17 14:01:06.968066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:01:06.980930 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-558a26c0-8374-4c4c-ae5c-ae1932a1ba19 req-7e69e0a8-35b7-48ac-bd24-f93a5b6de708 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056309 Oct 17 14:01:06.982235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3254/6520] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:07.416012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:07.417278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:07.425584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.426200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.426696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:07.427540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:07.428025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:07.428496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:07.586975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:07.594743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa531f76-a0c8-40f4-a530-24b6ecc5b53a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1692 microversion: 2.1 time: 0.182555 Oct 17 14:01:07.595322 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3267/6521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:07 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:01:08.620766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:08.621502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:08.629278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.630039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.630728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.631629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:08.632250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:08.632855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:08.786392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:08.794698 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64b77f2e-0ca2-4d37-8ee5-d29e97cda751 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1684 microversion: 2.1 time: 0.178671 Oct 17 14:01:08.795373 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3255/6522] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:08 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:14.230624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1227c2e-a82d-43a7-9425-149dca4e4d43 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'create', calling method: .version_select at 0x7f419c95e430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1819535793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSNz6HHN0i3Ar4guv03fHBkRmuNfPC0YTOERz1CL+CzSG0LSjRa6SYVQiMwIktjYt/aTmM25GrNr8uBPUout5mu21eEbBfbFPrHuiz4tyBocHMipMx/Nj2IbVgof8PfgA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:14.251087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b1227c2e-a82d-43a7-9425-149dca4e4d43 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for project 2dfa0c4055274aedab03ab42247817ad. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:01:14.258122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b1227c2e-a82d-43a7-9425-149dca4e4d43 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for user 8fc8aa11a5c74b76809ec5ac2fbc5608 and project 2dfa0c4055274aedab03ab42247817ad. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:01:14.292282 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1227c2e-a82d-43a7-9425-149dca4e4d43 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.065837 Oct 17 14:01:14.292900 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3268/6523] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:01:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:15.693782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1794530767", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "14d73b1a-3b04-4705-8247-df6e9ab17e3c"}], "key_name": "tempest-TestNetworkBasicOps-1819535793", "security_groups": [{"name": "tempest-secgroup-smoke-1547903336"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:15.829735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] validate_networks() for [('14d73b1a-3b04-4705-8247-df6e9ab17e3c', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:01:16.283765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:01:16.284882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:01:16.285404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:01:16.285841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:01:16.286494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:01:16.295692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:16.296059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:16.296685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:16.297435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:16.297888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:16.298308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:16.316798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for project 2dfa0c4055274aedab03ab42247817ad. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:01:16.323147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for user 8fc8aa11a5c74b76809ec5ac2fbc5608 and project 2dfa0c4055274aedab03ab42247817ad. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:01:16.337356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:01:16.339992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:01:16.393268 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-361c2f4c-951e-4f80-a614-8d5cf346aeef tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704372 Oct 17 14:01:16.394604 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3256/6524] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:01:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:01:16.406526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1a51a8e-495b-410e-a605-765976330178 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:16.407160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1a51a8e-495b-410e-a605-765976330178 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:16.473447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1a51a8e-495b-410e-a605-765976330178 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:16.481306 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1a51a8e-495b-410e-a605-765976330178 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1249 microversion: 2.1 time: 0.078768 Oct 17 14:01:16.481894 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3269/6525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:16 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1249 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:17.507230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:17.508225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:17.515514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.516011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.516457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.517312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:17.517848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:17.518286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:17.591933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:17.600607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64ce0416-903e-4f17-8826-34ca34a173d9 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1309 microversion: 2.1 time: 0.098242 Oct 17 14:01:17.601534 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3257/6526] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:17 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:01:18.625535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:18.626163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:18.630278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=17 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:18.644619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:18.645535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:18.645990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:18.646704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:18.647228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:18.647662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:18.882463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:18.890651 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c96ba128-bf3f-43e9-91bc-0f3219c47343 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.269415 Oct 17 14:01:18.891371 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3270/6527] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:18 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:19.037239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-67564a3c-37f6-434f-91c4-df73cc9496f3 req-90926352-4e72-47d8-b503-c9a8c252649d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6594a9-658f-49b1-bf22-e414d3541361", "tag": "2aba7737-122c-4a3e-b28f-85d0f00d0459"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:19.048481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-67564a3c-37f6-434f-91c4-df73cc9496f3 req-90926352-4e72-47d8-b503-c9a8c252649d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.048965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-67564a3c-37f6-434f-91c4-df73cc9496f3 req-90926352-4e72-47d8-b503-c9a8c252649d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.049568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-67564a3c-37f6-434f-91c4-df73cc9496f3 req-90926352-4e72-47d8-b503-c9a8c252649d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.061813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-67564a3c-37f6-434f-91c4-df73cc9496f3 req-90926352-4e72-47d8-b503-c9a8c252649d service nova] Creating event network-changed:2aba7737-122c-4a3e-b28f-85d0f00d0459 for instance 9b6594a9-658f-49b1-bf22-e414d3541361 on n-h1-854121-14 Oct 17 14:01:19.066713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-67564a3c-37f6-434f-91c4-df73cc9496f3 req-90926352-4e72-47d8-b503-c9a8c252649d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034102 Oct 17 14:01:19.067323 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3258/6528] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:19.915827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:19.916387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:19.923370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.923857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.924301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:19.925698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:19.926206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:19.926638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:20.074809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:20.083021 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc5ae09b-6301-43f6-b2a2-b07c3f06a0be tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.171139 Oct 17 14:01:20.083580 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3271/6529] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:19 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:21.107260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:21.107968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:21.110047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:21.115906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:21.116402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:21.116844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:21.117576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:21.118218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:21.118653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:21.259195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:21.267230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9bc370a3-ba74-4589-85ff-544e360efe2f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.165197 Oct 17 14:01:21.267805 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3259/6530] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:21 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:22.291128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:22.291757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:22.298810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:22.299352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:22.300356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:22.301073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:22.301570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:22.302001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:22.441090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:22.449305 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-383d9aec-36ab-42f2-a39a-0ca35ee2c55f tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.162056 Oct 17 14:01:22.449895 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3272/6531] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:22 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:23.472014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:23.472952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:23.479905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:23.480570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:23.481022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:23.481762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:23.482858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:23.483296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:23.625231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:23.633978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0ed9fe2-8d2b-4717-9d5f-b2dbe380ac9c tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.165921 Oct 17 14:01:23.634579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3260/6532] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:23 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:24.657663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:24.658275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:24.661391 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:01:24.661540 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 (ip 10.222.0.65) !!! Oct 17 14:01:24.668862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:24.669469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:24.669917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:24.670630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:24.671087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:24.671517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:24.808948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:24.817830 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-479f1d59-225e-4344-a118-3d99fb831e5d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.164469 Oct 17 14:01:24.818408 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3273/6533] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:24 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:25.003256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2c9c21b1-6427-407e-9304-40e78062c859 req-aeef90ed-e4dd-4efd-9676-664fb1ceaf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6594a9-658f-49b1-bf22-e414d3541361", "name": "network-vif-plugged", "status": "completed", "tag": "2aba7737-122c-4a3e-b28f-85d0f00d0459"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:25.016243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2c9c21b1-6427-407e-9304-40e78062c859 req-aeef90ed-e4dd-4efd-9676-664fb1ceaf5c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:25.016779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2c9c21b1-6427-407e-9304-40e78062c859 req-aeef90ed-e4dd-4efd-9676-664fb1ceaf5c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:25.017249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2c9c21b1-6427-407e-9304-40e78062c859 req-aeef90ed-e4dd-4efd-9676-664fb1ceaf5c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:25.030244 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2c9c21b1-6427-407e-9304-40e78062c859 req-aeef90ed-e4dd-4efd-9676-664fb1ceaf5c service nova] Creating event network-vif-plugged:2aba7737-122c-4a3e-b28f-85d0f00d0459 for instance 9b6594a9-658f-49b1-bf22-e414d3541361 on n-h1-854121-14 Oct 17 14:01:25.035768 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2c9c21b1-6427-407e-9304-40e78062c859 req-aeef90ed-e4dd-4efd-9676-664fb1ceaf5c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036298 Oct 17 14:01:25.036924 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3261/6534] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:25.841378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:25.841989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:25.849047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:25.849568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:25.850005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:25.850692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:25.851141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:25.851561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:26.262802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:26.270708 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-16d8e751-6e76-45e0-860f-5f524281a802 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1375 microversion: 2.1 time: 0.433399 Oct 17 14:01:26.271285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3274/6535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:25 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1375 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:27.295238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:27.295975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:27.298789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:27.299511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:27.311113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:27.311962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:27.312745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:27.313992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:27.314793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:27.315554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:27.453004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:27.461690 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dbbec98b-16be-4681-b04e-6a27102a0e18 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1547 microversion: 2.1 time: 0.170744 Oct 17 14:01:27.462416 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3262/6536] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:27 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:27.485110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:01:27.486675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:27.487776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:27.489556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:27.496770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:27.496770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:27.496770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:27.497603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:27.498059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:27.498492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:27.636114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:01:27.644512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f347307f-afc8-4d62-aa11-c63a4989554a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1547 microversion: 2.1 time: 0.163379 Oct 17 14:01:27.645096 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3275/6537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:01:27 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:01:29.296029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0f46007a-1f9d-435d-81e7-dadf1160189d req-25ba7a5e-6387-4f54-8082-bf6fb8136c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6594a9-658f-49b1-bf22-e414d3541361", "tag": "2aba7737-122c-4a3e-b28f-85d0f00d0459"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:29.307882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f46007a-1f9d-435d-81e7-dadf1160189d req-25ba7a5e-6387-4f54-8082-bf6fb8136c80 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:29.308762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f46007a-1f9d-435d-81e7-dadf1160189d req-25ba7a5e-6387-4f54-8082-bf6fb8136c80 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:29.309498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f46007a-1f9d-435d-81e7-dadf1160189d req-25ba7a5e-6387-4f54-8082-bf6fb8136c80 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:29.322409 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0f46007a-1f9d-435d-81e7-dadf1160189d req-25ba7a5e-6387-4f54-8082-bf6fb8136c80 service nova] Creating event network-changed:2aba7737-122c-4a3e-b28f-85d0f00d0459 for instance 9b6594a9-658f-49b1-bf22-e414d3541361 on n-h1-854121-14 Oct 17 14:01:29.327898 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0f46007a-1f9d-435d-81e7-dadf1160189d req-25ba7a5e-6387-4f54-8082-bf6fb8136c80 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036210 Oct 17 14:01:29.328540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3263/6538] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:01:41.026974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:41.029290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:41.032186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:41.032857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=36 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:41.039768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:41.040260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:41.040726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:41.041439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:41.041900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:41.042333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:41.113151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c816f8d0-21c1-4d74-8548-3a646f958c13 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action" status: 200 len: 24574 microversion: 2.1 time: 0.089884 Oct 17 14:01:41.113845 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3276/6539] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:01:41 2022] POST /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3/action => generated 24574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:01:50.539796 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:01:50.540391 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:01:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361/action (ip 10.222.0.65) !!! Oct 17 14:01:50.541088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=9 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:50.541858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:01:50.546573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:01:50.548929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:01:50.558690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.559180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.559619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.560316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:01:50.560804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:01:50.561314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:01:50.618061 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fd260c1-7a4e-42e5-bec9-9cecd4745fa7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361/action" status: 200 len: 24567 microversion: 2.1 time: 0.080277 Oct 17 14:01:50.618990 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3264/6540] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:01:50 2022] POST /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361/action => generated 24567 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:03.860278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:03.860986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:03.864335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:03.865026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:03.871486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:03.871973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:03.872413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:03.873110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:03.873594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:03.874026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:04.006456 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4db569f-7a18-4c17-8616-9488a22317a5 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1837 microversion: 2.1 time: 0.150405 Oct 17 14:02:04.007053 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3277/6541] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:03 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1837 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:05.061022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c12d87f-9751-41de-bd7a-9fda6620580b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'create', calling method: .version_select at 0x7f419d0481f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-374213775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOV7nT/p4YQWAOKFmxvu7cS5anixEfgydCqs/BzPTvWkZ18/R/yweag9Cv3cHLrHcylGpokEgfCKkUfggu4o+brlT2UYrBrhHnOqUELbRgkj+dFpSCho6UXnlxGGqMHZIw=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:05.068602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:05.069556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:05.084637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-6c12d87f-9751-41de-bd7a-9fda6620580b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for project 2dfa0c4055274aedab03ab42247817ad. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:05.090833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-6c12d87f-9751-41de-bd7a-9fda6620580b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for user 8fc8aa11a5c74b76809ec5ac2fbc5608 and project 2dfa0c4055274aedab03ab42247817ad. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:05.122412 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c12d87f-9751-41de-bd7a-9fda6620580b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.065758 Oct 17 14:02:05.130113 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3265/6542] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:02:05 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:05.189547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:05.190131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:05.193310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8e4db67f-d7c2-4009-8703-17f4bea8d51c req-af5dc617-f0fd-4a54-b1ab-82ee479be4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:05.198254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:05.199016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:05.199636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:05.200549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:05.201201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:05.201807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:05.208361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e4db67f-d7c2-4009-8703-17f4bea8d51c req-af5dc617-f0fd-4a54-b1ab-82ee479be4e1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:05.208998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e4db67f-d7c2-4009-8703-17f4bea8d51c req-af5dc617-f0fd-4a54-b1ab-82ee479be4e1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:05.209656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e4db67f-d7c2-4009-8703-17f4bea8d51c req-af5dc617-f0fd-4a54-b1ab-82ee479be4e1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:05.226726 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8e4db67f-d7c2-4009-8703-17f4bea8d51c req-af5dc617-f0fd-4a54-b1ab-82ee479be4e1 service nova] Creating event network-changed:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h2-854121-14 Oct 17 14:02:05.231046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:02:05.233949 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8e4db67f-d7c2-4009-8703-17f4bea8d51c req-af5dc617-f0fd-4a54-b1ab-82ee479be4e1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045195 Oct 17 14:02:05.235892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3266/6543] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:05.370241 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d2cc2be-4d42-40df-a0f5-61ac84fa1112 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 204 len: 0 microversion: 2.1 time: 0.184448 Oct 17 14:02:05.374272 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3278/6544] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:02:05 2022] DELETE /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:02:05.382654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:05.383520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:05.396631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:05.398030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:05.398818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:05.399765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:05.400462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:05.401028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:05.598309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:05.609057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c53f819-2afe-4f7b-b215-f254d48972b3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1690 microversion: 2.1 time: 0.233132 Oct 17 14:02:05.609938 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3267/6545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:05 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:06.269573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-425504055", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "332dc696-90fc-49a6-a4a4-4aaa6509392a"}], "key_name": "tempest-TestNetworkBasicOps-374213775", "security_groups": [{"name": "tempest-secgroup-smoke-1980638228"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:06.379386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] validate_networks() for [('332dc696-90fc-49a6-a4a4-4aaa6509392a', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:02:06.637101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:06.637962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:06.655351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:06.665497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:06.665960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:06.667275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:06.668110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:06.668223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:06.954661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:06.967089 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3130456b-c4a9-4f90-867d-520aecdb02f0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1690 microversion: 2.1 time: 0.334495 Oct 17 14:02:06.977825 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3268/6546] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:06 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1690 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:07.177997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:02:07.178433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:02:07.178910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:02:07.179323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:02:07.179740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:02:07.189954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:07.191028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:07.191552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:07.192410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:07.192865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:07.193322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:07.212590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for project 2dfa0c4055274aedab03ab42247817ad. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:07.218515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for user 8fc8aa11a5c74b76809ec5ac2fbc5608 and project 2dfa0c4055274aedab03ab42247817ad. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:07.232926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:02:07.235413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:02:07.292226 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6138fd67-f21d-4013-9e0a-c83f42b570eb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.028504 Oct 17 14:02:07.299457 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3279/6547] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:02:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:02:07.304951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb7968a9-3a15-4eff-b04d-f87cff7f9540 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:07.305658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb7968a9-3a15-4eff-b04d-f87cff7f9540 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:07.395174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb7968a9-3a15-4eff-b04d-f87cff7f9540 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:07.412108 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb7968a9-3a15-4eff-b04d-f87cff7f9540 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1247 microversion: 2.1 time: 0.110649 Oct 17 14:02:07.412811 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3269/6548] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:07 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1247 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:07.804409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2987a6f3-56ba-4c9e-bb09-9e70f085f221 req-e4d54fe9-04b7-43ef-b283-e3e374c2bc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12584f73-d78a-440f-92bc-a9a2fca623f3", "name": "network-vif-deleted", "tag": "368c32ac-229f-48c2-b90b-1217698b890b"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:07.816374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2987a6f3-56ba-4c9e-bb09-9e70f085f221 req-e4d54fe9-04b7-43ef-b283-e3e374c2bc5c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:07.817221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2987a6f3-56ba-4c9e-bb09-9e70f085f221 req-e4d54fe9-04b7-43ef-b283-e3e374c2bc5c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:07.817845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2987a6f3-56ba-4c9e-bb09-9e70f085f221 req-e4d54fe9-04b7-43ef-b283-e3e374c2bc5c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:07.829582 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2987a6f3-56ba-4c9e-bb09-9e70f085f221 req-e4d54fe9-04b7-43ef-b283-e3e374c2bc5c service nova] Creating event network-vif-deleted:368c32ac-229f-48c2-b90b-1217698b890b for instance 12584f73-d78a-440f-92bc-a9a2fca623f3 on n-h2-854121-14 Oct 17 14:02:07.835364 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2987a6f3-56ba-4c9e-bb09-9e70f085f221 req-e4d54fe9-04b7-43ef-b283-e3e374c2bc5c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035922 Oct 17 14:02:07.836012 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3280/6549] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:07.996976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:07.997841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:08.006255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:08.006757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:08.007200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:08.007915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:08.008377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:08.008866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:08.042749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:08.043578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:08.044359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:08.044969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lazy-loading 'fault' on Instance uuid 12584f73-d78a-440f-92bc-a9a2fca623f3 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:02:08.107649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:08.118137 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ecc7169-35e2-42c8-a48f-4512ff69dc4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 200 len: 1357 microversion: 2.1 time: 0.124933 Oct 17 14:02:08.119194 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3270/6550] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:07 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 1357 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:08.439950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:08.441495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:08.449406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:08.449901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:08.450334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:08.451328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:08.451776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:08.452201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:08.541458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:08.551342 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1e978a7-91c6-4c7a-aab0-e3f281e27faa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1299 microversion: 2.1 time: 0.116066 Oct 17 14:02:08.551885 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3281/6551] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:08 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:09.142756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:09.143593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 12584f73-d78a-440f-92bc-a9a2fca623f3] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:09.150550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:09.151038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:09.151507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:09.152206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:09.152657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:09.153124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:09.167783 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] HTTP exception thrown: Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 could not be found. Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Request method failure captured: Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 HTTP/1.1 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV_PgO2oVzsPWCFVF-Fj96y0E8wrPFwlaAXVxcDjVXPmMRRdsfsS5c8iL3LVx_6gwqFrYjUxK5-nfmFMQ4-xhEjabCG0_nw46-IVNPiZQLL3NpnIWDlt02E3Eh25va4J7ziMmiebAy2I3elil_Z3K4RZRQSs9OGl7P0TMqk8R6_ATFI Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 95284ccf684a481691e67ffcb5e66785 Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 could not be found. Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '12584f73-d78a-440f-92bc-a9a2fca623f3'} Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 could not be found. Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 could not be found. Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:02:09.169500 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 could not be found. Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Returning 404 to user: Instance 12584f73-d78a-440f-92bc-a9a2fca623f3 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-baf00730-32b1-4396-9638-297c73f44b4f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3" status: 404 len: 111 microversion: 2.1 time: 0.032108 Oct 17 14:02:09.172837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3271/6552] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:09 2022] GET /compute/v2.1/servers/12584f73-d78a-440f-92bc-a9a2fca623f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:02:09.576342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:09.577285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:09.584973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:09.585630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:09.586163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:09.586979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:09.587599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:09.588029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:09.876325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:09.888304 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-527c9ca7-603b-46d3-9370-6673f8b10909 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.315955 Oct 17 14:02:09.888903 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3282/6553] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:09 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:10.594980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2c375c6d-532d-4f80-95ba-fa0939132209 req-29cbfc50-6049-42af-92af-ae14080f461a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5420a3c8-b962-46fc-be73-0d42ace8e07a", "tag": "dc081382-e30d-49fb-9efc-d1b46c4a5cdc"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:10.616743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2c375c6d-532d-4f80-95ba-fa0939132209 req-29cbfc50-6049-42af-92af-ae14080f461a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:10.617282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2c375c6d-532d-4f80-95ba-fa0939132209 req-29cbfc50-6049-42af-92af-ae14080f461a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:10.617877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2c375c6d-532d-4f80-95ba-fa0939132209 req-29cbfc50-6049-42af-92af-ae14080f461a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:10.630185 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2c375c6d-532d-4f80-95ba-fa0939132209 req-29cbfc50-6049-42af-92af-ae14080f461a service nova] Creating event network-changed:dc081382-e30d-49fb-9efc-d1b46c4a5cdc for instance 5420a3c8-b962-46fc-be73-0d42ace8e07a on n-h2-854121-14 Oct 17 14:02:10.638684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2c375c6d-532d-4f80-95ba-fa0939132209 req-29cbfc50-6049-42af-92af-ae14080f461a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044971 Oct 17 14:02:10.639684 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3272/6554] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:10.913128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:10.913783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:10.920425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:10.920917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:10.921386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:10.922099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:10.922554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:10.922979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:11.218445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:11.230455 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26cc85cc-026e-426e-aa23-ea194dee88f7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.321711 Oct 17 14:02:11.231835 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3283/6555] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:10 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:12.257756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:12.259262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:12.267212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:12.267705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:12.268662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:12.269814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:12.270322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:12.270748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:12.523974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:12.533275 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-759a253f-b613-4673-8db2-7d0ba9cf4caa tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.281555 Oct 17 14:02:12.534929 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3273/6556] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:12 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:13.167836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7caa652f-8f22-4f95-9bc4-ea74b4ad1c31 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '.version_select at 0x7f419cc48040>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:13.191162 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7caa652f-8f22-4f95-9bc4-ea74b4ad1c31 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1920003692" status: 202 len: 0 microversion: 2.1 time: 0.027530 Oct 17 14:02:13.195272 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3284/6557] 10.222.0.65 () {58 vars in 1284 bytes} [Mon Oct 17 14:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1920003692 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:02:13.220028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dae9e3cd-e73e-42e6-962b-9ed04043e106 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: .version_select at 0x7f419ca91a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-42813697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTss7VFPNBSsO47WM0W3GZj+7Px2MYFaI9qns91miqtairmmvIUSWAxGnAQ9NcmzaMOnGemq2W6zToRtQS7eUhYusN7Is6/skGZDsTulFgMGpnm6+pzHL+BH5+rUcfm2w=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:13.235689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dae9e3cd-e73e-42e6-962b-9ed04043e106 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:13.241559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dae9e3cd-e73e-42e6-962b-9ed04043e106 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:13.267625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dae9e3cd-e73e-42e6-962b-9ed04043e106 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.051530 Oct 17 14:02:13.268410 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3274/6558] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:02:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:13.558873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:13.559791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:13.568463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:13.569393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:13.569933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:13.570729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:13.571430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:13.571920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:13.794730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:13.806138 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47aae1d4-f871-470e-9193-16a78220a2f8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.250556 Oct 17 14:02:13.807122 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3285/6559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:13 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:14.832573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:14.834098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:14.840173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:14.840674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:14.841124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:14.841857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:14.842319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:14.842756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:15.114269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:15.123420 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6996284e-5494-4cb9-a48d-9dc99e6443d2 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.295657 Oct 17 14:02:15.124014 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3275/6560] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:14 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:16.147392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:16.148171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:16.155166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:16.155984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:16.156502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:16.157316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:16.157846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:16.158350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:16.334422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:16.342475 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8dc3d814-d131-46eb-a337-acd2198f48db tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.199270 Oct 17 14:02:16.357260 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3286/6561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:16 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:17.366064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:17.368172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:17.378054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:17.378790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:17.379369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:17.380226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:17.380852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:17.381453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:17.505869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:17.508865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:17.625484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:17.642401 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e9f9bbe-5de9-462c-9aa2-5fa0cbac7f53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.280853 Oct 17 14:02:17.643202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3276/6562] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:17 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:17.693852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0690af7e-a28b-466d-b47d-1fe007bd781c req-b38a240a-6b00-46e5-9ef9-6a778f96f1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5420a3c8-b962-46fc-be73-0d42ace8e07a", "name": "network-vif-plugged", "status": "completed", "tag": "dc081382-e30d-49fb-9efc-d1b46c4a5cdc"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:17.706758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0690af7e-a28b-466d-b47d-1fe007bd781c req-b38a240a-6b00-46e5-9ef9-6a778f96f1bf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:17.708619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0690af7e-a28b-466d-b47d-1fe007bd781c req-b38a240a-6b00-46e5-9ef9-6a778f96f1bf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:17.709695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0690af7e-a28b-466d-b47d-1fe007bd781c req-b38a240a-6b00-46e5-9ef9-6a778f96f1bf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:17.724940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0690af7e-a28b-466d-b47d-1fe007bd781c req-b38a240a-6b00-46e5-9ef9-6a778f96f1bf service nova] Creating event network-vif-plugged:dc081382-e30d-49fb-9efc-d1b46c4a5cdc for instance 5420a3c8-b962-46fc-be73-0d42ace8e07a on n-h2-854121-14 Oct 17 14:02:17.730415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0690af7e-a28b-466d-b47d-1fe007bd781c req-b38a240a-6b00-46e5-9ef9-6a778f96f1bf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232853 Oct 17 14:02:17.731486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3287/6563] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:18.667109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:18.668340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:18.677635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:18.678362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:18.678953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:18.680391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:18.681033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:18.681695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:18.976573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:18.988069 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16202102-5536-457f-a9d2-59e5b753e12d tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1373 microversion: 2.1 time: 0.325752 Oct 17 14:02:18.989648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3277/6564] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:18 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1373 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:19.726914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-244805083", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "740868ef-fef6-488b-b1c5-b684687e622d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-42813697", "security_groups": [{"name": "tempest-secgroup-smoke-566783040"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:19.881483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] validate_networks() for [('740868ef-fef6-488b-b1c5-b684687e622d', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:02:20.022627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:20.024802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:20.042114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.043009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.044126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.052742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.054725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.057305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.327878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:20.337255 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9fb2561d-fa30-42dc-bee1-291721bff52b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1546 microversion: 2.1 time: 0.325337 Oct 17 14:02:20.338030 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3278/6565] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:20 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1546 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:20.360548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:20.361188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:20.368327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.369036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.369650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.370623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.371217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.371790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.491520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:02:20.495734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:02:20.496660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:02:20.497225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:02:20.498929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:02:20.530134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.531409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.532823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.534994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:20.536637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:20.538161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:20.575160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:02:20.582899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:02:20.602043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:02:20.606516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:02:20.650467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:20.662928 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-438d1d88-90fc-433e-8789-8277d23d9b49 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1546 microversion: 2.1 time: 0.305481 Oct 17 14:02:20.664104 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3279/6566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:20 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1546 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:20.683404 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b973166-9141-4f4a-bff3-e150fb73f243 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.962421 Oct 17 14:02:20.690195 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3288/6567] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:02:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:02:20.697436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15097e79-a645-44ea-a228-3da52eb074c5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:20.698059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15097e79-a645-44ea-a228-3da52eb074c5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:20.780670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-15097e79-a645-44ea-a228-3da52eb074c5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:20.789416 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15097e79-a645-44ea-a228-3da52eb074c5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1264 microversion: 2.1 time: 0.096791 Oct 17 14:02:20.790671 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3280/6568] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:20 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1264 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:21.817977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:21.818813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:21.828656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:21.829405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:21.832215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:21.833116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:21.833655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:21.838034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:21.940642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:21.949859 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cfcbc420-aa3c-406e-ba3e-31d4e9a57101 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1324 microversion: 2.1 time: 0.138492 Oct 17 14:02:21.955164 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3289/6569] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:21 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1324 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:22.974567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:22.975334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:22.983498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.983809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.984247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:22.984954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:22.985465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:22.985894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:23.088491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:23.096942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-903c3c81-ce32-4b3d-9d13-7002598f2572 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1322 microversion: 2.1 time: 0.127397 Oct 17 14:02:23.097779 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3281/6570] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:22 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1322 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:02:24.120835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:24.121758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:24.133475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:24.135130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:24.136763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.137810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:24.138505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:24.139250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.485039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:24.494059 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a61cac11-cc93-4296-ba2f-64f688bf91c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.377868 Oct 17 14:02:24.504486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3290/6571] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:24 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:24.824147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-dd558982-cdf8-40eb-bbab-c1a3534bfb0c req-f5154174-16c4-41f6-8411-b72d8b584483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:24.836583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd558982-cdf8-40eb-bbab-c1a3534bfb0c req-f5154174-16c4-41f6-8411-b72d8b584483 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:24.837186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd558982-cdf8-40eb-bbab-c1a3534bfb0c req-f5154174-16c4-41f6-8411-b72d8b584483 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:24.837635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-dd558982-cdf8-40eb-bbab-c1a3534bfb0c req-f5154174-16c4-41f6-8411-b72d8b584483 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:24.850367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-dd558982-cdf8-40eb-bbab-c1a3534bfb0c req-f5154174-16c4-41f6-8411-b72d8b584483 service nova] Creating event network-changed:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:02:24.856393 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-dd558982-cdf8-40eb-bbab-c1a3534bfb0c req-f5154174-16c4-41f6-8411-b72d8b584483 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Oct 17 14:02:24.857082 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3282/6572] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:25.518369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:25.519002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:25.526007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:25.526499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:25.527081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:25.527657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:25.528117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:25.528549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:25.884614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:25.893326 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ccb382f-d9e6-426e-bdb3-f572b7ad22af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.379568 Oct 17 14:02:25.894149 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3291/6573] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:25 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:26.919171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:26.920083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:26.927424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:26.927743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:26.928303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:26.928999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:26.929618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:26.930076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:27.160092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:27.168609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a87d48f-72bd-41ee-a9b1-4c20b236a3a9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.255191 Oct 17 14:02:27.169588 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3283/6574] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:26 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:28.191798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:28.192335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:28.199418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:28.199959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:28.200410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:28.201113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:28.201591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:28.202017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:28.340325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:28.349685 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82e942df-f23b-4ac6-b623-e94c5dc63ba4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.162141 Oct 17 14:02:28.350288 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3292/6575] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:28 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:29.373584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:29.374281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:29.382274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:29.382768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:29.383215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:29.383916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:29.384374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:29.384882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:29.528610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:29.536831 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c40455ca-7741-41e8-bf4a-25ef889d0705 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.167656 Oct 17 14:02:29.537431 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3284/6576] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:29 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:30.559925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:30.560700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:30.563526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:30.570071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:30.570806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:30.571295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:30.572006 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:30.572469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:30.573053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:30.595037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:30.714921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:30.723160 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a015b451-d937-4511-892f-52b34cfe15ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.167176 Oct 17 14:02:30.723749 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3293/6577] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:30 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:31.360737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bba336ed-9e13-4529-a2af-a273d258f43c req-dcab41d3-a832-46ce-8325-3011bd840172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "name": "network-vif-plugged", "status": "completed", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:31.366806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:31.374763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bba336ed-9e13-4529-a2af-a273d258f43c req-dcab41d3-a832-46ce-8325-3011bd840172 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:31.375600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bba336ed-9e13-4529-a2af-a273d258f43c req-dcab41d3-a832-46ce-8325-3011bd840172 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:31.378144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bba336ed-9e13-4529-a2af-a273d258f43c req-dcab41d3-a832-46ce-8325-3011bd840172 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:31.391813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bba336ed-9e13-4529-a2af-a273d258f43c req-dcab41d3-a832-46ce-8325-3011bd840172 service nova] Creating event network-vif-plugged:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:02:31.397953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bba336ed-9e13-4529-a2af-a273d258f43c req-dcab41d3-a832-46ce-8325-3011bd840172 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041103 Oct 17 14:02:31.398578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3285/6578] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:02:31.747215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:31.747855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:31.755403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:31.755920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:31.756358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:31.757057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:31.757610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:31.758038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:31.894514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:31.902454 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-042a8ad0-aadd-496d-a3b2-ef2c76f1344b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1389 microversion: 2.1 time: 0.159163 Oct 17 14:02:31.903040 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3294/6579] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:31 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:32.927353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:32.928056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:32.935231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:32.935720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:32.936163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:32.936852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:32.937337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:32.937767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:33.076702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:33.085225 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-51b63567-3906-4f43-b22e-96fe6fc63321 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1561 microversion: 2.1 time: 0.162885 Oct 17 14:02:33.085820 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3286/6580] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:32 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:33.107899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:33.108508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:33.116128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:33.116608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:33.117040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:33.117757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:33.118204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:33.118627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:33.137072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:33.255654 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:33.263973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01a60f6b-a831-4ff6-9b48-f904fe7467f2 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1561 microversion: 2.1 time: 0.159885 Oct 17 14:02:33.264558 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3295/6581] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:33 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:34.913227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f9c5dddd-cb7a-4042-ad70-d06578549c3c req-6461dc16-ad66-4dd8-b497-a89428a3ea40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:34.917391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:34.918830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:34.926400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:34.926893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:34.927337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:34.928044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:34.928499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:34.928927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:34.938984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:34.947265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9c5dddd-cb7a-4042-ad70-d06578549c3c req-6461dc16-ad66-4dd8-b497-a89428a3ea40 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:34.947833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9c5dddd-cb7a-4042-ad70-d06578549c3c req-6461dc16-ad66-4dd8-b497-a89428a3ea40 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:34.948952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9c5dddd-cb7a-4042-ad70-d06578549c3c req-6461dc16-ad66-4dd8-b497-a89428a3ea40 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:34.963426 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f9c5dddd-cb7a-4042-ad70-d06578549c3c req-6461dc16-ad66-4dd8-b497-a89428a3ea40 service nova] Creating event network-changed:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:02:34.968704 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f9c5dddd-cb7a-4042-ad70-d06578549c3c req-6461dc16-ad66-4dd8-b497-a89428a3ea40 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062989 Oct 17 14:02:34.969659 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3296/6582] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:02:35.447418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:35.450224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:35.457484 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-02b19aeb-bc54-4135-9656-81fb7a8ed67e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1561 microversion: 2.1 time: 0.554117 Oct 17 14:02:35.458727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3287/6583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:34 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1561 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:02:58.716752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:58.721065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:02:58.723396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:58.730279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:58.730766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:58.731226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:58.731915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:58.732372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:58.732804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:58.785314 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-90b15517-509c-4e16-bb1d-96d02f61936f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action" status: 200 len: 24570 microversion: 2.1 time: 0.070231 Oct 17 14:02:58.789042 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3297/6584] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:02:58 2022] POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:02:59.359181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:59.359696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:59.362094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:02:59.368142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:59.368647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:59.369941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:59.372248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:59.372750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:59.373224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:59.403742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:02:59.492499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65f31b70-f5f0-4a63-950a-239e9b556e60 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 204 len: 0 microversion: 2.1 time: 0.137553 Oct 17 14:02:59.493696 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3288/6585] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:02:59 2022] DELETE /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:02:59.504433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:02:59.505365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:02:59.514881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:59.516095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:59.516858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:59.517916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:02:59.518748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:02:59.519513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:02:59.688013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:02:59.697956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97c644e2-4c75-449e-89ae-87582003e2d7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1552 microversion: 2.1 time: 0.199020 Oct 17 14:02:59.698889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3298/6586] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:02:59 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:00.728404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:00.729246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:00.738019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:00.738549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:00.738995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:00.739717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:00.740183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:00.740611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:00.894756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:00.907227 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96fdeb77-f308-4b84-9a91-a81dbb9e6cf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1552 microversion: 2.1 time: 0.184090 Oct 17 14:03:00.908475 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3289/6587] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:00 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:01.819121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d72bcf2b-1db6-4741-8a02-9313baf051a1 req-1781329f-b6d6-481e-aefc-3570b794c8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5420a3c8-b962-46fc-be73-0d42ace8e07a", "name": "network-vif-deleted", "tag": "dc081382-e30d-49fb-9efc-d1b46c4a5cdc"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:01.829717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d72bcf2b-1db6-4741-8a02-9313baf051a1 req-1781329f-b6d6-481e-aefc-3570b794c8dc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:01.830239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d72bcf2b-1db6-4741-8a02-9313baf051a1 req-1781329f-b6d6-481e-aefc-3570b794c8dc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:01.831215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d72bcf2b-1db6-4741-8a02-9313baf051a1 req-1781329f-b6d6-481e-aefc-3570b794c8dc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:01.842286 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d72bcf2b-1db6-4741-8a02-9313baf051a1 req-1781329f-b6d6-481e-aefc-3570b794c8dc service nova] Creating event network-vif-deleted:dc081382-e30d-49fb-9efc-d1b46c4a5cdc for instance 5420a3c8-b962-46fc-be73-0d42ace8e07a on n-h2-854121-14 Oct 17 14:03:01.847624 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d72bcf2b-1db6-4741-8a02-9313baf051a1 req-1781329f-b6d6-481e-aefc-3570b794c8dc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113222 Oct 17 14:03:01.848222 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3299/6588] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:01.938421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:01.939036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:01.946134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:01.946555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:01.946996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:01.947695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:01.948155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:01.948579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:01.981112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:01.981623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:01.982067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:01.982513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lazy-loading 'fault' on Instance uuid 5420a3c8-b962-46fc-be73-0d42ace8e07a {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:03:02.024883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:02.033175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a412a3a0-20e9-49a6-aa48-701dbed2ba53 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 200 len: 1337 microversion: 2.1 time: 0.098488 Oct 17 14:03:02.034384 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3290/6589] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:01 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 1337 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:03.059050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:03.059845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 5420a3c8-b962-46fc-be73-0d42ace8e07a] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:03.066454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:03.066944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:03.067386 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:03.068083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:03.068542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:03.068970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:03.082802 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] HTTP exception thrown: Instance 5420a3c8-b962-46fc-be73-0d42ace8e07a could not be found. Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Request method failure captured: Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a HTTP/1.1 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWAj4nRezS_9tPjxpaRSBSZTeulG61B3Dg5gF0pSo8LpXFaSTQlVo_m2l3Cg40CTm7P-8GMha2vqz9qd8mmkr7KqearLi3Izf1xclVAK8Ffy_wLyeDw_u4e--FXdmt5id8-dj43rmGivnSIQako9o39TXtN94lqqJAKCwI4gdSRT7M8 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2dfa0c4055274aedab03ab42247817ad Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkBasicOps-64338129 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkBasicOps-64338129 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2dfa0c4055274aedab03ab42247817ad Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkBasicOps-64338129 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkBasicOps-64338129-project Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8fc8aa11a5c74b76809ec5ac2fbc5608 Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkBasicOps-64338129-project Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5420a3c8-b962-46fc-be73-0d42ace8e07a could not be found. Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5420a3c8-b962-46fc-be73-0d42ace8e07a'} Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5420a3c8-b962-46fc-be73-0d42ace8e07a could not be found. Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5420a3c8-b962-46fc-be73-0d42ace8e07a could not be found. Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:03:03.084435 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5420a3c8-b962-46fc-be73-0d42ace8e07a could not be found. Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Returning 404 to user: Instance 5420a3c8-b962-46fc-be73-0d42ace8e07a could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8c6b60e-e65f-48da-ad6f-4445a578764b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a" status: 404 len: 111 microversion: 2.1 time: 0.032088 Oct 17 14:03:03.087984 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3300/6590] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:03 2022] GET /compute/v2.1/servers/5420a3c8-b962-46fc-be73-0d42ace8e07a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:03:03.252739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c83c613-9515-4aec-8694-8b5a16861dfc tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '.version_select at 0x7f419c9b8e50>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:03.274789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c83c613-9515-4aec-8694-8b5a16861dfc tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-374213775" status: 202 len: 0 microversion: 2.1 time: 0.026139 Oct 17 14:03:03.275728 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3291/6591] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Oct 17 14:03:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-374213775 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:03:05.078860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:05.079370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:05.087845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.088339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.088785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.089543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.090003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.090434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.123183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:03:05.209442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2ba0ed63-db60-4e4c-b34f-ccb730b6ebdc req-2aa85d8a-1100-429c-9239-ba697506cdc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b6594a9-658f-49b1-bf22-e414d3541361", "tag": "2aba7737-122c-4a3e-b28f-85d0f00d0459"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:05.221479 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ded14739-e364-42f2-a523-ff5a1d88acf8 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "DELETE /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 204 len: 0 microversion: 2.1 time: 0.152159 Oct 17 14:03:05.221740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ba0ed63-db60-4e4c-b34f-ccb730b6ebdc req-2aa85d8a-1100-429c-9239-ba697506cdc3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.222606 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3301/6592] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:03:05 2022] DELETE /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:03:05.225698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ba0ed63-db60-4e4c-b34f-ccb730b6ebdc req-2aa85d8a-1100-429c-9239-ba697506cdc3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.226452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ba0ed63-db60-4e4c-b34f-ccb730b6ebdc req-2aa85d8a-1100-429c-9239-ba697506cdc3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.228616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:05.229741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:05.236554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.237650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.238100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.238813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.239652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.240082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.241712 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2ba0ed63-db60-4e4c-b34f-ccb730b6ebdc req-2aa85d8a-1100-429c-9239-ba697506cdc3 service nova] Creating event network-changed:2aba7737-122c-4a3e-b28f-85d0f00d0459 for instance 9b6594a9-658f-49b1-bf22-e414d3541361 on n-h1-854121-14 Oct 17 14:03:05.248983 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2ba0ed63-db60-4e4c-b34f-ccb730b6ebdc req-2aa85d8a-1100-429c-9239-ba697506cdc3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177072 Oct 17 14:03:05.250268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3292/6593] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:03:05.257663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:05.258458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:05.265058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.265685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.266202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.266979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.267508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.268619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.444715 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1d1a80b0-73dc-44a4-a665-c24b2065ba54 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1832 microversion: 2.1 time: 0.220654 Oct 17 14:03:05.445246 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3302/6594] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:05 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1832 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:05.458028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:05.467861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:05.468626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:05.468746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad5fd823-f4c0-4a80-9370-9d52b4e27a1a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1671 microversion: 2.1 time: 0.216782 Oct 17 14:03:05.469395 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3293/6595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:05 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1671 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:05.475242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.475738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.476184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.476896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.477379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.477806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.617740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:05.625846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10d49a89-2363-4b31-9e11-f2a05b46dfe0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1679 microversion: 2.1 time: 0.161817 Oct 17 14:03:05.626433 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3303/6596] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:05 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:05.729491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:05.731838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:05.738422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.738899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.739341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:05.740033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:05.740483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:05.740903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:06.295534 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82d91176-81bc-4d78-8cc0-dae0ddaa22b7 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action" status: 200 len: 32643 microversion: 2.1 time: 0.569925 Oct 17 14:03:06.296183 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3294/6597] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:03:05 2022] POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action => generated 32643 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:03:06.494121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:06.494776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:06.502808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:06.503607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:06.504055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:06.504776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:06.505263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:06.505700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:06.572829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:06.573341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:06.581264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:06.581772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:06.582271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:06.582992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:06.583928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:06.583928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:06.616632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'bc384013ad884282aa26436430c0089a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f5954a6c034c6fac1916087189ab5b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:06.617242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] flavor_id is None. Assuming migration. {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 17 14:03:06.617875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:03:06.735369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:06.744077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32ef725e-e6a3-4991-ae44-a983e8e8de5a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 200 len: 1671 microversion: 2.1 time: 0.253931 Oct 17 14:03:06.745271 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3304/6598] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:06 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 1671 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:06.759533 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68700c31-39c0-4d57-bdbc-492de5f4b873 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action" status: 202 len: 0 microversion: 2.1 time: 0.191290 Oct 17 14:03:06.761216 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3295/6599] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:03:06 2022] POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:03:06.770830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:06.771920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:06.778993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:06.779498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:06.779943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:06.780703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:06.781312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:06.781778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.270274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-930381d2-6ba6-48ea-91a4-5734d640403c req-a41a94dd-5d9f-4098-bb0e-7214bb48549d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b6594a9-658f-49b1-bf22-e414d3541361", "name": "network-vif-deleted", "tag": "2aba7737-122c-4a3e-b28f-85d0f00d0459"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:07.282742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-930381d2-6ba6-48ea-91a4-5734d640403c req-a41a94dd-5d9f-4098-bb0e-7214bb48549d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.283353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-930381d2-6ba6-48ea-91a4-5734d640403c req-a41a94dd-5d9f-4098-bb0e-7214bb48549d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.284302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-930381d2-6ba6-48ea-91a4-5734d640403c req-a41a94dd-5d9f-4098-bb0e-7214bb48549d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.297791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:07.298292 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-930381d2-6ba6-48ea-91a4-5734d640403c req-a41a94dd-5d9f-4098-bb0e-7214bb48549d service nova] Creating event network-vif-deleted:2aba7737-122c-4a3e-b28f-85d0f00d0459 for instance 9b6594a9-658f-49b1-bf22-e414d3541361 on n-h1-854121-14 Oct 17 14:03:07.306147 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-930381d2-6ba6-48ea-91a4-5734d640403c req-a41a94dd-5d9f-4098-bb0e-7214bb48549d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043075 Oct 17 14:03:07.306837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3296/6600] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:07.314318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-710c5c85-e69e-49fe-a403-29a7d70aaff0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1688 microversion: 2.1 time: 0.548330 Oct 17 14:03:07.329557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3305/6601] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:06 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1688 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:07.772921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:07.773666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: 9b6594a9-658f-49b1-bf22-e414d3541361] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:07.780709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.781926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.781926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.782514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:07.782982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:07.783427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:07.799372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] HTTP exception thrown: Instance 9b6594a9-658f-49b1-bf22-e414d3541361 could not be found. Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Request method failure captured: Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 HTTP/1.1 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWAj4nRezS_9tPjxpaRSBSZTeulG61B3Dg5gF0pSo8LpXFaSTQlVo_m2l3Cg40CTm7P-8GMha2vqz9qd8mmkr7KqearLi3Izf1xclVAK8Ffy_wLyeDw_u4e--FXdmt5id8-dj43rmGivnSIQako9o39TXtN94lqqJAKCwI4gdSRT7M8 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2dfa0c4055274aedab03ab42247817ad Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestNetworkBasicOps-64338129 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestNetworkBasicOps-64338129 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2dfa0c4055274aedab03ab42247817ad Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestNetworkBasicOps-64338129 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestNetworkBasicOps-64338129-project Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 8fc8aa11a5c74b76809ec5ac2fbc5608 Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestNetworkBasicOps-64338129-project Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 9b6594a9-658f-49b1-bf22-e414d3541361 could not be found. Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '9b6594a9-658f-49b1-bf22-e414d3541361'} Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b6594a9-658f-49b1-bf22-e414d3541361 could not be found. Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b6594a9-658f-49b1-bf22-e414d3541361 could not be found. Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:03:07.801627 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b6594a9-658f-49b1-bf22-e414d3541361 could not be found. Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Returning 404 to user: Instance 9b6594a9-658f-49b1-bf22-e414d3541361 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e412d5c3-11c5-43fb-ab1b-d7549eab704b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361" status: 404 len: 111 microversion: 2.1 time: 0.034836 Oct 17 14:03:07.805064 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3297/6602] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:07 2022] GET /compute/v2.1/servers/9b6594a9-658f-49b1-bf22-e414d3541361 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:03:07.984650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0832815e-7b36-41f8-9be5-d2c71bc39fd3 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '.version_select at 0x7f419c918700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:08.018645 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0832815e-7b36-41f8-9be5-d2c71bc39fd3 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1819535793" status: 202 len: 0 microversion: 2.1 time: 0.040260 Oct 17 14:03:08.019649 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3306/6603] 10.222.0.65 () {58 vars in 1257 bytes} [Mon Oct 17 14:03:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1819535793 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:03:08.339023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:08.340309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:08.349611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:08.350180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:08.350822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:08.351717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:08.352354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:08.352967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:08.493964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:08.502836 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-207c27a6-d0de-40ab-bcc1-a88ceb87b8e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1688 microversion: 2.1 time: 0.167302 Oct 17 14:03:08.503876 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3298/6604] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:08 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:09.527253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:09.528614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:09.535901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:09.536294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:09.536727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:09.537626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:09.538249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:09.538678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:09.696927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:09.705193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3cd0d35e-da67-4591-9ce6-3f33cad9af4a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.183244 Oct 17 14:03:09.705780 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3307/6605] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:09 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:10.730157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:10.730843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:10.738769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:10.739314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:10.739768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:10.740478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:10.740934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:10.741540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:10.918372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:10.927169 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7600b2f2-8134-4c70-8afa-b5510cf89875 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.200982 Oct 17 14:03:10.928586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3299/6606] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:10 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:11.951819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:11.952495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:11.961009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:11.961525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:11.961961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:11.962659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:11.963105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:11.963524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:12.236908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:12.245292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3423b090-4bb1-4556-a52a-b1c287bd9d36 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.297521 Oct 17 14:03:12.246074 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3308/6607] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:11 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:13.271068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:13.271822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:13.279216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.279823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.280331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.281101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:13.281757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:13.282271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:13.836756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:13.846261 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52bf6b3a-3779-474b-a70b-dab448090ca1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.579021 Oct 17 14:03:13.847383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3300/6608] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:13 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:14.884476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:14.889059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:14.903756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:14.904616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:14.908742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:14.910188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:14.911283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:14.912243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:15.155863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:15.170423 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9fe09a5-6466-4f33-a618-eb88b7f2a503 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.303214 Oct 17 14:03:15.171023 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3309/6609] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:14 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:16.196479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:16.197303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:16.205441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:16.206161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:16.206718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:16.207679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:16.208342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:16.208841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:16.420332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:16.433043 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72692c85-23db-4b75-8632-8e6241249f88 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.240088 Oct 17 14:03:16.433911 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3301/6610] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:16 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:16.793083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53a1c186-063e-4e8d-8627-805427f77e82 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'create', calling method: .version_select at 0x7f41a2041c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1653319933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1bSEykT2vG6p3wfbQiZEEf7bGWJE/Y8xt4ygGx60xCFvqD8/fzpIMe2kDjORSwW/lbvqp0G+Ja7zWza968obzVfE+3G1uwccu3GXRCXf1j+eSV+TfkB1GrwLq3pqmG7w=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:16.816061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-53a1c186-063e-4e8d-8627-805427f77e82 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for project 2dfa0c4055274aedab03ab42247817ad. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:03:16.822888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-53a1c186-063e-4e8d-8627-805427f77e82 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for user 8fc8aa11a5c74b76809ec5ac2fbc5608 and project 2dfa0c4055274aedab03ab42247817ad. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:03:16.857192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53a1c186-063e-4e8d-8627-805427f77e82 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.068389 Oct 17 14:03:16.861237 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3310/6611] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:03:16 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:17.457954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:17.459043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:17.467545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:17.468427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:17.468855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:17.469968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:17.471549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:17.472152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:17.672294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:17.692423 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f199ec1-9d77-42b5-b8c5-e3136dc65ee8 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.239955 Oct 17 14:03:17.704350 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3302/6612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:17 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:18.147102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1762980604", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "67ebb1bc-2c34-4d88-8fc0-3fe4413a3883"}], "key_name": "tempest-TestNetworkBasicOps-1653319933", "security_groups": [{"name": "tempest-secgroup-smoke-491169468"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:18.262022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] validate_networks() for [('67ebb1bc-2c34-4d88-8fc0-3fe4413a3883', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:03:18.700508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:03:18.700941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:03:18.701525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:03:18.701941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:03:18.702354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:03:18.713630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:18.714345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:18.714950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:18.715843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:18.716466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:18.716975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:18.717470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:18.718247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:18.726985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:18.727829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:18.728604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:18.729430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:18.730081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:18.730614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:18.743037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for project 2dfa0c4055274aedab03ab42247817ad. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:03:18.750275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Getting quotas for user 8fc8aa11a5c74b76809ec5ac2fbc5608 and project 2dfa0c4055274aedab03ab42247817ad. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:03:18.766330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:03:18.769480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:03:18.857636 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d04b993-61fb-4b80-8e91-63c03bffdb91 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.714978 Oct 17 14:03:18.859212 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3311/6613] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:03:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:03:18.876963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8901fa26-6187-475e-9e19-21e8783e9dc3 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:18.879022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8901fa26-6187-475e-9e19-21e8783e9dc3 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:18.942226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:18.957705 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cca7d9df-97aa-437e-af48-6d12f6a23e1b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.245480 Oct 17 14:03:18.973260 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3303/6614] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:18 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:18.989283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8901fa26-6187-475e-9e19-21e8783e9dc3 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:19.000793 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8901fa26-6187-475e-9e19-21e8783e9dc3 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1249 microversion: 2.1 time: 0.133975 Oct 17 14:03:19.003440 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3312/6615] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:18 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:19.985220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:19.986397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:19.993789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:19.994280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:19.994724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:19.995453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:19.995914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:19.996349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:19.999632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:20.026264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:20.027684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:20.046459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:20.046986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:20.047433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:20.048911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:20.050193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:20.050671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:20.153561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:20.165714 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba8771ce-61b1-4b1d-949d-f5024119f741 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1301 microversion: 2.1 time: 0.143660 Oct 17 14:03:20.177209 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3313/6616] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:20 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1301 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:20.285963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:20.297126 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bd66942-dc70-4d94-b496-94b388b5fa8f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1693 microversion: 2.1 time: 0.316188 Oct 17 14:03:20.298443 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3304/6617] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:19 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1693 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:21.191057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:21.192314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:21.199971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:21.200496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:21.201114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:21.201940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:21.202400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:21.202828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:21.320125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:21.321350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:21.328652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:21.329149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:21.330221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:21.330945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:21.331403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:21.331839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:21.583453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:21.592324 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8394f1a1-fa4a-4a93-a3c4-04d2bb8028d6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.405071 Oct 17 14:03:21.593017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3314/6618] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:21 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:21.982119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:21.990155 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc9e23b4-31b8-4dae-9e75-c5670bc8de5b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1692 microversion: 2.1 time: 0.674034 Oct 17 14:03:21.990743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3305/6619] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:21 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1692 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:22.477881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "name": "network-vif-unplugged", "status": "completed", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:22.488610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:22.489089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:22.489545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:22.504361 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] Creating event network-vif-unplugged:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h2-854121-14 Oct 17 14:03:22.510414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:03:22.522441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9569f61a-a0d8-4f56-9c83-ddd23f9aea96 req-d5eafb3c-8846-4a9b-b121-d44d4447d773 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048392 Oct 17 14:03:22.522994 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3315/6620] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:03:22.617953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:22.618569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:22.625728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:22.626719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:22.627159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:22.627861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:22.628315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:22.628747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:23.014639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:23.015430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:23.021836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:23.022323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:23.022757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:23.023461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:23.023970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:23.024089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:23.024329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:23.032839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a89e5c04-9eae-4512-b160-83d689d6fae1 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.418740 Oct 17 14:03:23.033712 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3306/6621] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:22 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:23.344335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:23.352930 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4cc4586e-54ab-41f6-9860-2f2a848d3b07 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1692 microversion: 2.1 time: 0.342461 Oct 17 14:03:23.353560 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3316/6622] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:23 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1692 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:24.057570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:24.058176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:24.065221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.065699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.066132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.066815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.067263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.067683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.201853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:24.210263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82766188-d5ec-4395-9bed-6e5bd1a39f22 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.156839 Oct 17 14:03:24.210860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3307/6623] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:24 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:24.377583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:24.378113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:24.385192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.385684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.386143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.386811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.387276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.387674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.406460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:24.530191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:24.539409 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ba9b850-1632-47c5-9340-0838e76d760a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1692 microversion: 2.1 time: 0.165921 Oct 17 14:03:24.550605 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3317/6624] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:24 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:24.550808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da545a2c-65e8-404c-8398-681c2715cdaf", "tag": "f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce"}, {"name": "network-changed", "server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:24.553030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:24.553569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:24.554010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:24.567628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Creating event network-changed:f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce for instance da545a2c-65e8-404c-8398-681c2715cdaf on n-h2-854121-14 Oct 17 14:03:24.568140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Creating event network-changed:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h2-854121-14 Oct 17 14:03:24.573519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:03:24.586255 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-15b70b40-f801-45fb-9138-22bcfc28fc3c req-2499796f-2989-48d9-917a-c27e0bfe6db8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048756 Oct 17 14:03:24.586861 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3308/6625] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:25.236421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:25.237119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:25.243617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.244111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.244552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.245283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.245740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.246162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.408138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:25.416232 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e4fb9a9-cd12-408a-99fa-6ca3b9702114 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.185285 Oct 17 14:03:25.416804 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3318/6626] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:25 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:25.566902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:25.567594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:25.574716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.575197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.575684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.576312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:25.576761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:25.577234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:25.717312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:25.726011 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c62fa7e-8dbb-4bc3-add9-4854052cbc1a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1692 microversion: 2.1 time: 0.163344 Oct 17 14:03:25.726586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3309/6627] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:25 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:26.440579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:26.441594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:26.448873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.449413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.449973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.450562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.451029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.451451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.749366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:26.749986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:26.757472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.757994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.758477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.759188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:26.759903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:26.760374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:26.974469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:26.983138 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-81aaf721-948b-4a89-ad66-3d1f4b225f85 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.547067 Oct 17 14:03:26.983732 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3319/6628] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:26 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:27.085295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:27.093068 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77d59d87-a81a-404f-a01f-6a540275b240 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1690 microversion: 2.1 time: 0.347659 Oct 17 14:03:27.093671 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3310/6629] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:26 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1690 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:28.007518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:28.008179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:28.015454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.015945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.016898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.017648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.018098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.018518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.117503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:28.118782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:28.127620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.128488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.129103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.129875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:28.130341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:28.130792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:28.162837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.171044 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15b52514-b19c-4ce3-987a-2bb841737f05 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.167495 Oct 17 14:03:28.171639 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3320/6630] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:28 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:28.277133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:28.285277 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1296c79-942f-4693-ada5-da625b40f76e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1690 microversion: 2.1 time: 0.171660 Oct 17 14:03:28.285865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3311/6631] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:28 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:29.194193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:29.194801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:29.196774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:29.197522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:29.199290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:29.207170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.207676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.208119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.208846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.209345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.209776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.308915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:29.309644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:29.316936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.317384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.317826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.318822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.319658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.320092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.363347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:29.372159 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4a2432e-ff57-4765-b5bc-d1b9fe78d8e7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.181877 Oct 17 14:03:29.372786 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3321/6632] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:29 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:29.475846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:29.484992 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a44f3cf7-d395-41ca-9aae-8bbaada9659f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1690 microversion: 2.1 time: 0.179985 Oct 17 14:03:29.486108 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3312/6633] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:29 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:29.620191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b9e5f3ab-f853-49b7-b182-b83e44283738 req-e841e50c-ed50-47be-8841-81c32f34a88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da545a2c-65e8-404c-8398-681c2715cdaf", "name": "network-vif-plugged", "status": "completed", "tag": "f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:29.633397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9e5f3ab-f853-49b7-b182-b83e44283738 req-e841e50c-ed50-47be-8841-81c32f34a88e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:29.634143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9e5f3ab-f853-49b7-b182-b83e44283738 req-e841e50c-ed50-47be-8841-81c32f34a88e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:29.635163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b9e5f3ab-f853-49b7-b182-b83e44283738 req-e841e50c-ed50-47be-8841-81c32f34a88e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:29.651436 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b9e5f3ab-f853-49b7-b182-b83e44283738 req-e841e50c-ed50-47be-8841-81c32f34a88e service nova] Creating event network-vif-plugged:f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce for instance da545a2c-65e8-404c-8398-681c2715cdaf on n-h2-854121-14 Oct 17 14:03:29.656786 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b9e5f3ab-f853-49b7-b182-b83e44283738 req-e841e50c-ed50-47be-8841-81c32f34a88e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042287 Oct 17 14:03:29.658416 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3322/6634] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:30.398827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:30.399445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:30.402362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:30.408333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.408827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.409320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.410065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.410526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.410957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.510088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:30.510984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:30.518860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.519241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.519679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.520384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.520835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.521285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.583041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:30.591152 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ebf10be-a07a-465d-b82a-f44aa572ed61 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1374 microversion: 2.1 time: 0.196332 Oct 17 14:03:30.591743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3313/6635] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:30 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1374 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:30.675481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:30.683475 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5fca1558-9c60-4b97-b8df-2bfee1c821fc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1687 microversion: 2.1 time: 0.177927 Oct 17 14:03:30.684042 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3323/6636] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:30 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:30.706255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:30.706829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:30.712926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.713454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.713903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.714603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.715067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.715854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.826244 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c5700c5-60f7-4778-b6bc-211e07408d9e tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action" status: 202 len: 0 microversion: 2.1 time: 0.124086 Oct 17 14:03:30.826886 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3314/6637] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:03:30 2022] POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:03:30.835652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:30.836302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:30.842504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.842991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.843434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.844132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:30.845153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:30.845789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:30.997365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:31.006052 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3584d4a-7e65-4833-859f-1031aaf94391 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1686 microversion: 2.1 time: 0.174403 Oct 17 14:03:31.021585 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3324/6638] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:30 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1686 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:31.616286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:31.617021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:31.624574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.625102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.626057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.627065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.627522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.627974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.675060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "name": "network-vif-plugged", "status": "completed", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:31.685533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.686018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.686457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.699551 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] Creating event network-vif-plugged:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h2-854121-14 Oct 17 14:03:31.705859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:03:31.717954 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-969c600c-b78e-42f1-8bc9-37df11c267cc req-64d6c38f-38bf-498c-bf9b-a1eec2133e5e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046983 Oct 17 14:03:31.719282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3325/6639] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:03:31.877499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:31.885879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a529a954-5fb6-43dc-8303-2102b3c24bd7 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1545 microversion: 2.1 time: 0.274489 Oct 17 14:03:31.886473 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3315/6640] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:31 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1545 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:31.911281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:31.911998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:31.919044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.919536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.920008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:31.920719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:31.921324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:31.921680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:32.034593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:32.035219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:32.041568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:32.042063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:32.042506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:32.043213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:32.043670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:32.044099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:32.201134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:32.209746 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0af8c516-51e9-4555-9c2b-cf146216245b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1545 microversion: 2.1 time: 0.303571 Oct 17 14:03:32.210520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3326/6641] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:31 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1545 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:32.295192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:32.304347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3105565d-44ae-4d3f-a8f8-43578030a772 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1686 microversion: 2.1 time: 0.274298 Oct 17 14:03:32.310559 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3316/6642] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:32 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1686 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:03:33.328189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:33.329483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:33.336945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:33.337479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:33.337952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:33.338679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:33.339162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:33.339758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:33.486677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:33.494774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4eb089c7-edaa-4bda-9703-b40f4f37b9fa tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1686 microversion: 2.1 time: 0.170597 Oct 17 14:03:33.495348 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3327/6643] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:33 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:34.319864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fb7ff32e-fa99-4dd8-94dc-c0573f1468f9 req-727c6f18-6bfd-4e9f-9157-c20eee80043c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da545a2c-65e8-404c-8398-681c2715cdaf", "tag": "f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:34.334039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fb7ff32e-fa99-4dd8-94dc-c0573f1468f9 req-727c6f18-6bfd-4e9f-9157-c20eee80043c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:34.334619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fb7ff32e-fa99-4dd8-94dc-c0573f1468f9 req-727c6f18-6bfd-4e9f-9157-c20eee80043c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:34.335124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fb7ff32e-fa99-4dd8-94dc-c0573f1468f9 req-727c6f18-6bfd-4e9f-9157-c20eee80043c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:34.348286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fb7ff32e-fa99-4dd8-94dc-c0573f1468f9 req-727c6f18-6bfd-4e9f-9157-c20eee80043c service nova] Creating event network-changed:f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce for instance da545a2c-65e8-404c-8398-681c2715cdaf on n-h2-854121-14 Oct 17 14:03:34.356139 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fb7ff32e-fa99-4dd8-94dc-c0573f1468f9 req-727c6f18-6bfd-4e9f-9157-c20eee80043c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040538 Oct 17 14:03:34.357198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3317/6644] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:34.523449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:34.524449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:34.546565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:34.548233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:34.550274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:34.552701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:34.554107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:34.555229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:34.833179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:34.842612 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12a5e4af-8123-404b-ada8-55943b2a4d63 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1686 microversion: 2.1 time: 0.325945 Oct 17 14:03:34.843661 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3328/6645] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:34 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1686 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:35.455005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "name": "network-vif-unplugged", "status": "completed", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:35.476297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.477079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.478187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.495963 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] Creating event network-vif-unplugged:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:03:35.503205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:03:35.517955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-03e08553-b9bb-4703-9931-535047102057 req-8a07a314-f4a4-4d7e-ad18-6d4491068909 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070302 Oct 17 14:03:35.518611 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3318/6646] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:35.867549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:35.868162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:35.876018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.876501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.876953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:35.877672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:35.878179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:35.878687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:36.144431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:36.152261 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-62f28cc6-4d5b-4dca-bd54-ab1cb993f0fb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1686 microversion: 2.1 time: 0.288579 Oct 17 14:03:36.152845 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3329/6647] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:35 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1686 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:37.176352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:37.177050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:37.184210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.184697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.185135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.185851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.186312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.186738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.320362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:37.328890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eee60b25-494d-4939-892d-561767a4e04b tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1686 microversion: 2.1 time: 0.156531 Oct 17 14:03:37.329517 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3319/6648] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:37 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:37.537515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:37.548037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:37.548530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:37.548934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:37.563395 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] Creating event network-changed:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:03:37.569094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:03:37.580799 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-15a8d7a0-a122-499f-ab26-776023ec7196 req-be68d26f-6e6b-40b5-a694-6599cd68d019 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046808 Oct 17 14:03:37.581451 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3330/6649] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:03:38.352327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:03:38.352941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:03:38.360720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:38.361229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:38.361668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:38.362369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:38.362819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:38.363248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:38.367761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:03:38.655798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:03:38.663914 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-721c2919-430b-47ce-bdc3-58193d03a205 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1679 microversion: 2.1 time: 0.315603 Oct 17 14:03:38.664610 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3320/6650] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:03:38 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1679 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:03:41.750780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a0bede8e-d329-4305-9d55-3d4c15e65664 req-2b9c22b4-1540-4fd4-bdb1-6931db1b1b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "name": "network-vif-plugged", "status": "completed", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:03:41.763553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a0bede8e-d329-4305-9d55-3d4c15e65664 req-2b9c22b4-1540-4fd4-bdb1-6931db1b1b23 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:03:41.764166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a0bede8e-d329-4305-9d55-3d4c15e65664 req-2b9c22b4-1540-4fd4-bdb1-6931db1b1b23 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:03:41.764607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a0bede8e-d329-4305-9d55-3d4c15e65664 req-2b9c22b4-1540-4fd4-bdb1-6931db1b1b23 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:03:41.776850 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a0bede8e-d329-4305-9d55-3d4c15e65664 req-2b9c22b4-1540-4fd4-bdb1-6931db1b1b23 service nova] Creating event network-vif-plugged:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:03:41.782571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a0bede8e-d329-4305-9d55-3d4c15e65664 req-2b9c22b4-1540-4fd4-bdb1-6931db1b1b23 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037833 Oct 17 14:03:41.783190 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3331/6651] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:02.866710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:02.868899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:02.871024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=19 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:02.871675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:02.877807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:02.878299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:02.878743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:02.879446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:02.879907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:02.880337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:02.936997 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fbf16f0a-f975-4c19-b376-42a91a479d9a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action" status: 200 len: 63009 microversion: 2.1 time: 0.074360 Oct 17 14:04:02.937709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3321/6652] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:02 2022] POST /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68/action => generated 63009 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:09.109105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:09.109827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:09.112646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=21 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:09.113430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=74 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:09.119622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:09.120122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:09.120553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:09.121270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:09.121726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:09.122152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:09.257005 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4610aeb2-dc29-4090-9312-0a05a570e670 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1832 microversion: 2.1 time: 0.152381 Oct 17 14:04:09.257636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3332/6653] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:09 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1832 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:10.139094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:10.139687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:10.141561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1c99fc30-6656-40a7-9ae8-500409e5cac4 req-5c4efed1-2e5a-4a88-b682-f05a275d8681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:10.148471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.148967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.149637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.150357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.150820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.151257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.153052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1c99fc30-6656-40a7-9ae8-500409e5cac4 req-5c4efed1-2e5a-4a88-b682-f05a275d8681 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.153629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1c99fc30-6656-40a7-9ae8-500409e5cac4 req-5c4efed1-2e5a-4a88-b682-f05a275d8681 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.154122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1c99fc30-6656-40a7-9ae8-500409e5cac4 req-5c4efed1-2e5a-4a88-b682-f05a275d8681 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.166927 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1c99fc30-6656-40a7-9ae8-500409e5cac4 req-5c4efed1-2e5a-4a88-b682-f05a275d8681 service nova] Creating event network-changed:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:04:10.172807 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1c99fc30-6656-40a7-9ae8-500409e5cac4 req-5c4efed1-2e5a-4a88-b682-f05a275d8681 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035404 Oct 17 14:04:10.173456 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3333/6654] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:10.183965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:04:10.269638 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68a8834a-8c7a-4938-99e3-3ad28d8f3d70 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 204 len: 0 microversion: 2.1 time: 0.133675 Oct 17 14:04:10.273597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3322/6655] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:04:10 2022] DELETE /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:04:10.280328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:10.281030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:10.288047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.288834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.289522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.290445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.291091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.291723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.453150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:10.462511 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa39c0c5-12f7-4fdc-841e-b863b063c01c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1685 microversion: 2.1 time: 0.187327 Oct 17 14:04:10.463114 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3334/6656] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:10 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:10.713358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:10.715611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:10.723131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.723622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.724067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.724775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:10.725283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:10.726104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:10.797405 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-93299fc6-9251-425d-893a-61ad460fb1b6 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf/action" status: 200 len: 24574 microversion: 2.1 time: 0.088144 Oct 17 14:04:10.798342 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3323/6657] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:10 2022] POST /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf/action => generated 24574 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:04:11.486303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:11.486972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:11.493910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:11.494407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:11.494851 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:11.495560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:11.496016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:11.496443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:11.718430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:11.728382 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c14c842-0e87-429e-9e3e-e0a7a02bf113 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 200 len: 1685 microversion: 2.1 time: 0.245970 Oct 17 14:04:11.738289 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3335/6658] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:11 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 1685 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:12.188524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-81f15517-95c1-430d-aefd-2f50758b0d19 req-678467c5-ca94-4f08-8171-25d0ac2f4d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20749cec-cdbd-4fc3-99a6-3e75ebae5d68", "name": "network-vif-deleted", "tag": "e99943e0-1b66-4d19-9796-bf4958682a14"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:12.201369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-81f15517-95c1-430d-aefd-2f50758b0d19 req-678467c5-ca94-4f08-8171-25d0ac2f4d3b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.202011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-81f15517-95c1-430d-aefd-2f50758b0d19 req-678467c5-ca94-4f08-8171-25d0ac2f4d3b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.202548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-81f15517-95c1-430d-aefd-2f50758b0d19 req-678467c5-ca94-4f08-8171-25d0ac2f4d3b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.215554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-81f15517-95c1-430d-aefd-2f50758b0d19 req-678467c5-ca94-4f08-8171-25d0ac2f4d3b service nova] Creating event network-vif-deleted:e99943e0-1b66-4d19-9796-bf4958682a14 for instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 on n-h1-854121-14 Oct 17 14:04:12.220667 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-81f15517-95c1-430d-aefd-2f50758b0d19 req-678467c5-ca94-4f08-8171-25d0ac2f4d3b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037075 Oct 17 14:04:12.221237 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3324/6659] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:12.751786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:12.752506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 20749cec-cdbd-4fc3-99a6-3e75ebae5d68] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:12.759960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.760445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.760886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.761618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:12.762104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:12.762529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:12.776261 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] HTTP exception thrown: Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 could not be found. Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Request method failure captured: Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 HTTP/1.1 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV_PgO2oVzsPWCFVF-Fj96y0E8wrPFwlaAXVxcDjVXPmMRRdsfsS5c8iL3LVx_6gwqFrYjUxK5-nfmFMQ4-xhEjabCG0_nw46-IVNPiZQLL3NpnIWDlt02E3Eh25va4J7ziMmiebAy2I3elil_Z3K4RZRQSs9OGl7P0TMqk8R6_ATFI Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 95284ccf684a481691e67ffcb5e66785 Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 could not be found. Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '20749cec-cdbd-4fc3-99a6-3e75ebae5d68'} Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 could not be found. Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 could not be found. Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:12.777950 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 could not be found. Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Returning 404 to user: Instance 20749cec-cdbd-4fc3-99a6-3e75ebae5d68 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9d1f02e-cc07-464a-954f-d9943226558f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68" status: 404 len: 111 microversion: 2.1 time: 0.031510 Oct 17 14:04:12.781810 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3336/6660] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:12 2022] GET /compute/v2.1/servers/20749cec-cdbd-4fc3-99a6-3e75ebae5d68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:04:15.939849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f34e0fb4-12ee-41f1-a21d-5c11ed960491 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '.version_select at 0x7f419c8a98b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:15.963354 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f34e0fb4-12ee-41f1-a21d-5c11ed960491 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-42813697" status: 202 len: 0 microversion: 2.1 time: 0.030195 Oct 17 14:04:15.964542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3325/6661] 10.222.0.65 () {58 vars in 1278 bytes} [Mon Oct 17 14:04:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-42813697 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:04:15.999102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41c38c50-b9cf-471f-8f67-cc67dc86aef3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: .version_select at 0x7f419c955af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1763128367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqK1y4gwADWg8hLmTbj09whK72fHJ2GDmC8S/Z/ohBqYbAI+46ruUR23Ei8vd0KUSYx7iD7RVW37EjO84+ciLhpolMoC11HynKjx+hvfr7APvDKFnzNsuBl1j1iauwGdw=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:16.016245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-41c38c50-b9cf-471f-8f67-cc67dc86aef3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:16.022292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-41c38c50-b9cf-471f-8f67-cc67dc86aef3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:16.046459 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41c38c50-b9cf-471f-8f67-cc67dc86aef3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051484 Oct 17 14:04:16.047061 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3337/6662] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:04:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:22.214268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:22.224140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1640751485", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "86867a90-de8f-41d3-bf7d-90aa2d169f25"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1763128367", "security_groups": [{"name": "tempest-secgroup-smoke-1444474816"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:22.355020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] validate_networks() for [('86867a90-de8f-41d3-bf7d-90aa2d169f25', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:04:22.996787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:04:22.997241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:04:22.997770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:04:22.998364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:04:22.998779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:04:23.011538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:23.012022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:23.012486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:23.013270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:23.013764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:23.014198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:23.032637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:04:23.038881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:04:23.052742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:04:23.055182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:04:23.105462 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4c169e6-0738-48ae-9888-d901d4cafd46 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.892695 Oct 17 14:04:23.106802 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3326/6663] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:04:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:04:23.116123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=22 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:23.121777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6890663-8bc0-4c13-9b8d-4f943cea0360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:23.122486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6890663-8bc0-4c13-9b8d-4f943cea0360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:23.186472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f6890663-8bc0-4c13-9b8d-4f943cea0360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:23.194832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6890663-8bc0-4c13-9b8d-4f943cea0360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1267 microversion: 2.1 time: 0.080581 Oct 17 14:04:23.195983 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3338/6664] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:23 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:24.219040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:24.219687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:24.227697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:24.228198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:24.228671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:24.229445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:24.229935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:24.230370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:24.293423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:24.302230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fd1a7ef-3749-4788-800c-855aa6b661dd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1319 microversion: 2.1 time: 0.087250 Oct 17 14:04:24.302887 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3327/6665] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:24 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1319 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:25.326948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:25.327584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:25.336761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:25.337556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:25.338194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:25.339116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:25.339732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:25.341786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:25.516142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:25.526200 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c650ea9-8fb5-455c-95c9-a3b9abf629c1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.203559 Oct 17 14:04:25.526880 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3339/6666] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:25 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:26.004730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-43b11213-83f6-49e7-9df2-6141927b43b1 req-35322420-2b9e-4e3e-aab0-c2aea973b80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:26.015826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-43b11213-83f6-49e7-9df2-6141927b43b1 req-35322420-2b9e-4e3e-aab0-c2aea973b80e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.016307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-43b11213-83f6-49e7-9df2-6141927b43b1 req-35322420-2b9e-4e3e-aab0-c2aea973b80e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.016746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-43b11213-83f6-49e7-9df2-6141927b43b1 req-35322420-2b9e-4e3e-aab0-c2aea973b80e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.028761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-43b11213-83f6-49e7-9df2-6141927b43b1 req-35322420-2b9e-4e3e-aab0-c2aea973b80e service nova] Creating event network-changed:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h1-854121-14 Oct 17 14:04:26.034412 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-43b11213-83f6-49e7-9df2-6141927b43b1 req-35322420-2b9e-4e3e-aab0-c2aea973b80e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 Oct 17 14:04:26.035386 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3328/6667] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:26.550574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:26.551191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:26.558396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.558882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.559326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.559990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:26.560514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:26.560925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:26.724255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:26.734697 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d7dcd7ef-c16d-4af3-b6e5-ca9f79c71dd9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.188094 Oct 17 14:04:26.741603 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3340/6668] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:26 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:27.759063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:27.759807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:27.767158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:27.767678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:27.768348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:27.769359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:27.769837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:27.770290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:27.915213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:27.923094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad8ca48c-19c1-4b28-b04d-f85ca2ad4c75 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.168602 Oct 17 14:04:27.923681 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3329/6669] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:27 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:28.946447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:28.947007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:28.954254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:28.954748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:28.955741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:28.956427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:28.956884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:28.957340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:29.097752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:29.106241 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77e7d823-e1d2-4a65-a92a-cbb6915644f1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.163668 Oct 17 14:04:29.106842 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3341/6670] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:28 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:04:30.130233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:30.130884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:30.138312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:30.138808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:30.139252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:30.139963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:30.140460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:30.140890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:30.280057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:30.288464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46f07f1d-b774-4ce4-9a63-e83fd45036ff tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.162694 Oct 17 14:04:30.289094 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3330/6671] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:30 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:31.311882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:31.312506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:31.319869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:31.320354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:31.320792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:31.321510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:31.322016 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:31.322473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:31.746242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:31.754732 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3aa26319-8511-4d22-9865-3a0f4e126e71 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.446738 Oct 17 14:04:31.755312 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3342/6672] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:31 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:32.008929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-14b37d0c-bd61-4da3-8611-9ba59a60c08e req-626dc816-8b35-474b-bcf8-db75e9a0a9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "name": "network-vif-plugged", "status": "completed", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:32.020991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-14b37d0c-bd61-4da3-8611-9ba59a60c08e req-626dc816-8b35-474b-bcf8-db75e9a0a9aa service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:32.021708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-14b37d0c-bd61-4da3-8611-9ba59a60c08e req-626dc816-8b35-474b-bcf8-db75e9a0a9aa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:32.023568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-14b37d0c-bd61-4da3-8611-9ba59a60c08e req-626dc816-8b35-474b-bcf8-db75e9a0a9aa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:32.034402 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-14b37d0c-bd61-4da3-8611-9ba59a60c08e req-626dc816-8b35-474b-bcf8-db75e9a0a9aa service nova] Creating event network-vif-plugged:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h1-854121-14 Oct 17 14:04:32.039717 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-14b37d0c-bd61-4da3-8611-9ba59a60c08e req-626dc816-8b35-474b-bcf8-db75e9a0a9aa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034753 Oct 17 14:04:32.040339 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3331/6673] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:32.777735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:32.778392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:32.785885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:32.786372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:32.786812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:32.787507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:32.787962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:32.788431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:32.921495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:32.929763 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c8557f8-4623-407e-bf67-3abcedf52850 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1393 microversion: 2.1 time: 0.155944 Oct 17 14:04:32.930343 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3343/6674] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:32 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:33.954373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:33.955038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:33.957845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:33.958519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:33.959168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:33.965626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:33.966110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:33.966549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:33.967247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:33.967701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:33.968127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:34.104580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:34.113228 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9166ad88-a33f-4d6e-9f1d-73889adb1e2f tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1564 microversion: 2.1 time: 0.163208 Oct 17 14:04:34.113822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3332/6675] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:33 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:34.136696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:34.137337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:34.139249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:34.145443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:34.145933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:34.146374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:34.147078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:34.147536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:34.147967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:34.278811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:34.287232 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-99b12594-a849-4265-92ed-6ba59a4e2ac9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1564 microversion: 2.1 time: 0.154647 Oct 17 14:04:34.287811 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3344/6676] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:34 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:35.919810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:35.920608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:35.921910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-690e5c83-cdc2-4772-9073-6a231bb6bcf6 req-d9ed9167-f682-4b03-91af-77e4b9788a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:35.928623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:35.929446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:35.930076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:35.930846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:35.931304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:35.931731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:35.935280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-690e5c83-cdc2-4772-9073-6a231bb6bcf6 req-d9ed9167-f682-4b03-91af-77e4b9788a5d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:35.937428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-690e5c83-cdc2-4772-9073-6a231bb6bcf6 req-d9ed9167-f682-4b03-91af-77e4b9788a5d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:35.938019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-690e5c83-cdc2-4772-9073-6a231bb6bcf6 req-d9ed9167-f682-4b03-91af-77e4b9788a5d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:35.951571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-690e5c83-cdc2-4772-9073-6a231bb6bcf6 req-d9ed9167-f682-4b03-91af-77e4b9788a5d service nova] Creating event network-changed:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h1-854121-14 Oct 17 14:04:35.959107 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-690e5c83-cdc2-4772-9073-6a231bb6bcf6 req-d9ed9167-f682-4b03-91af-77e4b9788a5d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041194 Oct 17 14:04:35.959858 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3345/6677] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:36.080462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:36.088927 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74893674-809b-4da1-8d21-c39d3c06415a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1564 microversion: 2.1 time: 0.173769 Oct 17 14:04:36.089764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3333/6678] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:35 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1564 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:49.665539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:49.667858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:49.671055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:49.671704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=38 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:49.679429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:49.679911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:49.680348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:49.681050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:49.681529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:49.681957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:49.755916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77ede425-cfd2-4c98-b1c7-76c1174ba6e5 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "POST /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf/action" status: 200 len: 32645 microversion: 2.1 time: 0.094751 Oct 17 14:04:49.756587 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3346/6679] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:49 2022] POST /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf/action => generated 32645 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 17 14:04:50.745228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:50.746324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:50.747769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b1ee0559-e6c8-4fe3-b44a-fde954869a84 req-6179e9df-bad3-4ae8-958e-8d159e4964e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da545a2c-65e8-404c-8398-681c2715cdaf", "tag": "f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:50.749713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:50.750834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:04:50.756631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.757133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.757622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:50.758741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.759206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.759852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:50.761198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b1ee0559-e6c8-4fe3-b44a-fde954869a84 req-6179e9df-bad3-4ae8-958e-8d159e4964e3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.761745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b1ee0559-e6c8-4fe3-b44a-fde954869a84 req-6179e9df-bad3-4ae8-958e-8d159e4964e3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.762398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b1ee0559-e6c8-4fe3-b44a-fde954869a84 req-6179e9df-bad3-4ae8-958e-8d159e4964e3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:50.775429 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b1ee0559-e6c8-4fe3-b44a-fde954869a84 req-6179e9df-bad3-4ae8-958e-8d159e4964e3 service nova] Creating event network-changed:f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce for instance da545a2c-65e8-404c-8398-681c2715cdaf on n-h2-854121-14 Oct 17 14:04:50.780702 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b1ee0559-e6c8-4fe3-b44a-fde954869a84 req-6179e9df-bad3-4ae8-958e-8d159e4964e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037259 Oct 17 14:04:50.782506 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3347/6680] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:04:50.789721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:04:50.890224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec773046-b77b-4a4c-885e-24fb9e8511c4 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "DELETE /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 204 len: 0 microversion: 2.1 time: 0.148850 Oct 17 14:04:50.897620 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3334/6681] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:04:50 2022] DELETE /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:04:50.907001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:50.908212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:50.915420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.915941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.916408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:50.917195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:50.917793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:50.918268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:51.088860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:51.097278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15f045ca-e5ce-4ad1-b6a1-775825a63d01 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1670 microversion: 2.1 time: 0.197072 Oct 17 14:04:51.097885 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3348/6682] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:50 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:52.122861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:52.123583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:52.130668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:52.131235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:52.131581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:52.132278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:52.132727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:52.133422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:52.353223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:52.361602 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c5c009e-d5a9-4b1a-b96e-535a2d81b680 tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1670 microversion: 2.1 time: 0.242683 Oct 17 14:04:52.362188 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3335/6683] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:52 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1670 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:04:53.369907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9c093dfb-4309-4a02-8562-192f9e4ad247 req-680dedfb-96a7-42af-9a06-ee88a35d92ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da545a2c-65e8-404c-8398-681c2715cdaf", "name": "network-vif-deleted", "tag": "f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:53.380929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9c093dfb-4309-4a02-8562-192f9e4ad247 req-680dedfb-96a7-42af-9a06-ee88a35d92ec service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:53.381439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9c093dfb-4309-4a02-8562-192f9e4ad247 req-680dedfb-96a7-42af-9a06-ee88a35d92ec service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:53.381859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9c093dfb-4309-4a02-8562-192f9e4ad247 req-680dedfb-96a7-42af-9a06-ee88a35d92ec service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:53.386106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:53.386799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:53.394984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:53.395483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:53.395923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:53.396582 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9c093dfb-4309-4a02-8562-192f9e4ad247 req-680dedfb-96a7-42af-9a06-ee88a35d92ec service nova] Creating event network-vif-deleted:f0a62fb3-bfaa-4ee5-845d-8a5f649d79ce for instance da545a2c-65e8-404c-8398-681c2715cdaf on n-h2-854121-14 Oct 17 14:04:53.396700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:53.397124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:53.397787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:53.404489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9c093dfb-4309-4a02-8562-192f9e4ad247 req-680dedfb-96a7-42af-9a06-ee88a35d92ec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038116 Oct 17 14:04:53.405153 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3349/6684] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:04:53.462910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc8aa11a5c74b76809ec5ac2fbc5608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dfa0c4055274aedab03ab42247817ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:04:53.471816 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1aa1f63e-cfeb-4cc8-a7d7-2592d857e7fb tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 200 len: 1334 microversion: 2.1 time: 0.090580 Oct 17 14:04:53.472838 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3336/6685] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:53 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:04:54.496958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:54.497707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] [instance: da545a2c-65e8-404c-8398-681c2715cdaf] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:54.504068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:54.504563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:54.505005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:54.505733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:54.506209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:54.506653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:54.520662 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] HTTP exception thrown: Instance da545a2c-65e8-404c-8398-681c2715cdaf could not be found. Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Request method failure captured: Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf HTTP/1.1 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWAj4nRezS_9tPjxpaRSBSZTeulG61B3Dg5gF0pSo8LpXFaSTQlVo_m2l3Cg40CTm7P-8GMha2vqz9qd8mmkr7KqearLi3Izf1xclVAK8Ffy_wLyeDw_u4e--FXdmt5id8-dj43rmGivnSIQako9o39TXtN94lqqJAKCwI4gdSRT7M8 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2dfa0c4055274aedab03ab42247817ad Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkBasicOps-64338129 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2dfa0c4055274aedab03ab42247817ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkBasicOps-64338129 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2dfa0c4055274aedab03ab42247817ad Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkBasicOps-64338129 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkBasicOps-64338129-project Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 8fc8aa11a5c74b76809ec5ac2fbc5608 Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkBasicOps-64338129-project Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance da545a2c-65e8-404c-8398-681c2715cdaf could not be found. Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'da545a2c-65e8-404c-8398-681c2715cdaf'} Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da545a2c-65e8-404c-8398-681c2715cdaf could not be found. Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da545a2c-65e8-404c-8398-681c2715cdaf could not be found. Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:04:54.522317 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da545a2c-65e8-404c-8398-681c2715cdaf could not be found. Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Returning 404 to user: Instance da545a2c-65e8-404c-8398-681c2715cdaf could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-81a5d06a-823d-49ef-ac08-c0bb71672f9b tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf" status: 404 len: 111 microversion: 2.1 time: 0.031932 Oct 17 14:04:54.526882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3350/6686] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:04:54 2022] GET /compute/v2.1/servers/da545a2c-65e8-404c-8398-681c2715cdaf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:04:54.701770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0504683f-9603-4498-b5c9-5ef2bbb5467a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] Calling method '.version_select at 0x7f419d0481f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:04:54.728926 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0504683f-9603-4498-b5c9-5ef2bbb5467a tempest-TestNetworkBasicOps-64338129 tempest-TestNetworkBasicOps-64338129-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1653319933" status: 202 len: 0 microversion: 2.1 time: 0.029861 Oct 17 14:04:54.732690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3337/6687] 10.222.0.65 () {58 vars in 1257 bytes} [Mon Oct 17 14:04:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1653319933 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:04:57.470462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:04:57.472858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:04:57.479905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:57.480469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:57.480972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:57.481759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:04:57.482299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:04:57.482790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:04:57.537415 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b39f8a41-a606-41c7-ac35-b09ea4e2a0e3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action" status: 200 len: 24574 microversion: 2.1 time: 0.154885 Oct 17 14:04:57.538092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3351/6688] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:04:57 2022] POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action => generated 24574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:05:08.548209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:08.549114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:08.553703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:08.554398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:08.562556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.563117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.563671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.564367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.564815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.565276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.707452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:08.715818 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a8b7b9c-6584-4451-9924-1df59f704b4c tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1683 microversion: 2.1 time: 0.169804 Oct 17 14:05:08.716403 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3338/6689] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:08 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:05:08.818811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:08.821076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:08.823981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:08.824633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=20 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:08.831749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.832234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.832665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.833393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:08.833842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:08.834261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:08.884015 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d5378a0a-17da-4d3d-8396-f1213782d701 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action" status: 200 len: 32643 microversion: 2.1 time: 0.069432 Oct 17 14:05:08.884815 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3352/6690] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:05:08 2022] POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action => generated 32643 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:05:09.288687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:09.289328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:09.295373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:09.295855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:09.296311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:09.297516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:09.297970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:09.298401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:09.427054 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26863db1-27bf-4315-acbf-a22048af9022 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1836 microversion: 2.1 time: 0.384443 Oct 17 14:05:09.427624 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3339/6691] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:09 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1836 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:09.457582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:09.460087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:09.467132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:09.467614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:09.468053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:09.469288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:09.469808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:09.470234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:09.507393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lazy-loading 'flavor' on Instance uuid 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:05:09.520271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Going to try to live migrate instance to another host {{(pid=120698) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 17 14:05:11.247904 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-639ef32e-98c9-4dc2-b3cd-f1f7fe8a99f2 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action" status: 202 len: 0 microversion: 2.1 time: 1.794587 Oct 17 14:05:11.248572 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3353/6692] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:05:09 2022] POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action => generated 0 bytes in 1796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:05:11.258379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:11.259001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:11.266845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.267424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.267911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.268606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:11.269096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:11.269746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:11.412104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:11.420110 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71717570-4ae0-492b-b785-65e55072c7e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.166086 Oct 17 14:05:11.420705 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3340/6693] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:11 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:12.412367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-480d95dc-08a0-4f44-b771-dee8de65718d req-d6b5ea27-e922-4106-9ea9-55a9ad45285e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "name": "network-vif-unplugged", "status": "completed", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:12.425483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-480d95dc-08a0-4f44-b771-dee8de65718d req-d6b5ea27-e922-4106-9ea9-55a9ad45285e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:12.425975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-480d95dc-08a0-4f44-b771-dee8de65718d req-d6b5ea27-e922-4106-9ea9-55a9ad45285e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:12.426415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-480d95dc-08a0-4f44-b771-dee8de65718d req-d6b5ea27-e922-4106-9ea9-55a9ad45285e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:12.441473 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-480d95dc-08a0-4f44-b771-dee8de65718d req-d6b5ea27-e922-4106-9ea9-55a9ad45285e service nova] Creating event network-vif-unplugged:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h1-854121-14 Oct 17 14:05:12.446512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-480d95dc-08a0-4f44-b771-dee8de65718d req-d6b5ea27-e922-4106-9ea9-55a9ad45285e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038065 Oct 17 14:05:12.447197 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3354/6694] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:12.447512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:12.448155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:12.456058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:12.456566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:12.457019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:12.457804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:12.458271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:12.458709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:12.951490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:12.959838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c1f137d-6497-488b-a4d8-5fc528c5f360 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.518037 Oct 17 14:05:12.960612 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3341/6695] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:12 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:05:13.986498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:13.987227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:13.993574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:13.994058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:13.994502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:13.995195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:13.995652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:13.996090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:14.128362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:14.136539 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df00ba64-435c-4963-9941-4e40ee0094d3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.155909 Oct 17 14:05:14.137111 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3355/6696] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:13 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:14.740213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a41f8324-eba4-4b19-8738-18126032c753 req-2b0bd4a6-73d4-4128-81a7-a1ad3d2c88cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:14.751203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a41f8324-eba4-4b19-8738-18126032c753 req-2b0bd4a6-73d4-4128-81a7-a1ad3d2c88cc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:14.752055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a41f8324-eba4-4b19-8738-18126032c753 req-2b0bd4a6-73d4-4128-81a7-a1ad3d2c88cc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:14.752575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a41f8324-eba4-4b19-8738-18126032c753 req-2b0bd4a6-73d4-4128-81a7-a1ad3d2c88cc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:14.764076 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a41f8324-eba4-4b19-8738-18126032c753 req-2b0bd4a6-73d4-4128-81a7-a1ad3d2c88cc service nova] Creating event network-changed:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h1-854121-14 Oct 17 14:05:14.769942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a41f8324-eba4-4b19-8738-18126032c753 req-2b0bd4a6-73d4-4128-81a7-a1ad3d2c88cc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Oct 17 14:05:14.770533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3342/6697] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:15.160157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:15.160767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:15.167754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.168239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.168690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.169402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:15.169852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:15.170273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:15.314549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:15.322399 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b640ff94-4dde-41bc-bbaa-02a6d17232b0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.166622 Oct 17 14:05:15.323038 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3356/6698] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:15 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:16.347878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:16.348595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:16.354894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:16.355363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:16.355801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:16.356496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:16.356947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:16.357401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:16.495157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:16.503579 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf40d9f7-48bf-453b-b837-2692b7ad57d9 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.161075 Oct 17 14:05:16.504153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3343/6699] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:16 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:17.527633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:17.528241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:17.535236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:17.535710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:17.536145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:17.536834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:17.537316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:17.537731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:17.676729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:17.684642 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37b76be9-4f6c-44a9-b9b0-ba3c1e87c687 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.160986 Oct 17 14:05:17.685227 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3357/6700] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:17 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:18.708923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:18.709571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:18.716463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:18.716948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:18.717423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:18.718124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:18.718582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:18.719015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:18.858872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:18.867444 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c89e6ca-539d-44a6-af1e-851d0900b693 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.162459 Oct 17 14:05:18.868061 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3344/6701] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:18 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:19.893909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:19.894535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:19.902032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:19.902522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:19.902963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:19.903743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:19.904207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:19.904635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:20.044251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:20.052613 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3474f9c2-7be0-478d-bd05-3eaac6be2ebd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.163124 Oct 17 14:05:20.053220 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3358/6702] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:19 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:21.076687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:21.077482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:21.088154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:21.088654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:21.089094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:21.089829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:21.090291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:21.090717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:21.232677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:21.240950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4059d3c2-7e3f-482d-b6f5-5b17b366ed39 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.168291 Oct 17 14:05:21.241606 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3345/6703] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:21 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:22.265329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:22.266787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:22.274009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:22.274496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:22.274937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:22.275636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:22.276087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:22.276511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:22.424012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:22.432696 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-722a619b-4633-4a99-a688-8fe80b55aaeb tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1693 microversion: 2.1 time: 0.171297 Oct 17 14:05:22.433364 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3359/6704] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:22 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:23.457401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:23.458028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:23.465678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.466173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.466626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.467333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.467793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.468256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.639786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:23.648041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-171a9c68-2901-4d64-9b64-b0e6ed377b81 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1683 microversion: 2.1 time: 0.194681 Oct 17 14:05:23.648608 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3346/6705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:23 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:23.669934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:23.670465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:23.677793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.678260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.678687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.679370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.679820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.680239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.813597 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b44bd65f-b820-4407-8a9d-8df85defa323 tempest-TestNetworkAdvancedServerOps-530077656 tempest-TestNetworkAdvancedServerOps-530077656-project-admin] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1836 microversion: 2.1 time: 0.146735 Oct 17 14:05:23.814268 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3360/6706] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:23 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1836 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:23.840231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:23.840916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:23.847529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.848015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.848454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.849185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:23.849700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:23.850138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:23.995353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:24.003717 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b390cdce-153c-4802-8105-c48c0150a122 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1683 microversion: 2.1 time: 0.169337 Oct 17 14:05:24.004294 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3347/6707] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:23 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:05:24.100520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:24.102836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:24.109045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:24.110207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:24.110650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:24.111355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:24.111814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:24.112242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:24.176765 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68034b1f-7a88-4ae0-9adc-da3851354467 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action" status: 200 len: 38636 microversion: 2.1 time: 0.079882 Oct 17 14:05:24.179538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3361/6708] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:05:24 2022] POST /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f/action => generated 38636 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:05:25.164798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:25.165969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:25.166143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-50c3562f-9db2-4c0f-989e-5d70bc6ceb5d req-571bee95-7d7f-4765-b7a5-40e3a56e2e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:25.176246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.176750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.177215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.178142 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50c3562f-9db2-4c0f-989e-5d70bc6ceb5d req-571bee95-7d7f-4765-b7a5-40e3a56e2e0f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.178287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.178625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50c3562f-9db2-4c0f-989e-5d70bc6ceb5d req-571bee95-7d7f-4765-b7a5-40e3a56e2e0f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.179064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.179197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50c3562f-9db2-4c0f-989e-5d70bc6ceb5d req-571bee95-7d7f-4765-b7a5-40e3a56e2e0f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.179495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.191305 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-50c3562f-9db2-4c0f-989e-5d70bc6ceb5d req-571bee95-7d7f-4765-b7a5-40e3a56e2e0f service nova] Creating event network-changed:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h2-854121-14 Oct 17 14:05:25.196598 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-50c3562f-9db2-4c0f-989e-5d70bc6ceb5d req-571bee95-7d7f-4765-b7a5-40e3a56e2e0f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034469 Oct 17 14:05:25.197811 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3362/6709] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:05:25.209802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:05:25.301677 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed8519c7-5f0e-4f66-92fa-86ad1667b5a3 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 204 len: 0 microversion: 2.1 time: 0.141122 Oct 17 14:05:25.302595 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3348/6710] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:05:25 2022] DELETE /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:05:25.314262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:25.317296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:25.324941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.325461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.326153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.327169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:25.327639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:25.328057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:25.494364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:25.503172 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94620ce8-028d-40b6-8c07-82c9c397bac5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1689 microversion: 2.1 time: 0.194767 Oct 17 14:05:25.503763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3363/6711] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:25 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:26.528673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:26.529466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:26.536641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:26.537133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:26.537610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:26.538425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:26.538765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:26.539196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:26.552337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1d2a58bb-c2eb-4596-8563-532cb106e111 req-dff3e6e5-9000-4339-979f-84d239436a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f", "name": "network-vif-deleted", "tag": "bfebaa11-2422-4b6a-957e-a441eb907de2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:26.563723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1d2a58bb-c2eb-4596-8563-532cb106e111 req-dff3e6e5-9000-4339-979f-84d239436a14 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:26.564248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1d2a58bb-c2eb-4596-8563-532cb106e111 req-dff3e6e5-9000-4339-979f-84d239436a14 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:26.564691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1d2a58bb-c2eb-4596-8563-532cb106e111 req-dff3e6e5-9000-4339-979f-84d239436a14 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:26.577392 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1d2a58bb-c2eb-4596-8563-532cb106e111 req-dff3e6e5-9000-4339-979f-84d239436a14 service nova] Creating event network-vif-deleted:bfebaa11-2422-4b6a-957e-a441eb907de2 for instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f on n-h2-854121-14 Oct 17 14:05:26.584088 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1d2a58bb-c2eb-4596-8563-532cb106e111 req-dff3e6e5-9000-4339-979f-84d239436a14 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035364 Oct 17 14:05:26.585136 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3364/6712] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:26.616318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:26.627022 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c280315-f278-42c3-ae77-34a09f6c7b1d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 200 len: 1502 microversion: 2.1 time: 0.102626 Oct 17 14:05:26.627602 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3349/6713] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:26 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 1502 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:27.652863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:27.653624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:27.660378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:27.660863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:27.661408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:27.662100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:27.662553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:27.662977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:27.676872 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] HTTP exception thrown: Instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f could not be found. Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Request method failure captured: Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f HTTP/1.1 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTV_PgO2oVzsPWCFVF-Fj96y0E8wrPFwlaAXVxcDjVXPmMRRdsfsS5c8iL3LVx_6gwqFrYjUxK5-nfmFMQ4-xhEjabCG0_nw46-IVNPiZQLL3NpnIWDlt02E3Eh25va4J7ziMmiebAy2I3elil_Z3K4RZRQSs9OGl7P0TMqk8R6_ATFI Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 95284ccf684a481691e67ffcb5e66785 Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f could not be found. Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f'} Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f could not be found. Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f could not be found. Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:05:27.678594 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f could not be found. Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Returning 404 to user: Instance 0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9dece613-0635-48e3-8c78-014857d78968 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f" status: 404 len: 111 microversion: 2.1 time: 0.032375 Oct 17 14:05:27.683044 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3365/6714] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:27 2022] GET /compute/v2.1/servers/0b6dfea3-fe10-4236-a3d1-92c6f03e2f2f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:05:31.351822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c2f31b2-0537-44ff-85a9-3f13ef0dc429 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '.version_select at 0x7f41a21669d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:31.376354 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c2f31b2-0537-44ff-85a9-3f13ef0dc429 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1763128367" status: 202 len: 0 microversion: 2.1 time: 0.028503 Oct 17 14:05:31.377003 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3350/6715] 10.222.0.65 () {58 vars in 1284 bytes} [Mon Oct 17 14:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1763128367 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:05:31.408197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e341af9f-2dea-4dea-8dbd-69ce7a8592a5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: .version_select at 0x7f419c8a99d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-255840725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOp+oUPkjOnoZTw86cjNFg7lHKYiuZPgYkiPgwGhWeF2Lj4ZA6Xgnmjutbp6Rz8z5Odph227NKTKNR8BCaWcHyjVR6r5bkxLe3B9hKTYW3Dhxg8vgqWCgGf4boJbHkT7GA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:31.426109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e341af9f-2dea-4dea-8dbd-69ce7a8592a5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:31.431219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e341af9f-2dea-4dea-8dbd-69ce7a8592a5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:31.454844 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e341af9f-2dea-4dea-8dbd-69ce7a8592a5 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050989 Oct 17 14:05:31.455366 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3366/6716] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:05:31 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:37.030969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-939570677", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "de919f8a-54de-4102-99ea-40c9d919095a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-255840725", "security_groups": [{"name": "tempest-secgroup-smoke-1152681926"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:37.042157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:37.489653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] validate_networks() for [('de919f8a-54de-4102-99ea-40c9d919095a', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:05:37.920897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:05:37.921384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:05:37.922001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:05:37.922664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:05:37.923082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:05:37.932457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:37.933175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:37.933615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:37.934368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:37.934815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:37.935240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:37.955681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:05:37.961030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Getting quotas for user 95284ccf684a481691e67ffcb5e66785 and project 0eaad0beca0d46d284b82a54dfd557bc. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:05:37.975746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:05:37.978232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:05:38.033459 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dae14ccf-589a-4cd2-9da4-d5ecd3ab5731 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.006366 Oct 17 14:05:38.040682 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3351/6717] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:05:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:05:38.044106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:38.049830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-740888a5-5e78-462c-ac6f-3a044ca41bcd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:38.050448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-740888a5-5e78-462c-ac6f-3a044ca41bcd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:38.201420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-740888a5-5e78-462c-ac6f-3a044ca41bcd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:38.217048 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-740888a5-5e78-462c-ac6f-3a044ca41bcd tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1265 microversion: 2.1 time: 0.174685 Oct 17 14:05:38.221699 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3367/6718] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:38 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:05:39.257338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:39.258368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:39.261497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:39.271438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:39.272290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:39.272834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:39.273742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:39.274478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:39.275126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:39.414454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:39.423774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e3375c7-58dc-4221-ae86-8c26e94133af tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1335 microversion: 2.1 time: 0.171356 Oct 17 14:05:39.424475 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3352/6719] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:39 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1335 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:40.448299 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:40.449513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:40.452404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:40.459998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:40.460497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:40.461029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:40.461783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:40.462242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:40.462672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:40.622409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:40.632085 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f43502cc-6c8e-4590-95b7-cb0b4bd88914 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1391 microversion: 2.1 time: 0.187577 Oct 17 14:05:40.634868 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3368/6720] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:40 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1391 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:40.980229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a040f9a8-b388-4a04-a24c-34bebad179ca req-dbe723a9-0c92-4b2f-9ae1-80987a4c683d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:40.991688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a040f9a8-b388-4a04-a24c-34bebad179ca req-dbe723a9-0c92-4b2f-9ae1-80987a4c683d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:40.992176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a040f9a8-b388-4a04-a24c-34bebad179ca req-dbe723a9-0c92-4b2f-9ae1-80987a4c683d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:40.992613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a040f9a8-b388-4a04-a24c-34bebad179ca req-dbe723a9-0c92-4b2f-9ae1-80987a4c683d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:41.004982 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a040f9a8-b388-4a04-a24c-34bebad179ca req-dbe723a9-0c92-4b2f-9ae1-80987a4c683d service nova] Creating event network-changed:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:05:41.010591 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a040f9a8-b388-4a04-a24c-34bebad179ca req-dbe723a9-0c92-4b2f-9ae1-80987a4c683d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034323 Oct 17 14:05:41.011236 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3353/6721] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:41.658770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:41.659376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:41.666362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:41.666901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:41.667278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:41.667960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:41.668413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:41.668832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:41.809826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:41.817673 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f88f9bb1-6a29-4501-866f-9b2e721d9f16 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1391 microversion: 2.1 time: 0.162916 Oct 17 14:05:41.818257 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3369/6722] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:41 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:42.842286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:42.842896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:42.850063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:42.850753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:42.851364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:42.852250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:42.852847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:42.853472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:42.998936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:43.007666 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66892327-6552-4863-b3f3-5db23dd509e6 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1391 microversion: 2.1 time: 0.170386 Oct 17 14:05:43.008253 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3354/6723] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:42 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:05:44.031187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:44.031795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:44.038515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:44.038998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:44.039443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:44.040137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:44.040596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:44.041067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:44.179259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:44.188168 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c607b9d2-c7ed-4f19-af72-5a09788dc6c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1391 microversion: 2.1 time: 0.160772 Oct 17 14:05:44.188783 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3370/6724] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:44 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:45.211930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:45.212468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:45.222545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:45.223193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:45.224615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:45.225374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:45.225840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:45.226277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:45.365204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:45.374495 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3e612e5-cba7-400f-bad3-8d0ef0a6dcee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1391 microversion: 2.1 time: 0.166381 Oct 17 14:05:45.375118 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3355/6725] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:45 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:46.298593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-00ddc377-e999-4d58-9658-603cafeb8d1a req-a04f2070-bae8-4a8e-9d28-d64c29d1e77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "name": "network-vif-plugged", "status": "completed", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:46.309061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-00ddc377-e999-4d58-9658-603cafeb8d1a req-a04f2070-bae8-4a8e-9d28-d64c29d1e77e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:46.309653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-00ddc377-e999-4d58-9658-603cafeb8d1a req-a04f2070-bae8-4a8e-9d28-d64c29d1e77e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:46.310109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-00ddc377-e999-4d58-9658-603cafeb8d1a req-a04f2070-bae8-4a8e-9d28-d64c29d1e77e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:46.322092 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-00ddc377-e999-4d58-9658-603cafeb8d1a req-a04f2070-bae8-4a8e-9d28-d64c29d1e77e service nova] Creating event network-vif-plugged:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:05:46.327127 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-00ddc377-e999-4d58-9658-603cafeb8d1a req-a04f2070-bae8-4a8e-9d28-d64c29d1e77e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Oct 17 14:05:46.328535 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3371/6726] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:05:46.398087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:46.398736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:46.405848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:46.406418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:46.406905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:46.407624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:46.408084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:46.408518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:46.545581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:46.554109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6112f9e8-62fc-4a33-9fbb-5413d61b2c96 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1391 microversion: 2.1 time: 0.159923 Oct 17 14:05:46.554678 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3356/6727] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:46 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:47.577583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:47.578335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:47.584551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:47.585036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:47.585515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:47.586209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:47.586671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:47.587103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:47.723967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:47.731943 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b946c693-290a-4f4c-945c-61974a234a48 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1563 microversion: 2.1 time: 0.159685 Oct 17 14:05:47.732523 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3372/6728] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:47 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:47.755220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:47.755854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:47.762597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:47.763081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:47.763532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:47.764220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:47.764705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:47.765137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:47.899262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:47.908062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85096888-6e9f-4ce4-a56e-da8134db31ee tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1563 microversion: 2.1 time: 0.156804 Oct 17 14:05:47.908641 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3357/6729] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:47 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:05:49.837863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-775f1b59-aba3-499f-b7e6-4530ceeb7be4 req-087754cf-cd5e-44f2-8b79-54f1e00a762b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:05:49.844215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:05:49.844836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:05:49.847844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:49.852823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:49.853563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:05:49.857708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:49.858214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:49.858766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:49.859475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:49.865620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-775f1b59-aba3-499f-b7e6-4530ceeb7be4 req-087754cf-cd5e-44f2-8b79-54f1e00a762b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:05:49.866108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-775f1b59-aba3-499f-b7e6-4530ceeb7be4 req-087754cf-cd5e-44f2-8b79-54f1e00a762b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:49.866542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-775f1b59-aba3-499f-b7e6-4530ceeb7be4 req-087754cf-cd5e-44f2-8b79-54f1e00a762b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:49.869759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:05:49.870205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:05:49.882960 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-775f1b59-aba3-499f-b7e6-4530ceeb7be4 req-087754cf-cd5e-44f2-8b79-54f1e00a762b service nova] Creating event network-changed:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:05:49.888411 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-775f1b59-aba3-499f-b7e6-4530ceeb7be4 req-087754cf-cd5e-44f2-8b79-54f1e00a762b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054507 Oct 17 14:05:49.889116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3358/6730] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:05:50.016495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:05:50.024590 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a433dbba-c58a-4446-82a9-8bcb6b7ef906 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1563 microversion: 2.1 time: 0.193974 Oct 17 14:05:50.025079 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3373/6731] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:05:49 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1563 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:06:13.280763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=13 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:13.281640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:13.286248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:13.288469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:13.295730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.296310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.296746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.297462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:13.297912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:13.298336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:13.350257 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07087f70-8a16-432a-b50b-ce9e1fe01232 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14/action" status: 200 len: 24566 microversion: 2.1 time: 0.071014 Oct 17 14:06:13.355525 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3359/6732] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:06:13 2022] POST /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14/action => generated 24566 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:06:19.791528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:19.794614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:19.797198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:19.798014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=32 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:19.804552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:19.805040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:19.805507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:19.806235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:19.806693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:19.807114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:19.891611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:06:19.892030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:06:19.892596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:06:19.892908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:06:19.893344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:06:19.954598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:19.960368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:19.960853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:19.961320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:19.962019 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:19.962469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:19.962892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:19.992416 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8c9aafc-91b6-44ea-8e06-e1236089ef0a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14/action" status: 202 len: 1136 microversion: 2.1 time: 0.204825 Oct 17 14:06:19.993270 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3374/6733] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:06:19 2022] POST /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14/action => generated 1136 bytes in 206 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 17 14:06:20.014408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:20.015130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:20.023305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:20.024279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:20.024619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:20.025804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:20.026457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:20.027051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:20.187446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:20.196566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c4ad18c-fb01-4b0a-98c8-0b43f475c400 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.186591 Oct 17 14:06:20.213154 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3360/6734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:20 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:21.220398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:21.221304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:21.228547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:21.229150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:21.229722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:21.230527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:21.231094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:21.231644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:21.624859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:21.633308 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db36bd9f-e09c-4039-99dd-77af2684df42 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.417231 Oct 17 14:06:21.634139 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3375/6735] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:21 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:22.657804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:22.658412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:22.668688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:22.669210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:22.669653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:22.670348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:22.670815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:22.671226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:22.806362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:22.814836 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd847fbc-1f1f-4cb2-9c2f-989c721d34c4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.161109 Oct 17 14:06:22.815436 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3361/6736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:22 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:23.838637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:23.839255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:23.846956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:23.847449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:23.847888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:23.848601 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:23.849056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:23.849511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:23.981939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:23.989846 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37f14dcc-767c-43e6-8e08-0ee72105ddba tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.155132 Oct 17 14:06:23.990414 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3376/6737] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:23 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:25.013103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:25.013734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:25.028797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:25.029320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:25.029757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:25.030449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:25.030899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:25.031326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:25.164959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:25.172832 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb2b9d4f-a0e5-4793-b297-46e4183edbb4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.163637 Oct 17 14:06:25.173455 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3362/6738] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:25 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:26.196193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:26.196803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:26.203252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:26.203924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:26.204537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:26.205270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:26.205717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:26.206143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:26.339666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:26.348099 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e07172bf-ed46-4617-81a2-a6e245929e58 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.155930 Oct 17 14:06:26.348659 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3377/6739] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:26 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:27.370887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:27.371542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:27.379196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:27.379681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:27.380155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:27.380857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:27.381354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:27.382042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:27.519494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:27.527314 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9d5b475-d495-418b-badf-7528c5c4bd2d tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.160403 Oct 17 14:06:27.527893 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3363/6740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:27 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:28.552126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:28.552774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:28.560195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:28.560691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:28.561139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:28.561877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:28.562340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:28.562775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:28.704143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:28.712439 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0d5e486-d98d-437a-be05-837729e6d109 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.164981 Oct 17 14:06:28.713029 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3378/6741] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:28 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:29.736857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:29.737542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:29.744656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:29.745202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:29.745654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:29.746363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:29.746822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:29.747254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:29.883831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:29.892609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-822a57d9-2078-4b1e-a189-007eedf750f4 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.159534 Oct 17 14:06:29.893578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3364/6742] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:29 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:30.924359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:30.924983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:30.932631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:30.933134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:30.933603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:30.934310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:30.934775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:30.935210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:31.070161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:31.078054 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5088d4df-91de-4e45-98fd-ba9afc3ddb44 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1690 microversion: 2.1 time: 0.158514 Oct 17 14:06:31.078634 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3379/6743] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:30 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:32.103367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:32.103984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:32.110978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:32.111463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:32.111903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:32.112594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:32.113049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:32.113503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:32.245950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:32.253795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2901726f-feab-47c4-81d3-eeabefdb77d1 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1696 microversion: 2.1 time: 0.154404 Oct 17 14:06:32.254374 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3365/6744] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:32 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:33.278504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:33.279121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:33.286583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:33.287071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:33.287520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:33.288218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:33.288677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:33.289106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:33.430967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:33.440184 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d613a6a8-f96b-480b-b5d8-9f30838ea3dc tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1696 microversion: 2.1 time: 0.164792 Oct 17 14:06:33.440759 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3380/6745] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:33 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:34.463761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:06:34.464383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:34.472011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:34.472503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:34.473006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:34.473695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:34.474157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:34.474590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:34.616477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:06:34.625103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de7c47a0-78e5-4882-9f99-2e2521bf14ae tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1681 microversion: 2.1 time: 0.165308 Oct 17 14:06:34.637540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3366/6746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:06:34 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:06:34.645427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c677d958-f9c4-4903-a26f-b8fcf5297a56 req-bc75597b-afe8-4790-8123-7246d5850df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "name": "network-vif-unplugged", "status": "completed", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:34.657179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c677d958-f9c4-4903-a26f-b8fcf5297a56 req-bc75597b-afe8-4790-8123-7246d5850df0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:34.658589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c677d958-f9c4-4903-a26f-b8fcf5297a56 req-bc75597b-afe8-4790-8123-7246d5850df0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:34.659937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c677d958-f9c4-4903-a26f-b8fcf5297a56 req-bc75597b-afe8-4790-8123-7246d5850df0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:34.674916 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c677d958-f9c4-4903-a26f-b8fcf5297a56 req-bc75597b-afe8-4790-8123-7246d5850df0 service nova] Creating event network-vif-unplugged:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:06:34.680168 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c677d958-f9c4-4903-a26f-b8fcf5297a56 req-bc75597b-afe8-4790-8123-7246d5850df0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042220 Oct 17 14:06:34.681273 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3381/6747] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:36.700241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-192ba2e9-78ef-423c-a303-05d074a0c915 req-0b5d96a4-5f91-4fa0-8637-112d2f274309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "name": "network-vif-plugged", "status": "completed", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:36.710927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-192ba2e9-78ef-423c-a303-05d074a0c915 req-0b5d96a4-5f91-4fa0-8637-112d2f274309 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:36.711410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-192ba2e9-78ef-423c-a303-05d074a0c915 req-0b5d96a4-5f91-4fa0-8637-112d2f274309 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:36.711849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-192ba2e9-78ef-423c-a303-05d074a0c915 req-0b5d96a4-5f91-4fa0-8637-112d2f274309 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:36.726487 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-192ba2e9-78ef-423c-a303-05d074a0c915 req-0b5d96a4-5f91-4fa0-8637-112d2f274309 service nova] Creating event network-vif-plugged:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:06:36.731591 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-192ba2e9-78ef-423c-a303-05d074a0c915 req-0b5d96a4-5f91-4fa0-8637-112d2f274309 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035127 Oct 17 14:06:36.732284 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3367/6748] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:06:58.838425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:06:58.840764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:06:58.842973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=20 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:58.843620 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:06:58.851015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:58.851496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:58.851937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:58.852631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:06:58.853081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:06:58.853530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:06:58.909764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ec95f80-9201-4c0c-9b38-c32d85c98737 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "POST /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14/action" status: 200 len: 24571 microversion: 2.1 time: 0.075956 Oct 17 14:06:58.911017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3382/6749] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:06:58 2022] POST /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:07:06.112433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=18 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:06.113400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=48 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:06.118350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-12d57724-e9fb-4097-8c46-3d42fc42f529 req-0ae78e2b-4edc-4edb-8906-a48d9ad8cac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:06.118831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:06.119127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:06.128089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.128759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.129229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.129598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12d57724-e9fb-4097-8c46-3d42fc42f529 req-0ae78e2b-4edc-4edb-8906-a48d9ad8cac5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.130085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12d57724-e9fb-4097-8c46-3d42fc42f529 req-0ae78e2b-4edc-4edb-8906-a48d9ad8cac5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.130209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.130515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-12d57724-e9fb-4097-8c46-3d42fc42f529 req-0ae78e2b-4edc-4edb-8906-a48d9ad8cac5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.130669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.131278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.143126 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-12d57724-e9fb-4097-8c46-3d42fc42f529 req-0ae78e2b-4edc-4edb-8906-a48d9ad8cac5 service nova] Creating event network-changed:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:07:06.149426 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-12d57724-e9fb-4097-8c46-3d42fc42f529 req-0ae78e2b-4edc-4edb-8906-a48d9ad8cac5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036604 Oct 17 14:07:06.150070 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3383/6750] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:07:06.445686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:07:06.566489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4dade838-67bd-4ff4-89b0-836e62495dd0 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 204 len: 0 microversion: 2.1 time: 0.455934 Oct 17 14:07:06.567293 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3368/6751] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:07:06 2022] DELETE /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:07:06.576704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:06.577447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:06.585187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.585705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.586151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.586939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:06.587328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:06.587756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:06.826072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:06.841869 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-249e881c-9346-4915-b754-e424a41b8050 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1687 microversion: 2.1 time: 0.269567 Oct 17 14:07:06.842929 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3384/6752] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:06 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1687 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:07.879861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:07.880875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:07.888787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:07.889223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:07.889760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:07.890737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:07.891216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:07.891631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:08.026693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95284ccf684a481691e67ffcb5e66785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eaad0beca0d46d284b82a54dfd557bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:08.034519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d38f27b-3648-44da-af42-491653af0960 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 200 len: 1569 microversion: 2.1 time: 0.159704 Oct 17 14:07:08.035841 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3369/6753] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:07 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:08.378254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9200964a-d9f9-4323-849e-c920655d8355 req-e5d6e1c5-13fc-4007-8adf-ba92b5c041e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1cfb13-13fc-44ea-8c3c-dde23a00cd14", "name": "network-vif-deleted", "tag": "cf7fc543-5f7d-4646-a343-9fa6f81035c1"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:08.391010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9200964a-d9f9-4323-849e-c920655d8355 req-e5d6e1c5-13fc-4007-8adf-ba92b5c041e0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:08.391669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9200964a-d9f9-4323-849e-c920655d8355 req-e5d6e1c5-13fc-4007-8adf-ba92b5c041e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:08.392174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9200964a-d9f9-4323-849e-c920655d8355 req-e5d6e1c5-13fc-4007-8adf-ba92b5c041e0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:08.404453 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9200964a-d9f9-4323-849e-c920655d8355 req-e5d6e1c5-13fc-4007-8adf-ba92b5c041e0 service nova] Creating event network-vif-deleted:cf7fc543-5f7d-4646-a343-9fa6f81035c1 for instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 on n-h1-854121-14 Oct 17 14:07:08.409688 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9200964a-d9f9-4323-849e-c920655d8355 req-e5d6e1c5-13fc-4007-8adf-ba92b5c041e0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035475 Oct 17 14:07:08.410999 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3385/6754] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:09.059918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:09.060554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] [instance: 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:09.067751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:09.068243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:09.068701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:09.069503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:09.069971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:09.070406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:09.084654 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] HTTP exception thrown: Instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 could not be found. Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Request method failure captured: Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 HTTP/1.1 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTV_PgO2oVzsPWCFVF-Fj96y0E8wrPFwlaAXVxcDjVXPmMRRdsfsS5c8iL3LVx_6gwqFrYjUxK5-nfmFMQ4-xhEjabCG0_nw46-IVNPiZQLL3NpnIWDlt02E3Eh25va4J7ziMmiebAy2I3elil_Z3K4RZRQSs9OGl7P0TMqk8R6_ATFI Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0eaad0beca0d46d284b82a54dfd557bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0eaad0beca0d46d284b82a54dfd557bc Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-949945867 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 95284ccf684a481691e67ffcb5e66785 Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestNetworkAdvancedServerOps-949945867-project Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 could not be found. Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '0d1cfb13-13fc-44ea-8c3c-dde23a00cd14'} Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 could not be found. Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 could not be found. Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:09.086363 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 could not be found. Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Returning 404 to user: Instance 0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62d0395f-1984-431b-8b94-12e97ef1312a tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14" status: 404 len: 111 microversion: 2.1 time: 0.031798 Oct 17 14:07:09.090140 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3370/6755] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:09 2022] GET /compute/v2.1/servers/0d1cfb13-13fc-44ea-8c3c-dde23a00cd14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:07:12.732717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a45a54f9-a212-4074-b4f3-ff86f062a134 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] Calling method '.version_select at 0x7f419c8a9430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:12.753815 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a45a54f9-a212-4074-b4f3-ff86f062a134 tempest-TestNetworkAdvancedServerOps-949945867 tempest-TestNetworkAdvancedServerOps-949945867-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-255840725" status: 202 len: 0 microversion: 2.1 time: 0.025021 Oct 17 14:07:12.754534 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3386/6756] 10.222.0.65 () {58 vars in 1281 bytes} [Mon Oct 17 14:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-255840725 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:16.789563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1777706952", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "32c9d780-d02d-4565-8842-c108dd42c116"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:16.844368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] validate_networks() for [('32c9d780-d02d-4565-8842-c108dd42c116', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:07:17.199446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:07:17.199870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:07:17.200645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:07:17.200794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:07:17.201179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:07:17.210984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:17.211759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:17.212202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:17.212949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:17.213917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:17.214345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:17.232175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Getting quotas for project 695bf2fb14e3485fb528cc744646418e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:07:17.237376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Getting quotas for user 276e6c60153842e3834d84f44a7af758 and project 695bf2fb14e3485fb528cc744646418e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:07:17.250442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:07:17.252724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:07:17.301013 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ec39482-7a9f-431f-ad94-245fb94fd853 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628931 Oct 17 14:07:17.301710 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3371/6757] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:07:17.314056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75a687f2-a436-40d7-9428-5e090a6c8eb7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:17.315555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-75a687f2-a436-40d7-9428-5e090a6c8eb7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:17.374309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-75a687f2-a436-40d7-9428-5e090a6c8eb7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:17.382226 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75a687f2-a436-40d7-9428-5e090a6c8eb7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1215 microversion: 2.1 time: 0.073124 Oct 17 14:07:17.382807 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3387/6758] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:17 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:18.406729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:18.407287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:18.414950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:18.415881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:18.416014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:18.416679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:18.417133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:18.417599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:18.490713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:18.498950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ed0456a9-00b4-4ead-9a8c-d50cf560affd tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1275 microversion: 2.1 time: 0.096835 Oct 17 14:07:18.499892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3372/6759] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:18 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1275 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:19.522504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:19.523190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:19.526530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:19.532645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:19.533143 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:19.533632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:19.534359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:19.535551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:19.536310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:19.798226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:19.812692 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-443138f5-817c-4acf-a4eb-70b7ee8918df tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.294044 Oct 17 14:07:19.813287 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3388/6760] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:19 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:19.952859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8826d720-c348-45d9-8005-e9a4b0a6ded6 req-b7fbf625-c4b7-49e8-ad2c-194ca3ca045c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdde610e-4b2b-4ed4-9af1-629937beaace", "tag": "4f42b64e-95c9-43bf-8095-9da54bf63db5"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:19.968266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8826d720-c348-45d9-8005-e9a4b0a6ded6 req-b7fbf625-c4b7-49e8-ad2c-194ca3ca045c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:19.968913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8826d720-c348-45d9-8005-e9a4b0a6ded6 req-b7fbf625-c4b7-49e8-ad2c-194ca3ca045c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:19.969634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8826d720-c348-45d9-8005-e9a4b0a6ded6 req-b7fbf625-c4b7-49e8-ad2c-194ca3ca045c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:19.984814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8826d720-c348-45d9-8005-e9a4b0a6ded6 req-b7fbf625-c4b7-49e8-ad2c-194ca3ca045c service nova] Creating event network-changed:4f42b64e-95c9-43bf-8095-9da54bf63db5 for instance cdde610e-4b2b-4ed4-9af1-629937beaace on n-h2-854121-14 Oct 17 14:07:19.989970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8826d720-c348-45d9-8005-e9a4b0a6ded6 req-b7fbf625-c4b7-49e8-ad2c-194ca3ca045c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043790 Oct 17 14:07:19.991143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3373/6761] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:20.837956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:20.838576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:20.845535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:20.846027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:20.847357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:20.848793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:20.849285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:20.849720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:20.979767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:20.987530 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d4b06b2-ce44-47d2-8c58-05a75bf245c1 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.153498 Oct 17 14:07:20.988104 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3389/6762] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:20 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:22.012562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:22.013294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:22.019606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:22.020103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:22.020637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:22.021383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:22.021853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:22.022288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:22.153433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:22.161761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b89f1ae6-28aa-48bf-a5de-213a2d75ff7d tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.154420 Oct 17 14:07:22.162338 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3374/6763] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:22 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:23.185616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:23.186148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:23.193874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:23.194368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:23.194813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:23.195518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:23.195978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:23.196410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:23.330468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:23.338575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bead643d-6c3c-4966-a95f-4eed45eea752 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.157084 Oct 17 14:07:23.339171 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3390/6764] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:23 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:24.361788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:24.362402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:24.370041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:24.370524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:24.370962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:24.371663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:24.372153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:24.372584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:24.504169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:24.512556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec352e50-848b-4747-92d4-c4c411ad6722 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.154704 Oct 17 14:07:24.513135 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3375/6765] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:24 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:25.534634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:25.535286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:25.542581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:25.543075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:25.543513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:25.544214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:25.544674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:25.545106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:25.678630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:25.686575 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5390fa76-9095-4484-8df8-beb9db647f72 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.155897 Oct 17 14:07:25.687153 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3391/6766] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:25 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:26.698284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-cdbc237b-9162-41c3-a2e5-42bdcf66148d req-1c0cf2db-2ab1-4f9b-baf3-62460c121536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde610e-4b2b-4ed4-9af1-629937beaace", "name": "network-vif-plugged", "status": "completed", "tag": "4f42b64e-95c9-43bf-8095-9da54bf63db5"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:26.708866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cdbc237b-9162-41c3-a2e5-42bdcf66148d req-1c0cf2db-2ab1-4f9b-baf3-62460c121536 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:26.709392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cdbc237b-9162-41c3-a2e5-42bdcf66148d req-1c0cf2db-2ab1-4f9b-baf3-62460c121536 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:26.709839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cdbc237b-9162-41c3-a2e5-42bdcf66148d req-1c0cf2db-2ab1-4f9b-baf3-62460c121536 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:26.710944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:26.712091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:26.719698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:26.720191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:26.720635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:26.721382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:26.721732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-cdbc237b-9162-41c3-a2e5-42bdcf66148d req-1c0cf2db-2ab1-4f9b-baf3-62460c121536 service nova] Creating event network-vif-plugged:4f42b64e-95c9-43bf-8095-9da54bf63db5 for instance cdde610e-4b2b-4ed4-9af1-629937beaace on n-h2-854121-14 Oct 17 14:07:26.721849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:26.722263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:26.727063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-cdbc237b-9162-41c3-a2e5-42bdcf66148d req-1c0cf2db-2ab1-4f9b-baf3-62460c121536 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105227 Oct 17 14:07:26.727666 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3376/6767] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:26.896440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:26.906306 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-042442e4-0425-483b-879b-adf22dd7e6a2 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.200130 Oct 17 14:07:26.906902 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3392/6768] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:26 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:07:27.926975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:27.927761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:27.933408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:27.934156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:27.940971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:27.942159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:27.942679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:27.943393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:27.943871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:27.944340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:28.081645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:28.090553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37803e13-b34e-4591-a07e-5cd586afd140 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1315 microversion: 2.1 time: 0.164699 Oct 17 14:07:28.091148 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3377/6769] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:27 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:29.113173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:29.115704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:29.117609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:29.119354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:29.125959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.126483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.126929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.127645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.128113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.128546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.273881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:29.281873 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d8f440b-ea82-41de-955d-32714722654b tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1501 microversion: 2.1 time: 0.172651 Oct 17 14:07:29.282460 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3393/6770] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:29 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1501 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:29.305143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:29.305835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:29.312924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.313446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.313893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.314598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.315053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.315480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.453078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:29.461211 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0abb0b2b-9a7e-40d0-8370-f365e2185236 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1501 microversion: 2.1 time: 0.160616 Oct 17 14:07:29.461786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3378/6771] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:29 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:29.483348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:29.483883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:29.490909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.491412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.491853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.492553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.493007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.493495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.517855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lazy-loading 'flavor' on Instance uuid cdde610e-4b2b-4ed4-9af1-629937beaace {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:07:29.584897 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20f37dcc-b7d7-4c8d-8282-c74c396809fa tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action" status: 202 len: 0 microversion: 2.1 time: 0.105371 Oct 17 14:07:29.585598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3394/6772] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:07:29 2022] POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:29.593849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:29.594467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:29.601664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.602218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.602726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.603496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:29.603986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:29.604423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:29.740445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:29.748499 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-73385d5a-ab34-4db0-bc13-0297f2cbd36c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1509 microversion: 2.1 time: 0.158646 Oct 17 14:07:29.749087 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3379/6773] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:29 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:30.773388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:30.774094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:30.780275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:30.780755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:30.781211 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:30.781900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:30.782347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:30.782774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:30.916908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:30.924800 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b95b70f4-2762-480d-b607-e200e3e6e1ff tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1492 microversion: 2.1 time: 0.156559 Oct 17 14:07:30.925462 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3395/6774] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:30 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1492 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:30.950251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:30.950876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:30.957667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:30.958150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:30.958594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:30.959303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:30.959758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:30.960189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:31.029736 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2e053ff-f31d-43c5-b15a-4e806a87521c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action" status: 202 len: 0 microversion: 2.1 time: 0.083070 Oct 17 14:07:31.030285 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3380/6775] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:07:30 2022] POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:31.039282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:31.039905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:31.045989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:31.046480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:31.046922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:31.047719 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:31.048248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:31.048730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:31.219486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:31.227961 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-236d69b0-5104-438f-a2f1-436d359fc886 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1498 microversion: 2.1 time: 0.193265 Oct 17 14:07:31.228547 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3396/6776] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:31 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:32.252838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:32.253557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:32.260756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:32.261277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:32.261723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:32.262421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:32.262877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:32.263307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:32.393455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:32.401451 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49963ce1-6f22-422b-8fc1-68775048726c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1498 microversion: 2.1 time: 0.153768 Oct 17 14:07:32.402035 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3381/6777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:32 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:33.424868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:33.425520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:33.432703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.433233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.433679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.434394 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.434867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.435289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.563678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:33.572047 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6efcae45-1dfb-49c8-957b-e909d0ad067f tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1501 microversion: 2.1 time: 0.151125 Oct 17 14:07:33.572615 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3397/6778] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:33 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:33.594779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:33.595327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:33.602425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.602918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.603365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.604072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.604534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.604971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.628722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lazy-loading 'flavor' on Instance uuid cdde610e-4b2b-4ed4-9af1-629937beaace {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:07:33.694068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:33.706087 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c21fb6aa-8292-4782-be72-d26417508b38 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action" status: 202 len: 0 microversion: 2.1 time: 0.115112 Oct 17 14:07:33.706735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3382/6779] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:07:33 2022] POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:33.715411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:33.716018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:33.723060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.723747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.724378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.725082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:33.725822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:33.726065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:33.864236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:33.873148 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de9b76bc-0110-4c99-a7fa-e50cff63763c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1509 microversion: 2.1 time: 0.161880 Oct 17 14:07:33.873748 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3398/6780] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:33 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:34.899817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:34.900434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:34.907211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:34.907706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:34.908147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:34.908858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:34.909362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:34.909796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.042283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:35.050184 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e294b1b8-6086-4f95-bc76-a543d7b57003 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1492 microversion: 2.1 time: 0.156614 Oct 17 14:07:35.050760 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3383/6781] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:34 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1492 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:35.074122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:35.074663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:35.080691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:35.081203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:35.081656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.082352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:35.082810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:35.083856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.154610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b68b9d4a-e41c-4526-a69f-8ea4c9ea0ac8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action" status: 202 len: 0 microversion: 2.1 time: 0.085021 Oct 17 14:07:35.155213 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3399/6782] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:07:35 2022] POST /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:07:35.163709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:35.164327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:35.170573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:35.171197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:35.171741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.172561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:35.172990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:35.173529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:35.357536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:35.365903 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-167f9ae3-1b77-4095-9a36-7c68c788da94 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1498 microversion: 2.1 time: 0.206404 Oct 17 14:07:35.366472 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3384/6783] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:35 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1498 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:36.391148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:36.391774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:36.398953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.399539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.399879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.400582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:36.401041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:36.401498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:36.534827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:36.542898 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a62e996-602b-412c-a5ba-c3709316f95c tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1498 microversion: 2.1 time: 0.157065 Oct 17 14:07:36.543474 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3400/6784] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:36 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:37.566685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:37.567325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:37.570341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:37.575580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:37.576061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:37.576498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:37.577217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:37.577674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:37.578099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:37.715740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:37.724553 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-131aac58-d931-4788-85f0-bd9fe7803a51 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1501 microversion: 2.1 time: 0.160975 Oct 17 14:07:37.725137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3385/6785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:37 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:37.747058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:37.747583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:37.754553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:37.755555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:37.756257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:37.756977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:37.757464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:37.757895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:37.783985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:07:37.786824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:37.863578 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79cede44-8cbf-4523-8801-9164883e2ddc tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 204 len: 0 microversion: 2.1 time: 0.119998 Oct 17 14:07:37.864090 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3401/6786] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:07:37 2022] DELETE /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:07:37.872604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:37.873260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:37.879328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:37.880595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:37.880747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:37.881732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:37.882195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:37.882628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:38.015851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:38.024603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e6660eb-d4d3-48dd-a8c3-f8d7c1c94d6e tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1507 microversion: 2.1 time: 0.155903 Oct 17 14:07:38.025184 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3386/6787] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:37 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:39.048428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:39.049196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:39.056258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:39.056757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:39.057223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:39.057929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:39.058393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:39.058825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:39.192657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:39.200554 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-775d8955-accb-44b6-9ef4-1a762062377a tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1507 microversion: 2.1 time: 0.156430 Oct 17 14:07:39.201123 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3402/6788] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:39 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:40.224107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:40.224811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:40.231924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:40.232474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:40.232928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:40.233688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:40.234152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:40.234590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:40.431068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '276e6c60153842e3834d84f44a7af758', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '695bf2fb14e3485fb528cc744646418e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:07:40.439008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7aa0a49-b77a-4012-9c98-bfb71d1773f7 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 200 len: 1507 microversion: 2.1 time: 0.218845 Oct 17 14:07:40.439641 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3387/6789] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:40 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:07:40.645602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-145422e4-c4c2-493f-8048-2a74c6eeb2e0 req-74823bc7-e842-455b-82c2-3b0b0b9175ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdde610e-4b2b-4ed4-9af1-629937beaace", "name": "network-vif-deleted", "tag": "4f42b64e-95c9-43bf-8095-9da54bf63db5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:40.656749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-145422e4-c4c2-493f-8048-2a74c6eeb2e0 req-74823bc7-e842-455b-82c2-3b0b0b9175ca service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:40.657783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-145422e4-c4c2-493f-8048-2a74c6eeb2e0 req-74823bc7-e842-455b-82c2-3b0b0b9175ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:40.658291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-145422e4-c4c2-493f-8048-2a74c6eeb2e0 req-74823bc7-e842-455b-82c2-3b0b0b9175ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:40.670902 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-145422e4-c4c2-493f-8048-2a74c6eeb2e0 req-74823bc7-e842-455b-82c2-3b0b0b9175ca service nova] Creating event network-vif-deleted:4f42b64e-95c9-43bf-8095-9da54bf63db5 for instance cdde610e-4b2b-4ed4-9af1-629937beaace on n-h2-854121-14 Oct 17 14:07:40.676031 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-145422e4-c4c2-493f-8048-2a74c6eeb2e0 req-74823bc7-e842-455b-82c2-3b0b0b9175ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034122 Oct 17 14:07:40.676691 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3403/6790] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:07:41.463636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:07:41.464260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] [instance: cdde610e-4b2b-4ed4-9af1-629937beaace] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:07:41.471562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:41.472051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:41.472495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:41.473217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:07:41.473676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:07:41.474750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:07:41.488498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] HTTP exception thrown: Instance cdde610e-4b2b-4ed4-9af1-629937beaace could not be found. Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Request method failure captured: Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace HTTP/1.1 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWGTXRrU69kbN85W2ynaSfluoI8nX3czk76G1R43UgvJ99sOXE8IusYatbqzebidGYT0KVBPyDvoq-HJ2cHFPGz0jbqOThB5teqDs84cWD8gqAn4S9bWjrkEjJHoOKPcb3fKYJQM7UEB5x84-Fqk3o8bdat3PvyAsd6fC2MRnnIubcQ Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 695bf2fb14e3485fb528cc744646418e Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestServerAdvancedOps-1752497907 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/695bf2fb14e3485fb528cc744646418e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/695bf2fb14e3485fb528cc744646418e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/695bf2fb14e3485fb528cc744646418e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_695bf2fb14e3485fb528cc744646418e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestServerAdvancedOps-1752497907 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 695bf2fb14e3485fb528cc744646418e Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestServerAdvancedOps-1752497907 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestServerAdvancedOps-1752497907-project Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 276e6c60153842e3834d84f44a7af758 Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestServerAdvancedOps-1752497907-project Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance cdde610e-4b2b-4ed4-9af1-629937beaace could not be found. Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'cdde610e-4b2b-4ed4-9af1-629937beaace'} Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdde610e-4b2b-4ed4-9af1-629937beaace could not be found. Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdde610e-4b2b-4ed4-9af1-629937beaace could not be found. Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:07:41.490465 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdde610e-4b2b-4ed4-9af1-629937beaace could not be found. Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] Returning 404 to user: Instance cdde610e-4b2b-4ed4-9af1-629937beaace could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd31332d-3e2f-4b46-ae6a-14c0b54808d8 tempest-TestServerAdvancedOps-1752497907 tempest-TestServerAdvancedOps-1752497907-project] 10.222.0.65 "GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace" status: 404 len: 111 microversion: 2.1 time: 0.032366 Oct 17 14:07:41.494336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3388/6791] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:07:41 2022] GET /compute/v2.1/servers/cdde610e-4b2b-4ed4-9af1-629937beaace => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:07:55.469274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:55.470214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:07:55.475237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-862099505", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8563d9c6-1e00-4dd9-a00c-17bc4070400a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:07:55.539830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:08:05.499020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:59.738711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:59.739511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=32 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:08:59.740924 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:08:59.741093 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:08:59.745480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-890183994", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c8cb84eb-544f-4650-a13a-4df71672419a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:08:59.809047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:09:00.179430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:09:00.179859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:09:00.180337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:09:00.180747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:09:00.181178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:09:00.190850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:00.191350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:00.191799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:00.192546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:00.193153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:00.193641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:00.211322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:09:00.216849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:09:00.278676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:09:00.280703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8cb84eb-544f-4650-a13a-4df71672419a',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:09:00.409345 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c29c05d0-d871-494b-a7bb-c974534b8bf5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672616 Oct 17 14:09:00.410492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3389/6792] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:08:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:09:00.422943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d32d6087-ad2b-4d1e-9d18-89456ec0892b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:00.423628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d32d6087-ad2b-4d1e-9d18-89456ec0892b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:00.480797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d32d6087-ad2b-4d1e-9d18-89456ec0892b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:00.487986 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d32d6087-ad2b-4d1e-9d18-89456ec0892b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1056 microversion: 2.1 time: 0.070537 Oct 17 14:09:00.488785 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3390/6793] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:00 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:01.515198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:01.517183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:01.528100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:01.528601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:01.529102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:01.529863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:01.530322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:01.530783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:01.598477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:01.606704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ebdbd99-3e46-42bf-94d2-bcb7bf5adfeb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1172 microversion: 2.1 time: 0.098209 Oct 17 14:09:01.607359 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3391/6794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:01 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1172 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:02.640377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:02.642381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:02.650482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:02.651215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:02.651951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:02.653455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:02.654079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:02.654750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:02.808485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:02.817495 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e6a72ed-633b-41d1-97b5-bfe85d82a324 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1214 microversion: 2.1 time: 0.188600 Oct 17 14:09:02.818143 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3392/6795] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:02 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:03.045253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a127e00e-4c64-4a1f-b7aa-9c2d1ab2fa1a req-70045a3d-e5ba-4679-8579-bf64ed70d29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f89ce1-3893-43b1-be09-c5895201dd0a", "tag": "6178d427-8cfe-4787-9ed0-e5244f0bf51c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:03.056114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a127e00e-4c64-4a1f-b7aa-9c2d1ab2fa1a req-70045a3d-e5ba-4679-8579-bf64ed70d29b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:03.056722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a127e00e-4c64-4a1f-b7aa-9c2d1ab2fa1a req-70045a3d-e5ba-4679-8579-bf64ed70d29b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:03.057288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a127e00e-4c64-4a1f-b7aa-9c2d1ab2fa1a req-70045a3d-e5ba-4679-8579-bf64ed70d29b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:03.070847 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a127e00e-4c64-4a1f-b7aa-9c2d1ab2fa1a req-70045a3d-e5ba-4679-8579-bf64ed70d29b service nova] Creating event network-changed:6178d427-8cfe-4787-9ed0-e5244f0bf51c for instance 13f89ce1-3893-43b1-be09-c5895201dd0a on n-h1-854121-14 Oct 17 14:09:03.076034 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a127e00e-4c64-4a1f-b7aa-9c2d1ab2fa1a req-70045a3d-e5ba-4679-8579-bf64ed70d29b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191139 Oct 17 14:09:03.076892 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3393/6796] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:09:03.845129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:03.846939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:03.853759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:03.854258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:03.854703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:03.855423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:03.856071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:03.856667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:04.005876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:04.014263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8f58bd9-8a89-4812-8610-f65adc821e40 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1214 microversion: 2.1 time: 0.176356 Oct 17 14:09:04.015121 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3394/6797] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:03 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1214 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:05.037783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:05.038423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:05.045379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:05.045885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:05.046332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:05.047176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:05.047669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:05.048093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:05.186409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:05.195097 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12771cb4-fbe9-4b92-98b5-240132b803f4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1214 microversion: 2.1 time: 0.161387 Oct 17 14:09:05.195688 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3395/6798] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:05 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:06.217966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:06.218643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:06.226806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:06.227303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:06.227748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:06.228463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:06.228927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:06.229388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:06.379475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:06.392392 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c1f8477-6586-4c79-bd9f-1de2d5b57323 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1214 microversion: 2.1 time: 0.177939 Oct 17 14:09:06.393364 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3396/6799] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:06 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1214 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:07.416991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:07.417696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:07.425711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:07.426208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:07.426725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:07.427452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:07.428022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:07.428458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:07.563498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:07.571322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-043e0c38-ef65-438e-8473-cfd96d67405f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.159005 Oct 17 14:09:07.571901 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3397/6800] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:07 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:08.594395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:08.595044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:08.601956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:08.602443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:08.602894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:08.603591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:08.604048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:08.604483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:08.735674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:08.743523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-922d92d7-4be8-47ef-a348-fa44299fd75a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.153144 Oct 17 14:09:08.744097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3398/6801] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:08 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:09.768290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:09.768993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:09.776299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:09.776802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:09.777274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:09.778040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:09.778505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:09.778942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:09.915452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:09.923394 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b0db36e-5a4f-4b90-b83b-09d9a6e8509b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.159885 Oct 17 14:09:09.923967 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3399/6802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:09 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:10.945779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:10.946414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:10.948396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:10.949085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:10.956239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:10.956725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:10.957190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:10.957887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:10.958340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:10.958766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:11.095594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:11.103480 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0ae23f3-d0d0-472b-8622-0c76bd4197a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.161684 Oct 17 14:09:11.104067 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3400/6803] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:10 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:12.127627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:12.128428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:12.135619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:12.136087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:12.136534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:12.137272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:12.137727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:12.138156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:12.270369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:12.278218 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fbc5c32-d851-480a-aac4-a59bea600703 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.155198 Oct 17 14:09:12.278792 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3401/6804] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:12 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:13.302095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:13.302750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:13.309539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:13.310027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:13.310468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:13.311167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:13.311625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:13.312059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:13.449792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:13.458144 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34247798-c77d-4e06-97ee-694f3945c5c0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.160099 Oct 17 14:09:13.458727 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3402/6805] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:13 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:14.481711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:14.482339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:14.489502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:14.489998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:14.490447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:14.491155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:14.491620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:14.492064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:14.628550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:14.636843 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bca332bd-312a-43e5-812a-fc5e19b0f1cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.159010 Oct 17 14:09:14.637459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3403/6806] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:14 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:15.660741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:15.661414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:15.668400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:15.668979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:15.669493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:15.670239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:15.670702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:15.671136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:15.806242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:15.814478 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e667394a-749c-4ef4-a50d-a0a811312146 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.158400 Oct 17 14:09:15.815060 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3404/6807] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:15 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:16.838925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:16.839533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:16.847290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:16.847794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:16.848243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:16.848953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:16.849438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:16.849878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:16.983580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:16.992603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f5545b7-7522-4f16-8711-0ef711fc4f44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.157851 Oct 17 14:09:16.993207 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3405/6808] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:16 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:17.334779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-53f9343c-8ff2-41e3-addc-79f523973304 req-886c6888-7bc7-4603-ac01-3737706818da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f89ce1-3893-43b1-be09-c5895201dd0a", "name": "network-vif-plugged", "status": "completed", "tag": "6178d427-8cfe-4787-9ed0-e5244f0bf51c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:17.345870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-53f9343c-8ff2-41e3-addc-79f523973304 req-886c6888-7bc7-4603-ac01-3737706818da service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:17.346374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-53f9343c-8ff2-41e3-addc-79f523973304 req-886c6888-7bc7-4603-ac01-3737706818da service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:17.346872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-53f9343c-8ff2-41e3-addc-79f523973304 req-886c6888-7bc7-4603-ac01-3737706818da service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:17.358436 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-53f9343c-8ff2-41e3-addc-79f523973304 req-886c6888-7bc7-4603-ac01-3737706818da service nova] Creating event network-vif-plugged:6178d427-8cfe-4787-9ed0-e5244f0bf51c for instance 13f89ce1-3893-43b1-be09-c5895201dd0a on n-h1-854121-14 Oct 17 14:09:17.364256 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-53f9343c-8ff2-41e3-addc-79f523973304 req-886c6888-7bc7-4603-ac01-3737706818da service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 Oct 17 14:09:17.364866 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3406/6809] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:18.017222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:18.017940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:18.024275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:18.024767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:18.025232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:18.025939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:18.026401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:18.026834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:18.162892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:18.170941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ead447f-d036-47a0-840c-0f277bf2d7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1202 microversion: 2.1 time: 0.159745 Oct 17 14:09:18.171804 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3407/6810] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:18 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:19.194588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:19.195261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:19.202112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.202598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.203382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.204099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.204562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.204998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.224528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:19.339838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:19.348618 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57018849-1372-4ae9-b93e-e8300ff7f869 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1390 microversion: 2.1 time: 0.158082 Oct 17 14:09:19.349213 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3408/6811] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:19 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:19.370801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:19.371415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:19.377374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.377868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.378316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.379022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.379482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.379916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.513107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:19.521936 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3cc17b84-22aa-4402-9351-bde4b19e9621 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1390 microversion: 2.1 time: 0.154803 Oct 17 14:09:19.522535 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3409/6812] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:19 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:19.544191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:19.544812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:19.551014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.551498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.551939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.552649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.553201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.553571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.690261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:19.698341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3bbf0a5c-85ce-4e4d-8835-24ae862de4b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1390 microversion: 2.1 time: 0.158023 Oct 17 14:09:19.699032 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3410/6813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:19 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:19.722054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:19.722564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:19.728878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.729415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.729863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.730576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.731037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.731469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.757805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:09:19.841856 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab67d5eb-9912-47f4-9ce9-8486fb44523b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 204 len: 0 microversion: 2.1 time: 0.124021 Oct 17 14:09:19.842443 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3411/6814] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:09:19 2022] DELETE /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:09:19.851307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:19.852624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:19.862893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.863393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.863842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:19.864552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:19.865015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:19.865497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:20.004488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:20.014142 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af4df9dc-f0d0-40b7-86c9-d7bf13f2970d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1396 microversion: 2.1 time: 0.166984 Oct 17 14:09:20.014771 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3412/6815] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:19 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1396 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:21.037969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:21.038635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:21.045641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:21.046126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:21.046652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:21.047460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:21.047922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:21.048379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:21.178580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:21.186792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-707d4330-c4d9-4650-a7a0-3047bf87a587 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1396 microversion: 2.1 time: 0.152777 Oct 17 14:09:21.187517 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3413/6816] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:21 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:21.745824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-39ead359-d884-41ad-a87a-676362ca9d21 req-1d4daa32-f0d7-406c-8748-6867b557270d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f89ce1-3893-43b1-be09-c5895201dd0a", "name": "network-vif-deleted", "tag": "6178d427-8cfe-4787-9ed0-e5244f0bf51c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:21.756553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-39ead359-d884-41ad-a87a-676362ca9d21 req-1d4daa32-f0d7-406c-8748-6867b557270d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:21.757040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-39ead359-d884-41ad-a87a-676362ca9d21 req-1d4daa32-f0d7-406c-8748-6867b557270d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:21.757511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-39ead359-d884-41ad-a87a-676362ca9d21 req-1d4daa32-f0d7-406c-8748-6867b557270d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:21.773469 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-39ead359-d884-41ad-a87a-676362ca9d21 req-1d4daa32-f0d7-406c-8748-6867b557270d service nova] Creating event network-vif-deleted:6178d427-8cfe-4787-9ed0-e5244f0bf51c for instance 13f89ce1-3893-43b1-be09-c5895201dd0a on n-h1-854121-14 Oct 17 14:09:21.778774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-39ead359-d884-41ad-a87a-676362ca9d21 req-1d4daa32-f0d7-406c-8748-6867b557270d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036726 Oct 17 14:09:21.779394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3414/6817] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:09:22.211891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:22.212582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:22.219082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:22.219582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:22.220030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:22.220741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:22.221261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:22.221661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:22.289045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:22.297196 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39f2bb7a-b61e-4a56-a210-e62bc623af99 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1187 microversion: 2.1 time: 0.090827 Oct 17 14:09:22.298005 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3415/6818] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:22 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:23.320486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:23.321232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:23.328978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:23.329488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:23.329930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:23.330633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:23.331088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:23.331512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:23.397573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:23.406022 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1ddfaa9-0bef-495c-b56e-14ad0d99f2fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1187 microversion: 2.1 time: 0.089297 Oct 17 14:09:23.407121 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3416/6819] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:23 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:24.429509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:24.430165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:24.437065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:24.437591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:24.438034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:24.438742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:24.439200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:24.439643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:24.502632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:24.511336 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2abce67-4f56-4082-80c2-a75b52286b91 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1187 microversion: 2.1 time: 0.085827 Oct 17 14:09:24.511932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3417/6820] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:24 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:25.534287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:25.534957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:25.542137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:25.542640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:25.543111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:25.543861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:25.544371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:25.544810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:25.608194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:25.616777 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bee96d29-5355-4c25-851f-88409e664186 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 200 len: 1187 microversion: 2.1 time: 0.087042 Oct 17 14:09:25.617394 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3418/6821] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:25 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:26.640248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:26.640895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 13f89ce1-3893-43b1-be09-c5895201dd0a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:26.648453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:26.648941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:26.649424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:26.650127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:26.650582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:26.651015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:26.665635 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 13f89ce1-3893-43b1-be09-c5895201dd0a could not be found. Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a HTTP/1.1 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 13f89ce1-3893-43b1-be09-c5895201dd0a could not be found. Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '13f89ce1-3893-43b1-be09-c5895201dd0a'} Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f89ce1-3893-43b1-be09-c5895201dd0a could not be found. Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f89ce1-3893-43b1-be09-c5895201dd0a could not be found. Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:09:26.667307 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f89ce1-3893-43b1-be09-c5895201dd0a could not be found. Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 13f89ce1-3893-43b1-be09-c5895201dd0a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67190aab-c878-40f8-b9bf-84239755cef7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a" status: 404 len: 111 microversion: 2.1 time: 0.032503 Oct 17 14:09:26.672331 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3419/6822] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:26 2022] GET /compute/v2.1/servers/13f89ce1-3893-43b1-be09-c5895201dd0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:09:47.689356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-316091312", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "845cac0a-8740-4059-be0f-ba74fc068fcc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:47.699970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:47.700623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:47.784583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:09:48.267845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:09:48.268309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:09:48.268800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:09:48.269265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:09:48.269691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:09:48.278713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:48.279202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:48.279708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:48.280500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:48.280966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:48.281433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:48.298813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:09:48.304106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:09:48.317129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:09:48.319227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='845cac0a-8740-4059-be0f-ba74fc068fcc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:09:48.392984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92c28742-835a-4a0a-a59c-0c1f6acc4dff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707962 Oct 17 14:09:48.393711 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3420/6823] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:09:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:09:48.405629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6deb74cd-7760-41c3-ad90-f147733c0a95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:48.406255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6deb74cd-7760-41c3-ad90-f147733c0a95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:48.465572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6deb74cd-7760-41c3-ad90-f147733c0a95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:48.473491 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6deb74cd-7760-41c3-ad90-f147733c0a95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1056 microversion: 2.1 time: 0.072394 Oct 17 14:09:48.474059 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3421/6824] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:48 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:49.496929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:49.497640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:49.505730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:49.506225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:49.506674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:49.507392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:49.507855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:49.508295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:49.572793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:49.580656 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e867410f-e200-4c1b-a815-56522c600315 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1060 microversion: 2.1 time: 0.087790 Oct 17 14:09:49.581263 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3422/6825] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:49 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1060 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:50.603289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:50.604018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:50.611521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:50.612270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:50.612892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:50.613798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:50.614566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:50.615155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:50.689090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:50.699965 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a13b386-daab-4756-8042-40220c4bc382 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1126 microversion: 2.1 time: 0.100678 Oct 17 14:09:50.700750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3423/6826] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:50 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1126 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:51.725042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:51.725709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:51.733689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:51.734332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:51.734773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:51.735515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:51.736151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:51.736581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:51.890873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:51.900032 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d34c62e-c30b-4ebb-97f1-76745be0d483 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.179050 Oct 17 14:09:51.900624 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3424/6827] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:51 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:51.905440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-debb85e5-d6f1-4746-bd08-445fbdf40d37 req-24415903-cb96-486d-8a48-e19b14fd7d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c954a35b-23be-45df-ad8b-e5f5463697bf", "tag": "78da5504-3677-439f-936d-ac96bc347fd9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:09:51.915500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-debb85e5-d6f1-4746-bd08-445fbdf40d37 req-24415903-cb96-486d-8a48-e19b14fd7d9b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:51.916240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-debb85e5-d6f1-4746-bd08-445fbdf40d37 req-24415903-cb96-486d-8a48-e19b14fd7d9b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:51.916842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-debb85e5-d6f1-4746-bd08-445fbdf40d37 req-24415903-cb96-486d-8a48-e19b14fd7d9b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:51.929516 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-debb85e5-d6f1-4746-bd08-445fbdf40d37 req-24415903-cb96-486d-8a48-e19b14fd7d9b service nova] Creating event network-changed:78da5504-3677-439f-936d-ac96bc347fd9 for instance c954a35b-23be-45df-ad8b-e5f5463697bf on n-h1-854121-14 Oct 17 14:09:51.934555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-debb85e5-d6f1-4746-bd08-445fbdf40d37 req-24415903-cb96-486d-8a48-e19b14fd7d9b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032580 Oct 17 14:09:51.935161 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3425/6828] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:09:52.924877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:52.925620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:52.932035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:52.932526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:52.932977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:52.933718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:52.934185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:52.934606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:53.072796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:53.081798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bf984f1-f100-4e49-81b6-d3c03252611b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.162438 Oct 17 14:09:53.082393 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3426/6829] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:52 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:54.104291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:54.105131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:54.112507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:54.113126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:54.113713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:54.114516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:54.115148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:54.115685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:54.307491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:54.324994 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-27fc074f-f00f-4e35-bfbf-1165e4848a13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.223973 Oct 17 14:09:54.336529 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3427/6830] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:54 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:55.357710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:55.358392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:55.367555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:55.368130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:55.368500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:55.369250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:55.369747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:55.370220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:55.578095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:55.588824 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f70fcb10-385b-4fbc-82d4-4d254d4bc7e2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.234226 Oct 17 14:09:55.589639 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3428/6831] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:55 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:09:56.615491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:56.616860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:56.625236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:56.625744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:56.626186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:56.626894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:56.627355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:56.627772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:56.778844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:56.787287 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b9ea788-c5d0-4643-a533-01e852386618 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.175821 Oct 17 14:09:56.787896 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3429/6832] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:56 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:57.810347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:57.811051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:57.819244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:57.819704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:57.820407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:57.821237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:57.821781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:57.822290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:57.969815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:57.977998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd2988f5-ee6a-4d85-a77a-6e3d77121b67 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.171900 Oct 17 14:09:57.989804 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3430/6833] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:57 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:09:59.004408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:09:59.005317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:09:59.007317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:59.008010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:09:59.016038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:59.016521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:59.016958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:59.017681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:09:59.018135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:09:59.018560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:09:59.151965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:09:59.160344 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ba01debd-32b6-4704-b3dc-fac8c230b2d9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.160043 Oct 17 14:09:59.160927 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3431/6834] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:09:58 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:00.183465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:00.184074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:00.191433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:00.192039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:00.192457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:00.193194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:00.193658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:00.194092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:00.330659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:00.340881 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8febeee1-ba3f-4082-8172-e4e6833d7087 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.161411 Oct 17 14:10:00.341519 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3432/6835] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:00 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:01.364785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:01.365480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:01.372431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:01.372998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:01.373464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:01.374244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:01.374701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:01.375127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:01.534717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:01.543172 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-242db25f-0fd7-4bb7-a495-80a1de55794f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.182325 Oct 17 14:10:01.544085 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3433/6836] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:01 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:02.567773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:02.568442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:02.575881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:02.577017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:02.577646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:02.578440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:02.578981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:02.579490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:02.715620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:02.723914 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3edc1178-f5d1-4f8b-b9f2-bd0359c3bad4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.160748 Oct 17 14:10:02.724511 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3434/6837] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:02 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:03.746967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:03.747680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:03.755427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:03.755920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:03.756370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:03.757082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:03.757569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:03.758001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:03.898006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:03.906556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c699d076-35d9-4ee3-b6b2-642d6f91f6ac tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1168 microversion: 2.1 time: 0.163610 Oct 17 14:10:03.907141 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3435/6838] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:03 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:04.930214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:04.930843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:04.937938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:04.938447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:04.938893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:04.939607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:04.940080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:04.940514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:05.081151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:05.089696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0ed03cad-f9db-440f-b32e-8ccac3301ec9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1214 microversion: 2.1 time: 0.163471 Oct 17 14:10:05.090679 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3436/6839] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:04 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:06.114513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:06.115206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:06.122177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:06.123406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:06.123894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:06.124609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:06.125073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:06.125609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:06.258490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:06.266492 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-abe76f99-231f-4bf8-81f9-c8017b159889 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.155978 Oct 17 14:10:06.267072 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3437/6840] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:06 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:07.289441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:07.290115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:07.297304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:07.297792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:07.298233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:07.298930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:07.299388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:07.299823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:07.433421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:07.437543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:07.442943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89bb4f31-9200-4a97-b591-7de79e3a73e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.157482 Oct 17 14:10:07.443670 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3438/6841] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:07 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:08.465412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:08.466171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:08.474195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:08.474762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:08.475205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:08.475902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:08.476358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:08.476794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:08.610525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:08.618684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c3b4ecd-4d35-4d5a-8bf8-3a0c7b013d6b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.157254 Oct 17 14:10:08.619268 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3439/6842] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:08 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:09.642914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:09.643569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:09.650673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:09.651161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:09.651606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:09.652310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:09.652768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:09.653228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:09.792873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:09.801039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-473a49ed-c0db-44de-acde-6eb2258e14b9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.162133 Oct 17 14:10:09.801658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3440/6843] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:09 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:10.825021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:10.825766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:10.832814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:10.833350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:10.833801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:10.834507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:10.834967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:10.835408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:10.967049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:10.974906 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db282e07-d102-44ed-97f6-21938fe2ee02 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.154946 Oct 17 14:10:10.975477 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3441/6844] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:10 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:11.999050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:11.999708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:12.006952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:12.007445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:12.007888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:12.008594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:12.009056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:12.009520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:12.146977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:12.154834 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0342a5de-fff8-4ecd-9d71-91438f443e58 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.160439 Oct 17 14:10:12.155402 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3442/6845] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:11 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:13.177985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:13.178654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:13.186357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.186836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.187271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.187965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:13.188415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:13.188840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:13.319870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:13.327896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9f9eefc-1819-43de-b22d-a154d0f623db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.153824 Oct 17 14:10:13.328486 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3443/6846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:13 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:14.351111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:14.351780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:14.359249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:14.359737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:14.360180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:14.361031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:14.361517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:14.361949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:14.491811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:14.500074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80c2650d-ae0e-4965-a51c-e0ff099071e0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.152884 Oct 17 14:10:14.500664 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3444/6847] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:14 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:15.524192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:15.524840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:15.532487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.532907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.533372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:15.534075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.534526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.534948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:15.678421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:15.687074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6bc5dfde-c0be-4136-ba47-e718c60b2739 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.166906 Oct 17 14:10:15.687660 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3445/6848] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:15 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:15.692252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-49ae4dc6-9d55-42cc-b7fb-3f44e6bf96a2 req-fd629261-49fe-4247-a61d-24fbf54c1141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c954a35b-23be-45df-ad8b-e5f5463697bf", "name": "network-vif-plugged", "status": "completed", "tag": "78da5504-3677-439f-936d-ac96bc347fd9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:15.703431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-49ae4dc6-9d55-42cc-b7fb-3f44e6bf96a2 req-fd629261-49fe-4247-a61d-24fbf54c1141 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:15.704048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-49ae4dc6-9d55-42cc-b7fb-3f44e6bf96a2 req-fd629261-49fe-4247-a61d-24fbf54c1141 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:15.704862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-49ae4dc6-9d55-42cc-b7fb-3f44e6bf96a2 req-fd629261-49fe-4247-a61d-24fbf54c1141 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:15.721896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-49ae4dc6-9d55-42cc-b7fb-3f44e6bf96a2 req-fd629261-49fe-4247-a61d-24fbf54c1141 service nova] Creating event network-vif-plugged:78da5504-3677-439f-936d-ac96bc347fd9 for instance c954a35b-23be-45df-ad8b-e5f5463697bf on n-h1-854121-14 Oct 17 14:10:15.728262 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-49ae4dc6-9d55-42cc-b7fb-3f44e6bf96a2 req-fd629261-49fe-4247-a61d-24fbf54c1141 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038974 Oct 17 14:10:15.729034 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3446/6849] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:16.711666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:16.712359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:16.718656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:16.719139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:16.719575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:16.720258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:16.720710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:16.721134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:16.872473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:16.880917 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be663f9b-e2ca-4c42-8452-dd973739860f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1202 microversion: 2.1 time: 0.174424 Oct 17 14:10:16.881575 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3447/6850] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:16 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1202 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:17.903579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:17.904197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:17.906801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:17.912749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:17.913607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:17.914121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:17.915056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:17.915550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:17.915985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.055772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:18.064749 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7c71254-0072-477d-bc58-d60dfd3b203b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1390 microversion: 2.1 time: 0.165403 Oct 17 14:10:18.065354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3448/6851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:17 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:18.086630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:18.087239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:18.093185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.093677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.094115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.094810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.095274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.095701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.224818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:18.233425 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-298956bb-5fae-4804-824f-6bebcd7c4332 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1390 microversion: 2.1 time: 0.150583 Oct 17 14:10:18.234011 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3449/6852] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:18 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:18.255689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:18.256296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:18.262222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.262712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.263153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.264021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.264487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.264915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.399474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:18.408254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e68cb87e-9889-4cb1-995d-32224ecee648 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1390 microversion: 2.1 time: 0.156597 Oct 17 14:10:18.408831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3450/6853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:18 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:18.489075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:18.489605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:18.495725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.496206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.496645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.497504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.497963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.498399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.524840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:10:18.601201 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-842be4bf-be64-4ff3-a3b7-ea2bce2b10fa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 204 len: 0 microversion: 2.1 time: 0.115812 Oct 17 14:10:18.602015 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3451/6854] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:10:18 2022] DELETE /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:10:18.611182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:18.611888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:18.618640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.619140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.619614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.620475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:18.620839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:18.621297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:18.758362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:18.766868 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3b6a039-f426-4367-adc9-5f23c034fe18 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1396 microversion: 2.1 time: 0.160758 Oct 17 14:10:18.767462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3452/6855] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:18 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:19.790831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:19.791501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:19.798748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:19.799239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:19.799680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:19.800382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:19.800840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:19.801297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:19.937897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:19.945925 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-859a21cc-b6d8-4d34-a256-43279c310822 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1396 microversion: 2.1 time: 0.159190 Oct 17 14:10:19.946513 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3453/6856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:19 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1396 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:20.527163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e801ca6c-be43-4ba1-9d25-e6b09c84f477 req-09820dc5-dc29-4e5a-8352-a1b1f0f957e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c954a35b-23be-45df-ad8b-e5f5463697bf", "name": "network-vif-deleted", "tag": "78da5504-3677-439f-936d-ac96bc347fd9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:20.540096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e801ca6c-be43-4ba1-9d25-e6b09c84f477 req-09820dc5-dc29-4e5a-8352-a1b1f0f957e6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:20.540855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e801ca6c-be43-4ba1-9d25-e6b09c84f477 req-09820dc5-dc29-4e5a-8352-a1b1f0f957e6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:20.541481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e801ca6c-be43-4ba1-9d25-e6b09c84f477 req-09820dc5-dc29-4e5a-8352-a1b1f0f957e6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:20.558692 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e801ca6c-be43-4ba1-9d25-e6b09c84f477 req-09820dc5-dc29-4e5a-8352-a1b1f0f957e6 service nova] Creating event network-vif-deleted:78da5504-3677-439f-936d-ac96bc347fd9 for instance c954a35b-23be-45df-ad8b-e5f5463697bf on n-h1-854121-14 Oct 17 14:10:20.565563 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e801ca6c-be43-4ba1-9d25-e6b09c84f477 req-09820dc5-dc29-4e5a-8352-a1b1f0f957e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042194 Oct 17 14:10:20.566576 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3454/6857] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:10:20.970131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:20.970869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:20.978578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:20.979080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:20.979527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:20.980238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:20.980697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:20.981132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:20.986257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:21.052973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:21.061821 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-43efb89d-2a01-4508-9db1-54add3bca5ae tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1187 microversion: 2.1 time: 0.096223 Oct 17 14:10:21.062405 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3455/6858] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:20 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:22.084224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:22.084862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:22.092648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:22.093546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:22.094003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:22.094721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:22.095187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:22.095625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:22.162357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:22.171390 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53d6beca-d007-4e1c-b091-4c877f8061b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1187 microversion: 2.1 time: 0.091049 Oct 17 14:10:22.171984 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3456/6859] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:22 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:23.194872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:23.195549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:23.202725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:23.203220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:23.203672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:23.204377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:23.204838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:23.205297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:23.268817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:23.276770 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-059f901c-6aa5-4b1b-a1cf-0e279f83561d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1187 microversion: 2.1 time: 0.085924 Oct 17 14:10:23.277381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3457/6860] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:23 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:24.300442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:24.301151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:24.309930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:24.311096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:24.311534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:24.312263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:24.312712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:24.313136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:24.375539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:24.384176 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a763cde8-8f11-4cad-90f6-2cf1a3d99dc7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 200 len: 1187 microversion: 2.1 time: 0.087701 Oct 17 14:10:24.384762 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3458/6861] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:24 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:25.411539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:25.412215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:25.420202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:25.420707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:25.421308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:25.421915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:25.422377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:25.422870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:25.437970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf HTTP/1.1 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c954a35b-23be-45df-ad8b-e5f5463697bf'} Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:10:25.439684 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-485f1352-a587-4bb1-8411-1c6cc90fa346 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 404 len: 111 microversion: 2.1 time: 0.033679 Oct 17 14:10:25.443905 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3459/6862] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:25 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:10:27.589864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:27.590980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:27.598511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:27.599068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:27.599571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:27.600359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:27.600898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:27.601436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:27.617202 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf HTTP/1.1 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c954a35b-23be-45df-ad8b-e5f5463697bf'} Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:10:27.618915 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:10:27.623263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff267492-14cd-4857-adb2-1b8c30cef70c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 404 len: 111 microversion: 2.1 time: 0.036443 Oct 17 14:10:27.624621 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3460/6863] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:10:27 2022] DELETE /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:10:27.632685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:27.633490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c954a35b-23be-45df-ad8b-e5f5463697bf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:27.640844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:27.641455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:27.641996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:27.642778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:27.643303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:27.643828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:27.658497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf HTTP/1.1 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c954a35b-23be-45df-ad8b-e5f5463697bf'} Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:10:27.660068 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance c954a35b-23be-45df-ad8b-e5f5463697bf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-86c994f4-1f6c-435d-8d12-8ec89127a6d2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf" status: 404 len: 111 microversion: 2.1 time: 0.032890 Oct 17 14:10:27.664362 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3461/6864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:27 2022] GET /compute/v2.1/servers/c954a35b-23be-45df-ad8b-e5f5463697bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:10:47.367759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2122693859", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "ffde7980-b47f-4705-a1fa-6ee7bc1b45e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:47.378598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:47.379287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=28 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:47.559917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:10:47.931635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:10:47.932064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:10:47.932546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:10:47.932988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:10:47.933438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:10:47.943119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:47.943606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:47.944046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:47.944774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:47.945264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:47.945696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:47.962932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:10:47.969528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:10:48.029765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:10:48.031891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ffde7980-b47f-4705-a1fa-6ee7bc1b45e0',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:10:48.162063 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c29ad078-486e-4d80-949b-0fa806ea4a00 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798332 Oct 17 14:10:48.162731 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3462/6865] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:10:48.174298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94add960-0ad3-4113-a215-64d1ed743037 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:48.174915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94add960-0ad3-4113-a215-64d1ed743037 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:48.232438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94add960-0ad3-4113-a215-64d1ed743037 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:48.240363 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94add960-0ad3-4113-a215-64d1ed743037 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1071 microversion: 2.1 time: 0.069928 Oct 17 14:10:48.240914 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3463/6866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:48 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1071 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:49.265276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:49.266089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:49.273853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:49.274350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:49.274791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:49.275521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:49.275978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:49.276409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:49.346512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:49.355330 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8999476c-426f-42a1-9568-4c7491dcb2cb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1177 microversion: 2.1 time: 0.095181 Oct 17 14:10:49.356230 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3464/6867] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:49 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1177 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:50.380235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:50.380853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:50.388576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:50.389364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:50.389809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:50.390517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:50.390968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:50.391395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:50.534552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:50.542975 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37bf0572-5b92-4371-af51-33658e654229 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1229 microversion: 2.1 time: 0.167033 Oct 17 14:10:50.543563 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3465/6868] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:50 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1229 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:50.708837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-375f0cef-031c-4ea0-abde-8039ca6857c7 req-0d5aa878-ae5c-44b7-af2a-0c6abaac9442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c76e3503-bc3d-4d4a-a40f-072aed1f7077", "tag": "18b4acda-a227-4af4-a98b-fa601128dcf9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:10:50.723317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-375f0cef-031c-4ea0-abde-8039ca6857c7 req-0d5aa878-ae5c-44b7-af2a-0c6abaac9442 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:50.735718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-375f0cef-031c-4ea0-abde-8039ca6857c7 req-0d5aa878-ae5c-44b7-af2a-0c6abaac9442 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:50.736203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-375f0cef-031c-4ea0-abde-8039ca6857c7 req-0d5aa878-ae5c-44b7-af2a-0c6abaac9442 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:50.753875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-375f0cef-031c-4ea0-abde-8039ca6857c7 req-0d5aa878-ae5c-44b7-af2a-0c6abaac9442 service nova] Creating event network-changed:18b4acda-a227-4af4-a98b-fa601128dcf9 for instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 on n-h1-854121-14 Oct 17 14:10:50.760558 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-375f0cef-031c-4ea0-abde-8039ca6857c7 req-0d5aa878-ae5c-44b7-af2a-0c6abaac9442 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055439 Oct 17 14:10:50.762025 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3466/6869] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:10:51.567322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:51.568007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:51.576097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:51.576583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:51.577228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:51.577951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:51.578401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:51.578995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:51.725892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:51.735746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-024000f7-6b44-430c-aaab-99d76ecb2e07 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1229 microversion: 2.1 time: 0.172972 Oct 17 14:10:51.746423 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3467/6870] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:51 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1229 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:10:52.759835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:52.760497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:52.767776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:52.768274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:52.768727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:52.769466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:52.769963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:52.770406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:52.906297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:52.914587 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d22c452d-3cfc-4184-a951-ae5336448c5e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1229 microversion: 2.1 time: 0.158710 Oct 17 14:10:52.915172 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3468/6871] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:52 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:53.939643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:53.940276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:53.947274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:53.947756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:53.948192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:53.948888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:53.949376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:53.949804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:54.084455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:54.093325 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30c33270-aba4-4e27-92c8-2e5af84cda92 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1229 microversion: 2.1 time: 0.157553 Oct 17 14:10:54.093939 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3469/6872] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:53 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:55.117376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:55.118058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:55.125618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:55.126112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:55.126569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:55.127272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:55.127735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:55.128165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:55.262015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:55.271249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-743e4697-e357-4b24-8b3e-5dc16d0832b8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.157919 Oct 17 14:10:55.271860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3470/6873] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:55 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:56.293778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:56.294498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:56.301731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:56.302211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:56.302648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:56.303333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:56.303785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:56.304207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:56.432791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:56.441248 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65806a2d-96e0-4ef2-8058-a98b6f1b4188 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.151466 Oct 17 14:10:56.441831 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3471/6874] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:56 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:57.463999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:57.464661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:57.472445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:57.472935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:57.473409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:57.474105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:57.474560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:57.474989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:57.610269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:57.618227 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b623dc21-7deb-4f30-9f44-f20c49f46c73 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.158272 Oct 17 14:10:57.618803 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3472/6875] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:57 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:58.641644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:58.642267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:58.644258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:58.644956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:10:58.652079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:58.652566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:58.653062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:58.653836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:58.654292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:58.654723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:58.786096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:58.794515 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9cbacede-3eaf-4b45-bc00-343fdf1a7fc2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.156417 Oct 17 14:10:58.795098 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3473/6876] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:58 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:10:59.817570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:10:59.818296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:10:59.826730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:59.827251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:59.827688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:59.828427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:10:59.828878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:10:59.829334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:10:59.964968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:10:59.973680 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dca250e2-0f54-4738-90d9-b845e88f2c7c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.160142 Oct 17 14:10:59.974264 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3474/6877] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:10:59 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:00.997568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:00.998235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:01.005515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:01.006001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:01.006438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:01.007134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:01.007589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:01.008018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:01.140229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:01.148132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f493bb8a-2dcc-457e-922b-0380301edd8c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.155150 Oct 17 14:11:01.148728 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3475/6878] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:00 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:02.171856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:02.172786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:02.179609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:02.180234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:02.180677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:02.181412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:02.181871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:02.182306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:02.314045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:02.321880 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-501e587c-d9f1-48e6-8c18-1b86f8f4df19 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.154726 Oct 17 14:11:02.322465 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3476/6879] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:02 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:03.345092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:03.345786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:03.352694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:03.353217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:03.353668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:03.354369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:03.354835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:03.355265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:03.487734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:03.495758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da00ae15-74f4-40c8-a9fc-89cb39eae6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.154761 Oct 17 14:11:03.496336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3477/6880] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:03 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:03.894123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-78d49dec-41d1-4720-a39d-59472b3e7d05 req-6d8cd833-51f6-489a-a7cb-b052f8adb4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76e3503-bc3d-4d4a-a40f-072aed1f7077", "name": "network-vif-plugged", "status": "completed", "tag": "18b4acda-a227-4af4-a98b-fa601128dcf9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:03.903953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-78d49dec-41d1-4720-a39d-59472b3e7d05 req-6d8cd833-51f6-489a-a7cb-b052f8adb4d0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:03.904441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-78d49dec-41d1-4720-a39d-59472b3e7d05 req-6d8cd833-51f6-489a-a7cb-b052f8adb4d0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:03.904877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-78d49dec-41d1-4720-a39d-59472b3e7d05 req-6d8cd833-51f6-489a-a7cb-b052f8adb4d0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:03.916637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-78d49dec-41d1-4720-a39d-59472b3e7d05 req-6d8cd833-51f6-489a-a7cb-b052f8adb4d0 service nova] Creating event network-vif-plugged:18b4acda-a227-4af4-a98b-fa601128dcf9 for instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 on n-h1-854121-14 Oct 17 14:11:03.922357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-78d49dec-41d1-4720-a39d-59472b3e7d05 req-6d8cd833-51f6-489a-a7cb-b052f8adb4d0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032174 Oct 17 14:11:03.922971 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3478/6881] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:11:04.521749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:04.522373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:04.530203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:04.532151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:04.532681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:04.533861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:04.534437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:04.535017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:04.673903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:04.682083 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4d70e7d-2b11-41d7-8a95-e2857ab2f202 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1217 microversion: 2.1 time: 0.166307 Oct 17 14:11:04.682669 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3479/6882] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:04 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:05.706079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:05.706735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:05.714040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.714532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.714978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:05.715680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.716143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.716576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:05.852773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:05.861014 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-caf27227-28ee-45d8-95fe-d862751b1d2d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1404 microversion: 2.1 time: 0.159174 Oct 17 14:11:05.861621 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3480/6883] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:05 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:05.883325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:05.883927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:05.890213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.891135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.891838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:05.892552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:05.893002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:05.895331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:05.912913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:06.024386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:06.033008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-185153c3-308d-4ad0-9a86-90239b7397a7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1404 microversion: 2.1 time: 0.153612 Oct 17 14:11:06.033670 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3481/6884] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:05 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:06.055051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1474121495"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:06.057409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:06.063390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:06.063878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:06.064323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:06.065016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:06.065499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:06.065926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:06.161864 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Attempting to quiesce instance before volume snapshot. Oct 17 14:11:06.230621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 17 14:11:06.302382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Creating snapshot from volume ffde7980-b47f-4705-a1fa-6ee7bc1b45e0. {{(pid=120697) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 17 14:11:07.206774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf642346-ec51-46e9-a2b9-00caba9a26f3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077/action" status: 202 len: 0 microversion: 2.1 time: 1.155344 Oct 17 14:11:07.207414 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3482/6885] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:11:06 2022] POST /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077/action => generated 0 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 17 14:11:08.376284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-594308585", "imageRef": "ca8557f7-397b-4a8c-8467-fd9586f1f30c", "flavorRef": "452", "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:08.445729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:11:09.125113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:11:09.125480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:11:09.125975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:11:09.126415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:11:09.126848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:11:09.136439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:09.136940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:09.137437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:09.138189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:09.138677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:09.139129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:09.158024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:11:09.164191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:11:09.177336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:11:09.180055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d87df1f3-77aa-401d-86c3-2ba136d9f50d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:11:09.257288 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67a179a1-9e55-4b5f-a5f1-12915e67f184 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886854 Oct 17 14:11:09.257950 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3483/6886] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:11:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:11:09.269859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8da278ed-721c-48c7-9239-c75b19b19d61 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:09.270493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8da278ed-721c-48c7-9239-c75b19b19d61 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:09.329754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8da278ed-721c-48c7-9239-c75b19b19d61 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:09.336830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8da278ed-721c-48c7-9239-c75b19b19d61 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1229 microversion: 2.1 time: 0.071693 Oct 17 14:11:09.337473 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3484/6887] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:09 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1229 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:10.359790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:10.360465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:10.368445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:10.368947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:10.369447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:10.370235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:10.370807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:10.371240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:10.490758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:10.499812 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bff34bf2-6fac-462f-bf4e-bde4bc18669e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1289 microversion: 2.1 time: 0.143879 Oct 17 14:11:10.500854 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3485/6888] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:10 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1289 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:11.524428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:11.525480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:11.533714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:11.534348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:11.536140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:11.536987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:11.537607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:11.538160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:11.759201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:11.769795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42ecbeb8-8873-4820-b0a2-774c8e650c9a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.249362 Oct 17 14:11:11.770735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3486/6889] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:11 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:12.154028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e20c6fd5-d4f4-4bee-86f2-2b7eb745df17 req-5344858e-cc79-4a18-b1d3-a9d47c2c0ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d51cee0-5831-4fa0-b020-b7ae110e6bdf", "tag": "f097fdb4-88c3-4116-b08b-5e57e536c17d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:12.165580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e20c6fd5-d4f4-4bee-86f2-2b7eb745df17 req-5344858e-cc79-4a18-b1d3-a9d47c2c0ba2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:12.166316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e20c6fd5-d4f4-4bee-86f2-2b7eb745df17 req-5344858e-cc79-4a18-b1d3-a9d47c2c0ba2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:12.166994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e20c6fd5-d4f4-4bee-86f2-2b7eb745df17 req-5344858e-cc79-4a18-b1d3-a9d47c2c0ba2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:12.181545 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e20c6fd5-d4f4-4bee-86f2-2b7eb745df17 req-5344858e-cc79-4a18-b1d3-a9d47c2c0ba2 service nova] Creating event network-changed:f097fdb4-88c3-4116-b08b-5e57e536c17d for instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf on n-h2-854121-14 Oct 17 14:11:12.188314 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e20c6fd5-d4f4-4bee-86f2-2b7eb745df17 req-5344858e-cc79-4a18-b1d3-a9d47c2c0ba2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119593 Oct 17 14:11:12.189449 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3487/6890] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:11:12.795631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:12.796320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:12.804610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:12.805130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:12.805672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:12.806345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:12.806825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:12.807333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:13.019901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:13.028654 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6eb5043-14b2-41ee-9efa-be2e9f53d23f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.238074 Oct 17 14:11:13.029262 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3488/6891] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:12 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:14.052518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:14.053322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:14.062036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:14.063182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:14.063730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:14.064464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:14.065187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:14.065418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:14.231171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:14.241526 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-311eeba2-ae25-41ae-a42b-fd6bcbb76b3d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.192739 Oct 17 14:11:14.253256 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3489/6892] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:14 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:15.273506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:15.277295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:15.293940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:15.295403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:15.296125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:15.297317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:15.298402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:15.299124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:15.557035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:15.570381 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40a1daa4-dd81-4c9b-8708-d280859f54ba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.306334 Oct 17 14:11:15.570839 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3490/6893] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:15 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:16.599536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:16.600403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:16.607420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:16.607953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:16.608537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:16.610193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:16.610193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:16.611978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:16.806033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:16.825996 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e137c672-fddf-4dde-a3b4-b346f9082596 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.230999 Oct 17 14:11:16.826873 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3491/6894] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:16 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:17.856235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:17.856915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:17.859818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:17.865732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:17.866238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:17.866943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:17.867415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:17.867968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:17.869020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:18.014018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:18.023315 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68b65ea3-3fb2-4460-a562-aa003abcfa15 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.171059 Oct 17 14:11:18.023939 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3492/6895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:17 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:19.048398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:19.049040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:19.056102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:19.056590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:19.057050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:19.057800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:19.058280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:19.058730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:19.147601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:19.193402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:19.201241 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fd0b76c-3afd-474c-b598-40caf4b9b044 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.157864 Oct 17 14:11:19.201815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3493/6896] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:19 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:20.224170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:20.224892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:20.226772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:20.233121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:20.233653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:20.234691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:20.235404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:20.236358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:20.236818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:20.380440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:20.388229 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7822ab01-123e-4f5a-aa02-afecb4d6e3ab tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.167957 Oct 17 14:11:20.388812 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3494/6897] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:20 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:21.412131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:21.412758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:21.419709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:21.420211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:21.420824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:21.421668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:21.422154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:21.422597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:21.562686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:21.571388 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-087fea58-5b8f-44ca-ab09-5abe69dba31a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.163329 Oct 17 14:11:21.572023 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3495/6898] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:21 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:22.597320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:22.597966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:22.605458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:22.605974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:22.606638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:22.607541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:22.608485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:22.609318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:22.772571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:22.781186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-09031e59-176b-4373-9b1b-fe24411beaaf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.189705 Oct 17 14:11:22.781836 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3496/6899] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:22 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:23.811065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:23.811787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:23.819040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:23.819548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:23.820010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:23.820733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:23.821226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:23.821684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:23.965670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:23.974512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d50efec-ea04-4490-9328-b2ac9d6c1bf2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.167513 Oct 17 14:11:23.975132 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3497/6900] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:23 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:24.997508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:24.998198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:25.005957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:25.006467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:25.006921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:25.007673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:25.008149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:25.008594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:25.025818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:25.151961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:25.161961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-007f63fc-5d18-45c8-a2db-24114b5e10ea tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1341 microversion: 2.1 time: 0.168405 Oct 17 14:11:25.162542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3498/6901] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:24 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1341 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:26.186579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:26.187247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:26.196334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:26.196844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:26.197364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:26.198163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:26.198670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:26.199119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:26.345414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:26.354686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0baeabf-a4c0-428f-888e-466f248178fe tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.172142 Oct 17 14:11:26.355269 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3499/6902] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:26 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:27.379995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:27.380632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:27.387620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:27.388130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:27.388587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:27.389338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:27.389819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:27.390275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:27.523812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:27.531875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29330394-5348-411f-baf3-6eb4553d1116 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.156826 Oct 17 14:11:27.532524 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3500/6903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:27 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:28.556227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:28.557003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:28.564404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:28.565075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:28.565474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:28.566809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:28.567443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:28.567888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:28.717174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:28.726277 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7c8d97f-ed0b-40d5-ae81-fb3dc1352da3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.174004 Oct 17 14:11:28.726888 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3501/6904] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:28 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:29.752747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:29.753567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:29.761521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:29.762034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:29.762491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:29.763220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:29.763711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:29.764186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:29.913235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:29.922459 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d787276-e6cb-4100-bbf0-3b3617ede7e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.173646 Oct 17 14:11:29.923360 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3502/6905] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:29 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:30.939614 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:11:30.940334 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:11:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:11:30.949058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:30.949736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:30.956850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:30.957398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:30.957862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:30.958588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:30.959067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:30.959511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:31.101606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:31.109529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-727792d4-c7f6-4c13-b630-f69b63f1efbb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.164889 Oct 17 14:11:31.110116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3503/6906] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:30 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:32.134762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:32.135405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:32.143438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:32.143879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:32.144402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:32.145233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:32.145710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:32.146164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:32.287685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:32.295835 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de0fed33-a844-4dcf-b256-43ef3fa54f96 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.165142 Oct 17 14:11:32.296515 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3504/6907] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:32 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:33.320222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:33.320952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:33.328012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:33.328513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:33.328971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:33.329723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:33.330195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:33.330635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:33.477364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:33.485549 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f05bd65a-31c8-4276-96ae-b918c7556e76 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.169266 Oct 17 14:11:33.486132 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3505/6908] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:33 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:34.510227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:34.510993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:34.519380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:34.519948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:34.521045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:34.521888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:34.522473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:34.523140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:34.681304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:34.689409 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5e1c433-d75a-4600-9af4-15ca9e65d6fc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.184420 Oct 17 14:11:34.690063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3506/6909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:34 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:35.713895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:35.714570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:35.721817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:35.722322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:35.722777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:35.723511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:35.724802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:35.725543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:35.879923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:35.888316 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ead28d5-94dd-485c-8410-96ba5ec0ad4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.178415 Oct 17 14:11:35.888920 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3507/6910] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:35 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:36.912579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:36.913296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:36.920297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:36.920808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:36.921306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:36.922060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:36.922600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:36.923112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:37.065731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:37.074387 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9ed7208-5e57-4267-a06d-afb9ef164208 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.166250 Oct 17 14:11:37.074970 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3508/6911] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:36 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:37.769394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-cb17d460-f0ea-455e-b0d7-d355c1d7e3ca req-2baa9218-e8d4-466b-a2a8-d60b357bc5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d51cee0-5831-4fa0-b020-b7ae110e6bdf", "name": "network-vif-plugged", "status": "completed", "tag": "f097fdb4-88c3-4116-b08b-5e57e536c17d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:37.780303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cb17d460-f0ea-455e-b0d7-d355c1d7e3ca req-2baa9218-e8d4-466b-a2a8-d60b357bc5d9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:37.781105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cb17d460-f0ea-455e-b0d7-d355c1d7e3ca req-2baa9218-e8d4-466b-a2a8-d60b357bc5d9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:37.781593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-cb17d460-f0ea-455e-b0d7-d355c1d7e3ca req-2baa9218-e8d4-466b-a2a8-d60b357bc5d9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:37.795396 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-cb17d460-f0ea-455e-b0d7-d355c1d7e3ca req-2baa9218-e8d4-466b-a2a8-d60b357bc5d9 service nova] Creating event network-vif-plugged:f097fdb4-88c3-4116-b08b-5e57e536c17d for instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf on n-h2-854121-14 Oct 17 14:11:37.800646 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-cb17d460-f0ea-455e-b0d7-d355c1d7e3ca req-2baa9218-e8d4-466b-a2a8-d60b357bc5d9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035090 Oct 17 14:11:37.801304 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3509/6912] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:11:38.100234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:38.100991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:38.107613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:38.108117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:38.108573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:38.109326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:38.109799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:38.110248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:38.246864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:38.255811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-045e1d1e-015f-464f-a834-2cdcc57f9054 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.161047 Oct 17 14:11:38.256747 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3510/6913] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:38 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:39.280144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:39.280818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:39.288862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:39.289402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:39.289866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:39.290593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:39.291071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:39.291521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:39.433536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:39.441560 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78cb3636-e624-42b7-a021-8846c4ca3e4e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1375 microversion: 2.1 time: 0.165564 Oct 17 14:11:39.442139 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3511/6914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:39 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:40.464655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:40.465348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:40.472434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.472967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.473458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.474201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.474713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.475157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.609442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:40.618265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-faf09ca6-8b91-4c3d-a385-897fb8d26c43 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1562 microversion: 2.1 time: 0.157481 Oct 17 14:11:40.618855 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3512/6915] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:40 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:40.641213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:40.641849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:40.648521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.649032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.649511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.650243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.650713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.651157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.789943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:40.798008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d6456ad-9e97-4ac3-8da9-510d671d6908 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1562 microversion: 2.1 time: 0.160982 Oct 17 14:11:40.798598 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3513/6916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:40 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:40.883608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:40.884249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:40.890748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.890947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.891400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.892120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:40.892591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:40.892591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:40.920727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:11:40.955485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:41.001043 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e3d9401-73d3-4d3c-8e9e-bc9870b17ed6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 204 len: 0 microversion: 2.1 time: 0.121502 Oct 17 14:11:41.001676 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3514/6917] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:11:40 2022] DELETE /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:11:41.010846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:41.011420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:41.017794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:41.018291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:41.018738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:41.019445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:41.019911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:41.020354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:41.157712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:41.166440 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-107cd586-39ba-4823-a91f-d677a8290cc5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1568 microversion: 2.1 time: 0.159990 Oct 17 14:11:41.167019 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3515/6918] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:41 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:42.190778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:42.191530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:42.198713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.199220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.199681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:42.200400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:42.200879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:42.201549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:42.334845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:42.342796 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9d67661-9543-41ce-a43c-9b7998dbc867 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1568 microversion: 2.1 time: 0.156098 Oct 17 14:11:42.343399 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3516/6919] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:42 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:43.368455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:43.369378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:43.378739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:43.385384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:43.386107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:43.386744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:43.387245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:43.387699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:43.467832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:43.477833 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ea4fbcb-e1b8-484e-aeca-d23b650a1166 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1526 microversion: 2.1 time: 0.114071 Oct 17 14:11:43.478485 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3517/6920] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:43 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1526 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:43.490708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-eb00103f-0660-43a5-b76a-c80947db3217 req-05008889-5c9b-427e-ad64-dab5b6e6e935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d51cee0-5831-4fa0-b020-b7ae110e6bdf", "name": "network-vif-deleted", "tag": "f097fdb4-88c3-4116-b08b-5e57e536c17d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:43.508781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-eb00103f-0660-43a5-b76a-c80947db3217 req-05008889-5c9b-427e-ad64-dab5b6e6e935 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:43.509334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-eb00103f-0660-43a5-b76a-c80947db3217 req-05008889-5c9b-427e-ad64-dab5b6e6e935 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:43.509830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-eb00103f-0660-43a5-b76a-c80947db3217 req-05008889-5c9b-427e-ad64-dab5b6e6e935 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:43.528984 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-eb00103f-0660-43a5-b76a-c80947db3217 req-05008889-5c9b-427e-ad64-dab5b6e6e935 service nova] Creating event network-vif-deleted:f097fdb4-88c3-4116-b08b-5e57e536c17d for instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf on n-h2-854121-14 Oct 17 14:11:43.536566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-eb00103f-0660-43a5-b76a-c80947db3217 req-05008889-5c9b-427e-ad64-dab5b6e6e935 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056401 Oct 17 14:11:43.538328 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3518/6921] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:11:44.509421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:44.510150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:44.516748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.517281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.517755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.518504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:44.518984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:44.519461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:44.590645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:44.599249 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a035e0f-e4b1-4904-89d2-712ec7abde14 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1360 microversion: 2.1 time: 0.095774 Oct 17 14:11:44.599860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3519/6922] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:44 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1360 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:11:45.624592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:45.625389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:45.634909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:45.635562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:45.636098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.636917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:45.637562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:45.638087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:45.729179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:45.738192 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f03cb121-7e9b-4b06-bf8d-70da7bb15daa tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1360 microversion: 2.1 time: 0.118430 Oct 17 14:11:45.738987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3520/6923] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:45 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1360 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:46.763326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:46.764008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:46.771208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:46.771707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:46.772159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:46.772880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:46.773381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:46.773818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:46.842673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:46.851892 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb4f7a3c-0973-4575-b6d6-87c5af79396f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1360 microversion: 2.1 time: 0.093003 Oct 17 14:11:46.852513 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3521/6924] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:46 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:47.876540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:47.877386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:47.880642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:47.886684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.887233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.887769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.888584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.889138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.889733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.926714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:47.927557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:47.928273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:47.928991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lazy-loading 'fault' on Instance uuid 5d51cee0-5831-4fa0-b020-b7ae110e6bdf {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:11:47.971601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:47.980961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-590b6286-dedc-43e1-8ad1-409c2bfd01ca tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 200 len: 1365 microversion: 2.1 time: 0.108764 Oct 17 14:11:47.981674 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3522/6925] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:47 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:49.004081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:49.005134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:49.012212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:49.012716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:49.013197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:49.013917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:49.014386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:49.014829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:49.028749 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf HTTP/1.1 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5d51cee0-5831-4fa0-b020-b7ae110e6bdf'} Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:11:49.030501 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-51e0b6c9-b7a9-46df-b136-03f3e6a5ab01 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 404 len: 111 microversion: 2.1 time: 0.031944 Oct 17 14:11:49.034710 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3523/6926] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:48 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:11:53.319637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:53.320261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:53.327448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:53.327942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:53.328393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:53.329097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:53.329586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:53.330027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:53.356656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:11:53.435229 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6868a557-45d0-4e46-8147-a15f93aa77ed tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 204 len: 0 microversion: 2.1 time: 0.118976 Oct 17 14:11:53.435820 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3524/6927] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:11:53 2022] DELETE /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:11:53.444661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:53.445491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:53.451412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:53.451907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:53.452356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:53.453057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:53.453577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:53.454013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:53.586235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:53.594566 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8558552e-b375-4b8f-b225-7478548bf0da tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1410 microversion: 2.1 time: 0.154104 Oct 17 14:11:53.595149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3525/6928] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:53 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1410 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:54.619961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:54.620735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:54.627709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:54.628221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:54.628678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:54.629426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:54.630191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:54.630675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:54.771058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:54.778998 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95e2225d-4cdc-40fc-a11d-dd48e59d725b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1410 microversion: 2.1 time: 0.163863 Oct 17 14:11:54.779569 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3526/6929] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:54 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:55.390028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6a8b80d5-53a2-4b85-8c8b-a58fc3dd1d47 req-e58c6a93-fd40-4e48-99f1-08c51b3c264e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c76e3503-bc3d-4d4a-a40f-072aed1f7077", "name": "network-vif-deleted", "tag": "18b4acda-a227-4af4-a98b-fa601128dcf9"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:11:55.400630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6a8b80d5-53a2-4b85-8c8b-a58fc3dd1d47 req-e58c6a93-fd40-4e48-99f1-08c51b3c264e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:55.401138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6a8b80d5-53a2-4b85-8c8b-a58fc3dd1d47 req-e58c6a93-fd40-4e48-99f1-08c51b3c264e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:55.401616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6a8b80d5-53a2-4b85-8c8b-a58fc3dd1d47 req-e58c6a93-fd40-4e48-99f1-08c51b3c264e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:55.413276 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6a8b80d5-53a2-4b85-8c8b-a58fc3dd1d47 req-e58c6a93-fd40-4e48-99f1-08c51b3c264e service nova] Creating event network-vif-deleted:18b4acda-a227-4af4-a98b-fa601128dcf9 for instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 on n-h1-854121-14 Oct 17 14:11:55.419085 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6a8b80d5-53a2-4b85-8c8b-a58fc3dd1d47 req-e58c6a93-fd40-4e48-99f1-08c51b3c264e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Oct 17 14:11:55.419710 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3527/6930] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:11:55.804509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:55.805372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:55.811684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:55.812178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:55.812630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:55.813365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:55.813832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:55.814272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:55.881473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:55.890399 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-441567d5-8fd3-4ecd-8f6a-15e78c1a9048 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1202 microversion: 2.1 time: 0.091098 Oct 17 14:11:55.891176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3528/6931] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:55 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1202 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:56.913422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:56.914445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:56.923370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:56.923869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:56.924321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:56.925063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:56.925583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:56.926007 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:56.994987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:57.003576 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9ec64a4e-1da2-464b-b4be-feb57b2e98e5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1202 microversion: 2.1 time: 0.094232 Oct 17 14:11:57.004173 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3529/6932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:56 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:58.028379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:58.029024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:58.036416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:58.036920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:58.037415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:58.038704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:58.039248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:58.039680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:58.110071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:58.112444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:11:58.119600 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4437940-58c8-49f7-a07a-e8a61e6e69db tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1202 microversion: 2.1 time: 0.095434 Oct 17 14:11:58.120305 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3530/6933] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:58 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:11:59.143538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:11:59.144225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:11:59.152891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:59.153359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:59.153822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:59.154555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:11:59.155032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:11:59.155481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:11:59.221107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:11:59.230044 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25e234e1-83ea-4c99-a4f2-a9d0eea58bba tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 200 len: 1202 microversion: 2.1 time: 0.090547 Oct 17 14:11:59.230755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3531/6934] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:11:59 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:00.253447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:00.254068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:00.262051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:00.262601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:00.263065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:00.263797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:00.264275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:00.264751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:00.279448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 HTTP/1.1 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c76e3503-bc3d-4d4a-a40f-072aed1f7077'} Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:00.281220 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01fa3c32-850d-4140-936e-992d6a9d7450 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 404 len: 111 microversion: 2.1 time: 0.033311 Oct 17 14:12:00.285670 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3532/6935] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:00 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:12:02.440871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:02.441478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:02.448718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.449351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.449875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.450656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.451194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.451651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.469129 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf HTTP/1.1 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5d51cee0-5831-4fa0-b020-b7ae110e6bdf'} Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:12:02.470754 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-24477323-6e51-42b0-8f22-d3df6d7bbf95 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 404 len: 111 microversion: 2.1 time: 0.036555 Oct 17 14:12:02.475072 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3533/6936] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:12:02 2022] DELETE /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:12:02.482290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:02.482925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 5d51cee0-5831-4fa0-b020-b7ae110e6bdf] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:02.490107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.491009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.491816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.492794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.493553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.494158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.511815 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf HTTP/1.1 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5d51cee0-5831-4fa0-b020-b7ae110e6bdf'} Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.513798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 5d51cee0-5831-4fa0-b020-b7ae110e6bdf could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f83b424a-1b7a-4ad6-aeb3-ef666de6d725 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf" status: 404 len: 111 microversion: 2.1 time: 0.037025 Oct 17 14:12:02.523408 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3534/6937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:02 2022] GET /compute/v2.1/servers/5d51cee0-5831-4fa0-b020-b7ae110e6bdf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:12:02.903158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:02.904754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:02.917680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.918538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.919360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.920288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.920897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.921387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.936438 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 HTTP/1.1 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c76e3503-bc3d-4d4a-a40f-072aed1f7077'} Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:12:02.938286 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6f47f40a-07ea-4a8a-901a-8434f74d6853 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 404 len: 111 microversion: 2.1 time: 0.044303 Oct 17 14:12:02.942450 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3535/6938] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:12:02 2022] DELETE /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:12:02.949396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:02.950024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: c76e3503-bc3d-4d4a-a40f-072aed1f7077] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:02.956136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.956638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.957094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.957833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:02.958301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:02.958744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:02.976987 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 HTTP/1.1 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'c76e3503-bc3d-4d4a-a40f-072aed1f7077'} Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:12:02.978600 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance c76e3503-bc3d-4d4a-a40f-072aed1f7077 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:12:02.983176 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ed0cb4c-d8bd-4403-a84b-abf9c1c6bd9b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077" status: 404 len: 111 microversion: 2.1 time: 0.034517 Oct 17 14:12:02.985240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3536/6939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:02 2022] GET /compute/v2.1/servers/c76e3503-bc3d-4d4a-a40f-072aed1f7077 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:12:03.058609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f18d793-456c-43fe-8d69-3dd98fb962ad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: .version_select at 0x7f419cc29310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-218989291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeSyhwwouBhpj/G9Q9ApHy9FMdDP0HcmUOCIK0y7zg1sHxXVtAp6QY8eeJiqQ3PR1ItPXAoKTGjbtxJ4V3Sd1ikKIgesCPsy78F8fW4NGx1iA5WgsODs44AcSrHiIDzKg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:03.075686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-3f18d793-456c-43fe-8d69-3dd98fb962ad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:12:03.080966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-3f18d793-456c-43fe-8d69-3dd98fb962ad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:12:03.096406 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3f18d793-456c-43fe-8d69-3dd98fb962ad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [661d870a-e61f-4b3f-b903-130bd3e92676] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:12:04.104143 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [None req-3f18d793-456c-43fe-8d69-3dd98fb962ad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [661d870a-e61f-4b3f-b903-130bd3e92676] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53724. Oct 17 14:12:04.120116 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f18d793-456c-43fe-8d69-3dd98fb962ad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.065737 Oct 17 14:12:04.120734 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3537/6940] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:12:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:12:20.386708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=17 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:20.387506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:20.388553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:20.393581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-663990671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-218989291", "security_groups": [{"name": "tempest-secgroup-smoke-349246232"}], "block_device_mapping_v2": [{"uuid": "8b69f289-f677-4dab-87b9-5edf62f21fd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:20.510693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:12:20.892555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:12:20.893003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:12:20.893584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:12:20.894020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:12:20.894455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:12:20.903705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:20.904212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:20.904669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:20.905456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:20.905932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:20.906379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:20.924466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:12:20.930406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:12:20.990464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:12:20.993286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b69f289-f677-4dab-87b9-5edf62f21fd7',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:12:21.125649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70c05ef0-2769-42c9-b61c-f7af91532e44 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.740889 Oct 17 14:12:21.126324 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3538/6941] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:12:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:12:21.137774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bf940bb2-cf54-4e16-bc45-419b17a016a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:21.138391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bf940bb2-cf54-4e16-bc45-419b17a016a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:21.193594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bf940bb2-cf54-4e16-bc45-419b17a016a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:21.200632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bf940bb2-cf54-4e16-bc45-419b17a016a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1093 microversion: 2.1 time: 0.066789 Oct 17 14:12:21.201229 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3539/6942] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:21 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:22.224339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:22.227110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:22.235908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:22.236521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:22.237267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:22.238008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:22.238655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:22.239107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:22.320405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:22.328402 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-774fe318-90a2-4a78-b730-9aff0bde4cff tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1209 microversion: 2.1 time: 0.109000 Oct 17 14:12:22.328964 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3540/6943] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:22 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:23.353144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:23.353891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:23.361196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:23.361808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:23.362484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:23.363292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:23.363839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:23.364382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:23.900912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:23.910000 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-459a2207-f44b-426c-b2f9-b3ce8464a7e4 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1276 microversion: 2.1 time: 0.561585 Oct 17 14:12:23.910601 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3541/6944] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:23 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1276 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:24.121248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-67702284-0b7c-4e4e-9431-958f2244c40d req-bf42f68c-ae9b-47f9-998a-cd620678bc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248d074b-cc0a-4232-917a-6069b24686e8", "tag": "db5c45b5-f256-4e44-b467-e591cd512862"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:24.134452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-67702284-0b7c-4e4e-9431-958f2244c40d req-bf42f68c-ae9b-47f9-998a-cd620678bc39 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:24.135293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-67702284-0b7c-4e4e-9431-958f2244c40d req-bf42f68c-ae9b-47f9-998a-cd620678bc39 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:24.136089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-67702284-0b7c-4e4e-9431-958f2244c40d req-bf42f68c-ae9b-47f9-998a-cd620678bc39 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:24.150421 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-67702284-0b7c-4e4e-9431-958f2244c40d req-bf42f68c-ae9b-47f9-998a-cd620678bc39 service nova] Creating event network-changed:db5c45b5-f256-4e44-b467-e591cd512862 for instance 248d074b-cc0a-4232-917a-6069b24686e8 on n-h2-854121-14 Oct 17 14:12:24.156458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-67702284-0b7c-4e4e-9431-958f2244c40d req-bf42f68c-ae9b-47f9-998a-cd620678bc39 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047987 Oct 17 14:12:24.157690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3542/6945] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:24.932797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:24.934164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:24.941560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:24.942307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:24.942871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:24.944788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:24.945543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:24.947240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:25.182933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:25.191692 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d2b7ad4a-083b-47ac-97f9-d26ad9afbabd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1276 microversion: 2.1 time: 0.263312 Oct 17 14:12:25.192716 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3543/6946] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:24 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1276 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:26.216875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:26.217606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:26.225306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:26.225828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:26.226291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:26.227030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:26.227506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:26.228067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:26.367179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:26.375363 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65360d4a-d7b9-4999-b851-ff8b732c01f2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1276 microversion: 2.1 time: 0.162797 Oct 17 14:12:26.376024 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3544/6947] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:26 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:27.398449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:27.399107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:27.406507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:27.407011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:27.407469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:27.408184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:27.408659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:27.409107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:27.547654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:27.555694 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-697a9c4a-ee6c-463b-bc9b-ec91dda4071a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.161409 Oct 17 14:12:27.556271 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3545/6948] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:27 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:28.579089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:28.579955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:28.587620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:28.588123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:28.588580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:28.589344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:28.589816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:28.590258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:28.724903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:28.732942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f46f6fb5-1758-4403-bb0f-857d4c44f1c3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.157814 Oct 17 14:12:28.733570 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3546/6949] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:28 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:29.757338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:29.758087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:29.764985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:29.765518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:29.765969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:29.766678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:29.767144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:29.767583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:29.910228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:29.918660 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e08d7ecb-2c57-403a-949a-6e1ef8ada753 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.166604 Oct 17 14:12:29.919235 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3547/6950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:29 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:30.942911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:30.944078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:30.947305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:30.952892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:30.953412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:30.953872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:30.954604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:30.955077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:30.955525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:31.087873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:31.095753 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cab91dd-8fa2-460d-84a9-29a7b7cd02e6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.156925 Oct 17 14:12:31.096262 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3548/6951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:30 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:32.119092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:32.119729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:32.121567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:32.127906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:32.128404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:32.128896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:32.129913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:32.130382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:32.130848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:32.274046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:32.282018 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b55e12b2-eb32-4540-914f-945160f41018 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.167108 Oct 17 14:12:32.282611 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3549/6952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:32 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:33.304556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:33.305222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:33.312094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:33.312584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:33.313032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:33.313768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:33.314234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:33.314680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:33.447942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:33.455770 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fdf745d-1cce-40f4-bb6a-3c94ad6e1227 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.155729 Oct 17 14:12:33.456347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3550/6953] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:33 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:34.479363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:34.480058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:34.487074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:34.487596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:34.488045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:34.488750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:34.489246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:34.489682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:34.625048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:34.634279 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7e9a2695-748f-4727-bf04-661659eacfce tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.158970 Oct 17 14:12:34.635078 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3551/6954] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:34 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:35.657949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:35.658575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:35.666425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:35.666927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:35.667380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:35.668080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:35.668574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:35.668985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:35.807181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:35.814997 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f177623-7305-4902-9a9d-22a73b50fe83 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.161039 Oct 17 14:12:35.815580 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3552/6955] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:35 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:36.839106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:36.839763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:36.846751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:36.847253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:36.847707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:36.848420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:36.848890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:36.849371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:36.980298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:36.988352 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dbcadf72-f144-4f7c-bb12-4c5d997c89a8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.154256 Oct 17 14:12:36.989295 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3553/6956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:36 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:38.012347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:38.013036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:38.020051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:38.020570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:38.021040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:38.021835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:38.022368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:38.022992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:38.165560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:38.173716 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db20132a-035f-4cb9-a9c8-279a0c02706c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.165281 Oct 17 14:12:38.174293 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3554/6957] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:38 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:12:38.240398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2d0a54d0-0e80-406d-8e07-25d8d27c1c6c req-df04d9b7-6440-48d8-ac0d-8b7e3d8f7640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248d074b-cc0a-4232-917a-6069b24686e8", "name": "network-vif-plugged", "status": "completed", "tag": "db5c45b5-f256-4e44-b467-e591cd512862"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:38.251029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2d0a54d0-0e80-406d-8e07-25d8d27c1c6c req-df04d9b7-6440-48d8-ac0d-8b7e3d8f7640 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:38.251524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2d0a54d0-0e80-406d-8e07-25d8d27c1c6c req-df04d9b7-6440-48d8-ac0d-8b7e3d8f7640 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:38.252017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2d0a54d0-0e80-406d-8e07-25d8d27c1c6c req-df04d9b7-6440-48d8-ac0d-8b7e3d8f7640 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:38.263631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2d0a54d0-0e80-406d-8e07-25d8d27c1c6c req-df04d9b7-6440-48d8-ac0d-8b7e3d8f7640 service nova] Creating event network-vif-plugged:db5c45b5-f256-4e44-b467-e591cd512862 for instance 248d074b-cc0a-4232-917a-6069b24686e8 on n-h2-854121-14 Oct 17 14:12:38.268894 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2d0a54d0-0e80-406d-8e07-25d8d27c1c6c req-df04d9b7-6440-48d8-ac0d-8b7e3d8f7640 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093469 Oct 17 14:12:38.269541 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3555/6958] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:12:39.200196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:39.200893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:39.207261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:39.207782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:39.208241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:39.208957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:39.209463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:39.210553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:39.348303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:39.356537 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dbd88acf-2a9e-496d-abe6-11c77fed61d6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1264 microversion: 2.1 time: 0.162313 Oct 17 14:12:39.357120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3556/6959] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:39 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:40.380051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:40.380741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:40.388356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.388860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.389359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.390078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.390553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.391002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.410192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:12:40.530205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:40.538209 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bd5b4511-e833-4ef1-b44d-14ffcc8896af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1452 microversion: 2.1 time: 0.162436 Oct 17 14:12:40.538783 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3557/6960] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:40 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:40.560170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:12:40.560790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:12:40.566735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.567232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.567682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.568381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:40.568853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:40.569325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:40.704068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:12:40.712687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a2d2693-9133-44b2-bc57-69c95e96736b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1452 microversion: 2.1 time: 0.156414 Oct 17 14:12:40.713457 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3558/6961] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:12:40 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:12:42.315390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5de39dd5-35f0-41f0-ace8-538e68620800 req-b7bb8b11-7c75-4637-b649-5c99adb8b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248d074b-cc0a-4232-917a-6069b24686e8", "tag": "db5c45b5-f256-4e44-b467-e591cd512862"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:12:42.326861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5de39dd5-35f0-41f0-ace8-538e68620800 req-b7bb8b11-7c75-4637-b649-5c99adb8b9c1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:12:42.327623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5de39dd5-35f0-41f0-ace8-538e68620800 req-b7bb8b11-7c75-4637-b649-5c99adb8b9c1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:12:42.328068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5de39dd5-35f0-41f0-ace8-538e68620800 req-b7bb8b11-7c75-4637-b649-5c99adb8b9c1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:12:42.340743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5de39dd5-35f0-41f0-ace8-538e68620800 req-b7bb8b11-7c75-4637-b649-5c99adb8b9c1 service nova] Creating event network-changed:db5c45b5-f256-4e44-b467-e591cd512862 for instance 248d074b-cc0a-4232-917a-6069b24686e8 on n-h2-854121-14 Oct 17 14:12:42.345761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5de39dd5-35f0-41f0-ace8-538e68620800 req-b7bb8b11-7c75-4637-b649-5c99adb8b9c1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Oct 17 14:12:42.346382 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3559/6962] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:13:10.942026 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:13:10.942600 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:13:10.944430 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:13:10.944609 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:14:35.491494 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 14:14:35.493123 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 14:14:35.493865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:35.494635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:35.495568 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 14:14:35.497025 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 17 14:14:35.650042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:35.650697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:35.658385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.658908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.659378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.660119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.660599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.661053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.692539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:14:35.772878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-04188ba6-b130-4700-9409-cfbd09b78a74 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 204 len: 0 microversion: 2.1 time: 0.283922 Oct 17 14:14:35.773865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3560/6963] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:14:35 2022] DELETE /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:14:35.782749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:35.783461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:35.789531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.790030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.790482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:35.791187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:35.791653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:35.792150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:36.015178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:36.023269 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f74aed94-dbc2-497f-b38a-9bb2106f9af6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1577 microversion: 2.1 time: 0.244645 Oct 17 14:14:36.023785 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3561/6964] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:35 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:37.047111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:37.047778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:37.057016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:37.057553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:37.058644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:37.059431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:37.059899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:37.060343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:37.067748 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53980. Oct 17 14:14:37.068610 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53978. Oct 17 14:14:37.204565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:37.212950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-787fe540-d7f4-4d3f-b92a-832dff6211f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1577 microversion: 2.1 time: 0.170319 Oct 17 14:14:37.213658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3562/6965] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:37 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1577 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:38.238643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:38.239526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:38.246445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:38.246965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:38.247422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:38.248147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:38.248627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:38.249084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:38.347850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:38.356804 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8e7a96a-c6ad-43f2-84ec-51e01d586f7b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1510 microversion: 2.1 time: 0.123306 Oct 17 14:14:38.357437 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3563/6966] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:38 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1510 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:38.656194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e16dfe10-dd99-4e04-82c7-b52b3f851461 req-957740ac-6cfd-4dce-bfff-f7aa29b30313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248d074b-cc0a-4232-917a-6069b24686e8", "name": "network-vif-deleted", "tag": "db5c45b5-f256-4e44-b467-e591cd512862"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:38.671777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e16dfe10-dd99-4e04-82c7-b52b3f851461 req-957740ac-6cfd-4dce-bfff-f7aa29b30313 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:38.672427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e16dfe10-dd99-4e04-82c7-b52b3f851461 req-957740ac-6cfd-4dce-bfff-f7aa29b30313 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:38.672977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e16dfe10-dd99-4e04-82c7-b52b3f851461 req-957740ac-6cfd-4dce-bfff-f7aa29b30313 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:38.686997 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e16dfe10-dd99-4e04-82c7-b52b3f851461 req-957740ac-6cfd-4dce-bfff-f7aa29b30313 service nova] Creating event network-vif-deleted:db5c45b5-f256-4e44-b467-e591cd512862 for instance 248d074b-cc0a-4232-917a-6069b24686e8 on n-h2-854121-14 Oct 17 14:14:38.692187 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e16dfe10-dd99-4e04-82c7-b52b3f851461 req-957740ac-6cfd-4dce-bfff-f7aa29b30313 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108619 Oct 17 14:14:38.693131 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3564/6967] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:14:39.383902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:39.384622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:39.391966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:39.392623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:39.393374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:39.394291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:39.395028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:39.395657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:39.469264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:39.479783 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fcea8c6-f740-46c1-8dba-2c3b6e0431f0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1224 microversion: 2.1 time: 0.101930 Oct 17 14:14:39.481389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3565/6968] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:39 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:40.503441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:40.504104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:40.512242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:40.512746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:40.513224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:40.513956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:40.514432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:40.514882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:40.578367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:40.588583 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e09cf28-994d-4229-a9f7-261c45592650 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1224 microversion: 2.1 time: 0.088917 Oct 17 14:14:40.589510 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3566/6969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:40 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:41.616355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:41.617089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:41.624928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:41.625554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:41.626100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:41.626892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:41.627436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:41.627949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:41.695742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:41.704838 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08a66238-6357-4424-a0be-e241bd261279 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1224 microversion: 2.1 time: 0.092562 Oct 17 14:14:41.705458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3567/6970] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:41 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:42.728239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:42.728963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:42.736284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:42.736833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:42.737398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:42.738238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:42.738714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:42.739158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:42.803812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:42.812416 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1da44b30-2390-4463-b18b-a61d04c89bad tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 200 len: 1224 microversion: 2.1 time: 0.088466 Oct 17 14:14:42.812998 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3568/6971] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:42 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:43.835801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:43.836521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:43.844386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:43.844887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:43.845379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:43.846088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:43.846554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:43.846990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:43.861107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 HTTP/1.1 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '248d074b-cc0a-4232-917a-6069b24686e8'} Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:14:43.862806 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcc6beae-8791-4200-8d09-b3d4d1fe0518 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 404 len: 111 microversion: 2.1 time: 0.032364 Oct 17 14:14:43.867820 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3569/6972] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:43 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:14:43.916594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-269985094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-218989291", "security_groups": [{"name": "tempest-secgroup-smoke-349246232"}], "block_device_mapping_v2": [{"uuid": "8b69f289-f677-4dab-87b9-5edf62f21fd7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:44.034889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:14:44.520868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:14:44.521340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:14:44.521859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:14:44.522282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:14:44.522701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:14:44.534807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:44.535300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:44.535744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:44.536482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:44.536944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:44.537405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:44.559428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:14:44.564884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:14:44.623680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:14:44.625874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8b69f289-f677-4dab-87b9-5edf62f21fd7',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:14:44.759368 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-374fb72d-27b0-4e37-a2b3-b10e174fc72b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846662 Oct 17 14:14:44.760028 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3570/6973] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:14:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:14:44.772610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5982fbe4-d857-4ac4-8b8d-352dca81abe8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:44.773272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5982fbe4-d857-4ac4-8b8d-352dca81abe8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:44.828527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5982fbe4-d857-4ac4-8b8d-352dca81abe8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:44.835623 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5982fbe4-d857-4ac4-8b8d-352dca81abe8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1093 microversion: 2.1 time: 0.067556 Oct 17 14:14:44.836195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3571/6974] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:44 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:45.859937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:45.860702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:45.869019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:45.869735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:45.870972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:45.871879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:45.872351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:45.872774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:45.951169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:45.960570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb47aa55-9bc0-43f0-918b-897a0d1a9d13 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1209 microversion: 2.1 time: 0.105676 Oct 17 14:14:45.961183 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3572/6975] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:45 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1209 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:46.984752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:46.986368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:46.993834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:46.994456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:46.995086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:46.996087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:46.996817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:46.997371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.161683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:47.170411 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df4ec1bb-f0ff-47b2-9542-0006e4fec36a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1276 microversion: 2.1 time: 0.189708 Oct 17 14:14:47.171585 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3573/6976] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:46 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:47.436858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-4747210b-f434-42ce-9105-9fb68e8b169a req-9f5881ea-78e4-462c-9da9-01fcad173fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c5d31f-890a-46ff-9d7a-3f60c11d7656", "tag": "f0c41efe-f1f3-42db-8e64-6144da7c2512"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:14:47.447055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4747210b-f434-42ce-9105-9fb68e8b169a req-9f5881ea-78e4-462c-9da9-01fcad173fa9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:47.447775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4747210b-f434-42ce-9105-9fb68e8b169a req-9f5881ea-78e4-462c-9da9-01fcad173fa9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:47.448938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4747210b-f434-42ce-9105-9fb68e8b169a req-9f5881ea-78e4-462c-9da9-01fcad173fa9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:47.461375 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-4747210b-f434-42ce-9105-9fb68e8b169a req-9f5881ea-78e4-462c-9da9-01fcad173fa9 service nova] Creating event network-changed:f0c41efe-f1f3-42db-8e64-6144da7c2512 for instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 on n-h1-854121-14 Oct 17 14:14:47.469418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-4747210b-f434-42ce-9105-9fb68e8b169a req-9f5881ea-78e4-462c-9da9-01fcad173fa9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092299 Oct 17 14:14:47.470740 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3574/6977] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:14:48.196109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:48.197659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:48.205192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:48.205714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:48.206157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:48.206884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:48.207351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:48.207789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:48.352627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:48.360813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9632dc78-34c5-4e8c-8853-c6dbc79328d8 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1276 microversion: 2.1 time: 0.169974 Oct 17 14:14:48.376444 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3575/6978] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:48 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:49.384744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:49.385419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:49.393271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:49.393781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:49.394236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:49.394958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:49.395430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:49.395877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:49.534200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:49.543004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80d1509d-4415-4e48-ab92-6777647d9d1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1276 microversion: 2.1 time: 0.162325 Oct 17 14:14:49.543565 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3576/6979] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:49 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:50.566227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:50.566925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:50.574548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:50.575060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:50.575518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:50.576249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:50.576719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:50.577190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:50.727697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:50.736208 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-286552c2-401b-4ae7-84f9-265459d15d6c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1276 microversion: 2.1 time: 0.173945 Oct 17 14:14:50.736702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3577/6980] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:50 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:50.952686 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:14:50.953330 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:14:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:14:51.760308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:51.761639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:51.768563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:51.769098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:51.769585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:51.770303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:51.770772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:51.771218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:51.789699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:51.910443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:51.918865 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-985efba2-82ed-49a5-bfaa-cd2b8f3aeea7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.162561 Oct 17 14:14:51.919442 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3578/6981] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:51 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:52.943309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:52.943968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:52.951615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:52.952111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:52.952565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:52.953352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:52.953822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:52.954263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:53.088008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:53.095981 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bff3920-2768-4dd9-aa5a-133e43087bd9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.156661 Oct 17 14:14:53.096564 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3579/6982] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:52 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:54.118908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:54.119580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:54.127371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:54.127870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:54.128322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:54.129031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:54.129790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:54.130232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:54.262451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:54.270374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29af42c9-8a2f-4553-8734-1888810d6888 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.155485 Oct 17 14:14:54.270951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3580/6983] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:54 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:55.294210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:55.294865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:55.296710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:55.297447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:14:55.304729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:55.305265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:55.305723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:55.306435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:55.306908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:55.307854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:55.443747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:55.452610 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8358fe00-66cc-4fcd-9f1d-7f91736c25d7 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.162296 Oct 17 14:14:55.453221 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3581/6984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:55 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:56.475498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:56.476177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:56.483811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:56.484314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:56.484769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:56.485510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:56.485981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:56.486421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:56.618748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:56.628529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3292ebe3-6686-42c7-8b7d-be4cb51501cf tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.156963 Oct 17 14:14:56.629582 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3582/6985] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:56 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:14:57.651931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:57.653340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:57.660162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:57.660665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:57.661127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:57.661865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:57.662342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:57.662791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:57.801203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:57.809307 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b63501a2-cec8-48f2-b9af-8f61cc68750b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.161151 Oct 17 14:14:57.809908 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3583/6986] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:57 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:14:58.832028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:14:58.832690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:14:58.839786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:58.840294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:58.840879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:58.841711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:14:58.842187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:14:58.842632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:14:58.989873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:14:58.998990 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5adfd37b-30c9-4a4f-a472-02ba65a826cd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.170917 Oct 17 14:14:58.999579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3584/6987] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:14:58 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:00.021826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:00.022505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:00.029350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:00.029909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:00.030308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:00.031020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:00.031513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:00.031955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:00.167071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:00.175635 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9736bc15-3646-4e3f-a961-b9c452d4c388 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.157804 Oct 17 14:15:00.176220 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3585/6988] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:00 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:01.139005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-45bb8593-ab1f-4e30-a875-41e452f6687f req-119b0b02-694a-4e3a-91b0-98562be9656e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c5d31f-890a-46ff-9d7a-3f60c11d7656", "name": "network-vif-plugged", "status": "completed", "tag": "f0c41efe-f1f3-42db-8e64-6144da7c2512"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:01.148767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45bb8593-ab1f-4e30-a875-41e452f6687f req-119b0b02-694a-4e3a-91b0-98562be9656e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:01.149305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45bb8593-ab1f-4e30-a875-41e452f6687f req-119b0b02-694a-4e3a-91b0-98562be9656e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:01.149760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45bb8593-ab1f-4e30-a875-41e452f6687f req-119b0b02-694a-4e3a-91b0-98562be9656e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:01.161213 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-45bb8593-ab1f-4e30-a875-41e452f6687f req-119b0b02-694a-4e3a-91b0-98562be9656e service nova] Creating event network-vif-plugged:f0c41efe-f1f3-42db-8e64-6144da7c2512 for instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 on n-h1-854121-14 Oct 17 14:15:01.166329 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-45bb8593-ab1f-4e30-a875-41e452f6687f req-119b0b02-694a-4e3a-91b0-98562be9656e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089522 Oct 17 14:15:01.166983 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3586/6989] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:15:01.200450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:01.201358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:01.207784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:01.208290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:01.208752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:01.209500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:01.209971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:01.210414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:01.346156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:01.353924 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f4688e6-17a5-47f9-9e5c-1d21669d22af tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1264 microversion: 2.1 time: 0.158774 Oct 17 14:15:01.354494 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3587/6990] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:01 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:02.377504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:02.378531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:02.385878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:02.387038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:02.387515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:02.388886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:02.389391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:02.389843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:02.525025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:02.534547 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a349ecc4-d97d-42c7-98b4-f75fd6d44094 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1452 microversion: 2.1 time: 0.161469 Oct 17 14:15:02.535140 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3588/6991] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:02 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:02.557539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:15:02.558172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:15:02.565282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:02.565792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:02.566248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:02.566960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:02.567440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:02.567879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:02.706673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:15:02.714684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e441fa20-c7a2-464a-a2ae-e4f6ec2bc06f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1452 microversion: 2.1 time: 0.161028 Oct 17 14:15:02.715314 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3589/6992] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:15:02 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:15:04.661677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-36999e6c-805d-4951-a782-2a203a371049 req-fc5b17da-647b-431a-8a5c-5b2739d5d68a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c5d31f-890a-46ff-9d7a-3f60c11d7656", "tag": "f0c41efe-f1f3-42db-8e64-6144da7c2512"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:15:04.673101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36999e6c-805d-4951-a782-2a203a371049 req-fc5b17da-647b-431a-8a5c-5b2739d5d68a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:15:04.673641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36999e6c-805d-4951-a782-2a203a371049 req-fc5b17da-647b-431a-8a5c-5b2739d5d68a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:15:04.674096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-36999e6c-805d-4951-a782-2a203a371049 req-fc5b17da-647b-431a-8a5c-5b2739d5d68a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:15:04.689300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-36999e6c-805d-4951-a782-2a203a371049 req-fc5b17da-647b-431a-8a5c-5b2739d5d68a service nova] Creating event network-changed:f0c41efe-f1f3-42db-8e64-6144da7c2512 for instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 on n-h1-854121-14 Oct 17 14:15:04.695514 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-36999e6c-805d-4951-a782-2a203a371049 req-fc5b17da-647b-431a-8a5c-5b2739d5d68a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037405 Oct 17 14:15:04.696165 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3590/6993] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:16:30.957146 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:16:30.957787 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:16:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:16:30.961803 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:16:30.961926 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:16:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:16:44.946654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:44.947437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=66 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:44.954661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1986873862", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-218989291", "security_groups": [{"name": "tempest-secgroup-smoke-349246232"}], "block_device_mapping_v2": [{"uuid": "bae413ff-d9e9-4470-bcc2-c9a96bee778f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "80545edd-18e6-4ee6-974b-236851ad99f6"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:45.077331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] validate_networks() for [('80545edd-18e6-4ee6-974b-236851ad99f6', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:16:45.459059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:16:45.459507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:16:45.460035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:16:45.460470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:16:45.460905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:16:45.470750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:45.471258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:45.471742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:45.472495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:45.472974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:45.473455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:45.492701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:16:45.499046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Getting quotas for user 69f1e428ca094d408ed5c1fb5b564e3a and project 2a832403b6b245fb8bbbbfbd89253db5. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:16:45.560009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:16:45.562305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bae413ff-d9e9-4470-bcc2-c9a96bee778f',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:16:45.697764 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-360fd39a-7c23-4794-91b6-6631643bc6bb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.753649 Oct 17 14:16:45.699182 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3591/6994] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:16:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:16:45.710464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-279142b6-3297-4f93-aa8b-de5ae7f44ecc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:45.711115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-279142b6-3297-4f93-aa8b-de5ae7f44ecc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:45.771440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-279142b6-3297-4f93-aa8b-de5ae7f44ecc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:45.779415 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-279142b6-3297-4f93-aa8b-de5ae7f44ecc tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1094 microversion: 2.1 time: 0.073049 Oct 17 14:16:45.779994 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3592/6995] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:45 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:46.803213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:46.803830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:46.811385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:46.811889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:46.812358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:46.813075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:46.813571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:46.814018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:46.881788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:46.891107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05fe9cdc-b5a6-4e14-9719-f0f6f12e4c98 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1192 microversion: 2.1 time: 0.091852 Oct 17 14:16:46.891931 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3593/6996] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:46 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:47.917778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:47.918645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:47.926133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:47.927028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:47.927722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:47.928886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:47.929738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:47.930621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:48.146003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:48.154961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e94b43f-3b39-424c-a773-234fe118453c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1277 microversion: 2.1 time: 0.243822 Oct 17 14:16:48.155775 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3594/6997] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:47 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:16:48.494445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0196c06a-b492-4557-8e8b-fe297f5c554d req-5e81bb10-df07-46c7-ad1a-e2082d2003ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acbd6e6-2f21-4222-82ec-9e52945f88ef", "tag": "7928f42a-17ee-4e43-8df9-f74ff97cb136"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:16:48.505915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0196c06a-b492-4557-8e8b-fe297f5c554d req-5e81bb10-df07-46c7-ad1a-e2082d2003ee service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:48.506887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0196c06a-b492-4557-8e8b-fe297f5c554d req-5e81bb10-df07-46c7-ad1a-e2082d2003ee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:48.508130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0196c06a-b492-4557-8e8b-fe297f5c554d req-5e81bb10-df07-46c7-ad1a-e2082d2003ee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:48.521342 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0196c06a-b492-4557-8e8b-fe297f5c554d req-5e81bb10-df07-46c7-ad1a-e2082d2003ee service nova] Creating event network-changed:7928f42a-17ee-4e43-8df9-f74ff97cb136 for instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef on n-h2-854121-14 Oct 17 14:16:48.527134 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0196c06a-b492-4557-8e8b-fe297f5c554d req-5e81bb10-df07-46c7-ad1a-e2082d2003ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037432 Oct 17 14:16:48.527765 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3595/6998] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:16:49.180102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:49.180829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:49.187497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:49.188006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:49.188463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:49.189205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:49.189680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:49.190123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:49.405836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:49.415084 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3a1bb98-cac3-4cfd-bf3a-cc2a83899fc6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1277 microversion: 2.1 time: 0.239863 Oct 17 14:16:49.415708 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3596/6999] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:49 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:50.439753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:50.440456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:50.447435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:50.447927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:50.448609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:50.449635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:50.450104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:50.450541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:50.585612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:50.593786 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-456f99d2-cb20-4b2b-830a-0e1dc6f52593 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1277 microversion: 2.1 time: 0.157984 Oct 17 14:16:50.594466 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3597/7000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:50 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:51.617702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:51.618392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:51.626135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:51.626646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:51.627107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:51.627840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:51.628315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:51.628765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:51.772243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:51.781729 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f0322d23-a88e-4fc0-b62b-84e43214cede tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1277 microversion: 2.1 time: 0.168138 Oct 17 14:16:51.782333 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3598/7001] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:51 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:52.806134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:52.806806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:52.814565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.815058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.815510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.816213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:52.816677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:52.817112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:52.952856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:52.960715 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b06f6edd-6eee-4dfd-94e1-cbd283cb9417 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.159217 Oct 17 14:16:52.961332 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3599/7002] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:52 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:53.984256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:53.984938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:53.991787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:53.992281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:53.992838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:53.993569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:53.994036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:53.994476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:54.133947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:54.142025 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f320662-2b35-47f8-bb4e-752c3608cc34 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.161746 Oct 17 14:16:54.142614 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3600/7003] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:53 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:55.165577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:55.166542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:55.173766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:55.174253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:55.174843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:55.175594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:55.176111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:55.176587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:55.330610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:55.340248 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fbed79df-9632-4fdd-ab66-16ca22289cb6 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.179240 Oct 17 14:16:55.340847 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3601/7004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:55 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:56.367429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:56.368106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:56.370870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:56.371667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:16:56.378609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:56.379106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:56.379806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:56.380523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:56.380986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:56.381478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:56.516944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:56.525077 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42b1fb49-0a39-4ccb-8893-11b41f384a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.161576 Oct 17 14:16:56.525696 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3602/7005] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:56 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:57.548968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:57.549676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:57.556696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:57.557843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:57.558308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:57.559024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:57.559498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:57.559943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:57.709488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:57.717663 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e81b94d-f375-481e-a4b9-2f77912de2bd tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.172651 Oct 17 14:16:57.718250 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3603/7006] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:57 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:58.739988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:58.740678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:58.747863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:58.748367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:58.748819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:58.749562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:58.750036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:58.750478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:58.888013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:16:58.896167 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b149db67-874e-4ac5-a08a-ffb187210905 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.160124 Oct 17 14:16:58.896763 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3604/7007] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:58 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:16:59.920280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:16:59.920938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:16:59.927879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:59.928369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:59.928819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:16:59.929546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:16:59.930011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:16:59.930447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:00.067181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:00.076237 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f0eb8c9-be56-4151-859c-25ff27a52a4b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.160658 Oct 17 14:17:00.076817 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3605/7008] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:16:59 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:01.100068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:01.100744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:01.108564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:01.109073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:01.109561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:01.110283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:01.110760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:01.111211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:01.244050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:01.251974 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-09bbdd3f-2d65-430c-a9ad-78cd912d14a0 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.155869 Oct 17 14:17:01.252554 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3606/7009] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:01 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:02.275222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:02.276068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:02.282864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:02.283367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:02.283824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:02.284538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:02.285006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:02.285546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:02.418626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:02.426713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f15a28ca-769d-4342-a79a-74c936ae1c10 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.155446 Oct 17 14:17:02.427302 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3607/7010] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:02 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:03.450902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:03.451639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:03.458824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:03.459335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:03.459797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:03.460523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:03.461000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:03.461471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:03.602530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:03.610568 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71beeaa3-da92-47bb-8108-efdceb06f677 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.164379 Oct 17 14:17:03.611155 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3608/7011] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:03 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:03.615788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-29fa033b-eaa1-41d1-a95c-be3c802bc154 req-829761a7-c088-4e49-8e58-b91b1e288206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4acbd6e6-2f21-4222-82ec-9e52945f88ef", "name": "network-vif-plugged", "status": "completed", "tag": "7928f42a-17ee-4e43-8df9-f74ff97cb136"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:03.626843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-29fa033b-eaa1-41d1-a95c-be3c802bc154 req-829761a7-c088-4e49-8e58-b91b1e288206 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:03.627335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-29fa033b-eaa1-41d1-a95c-be3c802bc154 req-829761a7-c088-4e49-8e58-b91b1e288206 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:03.627784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-29fa033b-eaa1-41d1-a95c-be3c802bc154 req-829761a7-c088-4e49-8e58-b91b1e288206 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:03.640660 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-29fa033b-eaa1-41d1-a95c-be3c802bc154 req-829761a7-c088-4e49-8e58-b91b1e288206 service nova] Creating event network-vif-plugged:7928f42a-17ee-4e43-8df9-f74ff97cb136 for instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef on n-h2-854121-14 Oct 17 14:17:03.645864 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-29fa033b-eaa1-41d1-a95c-be3c802bc154 req-829761a7-c088-4e49-8e58-b91b1e288206 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Oct 17 14:17:03.646491 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3609/7012] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:17:04.636227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:04.636950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:04.643405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:04.643909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:04.644363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:04.645087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:04.645601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:04.646031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:04.670020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:17:04.787982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:04.796614 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b269dac-e501-4a74-bfac-80da68b2c432 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1265 microversion: 2.1 time: 0.165709 Oct 17 14:17:04.797176 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3610/7013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:04 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:05.819884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:05.820572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:05.828138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:05.828615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:05.829059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:05.829783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:05.830250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:05.830684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:05.963761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:05.972048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3acf881b-a421-40a0-a3e3-1dc2ba5afa6a tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1453 microversion: 2.1 time: 0.156061 Oct 17 14:17:05.972637 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3611/7014] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:05 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:05.994107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:17:05.994734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:17:06.001354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:06.001858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:06.002320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:06.003038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:06.003510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:06.003959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:06.134971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:17:06.142908 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc7b23b3-aa1d-432a-9ec0-21465bf67756 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1453 microversion: 2.1 time: 0.152513 Oct 17 14:17:06.143477 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3612/7015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:17:05 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:17:08.066026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fdca4b47-b22c-42f7-b813-3b25660b84c4 req-d98d0e7b-6694-4cfb-8398-b52f196f9ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acbd6e6-2f21-4222-82ec-9e52945f88ef", "tag": "7928f42a-17ee-4e43-8df9-f74ff97cb136"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:17:08.075987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdca4b47-b22c-42f7-b813-3b25660b84c4 req-d98d0e7b-6694-4cfb-8398-b52f196f9ad9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:17:08.076496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdca4b47-b22c-42f7-b813-3b25660b84c4 req-d98d0e7b-6694-4cfb-8398-b52f196f9ad9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:17:08.076949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdca4b47-b22c-42f7-b813-3b25660b84c4 req-d98d0e7b-6694-4cfb-8398-b52f196f9ad9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:17:08.088802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-fdca4b47-b22c-42f7-b813-3b25660b84c4 req-d98d0e7b-6694-4cfb-8398-b52f196f9ad9 service nova] Creating event network-changed:7928f42a-17ee-4e43-8df9-f74ff97cb136 for instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef on n-h2-854121-14 Oct 17 14:17:08.094666 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fdca4b47-b22c-42f7-b813-3b25660b84c4 req-d98d0e7b-6694-4cfb-8398-b52f196f9ad9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032588 Oct 17 14:17:08.095326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3613/7016] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:10.965601 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:18:10.966263 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:18:50.159067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:50.160298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:18:50.161830 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:18:50.161967 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:18:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef (ip 10.222.0.65) !!! Oct 17 14:18:50.167746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:50.168348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:50.178301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.178807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.179260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.179972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.180432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.181051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.210350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:18:50.295466 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7095f4dd-fd1c-4687-8fa0-adbfe65f1bdb tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 204 len: 0 microversion: 2.1 time: 0.139253 Oct 17 14:18:50.296238 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3614/7017] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:18:50 2022] DELETE /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:18:50.302057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1b82b56b-7a15-4c58-9c4c-3ddc4e40ab79 req-58768bc9-68cb-40ca-9e36-8b86287e98dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acbd6e6-2f21-4222-82ec-9e52945f88ef", "tag": "7928f42a-17ee-4e43-8df9-f74ff97cb136"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:50.312173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1b82b56b-7a15-4c58-9c4c-3ddc4e40ab79 req-58768bc9-68cb-40ca-9e36-8b86287e98dc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.312667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1b82b56b-7a15-4c58-9c4c-3ddc4e40ab79 req-58768bc9-68cb-40ca-9e36-8b86287e98dc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.313112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1b82b56b-7a15-4c58-9c4c-3ddc4e40ab79 req-58768bc9-68cb-40ca-9e36-8b86287e98dc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.327264 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1b82b56b-7a15-4c58-9c4c-3ddc4e40ab79 req-58768bc9-68cb-40ca-9e36-8b86287e98dc service nova] Creating event network-changed:7928f42a-17ee-4e43-8df9-f74ff97cb136 for instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef on n-h2-854121-14 Oct 17 14:18:50.333105 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1b82b56b-7a15-4c58-9c4c-3ddc4e40ab79 req-58768bc9-68cb-40ca-9e36-8b86287e98dc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035441 Oct 17 14:18:50.333847 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3615/7018] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:50.342437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:50.343167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:50.349773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.350280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.350742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.351467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:50.351938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:50.352381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:50.491267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:50.499801 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b43953c-acec-484e-807a-86c1b2fd01e3 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1577 microversion: 2.1 time: 0.161251 Oct 17 14:18:50.500080 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3616/7019] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:50 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:18:51.523935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:51.524667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:51.531610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:51.532145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:51.532671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:51.533436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:51.533909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:51.534355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:51.685150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:51.693897 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f16db195-4f4f-4232-84f3-6a067f65e096 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1577 microversion: 2.1 time: 0.173893 Oct 17 14:18:51.694481 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3617/7020] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:51 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:52.718638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:52.719385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:52.727990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:52.728539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:52.729012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:52.729781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:52.730480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:52.730934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:52.798584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:52.807254 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e84bdbe-390c-47c0-b511-835f6f49127b tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1392 microversion: 2.1 time: 0.092546 Oct 17 14:18:52.808061 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3618/7021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:52 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1392 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:52.812392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-69bf086f-ef28-4cd3-a732-9bac6609b3fc req-a21b2789-46af-4577-802f-adf037ee21d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4acbd6e6-2f21-4222-82ec-9e52945f88ef", "name": "network-vif-deleted", "tag": "7928f42a-17ee-4e43-8df9-f74ff97cb136"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:18:52.821785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-69bf086f-ef28-4cd3-a732-9bac6609b3fc req-a21b2789-46af-4577-802f-adf037ee21d3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:52.822281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-69bf086f-ef28-4cd3-a732-9bac6609b3fc req-a21b2789-46af-4577-802f-adf037ee21d3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:52.822725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-69bf086f-ef28-4cd3-a732-9bac6609b3fc req-a21b2789-46af-4577-802f-adf037ee21d3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:52.834554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-69bf086f-ef28-4cd3-a732-9bac6609b3fc req-a21b2789-46af-4577-802f-adf037ee21d3 service nova] Creating event network-vif-deleted:7928f42a-17ee-4e43-8df9-f74ff97cb136 for instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef on n-h2-854121-14 Oct 17 14:18:52.839659 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-69bf086f-ef28-4cd3-a732-9bac6609b3fc req-a21b2789-46af-4577-802f-adf037ee21d3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030595 Oct 17 14:18:52.840298 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3619/7022] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:18:53.832729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:53.833457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:53.839767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:53.840273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:53.840725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:53.841474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:53.841946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:53.842387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:53.911093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:53.919226 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d71de87-b6ea-4e4c-a861-fa8973ca2313 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1225 microversion: 2.1 time: 0.092250 Oct 17 14:18:53.919837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3620/7023] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:53 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:54.943850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:54.944512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:54.951565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:54.952072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:54.952535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:54.953282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:54.953784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:54.954219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:55.019427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:55.027809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae5e14f0-c2b0-4de2-86fd-ae9c9792972d tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1225 microversion: 2.1 time: 0.087904 Oct 17 14:18:55.028386 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3621/7024] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:54 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:56.052477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:56.053124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:56.060467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:56.060972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:56.061462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:56.062195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:56.062670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:56.063602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:56.128179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:56.136828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f64bef33-16e3-484a-a014-bf381e1cbfe9 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1225 microversion: 2.1 time: 0.089015 Oct 17 14:18:56.137439 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3622/7025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:56 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:57.160277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:57.160885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:57.168088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:57.168597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:57.169066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:57.169837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:57.170341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:57.170791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:57.203453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:57.204785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:57.205276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:57.205745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lazy-loading 'fault' on Instance uuid 4acbd6e6-2f21-4222-82ec-9e52945f88ef {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:18:57.245611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:18:57.254177 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b9a6645-6549-425f-a8c6-9fa617c12c0e tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 200 len: 1230 microversion: 2.1 time: 0.098513 Oct 17 14:18:57.255037 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3623/7026] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:57 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:18:58.278504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:18:58.279209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 4acbd6e6-2f21-4222-82ec-9e52945f88ef] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:18:58.286751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:58.287254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:58.287708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:58.288415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:18:58.288887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:18:58.289356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:18:58.306645 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef could not be found. Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef HTTP/1.1 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef could not be found. Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4acbd6e6-2f21-4222-82ec-9e52945f88ef'} Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef could not be found. Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef could not be found. Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:18:58.308332 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef could not be found. Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 4acbd6e6-2f21-4222-82ec-9e52945f88ef could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf2969be-3e43-4dfd-a4b0-ca32e739b624 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef" status: 404 len: 111 microversion: 2.1 time: 0.035348 Oct 17 14:18:58.312694 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3624/7027] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:18:58 2022] GET /compute/v2.1/servers/4acbd6e6-2f21-4222-82ec-9e52945f88ef => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:04.845529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:04.846167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:04.853959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:04.854475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:04.854937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:04.855665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:04.856143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:04.856592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:04.886343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:19:04.976556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dfb5a047-4179-4056-83a2-73816d0b5352 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 204 len: 0 microversion: 2.1 time: 0.135989 Oct 17 14:19:04.981116 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3625/7028] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:04 2022] DELETE /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:19:04.983227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a0c3ce10-8d4e-4ebb-8458-593a788d34ff req-07fa8b76-49f5-403c-947c-541db8a33c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55c5d31f-890a-46ff-9d7a-3f60c11d7656", "tag": "f0c41efe-f1f3-42db-8e64-6144da7c2512"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:04.994341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0c3ce10-8d4e-4ebb-8458-593a788d34ff req-07fa8b76-49f5-403c-947c-541db8a33c0a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:04.994893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0c3ce10-8d4e-4ebb-8458-593a788d34ff req-07fa8b76-49f5-403c-947c-541db8a33c0a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:04.995349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a0c3ce10-8d4e-4ebb-8458-593a788d34ff req-07fa8b76-49f5-403c-947c-541db8a33c0a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:05.007659 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a0c3ce10-8d4e-4ebb-8458-593a788d34ff req-07fa8b76-49f5-403c-947c-541db8a33c0a service nova] Creating event network-changed:f0c41efe-f1f3-42db-8e64-6144da7c2512 for instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 on n-h1-854121-14 Oct 17 14:19:05.012861 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a0c3ce10-8d4e-4ebb-8458-593a788d34ff req-07fa8b76-49f5-403c-947c-541db8a33c0a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033845 Oct 17 14:19:05.013507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3626/7029] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:05.018971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:05.020330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:05.026167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:05.026673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:05.027142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:05.027953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:05.028313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:05.028859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:05.169550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:05.178212 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22252ce9-6667-4d2d-b6bd-48462f2c66b2 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1576 microversion: 2.1 time: 0.163538 Oct 17 14:19:05.179031 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3627/7030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:05 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:06.201645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:06.202302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:06.209789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:06.210291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:06.210735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:06.211451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:06.211911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:06.212350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:06.344060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:06.352103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebd2e607-71f8-40c2-82b5-eb126b352d3f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1576 microversion: 2.1 time: 0.154394 Oct 17 14:19:06.352664 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3628/7031] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:06 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:07.029545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d86945ef-f82c-4081-9a26-5ad32718f823 req-1c282f83-09d8-47a4-99f2-2965f087e4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55c5d31f-890a-46ff-9d7a-3f60c11d7656", "name": "network-vif-deleted", "tag": "f0c41efe-f1f3-42db-8e64-6144da7c2512"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:07.040256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d86945ef-f82c-4081-9a26-5ad32718f823 req-1c282f83-09d8-47a4-99f2-2965f087e4e3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:07.041192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d86945ef-f82c-4081-9a26-5ad32718f823 req-1c282f83-09d8-47a4-99f2-2965f087e4e3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:07.041893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d86945ef-f82c-4081-9a26-5ad32718f823 req-1c282f83-09d8-47a4-99f2-2965f087e4e3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:07.053774 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d86945ef-f82c-4081-9a26-5ad32718f823 req-1c282f83-09d8-47a4-99f2-2965f087e4e3 service nova] Creating event network-vif-deleted:f0c41efe-f1f3-42db-8e64-6144da7c2512 for instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 on n-h1-854121-14 Oct 17 14:19:07.058948 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d86945ef-f82c-4081-9a26-5ad32718f823 req-1c282f83-09d8-47a4-99f2-2965f087e4e3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Oct 17 14:19:07.059593 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3629/7032] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:07.377730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:07.378542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:07.385169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:07.385698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:07.386154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:07.386876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:07.387469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:07.387804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:07.391949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:07.453975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:07.462703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40561260-75fd-4a60-a685-8a3c3c518f1f tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1224 microversion: 2.1 time: 0.090412 Oct 17 14:19:07.463229 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3630/7033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:07 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:08.486187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:08.487133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:08.494629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:08.495226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:08.495764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:08.496513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:08.496992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:08.497476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:08.566805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:08.575152 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f678e9bd-32b3-446b-a1f7-4256d33987d5 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1224 microversion: 2.1 time: 0.092822 Oct 17 14:19:08.575750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3631/7034] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:08 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:09.601177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:09.601853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:09.609893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:09.610343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:09.610828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:09.611535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:09.612576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:09.612962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:09.680180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:09.688805 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df4ade77-406c-444a-9afc-f0cd68270192 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1224 microversion: 2.1 time: 0.091633 Oct 17 14:19:09.689415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3632/7035] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:09 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:10.712154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:10.712915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:10.720543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:10.721916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:10.722460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:10.723289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:10.723770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:10.724217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:10.788384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f1e428ca094d408ed5c1fb5b564e3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a832403b6b245fb8bbbbfbd89253db5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:10.796592 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddd8bbdf-12bf-4778-aba3-509e011ae481 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 200 len: 1224 microversion: 2.1 time: 0.088422 Oct 17 14:19:10.797426 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3633/7036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:10 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:11.820375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:11.821042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 55c5d31f-890a-46ff-9d7a-3f60c11d7656] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:11.827985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:11.828479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:11.828928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:11.829664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:11.830135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:11.831094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:11.844580 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 could not be found. Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 HTTP/1.1 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 could not be found. Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '55c5d31f-890a-46ff-9d7a-3f60c11d7656'} Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 could not be found. Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 could not be found. Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:11.846933 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 could not be found. Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 55c5d31f-890a-46ff-9d7a-3f60c11d7656 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5725363e-62bc-4718-9ff9-c3d7645c8cec tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656" status: 404 len: 111 microversion: 2.1 time: 0.032017 Oct 17 14:19:11.851335 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3634/7037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:11 2022] GET /compute/v2.1/servers/55c5d31f-890a-46ff-9d7a-3f60c11d7656 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:12.314523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:12.315909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:12.322173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:12.322670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:12.323121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:12.323826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:12.324293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:12.324731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:12.339062 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 HTTP/1.1 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '248d074b-cc0a-4232-917a-6069b24686e8'} Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:12.340613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38d03f37-577f-4251-9488-ccd9d2a0fb78 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 404 len: 111 microversion: 2.1 time: 0.031554 Oct 17 14:19:12.345333 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3635/7038] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:12 2022] DELETE /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:12.350970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:12.351596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] [instance: 248d074b-cc0a-4232-917a-6069b24686e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:12.357495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:12.357988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:12.358445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:12.359143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:12.359613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:12.360056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:12.374542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] HTTP exception thrown: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Request method failure captured: Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 HTTP/1.1 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWG0eO7roRqxJ_b9kNOM5KoQWq-3rtEdbb5UEVWErj-2_9CA0QOJbmvMBPo54mC7dE0Bp4UFGOjY8UGwdWTAm8qR2-ix9hOWWlFBleDIfqZWT3o7kXTLwthyUYgXmOuKREbCZdqbc4LuWKWGAEfDiCVS1elovdHR1wbeJ58bl1iXL40 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2a832403b6b245fb8bbbbfbd89253db5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2a832403b6b245fb8bbbbfbd89253db5 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-1916997843 Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 69f1e428ca094d408ed5c1fb5b564e3a Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-1916997843-project Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '248d074b-cc0a-4232-917a-6069b24686e8'} Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:12.376092 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 404 to user: Instance 248d074b-cc0a-4232-917a-6069b24686e8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3373f4de-4b2b-46ea-a1f6-ce3da87b5702 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8" status: 404 len: 111 microversion: 2.1 time: 0.030182 Oct 17 14:19:12.381435 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3636/7039] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:12 2022] GET /compute/v2.1/servers/248d074b-cc0a-4232-917a-6069b24686e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:19:15.812389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8943cde2-df7c-4f01-bbda-9a85d93d598c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Calling method '.version_select at 0x7f41a1f0cee0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:15.850539 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8943cde2-df7c-4f01-bbda-9a85d93d598c tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-218989291" status: 202 len: 0 microversion: 2.1 time: 0.042013 Oct 17 14:19:15.851240 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3637/7040] 10.222.0.65 () {58 vars in 1260 bytes} [Mon Oct 17 14:19:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-218989291 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:19:34.307105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=28 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:34.307966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:34.429667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1030637069", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:34.480714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] validate_networks() for None {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:19:34.683403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:19:34.683845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:19:34.684497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:19:34.685093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:19:34.685705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:19:34.695459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:34.695961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:34.696419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:34.697189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:34.697676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:34.698142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:34.716270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Getting quotas for project aa48916ffd8341b793b1c557da0e5dc8. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:34.722344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Getting quotas for user 95699dbadba54de1a5c1c6466287b1ca and project aa48916ffd8341b793b1c557da0e5dc8. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:34.734770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:19:34.737808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:19:34.787386 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5f825da4-90c1-497f-ab52-18083cf4ec84 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485571 Oct 17 14:19:34.788048 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3638/7041] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:19:34.800787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b31278b-b56a-4907-b066-664e6507b541 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:34.801463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b31278b-b56a-4907-b066-664e6507b541 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:34.854540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b31278b-b56a-4907-b066-664e6507b541 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:34.861754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b31278b-b56a-4907-b066-664e6507b541 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1222 microversion: 2.1 time: 0.064971 Oct 17 14:19:34.862389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3639/7042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:34 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1222 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:35.885921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0caf0b0a-057e-4e41-b099-6422b6baf075 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:35.886589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0caf0b0a-057e-4e41-b099-6422b6baf075 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:35.941765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0caf0b0a-057e-4e41-b099-6422b6baf075 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:35.948819 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0caf0b0a-057e-4e41-b099-6422b6baf075 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1222 microversion: 2.1 time: 0.066840 Oct 17 14:19:35.949420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3640/7043] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:35 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1222 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:36.973767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3bdde0d5-a236-4603-b732-76c049bae949 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:36.974418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3bdde0d5-a236-4603-b732-76c049bae949 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:37.129871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3bdde0d5-a236-4603-b732-76c049bae949 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:37.136985 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3bdde0d5-a236-4603-b732-76c049bae949 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1222 microversion: 2.1 time: 0.168102 Oct 17 14:19:37.137597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3641/7044] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:36 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:38.160046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:38.160762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:38.169587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:38.170255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:38.170769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:38.171577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:38.172121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:38.172667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:38.248232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:38.257118 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f70c625-05dd-4db2-933b-32065fc8a89d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1280 microversion: 2.1 time: 0.101328 Oct 17 14:19:38.257810 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3642/7045] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:38 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:39.281305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:39.282020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:39.289618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:39.290129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:39.290598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:39.291320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:39.291800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:39.292247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:39.503164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:39.511661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fd6efa8-bc8c-4e20-a3b4-b8f92d2baadd tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.234339 Oct 17 14:19:39.512252 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3643/7046] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:39 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:39.836267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-238279e5-99a5-4d7c-adbf-3051eeeca863 req-a6dc3307-77b2-421a-b5a6-c2994d08dd43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d391dfcd-d33d-4930-bbd4-9c6fb0e326af", "tag": "a8d05b0b-4801-4d14-ba3b-79a10182eeb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:39.846820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-238279e5-99a5-4d7c-adbf-3051eeeca863 req-a6dc3307-77b2-421a-b5a6-c2994d08dd43 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:39.847411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-238279e5-99a5-4d7c-adbf-3051eeeca863 req-a6dc3307-77b2-421a-b5a6-c2994d08dd43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:39.847875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-238279e5-99a5-4d7c-adbf-3051eeeca863 req-a6dc3307-77b2-421a-b5a6-c2994d08dd43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:39.859560 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-238279e5-99a5-4d7c-adbf-3051eeeca863 req-a6dc3307-77b2-421a-b5a6-c2994d08dd43 service nova] Creating event network-changed:a8d05b0b-4801-4d14-ba3b-79a10182eeb2 for instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af on n-h2-854121-14 Oct 17 14:19:39.865290 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-238279e5-99a5-4d7c-adbf-3051eeeca863 req-a6dc3307-77b2-421a-b5a6-c2994d08dd43 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095075 Oct 17 14:19:39.866001 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3644/7047] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:40.537427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:40.538538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:40.545254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:40.545761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:40.546223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:40.546945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:40.547420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:40.547864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:40.688400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:40.696460 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dbca7a8e-6ae5-4c5a-95b7-8ab5ba55d056 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.165117 Oct 17 14:19:40.697034 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3645/7048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:40 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:41.719737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:41.720496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:41.727484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:41.727983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:41.728433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:41.729144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:41.729639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:41.730082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:41.859231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:41.869492 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c7305f1-e778-4ec2-a19d-e2657762d20f tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.153918 Oct 17 14:19:41.870107 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3646/7049] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:41 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:42.894673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:42.895337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:42.902322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:42.902812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:42.903252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:42.903963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:42.904431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:42.904864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:43.134557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:43.142474 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08f6aa13-cde2-4806-8f14-392c1f693da1 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.252501 Oct 17 14:19:43.143641 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3647/7050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:42 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:44.166169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:44.167151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:44.175929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:44.176431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:44.176883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:44.177781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:44.178263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:44.178881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:44.331453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:44.339344 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da6a9d77-6828-4438-99ff-f14ef3333dca tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.177377 Oct 17 14:19:44.339942 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3648/7051] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:44 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:19:45.362937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:45.363624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:45.365550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:45.371650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:45.372147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:45.372595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:45.373335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:45.373801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:45.374240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:45.506616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:45.514441 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be0bcd7e-7fd3-4e7b-90fa-35b676ff5f69 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.156156 Oct 17 14:19:45.515022 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3649/7052] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:45 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:46.272366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6a9f2480-2671-4b51-a6f0-7d224ad58908 req-83c50bff-958f-419d-8447-3bbc10c5f496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d391dfcd-d33d-4930-bbd4-9c6fb0e326af", "name": "network-vif-plugged", "status": "completed", "tag": "a8d05b0b-4801-4d14-ba3b-79a10182eeb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:46.284671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6a9f2480-2671-4b51-a6f0-7d224ad58908 req-83c50bff-958f-419d-8447-3bbc10c5f496 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:46.285185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6a9f2480-2671-4b51-a6f0-7d224ad58908 req-83c50bff-958f-419d-8447-3bbc10c5f496 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:46.285656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6a9f2480-2671-4b51-a6f0-7d224ad58908 req-83c50bff-958f-419d-8447-3bbc10c5f496 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:46.297800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6a9f2480-2671-4b51-a6f0-7d224ad58908 req-83c50bff-958f-419d-8447-3bbc10c5f496 service nova] Creating event network-vif-plugged:a8d05b0b-4801-4d14-ba3b-79a10182eeb2 for instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af on n-h2-854121-14 Oct 17 14:19:46.303744 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6a9f2480-2671-4b51-a6f0-7d224ad58908 req-83c50bff-958f-419d-8447-3bbc10c5f496 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035192 Oct 17 14:19:46.304372 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3650/7053] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:46.538615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:46.539368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:46.546529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:46.547035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:46.547495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:46.548207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:46.548678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:46.549149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:46.680506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:46.688298 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fd367e9-e8be-4de5-9be1-a9a821948586 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.154266 Oct 17 14:19:46.688877 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3651/7054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:46 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:47.712118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:47.712784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:47.714802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:47.721300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:47.722520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:47.722988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:47.723719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:47.724198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:47.724652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:47.860358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:47.870653 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-badf5027-e836-44e8-bb8c-d74dc37a9a4d tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1322 microversion: 2.1 time: 0.162453 Oct 17 14:19:47.871242 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3652/7055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:47 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:48.895708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:48.897054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:48.904920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:48.905508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:48.905994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:48.906723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:48.907192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:48.907633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.038830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:49.046789 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23457ac6-d396-4dad-99bf-211e00b8d46a tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1472 microversion: 2.1 time: 0.156258 Oct 17 14:19:49.047378 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3653/7056] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:48 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1472 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:49.120170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92fc0c5d-1326-4f5f-9d14-2701a6693e63 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Calling method '.version_select at 0x7f41a1f94280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.184622 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92fc0c5d-1326-4f5f-9d14-2701a6693e63 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/9784cbf9f82c4326ae064b02a8059a5f" status: 200 len: 371 microversion: 2.1 time: 0.116566 Oct 17 14:19:49.185222 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3654/7057] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 14:19:49 2022] GET /compute/v2.1/os-quota-sets/9784cbf9f82c4326ae064b02a8059a5f => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:49.197479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9af7345-8e4d-4761-b59a-c462d3fafedb tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-716988626", "id": 1169315942, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:49.216484 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9af7345-8e4d-4761-b59a-c462d3fafedb tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022537 Oct 17 14:19:49.217247 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3655/7058] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:49 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:49.229049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1169315942"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:49.231349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:49.237829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.238331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.238785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.239489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.239959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.240399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.386099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6d8fc08d3d44a57adf4fe3ee85082cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9784cbf9f82c4326ae064b02a8059a5f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:49.392443 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-716988626 {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:19:49.399582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.400171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.400572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.401383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.401856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.402302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.423942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Getting quotas for project aa48916ffd8341b793b1c557da0e5dc8. Resources: {'cores', 'ram'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:49.429705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Getting quotas for user 95699dbadba54de1a5c1c6466287b1ca and project aa48916ffd8341b793b1c557da0e5dc8. Resources: {'cores', 'ram'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:49.442721 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] ram quota exceeded for 9784cbf9f82c4326ae064b02a8059a5f, tried to resize instance. Oct 17 14:19:49.443278 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Request method failure captured: Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af/action HTTP/1.1 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 39 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWR2ChN8PaoOqD-swqrwOlpsKim7UvrwIpHO7RzOC0CWbasptRo2hytGBk77GNVp46hlDONWkXpwbFW1Qv8c6l7_ZAU8Yf1a53xW-TUf2V6ciRcqn0a88CjS2FmmgCnzkeHpRYgrLWZhDkqGEEJtmf1fVfYd1yI5pzy5f2dos9KMCkA Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9784cbf9f82c4326ae064b02a8059a5f Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-349489 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdminNegativeTestJSON-349489 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9784cbf9f82c4326ae064b02a8059a5f Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-349489 Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdminNegativeTestJSON-349489-project-admin Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e6d8fc08d3d44a57adf4fe3ee85082cd Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdminNegativeTestJSON-349489-project-admin Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: {"resize": {"flavorRef": "1169315942"}} Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd391dfcd-d33d-4930-bbd4-9c6fb0e326af', 'body': {'resize': {'flavorRef': '1169315942'}}} Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:19:49.445463 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36ed43b1-16c3-4a6b-bc8f-c65301428ace tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af/action" status: 403 len: 118 microversion: 2.1 time: 0.221472 Oct 17 14:19:49.450425 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3656/7059] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:19:49 2022] POST /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af/action => generated 118 bytes in 222 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:49.455739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf790b92-0fbd-43dd-bbfb-c8c849ead47f tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.472831 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf790b92-0fbd-43dd-bbfb-c8c849ead47f tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/1169315942" status: 202 len: 0 microversion: 2.1 time: 0.020697 Oct 17 14:19:49.473433 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3657/7060] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 14:19:49 2022] DELETE /compute/v2.1/flavors/1169315942 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:19:49.480988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af8049bb-6393-4db0-b02e-b8a309ea222d tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.501230 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af8049bb-6393-4db0-b02e-b8a309ea222d tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023578 Oct 17 14:19:49.501804 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3658/7061] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 14:19:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:49.523227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b082d63-aa43-4502-8884-ec5e453b9dde tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Calling method '.version_select at 0x7f419e6979d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.589627 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b082d63-aa43-4502-8884-ec5e453b9dde tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "GET /compute/v2.1/os-quota-sets/9784cbf9f82c4326ae064b02a8059a5f" status: 200 len: 371 microversion: 2.1 time: 0.069827 Oct 17 14:19:49.590215 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3659/7062] 10.222.0.65 () {58 vars in 1242 bytes} [Mon Oct 17 14:19:49 2022] GET /compute/v2.1/os-quota-sets/9784cbf9f82c4326ae064b02a8059a5f => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:49.602236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c83e5cd7-b9d4-4925-b4b9-7b1e3d91aa63 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-559608859", "id": 2032826355, "os-flavor-access:is_public": "True"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:49.620725 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c83e5cd7-b9d4-4925-b4b9-7b1e3d91aa63 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021940 Oct 17 14:19:49.621383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3660/7063] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:49 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:19:49.633598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2032826355"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:49.635856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:49.642584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.643086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.643659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.644377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.644848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.645321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.673383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e6d8fc08d3d44a57adf4fe3ee85082cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9784cbf9f82c4326ae064b02a8059a5f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:49.679469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-559608859 {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:19:49.686024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.686518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.686970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.687706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.688174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.688627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.709249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Getting quotas for project aa48916ffd8341b793b1c557da0e5dc8. Resources: {'cores', 'ram'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:19:49.714320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Getting quotas for user 95699dbadba54de1a5c1c6466287b1ca and project aa48916ffd8341b793b1c557da0e5dc8. Resources: {'cores', 'ram'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:19:49.723921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:49.727819 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] cores quota exceeded for 9784cbf9f82c4326ae064b02a8059a5f, tried to resize instance. Oct 17 14:19:49.728367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Request method failure captured: Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af/action HTTP/1.1 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 39 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWR2ChN8PaoOqD-swqrwOlpsKim7UvrwIpHO7RzOC0CWbasptRo2hytGBk77GNVp46hlDONWkXpwbFW1Qv8c6l7_ZAU8Yf1a53xW-TUf2V6ciRcqn0a88CjS2FmmgCnzkeHpRYgrLWZhDkqGEEJtmf1fVfYd1yI5pzy5f2dos9KMCkA Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 9784cbf9f82c4326ae064b02a8059a5f Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-349489 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Role: reader,member,admin Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: reader,member,admin Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_9784cbf9f82c4326ae064b02a8059a5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdminNegativeTestJSON-349489 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 9784cbf9f82c4326ae064b02a8059a5f Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-349489 Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdminNegativeTestJSON-349489-project-admin Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: e6d8fc08d3d44a57adf4fe3ee85082cd Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdminNegativeTestJSON-349489-project-admin Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: {"resize": {"flavorRef": "2032826355"}} Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd391dfcd-d33d-4930-bbd4-9c6fb0e326af', 'body': {'resize': {'flavorRef': '2032826355'}}} Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:19:49.730376 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff964a6d-0cdb-4243-ac8b-072fa1374a87 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "POST /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af/action" status: 403 len: 113 microversion: 2.1 time: 0.102298 Oct 17 14:19:49.735011 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3661/7064] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:19:49 2022] POST /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af/action => generated 113 bytes in 103 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:49.741195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-418166cc-e1c2-4b38-9741-05e991604875 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.759974 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-418166cc-e1c2-4b38-9741-05e991604875 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "DELETE /compute/v2.1/flavors/2032826355" status: 202 len: 0 microversion: 2.1 time: 0.023186 Oct 17 14:19:49.760544 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3662/7065] 10.222.0.65 () {58 vars in 1161 bytes} [Mon Oct 17 14:19:49 2022] DELETE /compute/v2.1/flavors/2032826355 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:19:49.768331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ceaebbdf-9eb0-4cb1-b6a5-f11ca0ddb964 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.788065 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ceaebbdf-9eb0-4cb1-b6a5-f11ca0ddb964 tempest-ServersAdminNegativeTestJSON-349489 tempest-ServersAdminNegativeTestJSON-349489-project-admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023138 Oct 17 14:19:49.788648 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3663/7066] 10.222.0.65 () {58 vars in 1146 bytes} [Mon Oct 17 14:19:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:49.809695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.810212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:49.816659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.817183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.817650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.818362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.818836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.819281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.844481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:19:49.859326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:49.926206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc212b2a-4c14-4f42-819e-23d1380da6e6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 204 len: 0 microversion: 2.1 time: 0.120123 Oct 17 14:19:49.928354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3664/7067] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:19:49 2022] DELETE /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:19:49.935591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:49.936314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:49.942325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.942816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.943264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:49.943963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:49.944423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:49.944855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:50.077284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:50.086248 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18c556b4-1477-4f40-a3fa-f39a1b999bb6 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1478 microversion: 2.1 time: 0.154704 Oct 17 14:19:50.086827 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3665/7068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:49 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1478 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:50.973294 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:19:50.973880 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:19:50.974576 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:19:50.974711 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:19:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:19:51.110309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:51.111333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:51.119142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:51.119643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:51.120096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:51.120831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:51.121311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:51.121757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:51.257722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:51.265576 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7fecd656-1904-4bd0-82af-f0dbcf329953 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1478 microversion: 2.1 time: 0.159262 Oct 17 14:19:51.266178 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3666/7069] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:51 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:52.024043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1f4e40ce-19eb-459a-81ff-0253682d76df req-34d7bb39-0a6d-44d6-8968-f3513446a0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d391dfcd-d33d-4930-bbd4-9c6fb0e326af", "name": "network-vif-deleted", "tag": "a8d05b0b-4801-4d14-ba3b-79a10182eeb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:52.034900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1f4e40ce-19eb-459a-81ff-0253682d76df req-34d7bb39-0a6d-44d6-8968-f3513446a0bc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:52.035398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1f4e40ce-19eb-459a-81ff-0253682d76df req-34d7bb39-0a6d-44d6-8968-f3513446a0bc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:52.035852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1f4e40ce-19eb-459a-81ff-0253682d76df req-34d7bb39-0a6d-44d6-8968-f3513446a0bc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:52.048011 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1f4e40ce-19eb-459a-81ff-0253682d76df req-34d7bb39-0a6d-44d6-8968-f3513446a0bc service nova] Creating event network-vif-deleted:a8d05b0b-4801-4d14-ba3b-79a10182eeb2 for instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af on n-h2-854121-14 Oct 17 14:19:52.054037 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1f4e40ce-19eb-459a-81ff-0253682d76df req-34d7bb39-0a6d-44d6-8968-f3513446a0bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034021 Oct 17 14:19:52.054658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3667/7070] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:19:52.290891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:52.291605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:52.298024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:52.298521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:52.298974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:52.299678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:52.300336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:52.300782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:52.332285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:52.332788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:52.333282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:52.333748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lazy-loading 'fault' on Instance uuid d391dfcd-d33d-4930-bbd4-9c6fb0e326af {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:19:52.378661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95699dbadba54de1a5c1c6466287b1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa48916ffd8341b793b1c557da0e5dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:19:52.386779 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3d6134b-184f-4ce4-9bee-82305414a836 tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 200 len: 1312 microversion: 2.1 time: 0.101301 Oct 17 14:19:52.387364 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3668/7071] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:52 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:19:53.410837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:19:53.411474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] [instance: d391dfcd-d33d-4930-bbd4-9c6fb0e326af] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:19:53.418646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:53.419144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:53.419599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:53.420313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:19:53.420775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:19:53.421249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:19:53.435447 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] HTTP exception thrown: Instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af could not be found. Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Request method failure captured: Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af HTTP/1.1 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWR1d0DvwLzrCT6XmkKcpdYkxdM-g0V7FskzYEGNDoHT0sA7-9TG0lSjNDdskHm_HaBup3fnFCvDNvJj97dxpfE9LFNc2jFhaRQFUZxP-4EFT5yYBs1xT2vwBlwEdJKQDrbbXTeQmqB8vk_aAhA3yB4Wp-zGT8pb1_11hajbgaTl6eE Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: aa48916ffd8341b793b1c557da0e5dc8 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1370066406 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/aa48916ffd8341b793b1c557da0e5dc8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/aa48916ffd8341b793b1c557da0e5dc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/aa48916ffd8341b793b1c557da0e5dc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_aa48916ffd8341b793b1c557da0e5dc8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1370066406 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: aa48916ffd8341b793b1c557da0e5dc8 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1370066406 Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersAdminNegativeTestJSON-1370066406-project Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 95699dbadba54de1a5c1c6466287b1ca Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1370066406-project Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af could not be found. Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'd391dfcd-d33d-4930-bbd4-9c6fb0e326af'} Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af could not be found. Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af could not be found. Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:53.437103 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af could not be found. Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] Returning 404 to user: Instance d391dfcd-d33d-4930-bbd4-9c6fb0e326af could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df54969a-0653-4375-a5d0-2e2925d0148c tempest-ServersAdminNegativeTestJSON-1370066406 tempest-ServersAdminNegativeTestJSON-1370066406-project] 10.222.0.65 "GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af" status: 404 len: 111 microversion: 2.1 time: 0.032336 Oct 17 14:19:53.442002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3669/7072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:19:53 2022] GET /compute/v2.1/servers/d391dfcd-d33d-4930-bbd4-9c6fb0e326af => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:19:59.592526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:59.697702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:19:59.713632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1469850095", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "ab52c203-b71d-490a-888f-9e1b9078cc6f"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:19:59.771295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] validate_networks() for [('ab52c203-b71d-490a-888f-9e1b9078cc6f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:20:00.193315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:20:00.193753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:20:00.194242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:20:00.194668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:20:00.195090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:20:00.204403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.204899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.205383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.206341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:00.206811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:00.207248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:00.226028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Getting quotas for project 1e5c6e34a439448ab3694b40738d8a2e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:20:00.231847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Getting quotas for user 50cfa4ad45e74ec9b3082cd65d492055 and project 1e5c6e34a439448ab3694b40738d8a2e. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:20:00.246097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:20:00.248450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:20:00.297517 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a42d7956-7d98-462c-b3ab-51011468a71b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710309 Oct 17 14:20:00.298298 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3670/7073] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:19:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:20:00.310017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3af47837-dde9-46f6-9043-8e1ebc13938d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:00.310761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3af47837-dde9-46f6-9043-8e1ebc13938d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:00.370914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3af47837-dde9-46f6-9043-8e1ebc13938d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:00.381830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3af47837-dde9-46f6-9043-8e1ebc13938d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1215 microversion: 2.1 time: 0.075846 Oct 17 14:20:00.382763 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3671/7074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:00 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:01.406081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:01.406732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:01.414835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.415938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.416552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:01.417431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:01.418136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:01.419216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:01.529919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:01.538339 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-86bf22bb-0fc9-4686-87a0-0df34d9e99f0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1285 microversion: 2.1 time: 0.136144 Oct 17 14:20:01.539281 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3672/7075] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:01 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:02.561636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:02.563043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:02.571132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:02.571932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:02.572554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:02.573490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:02.574124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:02.574832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:02.795331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:02.804131 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f3294be-5b26-4136-86fe-1ff03f31fff2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1315 microversion: 2.1 time: 0.246460 Oct 17 14:20:02.804715 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3673/7076] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:02 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:02.939811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1a665824-0f9e-4da5-b39a-660906d168a1 req-d593dffb-cd7a-43a3-868a-e02fa75580e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af268f78-e539-4ef1-99e9-2a7028bd315a", "tag": "48ca4b15-23d4-4989-b355-055a2959d54e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:02.955187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1a665824-0f9e-4da5-b39a-660906d168a1 req-d593dffb-cd7a-43a3-868a-e02fa75580e4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:02.955771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1a665824-0f9e-4da5-b39a-660906d168a1 req-d593dffb-cd7a-43a3-868a-e02fa75580e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:02.956447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1a665824-0f9e-4da5-b39a-660906d168a1 req-d593dffb-cd7a-43a3-868a-e02fa75580e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:02.980173 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1a665824-0f9e-4da5-b39a-660906d168a1 req-d593dffb-cd7a-43a3-868a-e02fa75580e4 service nova] Creating event network-changed:48ca4b15-23d4-4989-b355-055a2959d54e for instance af268f78-e539-4ef1-99e9-2a7028bd315a on n-h1-854121-14 Oct 17 14:20:02.985429 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1a665824-0f9e-4da5-b39a-660906d168a1 req-d593dffb-cd7a-43a3-868a-e02fa75580e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051807 Oct 17 14:20:02.986050 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3674/7077] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:03.830962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:03.831676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:03.838171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:03.838593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:03.839038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:03.839746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:03.840214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:03.840659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:03.977068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:03.984814 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94699ff4-470a-43b1-a8df-145ab0ae0e05 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1315 microversion: 2.1 time: 0.159053 Oct 17 14:20:03.985412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3675/7078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:03 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:05.008972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:05.009664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:05.016914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:05.017455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:05.017918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:05.018640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:05.019116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:05.019569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:05.158024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:05.166155 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60db2c73-5c9d-4abd-bf09-71887809cef7 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1315 microversion: 2.1 time: 0.161360 Oct 17 14:20:05.166740 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3676/7079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:05 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:06.189955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:06.190617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:06.197750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:06.198248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:06.199010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:06.199724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:06.200197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:06.200639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:06.330391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:06.338422 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a3ca186-2cef-4c2e-a90f-50a639cecffa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1315 microversion: 2.1 time: 0.152411 Oct 17 14:20:06.339006 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3677/7080] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:06 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:07.361880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:07.362644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:07.369246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:07.369755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:07.370239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:07.370962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:07.371437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:07.371914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:07.507599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:07.515386 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8744fd09-06d8-4cbd-a34d-561eb4b63ebb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1315 microversion: 2.1 time: 0.158037 Oct 17 14:20:07.515955 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3678/7081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:07 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:08.163339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8bd38220-e665-440e-91ae-9b56b56175fd req-ca8eaa7e-78c8-4ee9-9e80-b079566e06c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af268f78-e539-4ef1-99e9-2a7028bd315a", "name": "network-vif-plugged", "status": "completed", "tag": "48ca4b15-23d4-4989-b355-055a2959d54e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:08.174687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8bd38220-e665-440e-91ae-9b56b56175fd req-ca8eaa7e-78c8-4ee9-9e80-b079566e06c2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:08.175261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8bd38220-e665-440e-91ae-9b56b56175fd req-ca8eaa7e-78c8-4ee9-9e80-b079566e06c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:08.176345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8bd38220-e665-440e-91ae-9b56b56175fd req-ca8eaa7e-78c8-4ee9-9e80-b079566e06c2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:08.187744 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8bd38220-e665-440e-91ae-9b56b56175fd req-ca8eaa7e-78c8-4ee9-9e80-b079566e06c2 service nova] Creating event network-vif-plugged:48ca4b15-23d4-4989-b355-055a2959d54e for instance af268f78-e539-4ef1-99e9-2a7028bd315a on n-h1-854121-14 Oct 17 14:20:08.193555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8bd38220-e665-440e-91ae-9b56b56175fd req-ca8eaa7e-78c8-4ee9-9e80-b079566e06c2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091034 Oct 17 14:20:08.194098 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3679/7082] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:20:08.539961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:08.540667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:08.548113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:08.548618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:08.549718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:08.549840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:08.551541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:08.551541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:08.689335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:08.697189 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb7a4cb2-db3d-42d6-bbed-fcfe58d88f17 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1315 microversion: 2.1 time: 0.162079 Oct 17 14:20:08.697764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3680/7083] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:08 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:09.722222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:09.722959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:09.729898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:09.730398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:09.730858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:09.731579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:09.732053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:09.732525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:09.868155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:09.876709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74466520-fa70-4e0b-b51b-d4e8cf05fbfe tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1502 microversion: 2.1 time: 0.158450 Oct 17 14:20:09.877313 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3681/7084] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:09 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:09.899387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:09.901683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:09.907742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:09.908248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:09.908702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:09.909444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:09.910479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:09.910861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:09.985669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:09.992016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:20:09.998645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:20:09.999082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:20:09.999576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:20:10.000002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:20:10.000432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:20:10.096044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:10.112288 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-192813e3-8f6d-47c5-a013-2d91b19ed52b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "POST /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a/action" status: 202 len: 0 microversion: 2.1 time: 0.216738 Oct 17 14:20:10.113767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3682/7085] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:20:09 2022] POST /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:20:10.121814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:10.122514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:10.131245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:10.131753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:10.132197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:10.132958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:10.133397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:10.133872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:10.214920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:10.282664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:10.291435 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-753c9759-3931-4bd9-99a9-16462561177e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1511 microversion: 2.1 time: 0.173496 Oct 17 14:20:10.292026 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3683/7086] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:10 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:11.317257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:11.317874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:11.321609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:11.327704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:11.328214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:11.328675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:11.329428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:11.329903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:11.330557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:11.473869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:11.481889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a10b6e26-caa8-421e-a586-feb1e9dd64f3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1511 microversion: 2.1 time: 0.170184 Oct 17 14:20:11.482471 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3684/7087] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:11 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:12.505995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:12.506698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:12.513798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:12.514308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:12.514796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:12.515571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:12.516045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:12.516511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:12.661037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:12.670024 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9e16844-9c60-448c-8d53-566e0159e509 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1511 microversion: 2.1 time: 0.168821 Oct 17 14:20:12.670970 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3685/7088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:12 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:13.695449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:13.696036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:13.702811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:13.703324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:13.703768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:13.704465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:13.704923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:13.705383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:13.840551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:13.848826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-efa7e47d-4c93-4b53-8ad4-93399bf2dce4 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.157838 Oct 17 14:20:13.849444 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3686/7089] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:13 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:14.874471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:14.875130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:14.882861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:14.883372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:14.883832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:14.884559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:14.885038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:14.885514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:15.023857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:15.031684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88bfd587-1c27-47c7-bd53-b5e3fad35dc3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.163528 Oct 17 14:20:15.032251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3687/7090] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:14 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:16.056593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:16.057300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:16.064946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:16.065491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:16.065971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:16.066681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:16.067162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:16.067838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:16.218042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:16.226815 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9366514-419f-4ce5-be1e-9c9d055679c3 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.175799 Oct 17 14:20:16.227529 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3688/7091] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:16 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:17.256920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:17.257618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:17.264378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:17.264869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:17.265340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:17.266046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:17.266509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:17.266947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:17.398477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:17.406263 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-651a3930-1cf0-442d-b110-99897989acdf tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.154154 Oct 17 14:20:17.406839 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3689/7092] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:17 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:18.429334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:18.429984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:18.436859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:18.437378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:18.437836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:18.438550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:18.439022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:18.439466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:18.572917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:18.580839 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0b58b7fa-a188-474f-8850-22c0e2771cf1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.155574 Oct 17 14:20:18.581453 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3690/7093] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:18 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:19.605408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:19.606022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:19.613178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.613688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.614161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.615547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:19.616174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:19.616614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:19.755753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:19.763765 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98258d60-4f04-41ba-a147-933d52b73a50 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.162366 Oct 17 14:20:19.764345 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3691/7094] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:19 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:20.787171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:20.787787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:20.790615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:20.796195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:20.796687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:20.797131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:20.797856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:20.798318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:20.798751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:20.934654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:20.943371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-06e7d845-99d4-4e73-8c21-d688df4fd5ee tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.159592 Oct 17 14:20:20.943956 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3692/7095] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:20 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:21.969353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:21.970003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:21.977051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:21.977584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:21.978048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:21.978760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:21.979235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:21.979681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:22.113914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:22.122738 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92f069c9-6166-4f04-9449-8da5447db83e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.157401 Oct 17 14:20:22.123347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3693/7096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:21 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:23.147435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:23.148137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:23.155020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.155520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.155975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.156680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:23.157150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:23.157618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:23.286220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:23.294121 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28f0683b-b8b2-4108-914e-dc8fe845456c tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.151213 Oct 17 14:20:23.294702 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3694/7097] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:23 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:24.317513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:24.318166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:24.325971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:24.326472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:24.326926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:24.327636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:24.328107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:24.328551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:24.457901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:24.465632 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07f43061-199e-406b-b3e8-be6616edba98 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.152095 Oct 17 14:20:24.466210 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3695/7098] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:24 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:25.488358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:25.489056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:25.496060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.496558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.497012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:25.497744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:25.498214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:25.498653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:25.635281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:25.643584 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c89e7fe-13b0-41a9-b7f1-4a9bfd2fe7b1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.159121 Oct 17 14:20:25.644160 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3696/7099] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:25 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:26.668427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:26.669083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:26.676207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:26.676707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:26.677178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:26.677893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:26.678370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:26.678805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:26.808607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:26.816511 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c39a7809-07be-421d-951e-3258802fa07e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.152009 Oct 17 14:20:26.817086 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3697/7100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:26 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:27.840461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:27.841101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:27.848144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:27.848657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:27.849142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:27.850410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:27.850888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:27.851330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:27.985819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:27.994917 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7fe8ce0-14cc-410c-9b69-48f3071279e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.158589 Oct 17 14:20:27.995512 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3698/7101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:27 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:29.018603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:29.019278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:29.026336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:29.026840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:29.027299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:29.028012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:29.028485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:29.028935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:29.047957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:29.176576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:29.186173 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-836fdc40-b545-42e0-bc11-d155e8b2055b tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.171343 Oct 17 14:20:29.186810 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3699/7102] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:29 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:30.210622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:30.211301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:30.218761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.219268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.219725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.220441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:30.220912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:30.221463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:30.359924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:30.368893 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1427471b-e192-41a0-a59d-dc4a5e261cc1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.162159 Oct 17 14:20:30.369531 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3700/7103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:30 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:31.393393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:31.394029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:31.400974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:31.401505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:31.401953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:31.402656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:31.403124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:31.403562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:31.537356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:31.545465 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c1db90d-4a79-4ff7-861c-336e5458d424 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.156265 Oct 17 14:20:31.546052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3701/7104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:31 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:32.569669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:32.570444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:32.577640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:32.578154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:32.579214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:32.579354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:32.579787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:32.580238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:32.718296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:32.726746 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d236354-f28f-4592-a2b0-1a9f6f79f8b9 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.161729 Oct 17 14:20:32.727273 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3702/7105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:32 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:33.750100 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:33.750781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:33.758245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:33.758734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:33.759176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:33.759871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:33.760330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:33.760763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:33.898960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:33.906813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9447c608-6850-495c-b211-18dce53253af tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.160599 Oct 17 14:20:33.907471 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3703/7106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:33 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:34.931558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:34.932204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:34.939108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:34.939611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:34.940070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:34.940780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:34.941281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:34.941724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:35.072961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:35.080733 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd5ba08b-4fcd-4355-8362-1588a741e93f tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.153830 Oct 17 14:20:35.081555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3704/7107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:34 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:36.103764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:36.104442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:36.111400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:36.111897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:36.112347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:36.113051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:36.113547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:36.113986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:36.247053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:36.255080 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4f9d6c5-6aad-430d-8305-d6a9a7ef5b7e tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.155113 Oct 17 14:20:36.256371 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3705/7108] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:36 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:37.279112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:37.279791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:37.285948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.286451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.287769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.288261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:37.288730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:37.289190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:37.417473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:37.425252 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1a0b194-020b-4996-88bb-caff3a553c18 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.150260 Oct 17 14:20:37.425827 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3706/7109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:37 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:38.448749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:38.449406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:38.456190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:38.456692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:38.457149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:38.457877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:38.458350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:38.458841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:38.589113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:38.596940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4dc87e0f-2a8d-4dbf-b92a-fa75ef21b702 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1516 microversion: 2.1 time: 0.152301 Oct 17 14:20:38.597540 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3707/7110] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:38 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:39.622832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:39.623531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:39.632206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:39.632721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:39.633200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:39.634101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:39.634573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:39.635013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:39.859333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:39.868208 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3318b42c-7230-49f8-add5-ecf99b6966e2 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1515 microversion: 2.1 time: 0.249616 Oct 17 14:20:39.868759 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3708/7111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:39 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1515 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:40.156638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af268f78-e539-4ef1-99e9-2a7028bd315a", "name": "network-vif-unplugged", "status": "completed", "tag": "48ca4b15-23d4-4989-b355-055a2959d54e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:40.174452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:40.175022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:40.175663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:40.190586 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] Creating event network-vif-unplugged:48ca4b15-23d4-4989-b355-055a2959d54e for instance af268f78-e539-4ef1-99e9-2a7028bd315a on n-h2-854121-14 Oct 17 14:20:40.201428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] Instance af268f78-e539-4ef1-99e9-2a7028bd315a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:20:40.213378 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f331ec24-4240-437d-9006-1968fbaeee5c req-ddc9fd4d-ca0f-4325-8d13-8d49eb25c678 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061459 Oct 17 14:20:40.214354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3709/7112] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:20:40.893493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:40.894146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:40.900739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:40.901293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:40.901771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:40.902519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:40.902989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:40.903431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:41.065798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:41.074849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15e1c2bb-c4c0-4d4a-ab2e-8c2e342a9db0 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1515 microversion: 2.1 time: 0.186509 Oct 17 14:20:41.075438 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3710/7113] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:40 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:42.098548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:42.099232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:42.106259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.106748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.107196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.107887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.108347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.108783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.246922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:42.254707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b85a49a-917b-4b23-a593-8af2251027c1 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1513 microversion: 2.1 time: 0.160103 Oct 17 14:20:42.256047 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3711/7114] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:42 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:42.265304 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af268f78-e539-4ef1-99e9-2a7028bd315a", "tag": "48ca4b15-23d4-4989-b355-055a2959d54e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:42.269609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:42.270092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:42.270549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:42.282664 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] Creating event network-changed:48ca4b15-23d4-4989-b355-055a2959d54e for instance af268f78-e539-4ef1-99e9-2a7028bd315a on n-h2-854121-14 Oct 17 14:20:42.288043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] Instance af268f78-e539-4ef1-99e9-2a7028bd315a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:20:42.299477 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7b84047f-b480-40ad-9635-4e9403cc9b6c req-dea15e46-f715-4dfb-ab6c-1faa77bf9f5d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042230 Oct 17 14:20:42.300060 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3712/7115] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:43.280891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:43.281638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:43.289894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:43.290401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:43.290860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:43.291575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:43.292049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:43.292493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:43.424175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:43.432296 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63823c50-94a1-4864-8bce-15951c5f3b7d tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1513 microversion: 2.1 time: 0.155700 Oct 17 14:20:43.432901 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3713/7116] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:43 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:44.455479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:44.457012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:44.465664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.466258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.466780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.467581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:44.468120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:44.468631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:44.687166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:44.695799 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d2e86d8-5af1-41f0-b0d1-0f86b5663408 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1513 microversion: 2.1 time: 0.244196 Oct 17 14:20:44.696389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3714/7117] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:44 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:45.719886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:45.720570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:45.728318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:45.728818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:45.729317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:45.730028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:45.730503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:45.730948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:45.864937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:45.873823 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3615fb6d-122c-417f-96cf-ddcbb75a1edb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1510 microversion: 2.1 time: 0.157679 Oct 17 14:20:45.874421 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3715/7118] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:45 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:45.897909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:45.898337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:45.904347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:45.904841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:45.905320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:45.906025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:45.906492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:45.906934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:45.932437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:20:45.935331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:45.984404 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Found an unconfirmed migration during delete, id: 16, status: finished Oct 17 14:20:47.340711 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f4d9094-6cfd-4853-bb4c-c4676f32b2eb tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "DELETE /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 204 len: 0 microversion: 2.1 time: 1.447335 Oct 17 14:20:47.341872 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3716/7119] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:20:45 2022] DELETE /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 0 bytes in 1449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:20:47.347061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5d4bcc21-711f-44f2-a6ff-34d3d4a008bd req-0c68ea86-3f6b-4da9-a30c-f9407bb783ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af268f78-e539-4ef1-99e9-2a7028bd315a", "name": "network-vif-plugged", "status": "completed", "tag": "48ca4b15-23d4-4989-b355-055a2959d54e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:47.357551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5d4bcc21-711f-44f2-a6ff-34d3d4a008bd req-0c68ea86-3f6b-4da9-a30c-f9407bb783ad service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:47.358044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5d4bcc21-711f-44f2-a6ff-34d3d4a008bd req-0c68ea86-3f6b-4da9-a30c-f9407bb783ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:47.358481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5d4bcc21-711f-44f2-a6ff-34d3d4a008bd req-0c68ea86-3f6b-4da9-a30c-f9407bb783ad service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:47.370240 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5d4bcc21-711f-44f2-a6ff-34d3d4a008bd req-0c68ea86-3f6b-4da9-a30c-f9407bb783ad service nova] Creating event network-vif-plugged:48ca4b15-23d4-4989-b355-055a2959d54e for instance af268f78-e539-4ef1-99e9-2a7028bd315a on n-h2-854121-14 Oct 17 14:20:47.375319 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5d4bcc21-711f-44f2-a6ff-34d3d4a008bd req-0c68ea86-3f6b-4da9-a30c-f9407bb783ad service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032256 Oct 17 14:20:47.375919 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3717/7120] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:20:47.381971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:47.382677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:47.389284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:47.389775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:47.390232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:47.390928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:47.391393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:47.391827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:47.523650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:47.531400 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad5e11ed-962c-407e-8441-7718780549e5 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1502 microversion: 2.1 time: 0.154381 Oct 17 14:20:47.531973 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3718/7121] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:47 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:20:48.555045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:48.555698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:48.562663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:48.563166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:48.563621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:48.564341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:48.564811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:48.565289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:48.702004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cfa4ad45e74ec9b3082cd65d492055', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e5c6e34a439448ab3694b40738d8a2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:48.709737 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-902f6552-3a67-49fd-9e56-a400c3722f69 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 200 len: 1502 microversion: 2.1 time: 0.159163 Oct 17 14:20:48.710298 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3719/7122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:48 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:20:49.433403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d372fa07-435d-4889-806b-1563862fc995 req-f3d56319-1910-4272-a86e-00eb86ce28b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af268f78-e539-4ef1-99e9-2a7028bd315a", "name": "network-vif-deleted", "tag": "48ca4b15-23d4-4989-b355-055a2959d54e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:49.443641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d372fa07-435d-4889-806b-1563862fc995 req-f3d56319-1910-4272-a86e-00eb86ce28b1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.444119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d372fa07-435d-4889-806b-1563862fc995 req-f3d56319-1910-4272-a86e-00eb86ce28b1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.444562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d372fa07-435d-4889-806b-1563862fc995 req-f3d56319-1910-4272-a86e-00eb86ce28b1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.455890 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d372fa07-435d-4889-806b-1563862fc995 req-f3d56319-1910-4272-a86e-00eb86ce28b1 service nova] Creating event network-vif-deleted:48ca4b15-23d4-4989-b355-055a2959d54e for instance af268f78-e539-4ef1-99e9-2a7028bd315a on n-h2-854121-14 Oct 17 14:20:49.461686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d372fa07-435d-4889-806b-1563862fc995 req-f3d56319-1910-4272-a86e-00eb86ce28b1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031917 Oct 17 14:20:49.462206 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3720/7123] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:20:49.734004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:49.735482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:49.742643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.743168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.743622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.744360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.744826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.745296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.760704 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] HTTP exception thrown: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Request method failure captured: Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a HTTP/1.1 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWSPtFV4eD6dUzCjUfA_bJbO1Bwe2irPSpF2xZkrvSMsJPQx0-g9i_n5CdZsKNnpNJqkFiBIBI8aJrFoZArEjoixxg3I8B_MePPHmkvYbs0C59DiQ4cjThqD4z8xtgMG9gZ0Uga9RtRAZbnFkdEZrtJF5uc-u-oVg2i7RwGXWKX3Gew Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1e5c6e34a439448ab3694b40738d8a2e Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1e5c6e34a439448ab3694b40738d8a2e Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-1980876760-project Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 50cfa4ad45e74ec9b3082cd65d492055 Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-1980876760-project Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'af268f78-e539-4ef1-99e9-2a7028bd315a'} Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:49.762441 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Returning 404 to user: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6acf048-1954-4cfc-b83a-d47c21cbd122 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 404 len: 111 microversion: 2.1 time: 0.035334 Oct 17 14:20:49.766677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3721/7124] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:49 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:20:49.777850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:49.778645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:49.784842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.785388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.785849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.786800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.787396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.787859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.802784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] HTTP exception thrown: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Request method failure captured: Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a HTTP/1.1 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWSPtFV4eD6dUzCjUfA_bJbO1Bwe2irPSpF2xZkrvSMsJPQx0-g9i_n5CdZsKNnpNJqkFiBIBI8aJrFoZArEjoixxg3I8B_MePPHmkvYbs0C59DiQ4cjThqD4z8xtgMG9gZ0Uga9RtRAZbnFkdEZrtJF5uc-u-oVg2i7RwGXWKX3Gew Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1e5c6e34a439448ab3694b40738d8a2e Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1e5c6e34a439448ab3694b40738d8a2e Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-1980876760-project Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 50cfa4ad45e74ec9b3082cd65d492055 Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-1980876760-project Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'af268f78-e539-4ef1-99e9-2a7028bd315a'} Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:20:49.804389 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Returning 404 to user: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45e82ee7-e568-49d5-afd6-0b1645de9ca6 tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "DELETE /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 404 len: 111 microversion: 2.1 time: 0.031850 Oct 17 14:20:49.809052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3722/7125] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:20:49 2022] DELETE /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:20:49.814889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:49.815610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] [instance: af268f78-e539-4ef1-99e9-2a7028bd315a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:49.822613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.823127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.823605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.824326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:49.824801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:49.825285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:49.843464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] HTTP exception thrown: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Request method failure captured: Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a HTTP/1.1 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWSPtFV4eD6dUzCjUfA_bJbO1Bwe2irPSpF2xZkrvSMsJPQx0-g9i_n5CdZsKNnpNJqkFiBIBI8aJrFoZArEjoixxg3I8B_MePPHmkvYbs0C59DiQ4cjThqD4z8xtgMG9gZ0Uga9RtRAZbnFkdEZrtJF5uc-u-oVg2i7RwGXWKX3Gew Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 1e5c6e34a439448ab3694b40738d8a2e Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_1e5c6e34a439448ab3694b40738d8a2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 1e5c6e34a439448ab3694b40738d8a2e Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1980876760 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-1980876760-project Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 50cfa4ad45e74ec9b3082cd65d492055 Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-1980876760-project Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'af268f78-e539-4ef1-99e9-2a7028bd315a'} Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:20:49.845041 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] Returning 404 to user: Instance af268f78-e539-4ef1-99e9-2a7028bd315a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ea7ba9b-8cbe-4dbb-89b3-728e92e99aaa tempest-DeleteServersTestJSON-1980876760 tempest-DeleteServersTestJSON-1980876760-project] 10.222.0.65 "GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a" status: 404 len: 111 microversion: 2.1 time: 0.035517 Oct 17 14:20:49.849027 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3723/7126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:49 2022] GET /compute/v2.1/servers/af268f78-e539-4ef1-99e9-2a7028bd315a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:20:58.791789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-664108286", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "191ec1c1-3927-45ff-bf83-efcddbcdf50e"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:20:58.800630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:20:58.852203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] validate_networks() for [('191ec1c1-3927-45ff-bf83-efcddbcdf50e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:20:59.541137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:20:59.541647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:20:59.542139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:20:59.542694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:20:59.543033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:20:59.552239 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:59.552829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:59.553227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:59.553982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:20:59.554455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:20:59.554899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:20:59.573313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Getting quotas for project 511c2b4e05284d15aa5edc703471a889. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:20:59.578835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Getting quotas for user c01f3fa4d5964520b22c6a2c82a1a161 and project 511c2b4e05284d15aa5edc703471a889. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:20:59.592445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:20:59.594887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:20:59.644571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e145d549-4f1b-4eab-a4d3-6669fd57be6d tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986269 Oct 17 14:20:59.645246 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3724/7127] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:20:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:20:59.658368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c58c5b2a-54b2-4aef-92c3-e731e1225986 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:20:59.659011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c58c5b2a-54b2-4aef-92c3-e731e1225986 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:20:59.722405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c58c5b2a-54b2-4aef-92c3-e731e1225986 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:20:59.734048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c58c5b2a-54b2-4aef-92c3-e731e1225986 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1217 microversion: 2.1 time: 0.081113 Oct 17 14:20:59.738206 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3725/7128] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:20:59 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:00.758789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:00.760188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:00.767291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:00.768040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:00.768654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:00.769565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:00.770186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:00.771461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:00.888791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:00.899953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5591060d-4875-4f5d-a374-6b54f4aeb91f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1287 microversion: 2.1 time: 0.145694 Oct 17 14:21:00.901130 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3726/7129] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:00 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1287 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:01.926277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:01.927584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:01.935320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:01.935828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:01.936310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:01.937067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:01.937590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:01.938029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:02.163556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:02.171882 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9ed3cd7-6174-4b68-b4d2-30ffda5d8b88 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.250790 Oct 17 14:21:02.172458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3727/7130] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:01 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:02.280971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5e422910-e6be-47c2-8c1e-52254f7de3ba req-2c5b12f5-99aa-4ebb-baa6-6376f2855cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72", "tag": "85b3f057-c4cd-47e0-abe0-65f105415824"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:02.305143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5e422910-e6be-47c2-8c1e-52254f7de3ba req-2c5b12f5-99aa-4ebb-baa6-6376f2855cf1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:02.305681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5e422910-e6be-47c2-8c1e-52254f7de3ba req-2c5b12f5-99aa-4ebb-baa6-6376f2855cf1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:02.306152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5e422910-e6be-47c2-8c1e-52254f7de3ba req-2c5b12f5-99aa-4ebb-baa6-6376f2855cf1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:02.323067 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5e422910-e6be-47c2-8c1e-52254f7de3ba req-2c5b12f5-99aa-4ebb-baa6-6376f2855cf1 service nova] Creating event network-changed:85b3f057-c4cd-47e0-abe0-65f105415824 for instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 on n-h1-854121-14 Oct 17 14:21:02.328379 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5e422910-e6be-47c2-8c1e-52254f7de3ba req-2c5b12f5-99aa-4ebb-baa6-6376f2855cf1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051097 Oct 17 14:21:02.328984 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3728/7131] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:03.197590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:03.198415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:03.204701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.205220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.205675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.206383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:03.206844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:03.207278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:03.354355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:03.362337 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c531b4a7-c2ff-4474-945c-bc2f0c432e94 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.170434 Oct 17 14:21:03.362955 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3729/7132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:03 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:04.386759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:04.387394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:04.394280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:04.394778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:04.395822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:04.396569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:04.397032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:04.397566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:04.531048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:04.539712 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b66b281c-f52a-486d-8ba6-d2851f09445f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.156849 Oct 17 14:21:04.540298 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3730/7133] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:04 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:05.562801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:05.563479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:05.570403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:05.570899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:05.571363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:05.572079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:05.572557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:05.573004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:05.715826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:05.724812 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb17faac-63f1-457e-83e5-5ca33515e60b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.165644 Oct 17 14:21:05.725440 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3731/7134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:05 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:06.747913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:06.748625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:06.756839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.757362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.757811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.759086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:06.759086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:06.759594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:06.897420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:06.905311 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53186f46-8d72-4fae-b64b-060667281314 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.161295 Oct 17 14:21:06.905937 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3732/7135] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:06 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:07.928513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:07.929206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:07.935864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:07.936361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:07.936814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:07.937557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:07.938028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:07.938469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.071407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:08.079448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-741dbf79-51b5-498e-9fd1-16ea27ce1cba tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.155010 Oct 17 14:21:08.080046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3733/7136] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:07 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:08.435217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-333c005d-14c6-4576-a48b-2643c5d034f1 req-9765934c-0526-432d-a031-f0cdfe9fb9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72", "name": "network-vif-plugged", "status": "completed", "tag": "85b3f057-c4cd-47e0-abe0-65f105415824"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:08.446003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-333c005d-14c6-4576-a48b-2643c5d034f1 req-9765934c-0526-432d-a031-f0cdfe9fb9cd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:08.446550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-333c005d-14c6-4576-a48b-2643c5d034f1 req-9765934c-0526-432d-a031-f0cdfe9fb9cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:08.446964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-333c005d-14c6-4576-a48b-2643c5d034f1 req-9765934c-0526-432d-a031-f0cdfe9fb9cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:08.459423 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-333c005d-14c6-4576-a48b-2643c5d034f1 req-9765934c-0526-432d-a031-f0cdfe9fb9cd service nova] Creating event network-vif-plugged:85b3f057-c4cd-47e0-abe0-65f105415824 for instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 on n-h1-854121-14 Oct 17 14:21:08.464445 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-333c005d-14c6-4576-a48b-2643c5d034f1 req-9765934c-0526-432d-a031-f0cdfe9fb9cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033206 Oct 17 14:21:08.465335 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3734/7137] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:21:09.105931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:09.106659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:09.112941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:09.113486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:09.114530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:09.115248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:09.115722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:09.116595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:09.247899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:09.256040 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8d737c8d-73ae-4d97-b04a-db5c13bb8c2a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1317 microversion: 2.1 time: 0.155623 Oct 17 14:21:09.256615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3735/7138] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:09 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:10.280082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:10.280757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.282745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:10.283520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:10.290885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.291390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.291848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.292595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.293066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.293563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.428173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:10.436112 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5b745f8-ad2d-4de2-86c6-c5bd57551f9e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1508 microversion: 2.1 time: 0.159972 Oct 17 14:21:10.436684 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3736/7139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:10 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:10.458385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:10.459006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.465044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.465579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.466035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.466744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.467219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.467680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.486270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:10.601960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:10.609923 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d1b2d6e-7807-4b31-9264-0ebc53e56660 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1508 microversion: 2.1 time: 0.155306 Oct 17 14:21:10.610504 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3737/7140] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:10 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:10.635296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:10.637811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.644043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.644545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.645086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.646166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.646645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.647093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.711262 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01b86926-3bc1-4d20-8e77-29a0a22e943e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "PUT /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1080 microversion: 2.1 time: 0.081419 Oct 17 14:21:10.711899 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3738/7141] 10.222.0.65 () {60 vars in 1256 bytes} [Mon Oct 17 14:21:10 2022] PUT /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1080 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:10.730871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:10.731502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.737631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.738126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.738582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.739886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.740356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.740799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.875598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:10.884671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6dfe949a-77c1-454b-87a8-275ede19ffc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1506 microversion: 2.1 time: 0.157506 Oct 17 14:21:10.885270 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3739/7142] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:10 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:10.906933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:10.907480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:10.913555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.914052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.914504 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:10.915210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:10.915682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:10.916121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:11.048636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:11.057224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-55b13578-db2e-44c2-89cc-ff2fd2807647 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1506 microversion: 2.1 time: 0.154166 Oct 17 14:21:11.057808 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3740/7143] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:10 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:11.079536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:11.082292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:11.087830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:11.088351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:11.088787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:11.089564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:11.090043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:11.090482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:11.119554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:11.125056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:21:11.132541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:21:11.132984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:21:11.133508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:21:11.133933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:21:11.134364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:21:11.197609 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c328bee-e5db-4055-ab01-6fcfb584e086 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72/action" status: 202 len: 0 microversion: 2.1 time: 0.121661 Oct 17 14:21:11.198149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3741/7144] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:21:11 2022] POST /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:21:11.205928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:11.206557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:11.214884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:11.215408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:11.216210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:11.217256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:11.217734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:11.218181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:11.357515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:11.365606 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c82ff93-8982-4216-9d29-f8863a53ed67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1517 microversion: 2.1 time: 0.163277 Oct 17 14:21:11.366185 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3742/7145] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:11 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:12.389039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:12.389692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:12.396965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:12.397550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:12.398014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:12.398730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:12.399204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:12.399649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:12.539915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:12.550305 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7d84761e-8bd2-4450-b24a-3352507588ac tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1517 microversion: 2.1 time: 0.165140 Oct 17 14:21:12.550885 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3743/7146] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:12 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:13.576056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:13.576694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:13.584412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:13.584908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:13.585394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:13.586106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:13.586573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:13.587013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:13.719558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:13.728204 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9a1c6056-fd99-46c9-8fc5-14a702fe96c0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.156109 Oct 17 14:21:13.728775 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3744/7147] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:13 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:14.752162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:14.752835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:14.760684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:14.761214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:14.761681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:14.762395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:14.762865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:14.763332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:14.898639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:14.907003 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4bde7168-0641-41a6-83c6-060b338c89cd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.158777 Oct 17 14:21:14.907592 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3745/7148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:14 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:15.930710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:15.931364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:15.938317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:15.938819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:15.939271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:15.939986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:15.940457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:15.940900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:16.076025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:16.084508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c24a798-1e10-4647-a244-86e361edb655 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.158015 Oct 17 14:21:16.085081 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3746/7149] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:15 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:17.109079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:17.109748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:17.116429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:17.116926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:17.117412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:17.118124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:17.118589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:17.119030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:17.249197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:17.257778 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6feb18c2-9cc9-4b7c-9c0a-e182564e3f67 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.153655 Oct 17 14:21:17.258355 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3747/7150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:17 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:21:18.282057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:18.282749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:18.291533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:18.292030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:18.292483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:18.293228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:18.293704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:18.294144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:18.443030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:18.450870 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d09bb1e9-1bcc-4f26-b051-e146ef56b235 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.172792 Oct 17 14:21:18.451443 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3748/7151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:18 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:19.475387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:19.476023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:19.483024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:19.483523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:19.483979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:19.484700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:19.485190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:19.485695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:19.622386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:19.631253 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-50553d05-3af7-46a3-b55f-2af74a12b923 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.160706 Oct 17 14:21:19.631853 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3749/7152] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:19 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:20.655441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:20.656128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:20.664216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:20.664727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:20.665207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:20.666000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:20.666527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:20.667022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:20.804971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:20.812826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da117af8-3f26-4636-8588-eee1aa098fc7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.161456 Oct 17 14:21:20.813415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3750/7153] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:20 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:21.836263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:21.836906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:21.843838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:21.844338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:21.844793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:21.845538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:21.846001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:21.846439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:21.980850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:21.988634 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08ed4114-e6dd-4245-a32f-dcb1efa91880 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.156537 Oct 17 14:21:21.989879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3751/7154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:21 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:23.012189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:23.012904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:23.019643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:23.020141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:23.020877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:23.021616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:23.022089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:23.022534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:23.026655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:23.156982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:23.164941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-629d89f1-d989-4e26-b966-83a9e405fdea tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.156739 Oct 17 14:21:23.165558 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3752/7155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:23 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:24.189882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:24.190567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:24.198017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:24.198521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:24.198987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:24.199777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:24.200172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:24.200613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:24.334460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:24.342260 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f70f75f4-6822-44c0-b1f0-83a54c5d0b34 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.156339 Oct 17 14:21:24.342824 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3753/7156] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:24 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:25.366125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:25.366784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:25.372829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:25.373373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:25.373835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:25.374604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:25.375091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:25.375538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:25.507849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:25.515822 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad2c3f56-073c-4d87-afd4-bdbb307c6e08 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.154705 Oct 17 14:21:25.516403 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3754/7157] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:25 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:26.539905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:26.540677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:26.547439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:26.547930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:26.548384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:26.549088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:26.549577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:26.550014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:26.689033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:26.697190 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1fb88547-dbd9-4932-897a-2ad7066994bd tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.161630 Oct 17 14:21:26.697791 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3755/7158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:26 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:27.720123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:27.720803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:27.728659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:27.729153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:27.729631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:27.730344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:27.730806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:27.731244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:27.861090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:27.869792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-878515ee-efe1-4163-a535-a79c7dea02eb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.153645 Oct 17 14:21:27.870383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3756/7159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:27 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:28.895714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:28.896489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:28.899472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:28.905303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:28.905826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:28.906283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:28.907019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:28.907488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:28.907929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:29.044334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:29.052758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d8c62ff7-4390-4b0a-bd37-f9d78489a2f1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.160771 Oct 17 14:21:29.053487 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3757/7160] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:28 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:30.076234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:30.076917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:30.084494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:30.085093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:30.085482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:30.086197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:30.086669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:30.087111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:30.224596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:30.232572 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc386370-65b9-42b9-9e45-e18cda0cdcf2 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.160234 Oct 17 14:21:30.233151 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3758/7161] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:30 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:30.979210 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:21:30.979802 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:21:31.256683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:31.257261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:31.264341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:31.264844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:31.265337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:31.266046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:31.266516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:31.266958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:31.403175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:31.411055 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89e7434e-f217-461d-a593-1f868a985f37 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.158705 Oct 17 14:21:31.412440 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3759/7162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:31 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:32.435263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:32.435898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:32.442820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:32.443424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:32.443753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:32.444458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:32.444922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:32.445386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:32.582217 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:32.591265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f5fa4777-8ad8-485e-b361-25e9884d7091 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.159810 Oct 17 14:21:32.591977 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3760/7163] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:32 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:33.614463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:33.615748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:33.624581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:33.625086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:33.625671 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:33.626395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:33.626865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:33.627313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:33.764595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:33.773462 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-877a56b8-5d32-4b1e-ace7-057688ec955f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.162837 Oct 17 14:21:33.774055 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3761/7164] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:33 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:34.797238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:34.797915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:34.805423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:34.805928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:34.806384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:34.807085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:34.807554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:34.807993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:34.941459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:34.949637 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98df9c9d-9e58-4a26-8ea6-be238e2033bf tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.156282 Oct 17 14:21:34.950216 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3762/7165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:34 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:35.973520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:35.974192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:35.981690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:35.982177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:35.982623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:35.983336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:35.983783 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:35.984218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:36.113992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:36.122715 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bd8e9175-c118-48f9-84e8-a6e543665cb3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.153059 Oct 17 14:21:36.123284 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3763/7166] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:35 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:37.146281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:37.146914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:37.153524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:37.154022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:37.154476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:37.155184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:37.155658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:37.156097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:37.285907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:37.293699 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33770470-910b-4ee0-ab7b-14f2dbcdb965 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.151492 Oct 17 14:21:37.294351 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3764/7167] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:37 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:38.316754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:38.317462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:38.324907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:38.325432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:38.325889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:38.326599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:38.327084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:38.327505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:38.460715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:38.469328 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7994f787-46c2-4513-a11f-23c025892c1f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.156477 Oct 17 14:21:38.469912 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3765/7168] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:38 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:39.492773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:39.493533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:39.500811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:39.501489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:39.501946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:39.502662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:39.503126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:39.503563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:39.639707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:39.647893 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8c684c4-f6cc-4520-9a62-617f7562aec7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.159026 Oct 17 14:21:39.648505 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3766/7169] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:39 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:40.672042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:40.672683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:40.679572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:40.680056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:40.680723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:40.682126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:40.682587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:40.683019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:40.820450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:40.828507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-817c05fb-cd48-4447-99b5-f6322c883d4b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.160363 Oct 17 14:21:40.829085 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3767/7170] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:40 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:41.852990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:41.853845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:41.860675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:41.861204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:41.861662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:41.862374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:41.862842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:41.863281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:41.997581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:42.001074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:42.006102 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3650b66-d70c-49d9-9a62-1d16b74cce2b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.157826 Oct 17 14:21:42.006690 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3768/7171] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:41 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:43.030700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:43.031460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:43.038499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:43.039000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:43.039459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:43.040749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:43.041345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:43.041792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:43.172291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:43.180139 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5048c9e-3538-4cb4-95d8-fed65fd740d1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.153975 Oct 17 14:21:43.180822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3769/7172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:43 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:44.203318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:44.203940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:44.210750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:44.211262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:44.211695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:44.212394 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:44.212849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:44.213316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:44.344812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:44.353514 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-043a3d6a-8f61-4265-a107-86223254115b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1522 microversion: 2.1 time: 0.154030 Oct 17 14:21:44.354097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3770/7173] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:44 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:45.377545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:45.378204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:45.386184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.386692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.387182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.387903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.388384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.388827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.595211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:45.603800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3ec19dd-43cf-44c6-ac8f-049b9c8e8c65 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1521 microversion: 2.1 time: 0.230270 Oct 17 14:21:45.604713 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3771/7174] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:45 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:45.652101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72", "name": "network-vif-unplugged", "status": "completed", "tag": "85b3f057-c4cd-47e0-abe0-65f105415824"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:45.662342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:45.662864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:45.663469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:45.677888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] Creating event network-vif-unplugged:85b3f057-c4cd-47e0-abe0-65f105415824 for instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 on n-h2-854121-14 Oct 17 14:21:45.684129 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:21:45.698286 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-243dd827-1c6d-44f7-bb61-c847de6df667 req-1189ae2c-9082-4754-802c-e4591b748568 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050265 Oct 17 14:21:45.699164 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3772/7175] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:46.629505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:46.630518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:46.637613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:46.638388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:46.638552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:46.639270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:46.639722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:46.640165 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:46.775464 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:46.783372 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a2ea959-0866-41a6-86b7-8b6eabcb6ca5 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1519 microversion: 2.1 time: 0.159173 Oct 17 14:21:46.783951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3773/7176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:46 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:47.726475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72", "tag": "85b3f057-c4cd-47e0-abe0-65f105415824"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:47.737953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:47.738444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:47.738896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:47.752892 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] Creating event network-changed:85b3f057-c4cd-47e0-abe0-65f105415824 for instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 on n-h2-854121-14 Oct 17 14:21:47.758542 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:21:47.769860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ce1c360a-e955-4f02-b887-08c1f9cf73f7 req-e90bf7ab-94de-41a7-8239-07dedc07aee6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047022 Oct 17 14:21:47.770436 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3774/7177] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:21:47.807248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:47.807961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:47.814311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:47.814816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:47.815273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:47.815987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:47.816466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:47.816907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:48.343537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:48.351872 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8095209-5cf3-4aff-ac32-13bd910be142 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1519 microversion: 2.1 time: 0.549122 Oct 17 14:21:48.352484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3775/7178] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:47 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1519 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:49.375564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:49.377050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:49.385858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:49.386376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:49.386836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:49.387572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:49.388155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:49.388853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:49.612741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:49.621687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76b418f8-59bf-404e-a203-15da041080b7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1519 microversion: 2.1 time: 0.250062 Oct 17 14:21:49.622279 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3776/7179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:49 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:50.645441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:50.646737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:50.654534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.655035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.655491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.656225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.656703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.657145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.794072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:50.802237 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a311839-df1b-4805-acf0-adf718b12406 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1516 microversion: 2.1 time: 0.160722 Oct 17 14:21:50.802821 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3777/7180] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:50 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:50.807997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72", "name": "network-vif-plugged", "status": "completed", "tag": "85b3f057-c4cd-47e0-abe0-65f105415824"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:50.818228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.818724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.819171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.831893 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] Creating event network-vif-plugged:85b3f057-c4cd-47e0-abe0-65f105415824 for instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 on n-h2-854121-14 Oct 17 14:21:50.838147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:21:50.848976 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e1f9604a-a1b7-4f1d-9a96-c90ec22a5c4e req-70048c86-7b74-4d6d-ba1f-f871a6a294da service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044968 Oct 17 14:21:50.849846 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3778/7181] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:21:50.855387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:50.856024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:50.862477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.862991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.863453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.864184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.864659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.865109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.925303 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a94f4748-7e87-45f2-b46e-782e175c0786 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72/action" status: 204 len: 0 microversion: 2.1 time: 0.074128 Oct 17 14:21:50.925837 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3779/7182] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:21:50 2022] POST /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:21:50.934341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:50.935062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:50.941319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.941827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.942285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:50.943004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:50.943471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:50.943915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:51.156096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:51.164058 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c86414ed-6dd6-4009-bd50-00f02797af1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1516 microversion: 2.1 time: 0.233889 Oct 17 14:21:51.164878 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3780/7183] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:50 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:52.189345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:52.190114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:52.199600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:52.200136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:52.200591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:52.201353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:52.201829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:52.202272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:52.348834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:52.357293 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16385175-4632-4813-86a9-eb5bbf6eb511 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1508 microversion: 2.1 time: 0.172439 Oct 17 14:21:52.357856 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3781/7184] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:52 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:52.379661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:52.380459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:52.386326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:52.386815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:52.387258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:52.387956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:52.388416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:52.388853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:52.517861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:52.526118 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5cdfb64-c75c-48e8-ab6f-4ddb4c8986f8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1508 microversion: 2.1 time: 0.150187 Oct 17 14:21:52.526685 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3782/7185] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:52 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:52.552455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24f6ca27-69f9-4d03-aae6-74f0a3988b00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'create', calling method: .version_select at 0x7f419c768040>, body: {"keypair": {"name": "tempest-keypair-1188894882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPICMoob2pQh0mEgUyuU5/mNC8PDZYA1kT/0grRyaD0Jua2Y3vV6w+lOrXm7ttxkH60XUpJSUgpKx8GyPhd+5qGVDQcVeQko+AldR+GiQqKEH8UMQ5ALoN3O7c+Mrp3A8w=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:52.570199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-24f6ca27-69f9-4d03-aae6-74f0a3988b00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Getting quotas for project 511c2b4e05284d15aa5edc703471a889. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:21:52.578205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-24f6ca27-69f9-4d03-aae6-74f0a3988b00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Getting quotas for user c01f3fa4d5964520b22c6a2c82a1a161 and project 511c2b4e05284d15aa5edc703471a889. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:21:52.593456 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-24f6ca27-69f9-4d03-aae6-74f0a3988b00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [661d870a-e61f-4b3f-b903-130bd3e92676] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:21:53.600988 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [None req-24f6ca27-69f9-4d03-aae6-74f0a3988b00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [661d870a-e61f-4b3f-b903-130bd3e92676] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55058. Oct 17 14:21:53.618483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-24f6ca27-69f9-4d03-aae6-74f0a3988b00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.069599 Oct 17 14:21:53.619102 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3783/7186] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:21:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:21:54.836647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:54.838353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:54.844407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:54.844898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:54.845374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:54.846075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:54.846538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:54.846970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:54.979028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:54.986889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-abb6e48e-15ff-4459-ac17-3498a7ac459f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 200 len: 1508 microversion: 2.1 time: 0.155220 Oct 17 14:21:54.987455 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3784/7187] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:54 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:55.009987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:55.010500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:55.016622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:55.017113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:55.017603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:55.018316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:55.018775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:55.019280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:55.045726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:21:55.069755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:55.124936 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c2f64ca-f6cb-40ed-aeb7-181a63a4f286 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 204 len: 0 microversion: 2.1 time: 0.118561 Oct 17 14:21:55.125914 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3785/7188] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:21:55 2022] DELETE /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:21:55.183326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-482815783", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "191ec1c1-3927-45ff-bf83-efcddbcdf50e"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:55.239430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] validate_networks() for [('191ec1c1-3927-45ff-bf83-efcddbcdf50e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:21:55.615439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:21:55.615879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:21:55.616366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:21:55.616785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:21:55.617235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:21:55.626357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:55.626842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:55.627285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:55.628021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:55.628478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:55.628912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:55.646874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Getting quotas for project 511c2b4e05284d15aa5edc703471a889. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:21:55.652955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Getting quotas for user c01f3fa4d5964520b22c6a2c82a1a161 and project 511c2b4e05284d15aa5edc703471a889. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:21:55.665315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:21:55.667729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:21:55.713861 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b021cfeb-dd59-48b5-a483-6f5543f81fbb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535024 Oct 17 14:21:55.714515 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3786/7189] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:21:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:21:55.725439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a2702c6-c1e6-42ee-abde-ea1516f21daa tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:55.726065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a2702c6-c1e6-42ee-abde-ea1516f21daa tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:55.780581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a2702c6-c1e6-42ee-abde-ea1516f21daa tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:55.788471 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a2702c6-c1e6-42ee-abde-ea1516f21daa tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1217 microversion: 2.1 time: 0.066797 Oct 17 14:21:55.789257 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3787/7190] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:55 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:56.813564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:56.814257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:56.821867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:56.823009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:56.823009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:56.823537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:56.824000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:56.825083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:56.937947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:56.946556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2676c3ed-7475-4ca3-aff5-fed98bb9078c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1287 microversion: 2.1 time: 0.136784 Oct 17 14:21:56.947156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3788/7191] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:56 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:57.593654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-999d212a-795d-4758-a5fd-ff5674b0d7ff req-049536db-a212-41f0-ad08-cdee28099c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72", "name": "network-vif-deleted", "tag": "85b3f057-c4cd-47e0-abe0-65f105415824"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:57.604649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-999d212a-795d-4758-a5fd-ff5674b0d7ff req-049536db-a212-41f0-ad08-cdee28099c6d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:57.605439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-999d212a-795d-4758-a5fd-ff5674b0d7ff req-049536db-a212-41f0-ad08-cdee28099c6d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:57.605934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-999d212a-795d-4758-a5fd-ff5674b0d7ff req-049536db-a212-41f0-ad08-cdee28099c6d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:57.618113 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-999d212a-795d-4758-a5fd-ff5674b0d7ff req-049536db-a212-41f0-ad08-cdee28099c6d service nova] Creating event network-vif-deleted:85b3f057-c4cd-47e0-abe0-65f105415824 for instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 on n-h2-854121-14 Oct 17 14:21:57.623540 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-999d212a-795d-4758-a5fd-ff5674b0d7ff req-049536db-a212-41f0-ad08-cdee28099c6d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Oct 17 14:21:57.624479 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3789/7192] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:21:57.972882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:57.973792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:57.980321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:57.980829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:57.981321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:57.982039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:57.982508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:57.982952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:58.201179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:58.209126 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-982539b8-846b-4255-bd7c-75248895503f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.242793 Oct 17 14:21:58.209747 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3790/7193] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:57 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:59.232148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:21:59.232804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:21:59.235595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:21:59.241023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.241717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.242175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:59.242911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.243451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.243898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:59.374485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:21:59.384407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d972d22-6636-4d33-b840-f38eb4ecf008 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.156171 Oct 17 14:21:59.385006 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3791/7194] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:21:59 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:21:59.639686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e8f16fe5-be10-4480-9c6e-0fe49caa3fbd req-10194170-44d8-4678-b780-01335dc005cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775dfc2e-c4f2-40dc-a180-ae59405e43fb", "tag": "571a120e-3324-4bba-ac6d-6c21595b1acb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:21:59.649269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e8f16fe5-be10-4480-9c6e-0fe49caa3fbd req-10194170-44d8-4678-b780-01335dc005cd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:21:59.649758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e8f16fe5-be10-4480-9c6e-0fe49caa3fbd req-10194170-44d8-4678-b780-01335dc005cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:21:59.650197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e8f16fe5-be10-4480-9c6e-0fe49caa3fbd req-10194170-44d8-4678-b780-01335dc005cd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:21:59.661131 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e8f16fe5-be10-4480-9c6e-0fe49caa3fbd req-10194170-44d8-4678-b780-01335dc005cd service nova] Creating event network-changed:571a120e-3324-4bba-ac6d-6c21595b1acb for instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb on n-h1-854121-14 Oct 17 14:21:59.666137 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e8f16fe5-be10-4480-9c6e-0fe49caa3fbd req-10194170-44d8-4678-b780-01335dc005cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030150 Oct 17 14:21:59.666730 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3792/7195] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:22:00.409697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:00.410424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:00.417466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:00.417970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:00.418423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:00.419141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:00.419614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:00.420067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:00.635789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:00.645758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11c8d24b-4aa1-49a8-a4f8-d5046cffb003 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.241306 Oct 17 14:22:00.646645 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3793/7196] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:00 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:01.671057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:01.677283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:01.680408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:01.681578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:01.682113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:01.682901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:01.683375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:01.683822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:01.817491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:01.825341 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4298aaa-5993-4552-9741-6ce6a5de5d6e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.158392 Oct 17 14:22:01.825904 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3794/7197] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:01 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:02.848306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:02.848927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:02.856102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:02.856611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:02.857066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:02.857815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:02.858285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:02.858728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:02.993230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:03.001529 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b245919b-3e94-4e6b-a903-4662af7da3fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.157418 Oct 17 14:22:03.002126 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3795/7198] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:02 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:04.026393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:04.027114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:04.033966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:04.034496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:04.034955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:04.035663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:04.036136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:04.036581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:04.173009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:04.180830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f6b2ec56-71de-4785-bcc3-9bc0d93b6d29 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.159122 Oct 17 14:22:04.181507 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3796/7199] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:04 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:04.733273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-4f1825f6-4b99-4556-b460-9a6e6a42285e req-30e32550-74eb-472f-9bfa-69e6c37b13ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dfc2e-c4f2-40dc-a180-ae59405e43fb", "name": "network-vif-plugged", "status": "completed", "tag": "571a120e-3324-4bba-ac6d-6c21595b1acb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:04.743765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4f1825f6-4b99-4556-b460-9a6e6a42285e req-30e32550-74eb-472f-9bfa-69e6c37b13ce service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:04.744352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4f1825f6-4b99-4556-b460-9a6e6a42285e req-30e32550-74eb-472f-9bfa-69e6c37b13ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:04.744820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4f1825f6-4b99-4556-b460-9a6e6a42285e req-30e32550-74eb-472f-9bfa-69e6c37b13ce service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:04.756300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-4f1825f6-4b99-4556-b460-9a6e6a42285e req-30e32550-74eb-472f-9bfa-69e6c37b13ce service nova] Creating event network-vif-plugged:571a120e-3324-4bba-ac6d-6c21595b1acb for instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb on n-h1-854121-14 Oct 17 14:22:04.761345 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-4f1825f6-4b99-4556-b460-9a6e6a42285e req-30e32550-74eb-472f-9bfa-69e6c37b13ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032006 Oct 17 14:22:04.761949 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3797/7200] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:22:05.205305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:05.206015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:05.212954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:05.213527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:05.213987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:05.214701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:05.215166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:05.215609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:05.352552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:05.361280 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a247ed4c-eca9-4450-abf2-df6b7518a834 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1317 microversion: 2.1 time: 0.161072 Oct 17 14:22:05.361839 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3798/7201] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:05 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:06.384487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:06.385204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:06.387214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:06.387910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:06.395305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.395804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.396246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.396941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.397424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.397859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.529186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:06.537047 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8362e405-08a6-432f-bf82-730689131904 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1507 microversion: 2.1 time: 0.156772 Oct 17 14:22:06.537658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3799/7202] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:06 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:06.560319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:06.560945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:06.567035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.567534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.567988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.568694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.569182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.569634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.700754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:06.708598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e31c20a-4511-44d3-bcd3-b2c33bfd12fb tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1507 microversion: 2.1 time: 0.152514 Oct 17 14:22:06.709198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3800/7203] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:06 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:06.731315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:06.733693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:06.739797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.740302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.740758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.741519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.741992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.742441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.773687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:06.780908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:22:06.790022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:22:06.790460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:22:06.790954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:22:06.791397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:22:06.792345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:22:06.857193 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-817cbe07-6da1-40c4-b43b-b778ee6661f3 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb/action" status: 202 len: 0 microversion: 2.1 time: 0.129997 Oct 17 14:22:06.857820 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3801/7204] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:22:06 2022] POST /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:22:06.865654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:06.866319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:06.872984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.873517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.873973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:06.874689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:06.875159 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:06.875601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:07.018586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:07.027527 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-836af3dc-5c76-4235-b54d-f0a5528aeda1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1514 microversion: 2.1 time: 0.165413 Oct 17 14:22:07.028115 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3802/7205] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:06 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:08.051961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:08.052839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:08.059759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:08.060260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:08.060720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:08.061473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:08.061946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:08.062417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:08.286732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:08.289009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:08.296528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-74d75968-9659-4154-8ba2-6d7bdaf13e50 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1514 microversion: 2.1 time: 0.248586 Oct 17 14:22:08.297113 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3803/7206] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:08 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:09.321241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:09.321913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:09.330819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:09.331310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:09.331759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:09.332457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:09.332917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:09.333374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:09.469429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:09.477422 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9dea32f9-5ff2-494c-8d06-590560b4818f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.160925 Oct 17 14:22:09.478002 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3804/7207] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:09 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:10.501332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:10.502042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:10.509818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:10.511025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:10.511493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:10.512215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:10.512680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:10.513113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:10.647039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:10.655448 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d654a5e-414b-429a-8391-b39028ddc2e1 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.158077 Oct 17 14:22:10.656033 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3805/7208] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:10 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:11.679459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:11.680067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:11.687667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:11.688168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:11.688626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:11.689375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:11.689854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:11.690293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:11.821741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:11.830310 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-574c678f-ad67-41bc-8f49-1f868413d3a4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.154892 Oct 17 14:22:11.830890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3806/7209] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:11 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:12.854326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:12.855014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:12.862513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:12.863019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:12.863478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:12.864186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:12.864654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:12.865096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:13.003485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:13.011737 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1078f754-abb3-4103-b6a3-eb896caa790a tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.161344 Oct 17 14:22:13.012484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3807/7210] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:12 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:14.034899 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:14.035560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:14.042376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:14.042874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:14.043334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:14.044038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:14.044509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:14.044948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:14.176472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:14.184304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11b2c388-47b6-4995-bd81-afd4134e3697 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.153439 Oct 17 14:22:14.184879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3808/7211] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:14 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:15.207465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:15.208105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:15.215670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:15.216190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:15.216684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:15.217451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:15.217918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:15.218360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:15.355125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:15.363737 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a9f7f18-4187-49e4-9b0f-fc5984fe029f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.160275 Oct 17 14:22:15.364363 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3809/7212] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:15 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:16.387978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:16.388630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:16.395587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:16.396078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:16.396526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:16.397254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:16.397716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:16.398149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:16.529313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:16.537064 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d7e3e498-eab6-4aa3-a50e-d07a689be52b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.153757 Oct 17 14:22:16.537662 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3810/7213] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:16 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:17.560317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:17.561000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:17.568172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:17.568675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:17.569138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:17.569868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:17.570331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:17.570769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:17.702434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:17.710402 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-403162ba-52e4-43e4-af87-29ec4c4bb473 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.154372 Oct 17 14:22:17.710996 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3811/7214] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:17 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:18.734509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:18.735205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:18.742092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:18.742594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:18.743051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:18.743759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:18.744231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:18.744672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:18.879905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:18.888582 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bdbf1d5-d76f-411e-9f5e-a1b707ded11e tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.158454 Oct 17 14:22:18.889319 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3812/7215] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:18 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:19.913772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:19.914461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:19.921848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:19.922342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:19.922797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:19.923527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:19.924060 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:19.924793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:20.084926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:20.094019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-982005e7-abb9-4257-9e9d-c92ae2ec22f0 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.184141 Oct 17 14:22:20.094615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3813/7216] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:19 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:21.126721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:21.127343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:21.134574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:21.135027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:21.135483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:21.136197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:21.136925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:21.137422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:21.271170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:21.279828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a6eb812-72d5-40fd-a5d1-f0cca88f7951 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.157168 Oct 17 14:22:21.280412 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3814/7217] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:21 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:22.303544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:22.304233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:22.311655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:22.312149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:22.312601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:22.313331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:22.313800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:22.314236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:22.447106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:22.455016 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2019013-f733-4215-9da1-c41235c364a8 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.155438 Oct 17 14:22:22.455603 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3815/7218] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:22 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:23.477668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:23.478339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:23.485437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:23.485933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:23.486386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:23.487086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:23.487555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:23.487990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:23.623106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:23.631377 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c50c3f77-64e8-4be0-90e2-00b997a2be36 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.157637 Oct 17 14:22:23.632073 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3816/7219] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:23 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:24.655923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:24.656554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:24.663455 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:24.663948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:24.664401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:24.665109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:24.665608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:24.666045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:24.798904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:24.806777 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ee5aab62-e5e7-490c-856b-cecaa626bdb4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.155720 Oct 17 14:22:24.807357 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3817/7220] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:24 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:25.829919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:25.830763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:25.837461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:25.837965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:25.838417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:25.839121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:25.839589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:25.840034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:25.974039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:25.982636 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7dba0a95-0669-406d-804c-6c68ac5c6f38 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.156608 Oct 17 14:22:25.983217 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3818/7221] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:25 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:27.006231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:27.006936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:27.014591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:27.015096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:27.015555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:27.016273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:27.016829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:27.017307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:27.152785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:27.160683 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1057c073-c814-4ffe-845f-063ec4a9dd57 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.158666 Oct 17 14:22:27.161279 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3819/7222] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:27 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:28.184776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:28.185524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:28.192432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:28.192931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:28.193407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:28.194116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:28.194579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:28.195015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:28.210543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:28.329099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:28.339176 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd54dac5-8bd8-45e5-9bb4-79707ba891ad tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.158299 Oct 17 14:22:28.339769 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3820/7223] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:28 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:29.363327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:29.364027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:29.366713 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=64 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:29.373322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:29.373828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:29.374290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:29.375013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:29.375486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:29.375928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:29.517205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:29.525135 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a05ca6b-90c7-42ab-bcdb-d75e5baa0a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.165804 Oct 17 14:22:29.525753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3821/7224] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:29 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:30.548447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:30.549197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:30.556204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:30.556734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:30.557205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:30.557918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:30.558384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:30.558851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:30.960374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:30.968785 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71039532-0c69-4286-98f0-a59c2ba30ca7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.424209 Oct 17 14:22:30.969417 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3822/7225] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:30 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:31.992583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:31.993264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:32.000272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:32.000770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:32.001250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:32.001956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:32.002422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:32.002869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:32.134739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:32.143358 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7bbb5f5-fb82-4866-a964-8f4c863002c4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.154709 Oct 17 14:22:32.143913 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3823/7226] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:31 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:33.166552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:33.167188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:33.174945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:33.175440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:33.175891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:33.176599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:33.177063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:33.177536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:33.311123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:33.319039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69ebb072-b05c-43b7-bd3b-630eba0e8c7b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.156402 Oct 17 14:22:33.319601 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3824/7227] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:33 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:34.343418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:34.344141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:34.353132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:34.353662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:34.354112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:34.354824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:34.355289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:34.355726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:34.485627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:34.493595 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de207e58-4ff1-455b-8408-154cdcd55a00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.155002 Oct 17 14:22:34.494171 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3825/7228] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:34 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:35.517365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:35.518095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:35.525227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:35.525734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:35.526185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:35.526898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:35.527360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:35.527799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:35.711686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:35.720757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33d6979c-2362-4a3d-bf07-e8c4a2b79230 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1519 microversion: 2.1 time: 0.207490 Oct 17 14:22:35.721650 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3826/7229] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:35 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:36.062563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dfc2e-c4f2-40dc-a180-ae59405e43fb", "name": "network-vif-unplugged", "status": "completed", "tag": "571a120e-3324-4bba-ac6d-6c21595b1acb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:36.072073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:36.072806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:36.073330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:36.086160 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] Creating event network-vif-unplugged:571a120e-3324-4bba-ac6d-6c21595b1acb for instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb on n-h2-854121-14 Oct 17 14:22:36.092450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:22:36.103828 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-4c0af355-9965-411e-a30f-4f88c2fb882f req-7a0f932f-b9d4-42cc-bb1d-e6bed686482e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046123 Oct 17 14:22:36.104815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3827/7230] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:36.744701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:36.745606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:36.753475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:36.753984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:36.754439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:36.755448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:36.755913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:36.756349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:36.948403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:36.956905 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4681c8bf-8b2e-4b88-921c-a28f0632e4fe tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1518 microversion: 2.1 time: 0.216629 Oct 17 14:22:36.957498 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3828/7231] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:36 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:37.981349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:37.982608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:37.988928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:37.989477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:37.989933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:37.990650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:37.991130 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:37.991573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:38.131705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:38.140041 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e289058f-2e43-4aad-87fd-65a92c2a18e4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1516 microversion: 2.1 time: 0.163038 Oct 17 14:22:38.140636 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3829/7232] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:37 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:38.145241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775dfc2e-c4f2-40dc-a180-ae59405e43fb", "tag": "571a120e-3324-4bba-ac6d-6c21595b1acb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:38.155076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:38.155575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:38.156026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:38.168257 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] Creating event network-changed:571a120e-3324-4bba-ac6d-6c21595b1acb for instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb on n-h2-854121-14 Oct 17 14:22:38.174635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:22:38.185889 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-16fe64e4-966d-467f-980d-fbfa31be050e req-63d12cb6-d14a-4668-a362-ccd867180793 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044101 Oct 17 14:22:38.186496 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3830/7233] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:39.166173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:39.166897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:39.174574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:39.175074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:39.175533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:39.176250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:39.176724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:39.177190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:39.307305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:39.315953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bfe32893-ad14-4944-8c46-70a18e9f8c77 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1516 microversion: 2.1 time: 0.154228 Oct 17 14:22:39.316535 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3831/7234] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:39 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:40.339503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:40.340203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:40.348256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:40.348763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:40.349270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:40.350004 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:40.350470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:40.350908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:40.558679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:40.567012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-165540ae-8e94-4ee5-bd48-6c06f10a86f4 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1513 microversion: 2.1 time: 0.231560 Oct 17 14:22:40.567802 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3832/7235] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:40 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:40.590200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:40.591300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:40.597880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:40.598382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:40.598833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:40.599579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:40.600050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:40.600499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:40.663410 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-38ba1ab6-9be4-4fc0-ab53-5f356c210b80 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "POST /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb/action" status: 204 len: 0 microversion: 2.1 time: 0.077073 Oct 17 14:22:40.664163 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3833/7236] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:22:40 2022] POST /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:22:40.672849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:40.673609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:40.679807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:40.680319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:40.680774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:40.681520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:40.681992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:40.682437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:40.901377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:40.910336 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c27066d6-2b41-4229-9a2d-50b160f47c70 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1513 microversion: 2.1 time: 0.241760 Oct 17 14:22:40.911236 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3834/7237] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:40 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:41.933750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:41.934525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:41.941548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.942050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.942509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:41.943225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:41.943696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:41.944138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.090279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:42.099151 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7215d364-919d-4f30-b90d-dacd0a656520 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1505 microversion: 2.1 time: 0.169355 Oct 17 14:22:42.099729 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3835/7238] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:41 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:42.121798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:42.122416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:42.128433 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.128872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.129362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.130059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.130772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.131207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.149697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:42.266085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:42.273941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2265829a-1b79-4265-9934-254e8c28ac1b tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1505 microversion: 2.1 time: 0.155875 Oct 17 14:22:42.274521 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3836/7239] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:42 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:42.296532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:42.297154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:42.302971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.303470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.303925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.304642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.305108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.305575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.436075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:42.444012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-090373d2-1c1d-44a9-aa15-2125f27f1936 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1505 microversion: 2.1 time: 0.151174 Oct 17 14:22:42.444597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3837/7240] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:42 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:42.467828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:42.468340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:42.474259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.474757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.475216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.475920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.476383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.476823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.503361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:22:42.582328 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-853ce8a5-ae33-4488-8768-7281667e771f tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "DELETE /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 204 len: 0 microversion: 2.1 time: 0.118593 Oct 17 14:22:42.583282 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3838/7241] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:22:42 2022] DELETE /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:22:42.600332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:42.600939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:42.607837 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.608414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.608937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.610185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.610310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.611139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.641679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:22:42.687505 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.compute.api [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Instance is already in deleting state, ignoring this request Oct 17 14:22:42.688345 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40214fda-a626-4340-a98e-d8f5b2d0a638 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "DELETE /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 204 len: 0 microversion: 2.1 time: 0.092683 Oct 17 14:22:42.688909 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3839/7242] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:22:42 2022] DELETE /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:22:42.696544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:42.697187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:42.703770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.704263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.704710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.705445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:42.705909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:42.706347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:42.840168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:42.848374 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31386db3-1425-42e8-be69-918b0b91ec00 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1511 microversion: 2.1 time: 0.155384 Oct 17 14:22:42.848954 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3840/7243] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:42 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:43.079867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bce3f805-4366-4e28-b281-efbc4e2b1e16 req-0ed21d0c-3d21-4c9b-ba48-4a5cde412636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dfc2e-c4f2-40dc-a180-ae59405e43fb", "name": "network-vif-plugged", "status": "completed", "tag": "571a120e-3324-4bba-ac6d-6c21595b1acb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:43.091627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bce3f805-4366-4e28-b281-efbc4e2b1e16 req-0ed21d0c-3d21-4c9b-ba48-4a5cde412636 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:43.092622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bce3f805-4366-4e28-b281-efbc4e2b1e16 req-0ed21d0c-3d21-4c9b-ba48-4a5cde412636 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:43.093210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bce3f805-4366-4e28-b281-efbc4e2b1e16 req-0ed21d0c-3d21-4c9b-ba48-4a5cde412636 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:43.104713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bce3f805-4366-4e28-b281-efbc4e2b1e16 req-0ed21d0c-3d21-4c9b-ba48-4a5cde412636 service nova] Creating event network-vif-plugged:571a120e-3324-4bba-ac6d-6c21595b1acb for instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb on n-h2-854121-14 Oct 17 14:22:43.110175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bce3f805-4366-4e28-b281-efbc4e2b1e16 req-0ed21d0c-3d21-4c9b-ba48-4a5cde412636 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034461 Oct 17 14:22:43.110781 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3841/7244] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:22:43.873035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:43.874143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:43.880789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:43.881369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:43.881834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:43.882775 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:43.883174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:43.883631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:44.021876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c01f3fa4d5964520b22c6a2c82a1a161', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511c2b4e05284d15aa5edc703471a889', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:44.030074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d4c73e3-d4d6-467b-9791-8b30a79dc8c7 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 200 len: 1511 microversion: 2.1 time: 0.161587 Oct 17 14:22:44.030852 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3842/7245] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:43 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:22:44.640812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7db3183b-fe49-4054-97c5-07d8dbe5f470 req-f2205229-d702-415a-af4e-cd5da5bd558a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775dfc2e-c4f2-40dc-a180-ae59405e43fb", "name": "network-vif-deleted", "tag": "571a120e-3324-4bba-ac6d-6c21595b1acb"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:44.650912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7db3183b-fe49-4054-97c5-07d8dbe5f470 req-f2205229-d702-415a-af4e-cd5da5bd558a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:44.651341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7db3183b-fe49-4054-97c5-07d8dbe5f470 req-f2205229-d702-415a-af4e-cd5da5bd558a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:44.651818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7db3183b-fe49-4054-97c5-07d8dbe5f470 req-f2205229-d702-415a-af4e-cd5da5bd558a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:44.663661 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7db3183b-fe49-4054-97c5-07d8dbe5f470 req-f2205229-d702-415a-af4e-cd5da5bd558a service nova] Creating event network-vif-deleted:571a120e-3324-4bba-ac6d-6c21595b1acb for instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb on n-h2-854121-14 Oct 17 14:22:44.668273 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7db3183b-fe49-4054-97c5-07d8dbe5f470 req-f2205229-d702-415a-af4e-cd5da5bd558a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031443 Oct 17 14:22:44.668881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3843/7246] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:22:45.054412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:45.055055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 775dfc2e-c4f2-40dc-a180-ae59405e43fb] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:45.061614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:45.062118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:45.062571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:45.063393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:45.063932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:45.064377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:45.078703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] HTTP exception thrown: Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb could not be found. Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Request method failure captured: Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb HTTP/1.1 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWTKAA4-yyiy0oBhoQ4g-LKzgdI7ZNzlNxrs4eAsyI74EsjjSmsK9addoiz68zobnEz7aYRghee-L4z8DsvLE8nYqqnBATfkAkXT8gvYNTbSqqU4qWOoNMIkXmTDKbsLHKh3yhtJ-rDm7umf44LmUlw3V4u8dzbTH1CoDIN40JFU5Us Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 511c2b4e05284d15aa5edc703471a889 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_511c2b4e05284d15aa5edc703471a889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 511c2b4e05284d15aa5edc703471a889 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-435919758-project Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c01f3fa4d5964520b22c6a2c82a1a161 Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-435919758-project Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb could not be found. Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '775dfc2e-c4f2-40dc-a180-ae59405e43fb'} Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb could not be found. Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb could not be found. Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:45.080357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb could not be found. Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Returning 404 to user: Instance 775dfc2e-c4f2-40dc-a180-ae59405e43fb could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40cbc63b-e636-42c1-8427-99f870ec356c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb" status: 404 len: 111 microversion: 2.1 time: 0.031978 Oct 17 14:22:45.085407 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3844/7247] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:45 2022] GET /compute/v2.1/servers/775dfc2e-c4f2-40dc-a180-ae59405e43fb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:22:45.090334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b58dd18b-cdd5-426c-b388-c124129b4631 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '.version_select at 0x7f419c741280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:45.110730 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b58dd18b-cdd5-426c-b388-c124129b4631 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188894882" status: 202 len: 0 microversion: 2.1 time: 0.023825 Oct 17 14:22:45.111325 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3845/7248] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 14:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188894882 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:22:45.729630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:45.730257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:45.737196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:45.737698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:45.738151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:45.738857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:45.739324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:45.739766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:45.753673 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] HTTP exception thrown: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Request method failure captured: Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 HTTP/1.1 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWTKAA4-yyiy0oBhoQ4g-LKzgdI7ZNzlNxrs4eAsyI74EsjjSmsK9addoiz68zobnEz7aYRghee-L4z8DsvLE8nYqqnBATfkAkXT8gvYNTbSqqU4qWOoNMIkXmTDKbsLHKh3yhtJ-rDm7umf44LmUlw3V4u8dzbTH1CoDIN40JFU5Us Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 511c2b4e05284d15aa5edc703471a889 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_511c2b4e05284d15aa5edc703471a889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 511c2b4e05284d15aa5edc703471a889 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-435919758-project Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c01f3fa4d5964520b22c6a2c82a1a161 Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-435919758-project Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72'} Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:22:45.755526 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Returning 404 to user: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de02e032-de2d-4cb3-b4b7-eb58ff538758 tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "DELETE /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 404 len: 111 microversion: 2.1 time: 0.032346 Oct 17 14:22:45.760842 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3846/7249] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:22:45 2022] DELETE /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:22:45.765252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:45.766488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] [instance: 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:45.772746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:45.773274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:45.773736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:45.774875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:45.774976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:45.775341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:45.789571 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] HTTP exception thrown: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Request method failure captured: Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 HTTP/1.1 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWTKAA4-yyiy0oBhoQ4g-LKzgdI7ZNzlNxrs4eAsyI74EsjjSmsK9addoiz68zobnEz7aYRghee-L4z8DsvLE8nYqqnBATfkAkXT8gvYNTbSqqU4qWOoNMIkXmTDKbsLHKh3yhtJ-rDm7umf44LmUlw3V4u8dzbTH1CoDIN40JFU5Us Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 511c2b4e05284d15aa5edc703471a889 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/511c2b4e05284d15aa5edc703471a889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_511c2b4e05284d15aa5edc703471a889"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 511c2b4e05284d15aa5edc703471a889 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-435919758 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerDiskConfigTestJSON-435919758-project Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: c01f3fa4d5964520b22c6a2c82a1a161 Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerDiskConfigTestJSON-435919758-project Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72'} Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:22:45.791138 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] Returning 404 to user: Instance 3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f96fd60b-3af5-44f6-814e-e247f846b32c tempest-ServerDiskConfigTestJSON-435919758 tempest-ServerDiskConfigTestJSON-435919758-project] 10.222.0.65 "GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72" status: 404 len: 111 microversion: 2.1 time: 0.031035 Oct 17 14:22:45.795607 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3847/7250] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:45 2022] GET /compute/v2.1/servers/3a1f8a30-5b32-4231-9a3e-1b3fb93a4d72 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:22:54.847211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7251a81a-47b1-43ed-8482-d2a4d9771265 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'create', calling method: .version_select at 0x7f419c741430>, body: {"keypair": {"name": "tempest-keypair-2042768162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKShHxVM+OVUfevoAt7ApZkYK5CZJ+1iwiMDxmp2CuH7JmeKTfxw5VP/ByXk6n1datZ20QAxBfnZExgAxMie8YTO42blZz2+3fAi8xxJpqEhX5wEYoFIvTvQiHEjs+lZ1Q=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:54.864487 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7251a81a-47b1-43ed-8482-d2a4d9771265 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:22:54.870192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7251a81a-47b1-43ed-8482-d2a4d9771265 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:22:54.898943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7251a81a-47b1-43ed-8482-d2a4d9771265 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177845 Oct 17 14:22:54.899557 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3848/7251] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:22:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:22:56.020952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG neutronclient.v2_0.client [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Error message: {"error": {"code": 401, "title": "Unauthorized", "message": "The request you have made requires authentication."}} {{(pid=120698) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 17 14:22:56.022194 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 500 len: 0 microversion: 2.1 time: 900.554765 Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Caught error: Not authorized.: nova.exception.Unauthorized: Not authorized. Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack Traceback (most recent call last): Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack exception_handler_v20(status_code, error_body) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack raise client_exc(message=error_message, Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack neutronclient.common.exceptions.Unauthorized: 401-{'error': {'code': 401, 'title': 'Unauthorized', 'message': 'The request you have made requires authentication.'}} Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack Neutron server returns request_ids: ['req-355fb184-0f16-4e72-abee-6bab34d718cd'] Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack During handling of the above exception, another exception occurred: Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack Traceback (most recent call last): Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/__init__.py", line 95, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return req.get_response(self.application) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 104, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack self._log_req(req, res, start) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack self.force_reraise() Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack raise self.value Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/requestlog.py", line 99, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack res = req.get_response(self.application) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return resp(environ, start_response) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/osprofiler/web.py", line 111, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return request.get_response(self.application) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack response = req.get_response(self._app) Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1313, in send Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack status, headers, app_iter = self.call_application( Oct 17 14:22:56.072199 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/request.py", line 1278, in call_application Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack app_iter = application(self.environ, start_response) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return resp(environ, start_response) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return resp(environ, start_response) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/routes/middleware.py", line 153, in __call__ Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack response = self.app(environ, start_response) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 143, in __call__ Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return resp(environ, start_response) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 129, in __call__ Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack resp = self.call_func(req, *args, **kw) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/webob/dec.py", line 193, in call_func Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.func(req, *args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 486, in __call__ Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self._process_stack(request, action, action_args, Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack action_result = self.dispatch(meth, request, action_args) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return method(req=request, **action_args) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return f(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return func(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack [Previous line repeated 10 more times] Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack instances, resv_id = self.compute_api.create( Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self._create_instance( Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ) = self._validate_and_build_base_options( Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 1080, in _validate_and_build_base_options Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack max_network_count = self._check_requested_networks( Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/compute/api.py", line 542, in _check_requested_networks Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.network_api.validate_networks(context, requested_networks, Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 2641, in validate_networks Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ports = neutron.list_ports(**params)['ports'] Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 815, in list_ports Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.list('ports', self.ports_path, retrieve_all, Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 372, in list Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack for r in self._pagination(collection, path, **params): Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 387, in _pagination Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack res = self.get(path, params=params) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.retry_request("GET", action, body=body, Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack return self.do_request(method, action, body=body, Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 17 14:22:56.076172 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack ret = obj(*args, **kwargs) Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack self._handle_fault_response(status_code, replybody, resp) Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack File "/opt/stack/nova/nova/network/neutron.py", line 204, in wrapper Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack raise exception.Unauthorized() Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack nova.exception.Unauthorized: Not authorized. Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] http://10.222.0.65/compute/v2.1/servers returned with HTTP 401 Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Returning 401 to user: This server could not verify that you are authorized to access the document you requested. Either you supplied the wrong credentials (e.g., bad password), or your browser does not understand how to supply the credentials required. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.65) !!! Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:22:56 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during POST /compute/v2.1/servers (10.222.0.65) Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: CRITICAL nova [None req-dc3c39ee-9353-43d2-9617-bf614340f818 tempest-TestVolumeBootPattern-1916997843 tempest-TestVolumeBootPattern-1916997843-project] Unhandled error: OSError: write error Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova OSError: write error Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova Oct 17 14:22:56.081725 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3404/7252] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:07:55 2022] POST /compute/v2.1/servers => generated 0 bytes in 900609 msecs (HTTP/1.1 401) 9 headers in 0 bytes (0 switches on core 0) Oct 17 14:22:56.330703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:56.336087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-293743666", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79d664e0-fda8-420d-91cd-80d4d061a144"}], "security_groups": [{"name": "tempest-securitygroup--363458275"}], "key_name": "tempest-keypair-2042768162", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:56.444901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] validate_networks() for [('79d664e0-fda8-420d-91cd-80d4d061a144', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:22:56.832418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:22:56.832864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:22:56.833552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:22:56.833979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:22:56.834408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:22:56.843784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:56.844442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:56.844931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:56.845731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:56.846205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:56.846684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:56.864993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:22:56.870441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:22:56.884593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:22:56.887021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:22:56.943304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f1bf895-41af-4efb-a554-1bd5ecf2dd46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.614244 Oct 17 14:22:56.944195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3849/7253] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:22:56 2022] POST /compute/v2.1/servers => generated 408 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:22:56.957221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b4b81ad-07db-4b17-8cee-a7bfce9bb157 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:56.957983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b4b81ad-07db-4b17-8cee-a7bfce9bb157 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:57.022599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b4b81ad-07db-4b17-8cee-a7bfce9bb157 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:57.032829 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b4b81ad-07db-4b17-8cee-a7bfce9bb157 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1238 microversion: 2.1 time: 0.081364 Oct 17 14:22:57.033646 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3405/7254] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:56 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:58.061806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:58.063301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:58.070432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:58.071277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:58.072120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:58.073144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:58.073861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:58.080943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:58.181846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:58.191521 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af1770c0-c23b-457c-8943-58f69783826d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1308 microversion: 2.1 time: 0.136842 Oct 17 14:22:58.192471 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3850/7255] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:58 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:59.217007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:22:59.217666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:22:59.241624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:59.242236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:59.242804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:59.243792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:59.244391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:59.244894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:59.451989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:22:59.460720 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6594358-75ff-4537-a639-bc105804f4aa tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.247940 Oct 17 14:22:59.461337 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3406/7256] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:22:59 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:22:59.588972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-56672a86-3bee-4142-b518-8407445ceb73 req-40222daf-741b-497f-b90a-69c112de0202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:22:59.596615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:22:59.604945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-56672a86-3bee-4142-b518-8407445ceb73 req-40222daf-741b-497f-b90a-69c112de0202 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:22:59.605465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-56672a86-3bee-4142-b518-8407445ceb73 req-40222daf-741b-497f-b90a-69c112de0202 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:22:59.605908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-56672a86-3bee-4142-b518-8407445ceb73 req-40222daf-741b-497f-b90a-69c112de0202 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:22:59.632310 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-56672a86-3bee-4142-b518-8407445ceb73 req-40222daf-741b-497f-b90a-69c112de0202 service nova] Creating event network-changed:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h1-854121-14 Oct 17 14:22:59.640767 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-56672a86-3bee-4142-b518-8407445ceb73 req-40222daf-741b-497f-b90a-69c112de0202 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055538 Oct 17 14:22:59.641461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3851/7257] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:00.484606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:00.485332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:00.494377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:00.494844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:00.495287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:00.495991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:00.496448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:00.496877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:00.628110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:00.636833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cad0e466-ab85-426b-96b0-2719b0615f26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.156208 Oct 17 14:23:00.637465 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3407/7258] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:00 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:01.663201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:01.663948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:01.670296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:01.670795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:01.671327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:01.672039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:01.672507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:01.672950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:01.811233 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:01.819197 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c91a6bd9-7deb-4811-9701-2c0244e58463 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.161211 Oct 17 14:23:01.819764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3852/7259] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:01 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:02.842130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:02.842736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:02.850286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:02.850780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:02.851229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:02.851940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:02.852407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:02.852842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:02.989835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:02.998721 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47991704-3108-4ad6-aa32-6f69e73b59ab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.160272 Oct 17 14:23:02.999836 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3408/7260] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:02 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:04.024103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:04.024896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:04.032447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.032952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.033444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.034158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:04.034628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:04.035071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:04.168705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:04.177366 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af5e40c4-6262-4b21-9606-b457e03641e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.157312 Oct 17 14:23:04.177941 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3853/7261] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:04 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:05.038991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "name": "network-vif-plugged", "status": "completed", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:05.052652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:05.053393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:05.054249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:05.068254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] Creating event network-vif-plugged:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h1-854121-14 Oct 17 14:23:05.071835 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] [c8edc6c4-1d0a-4ec3-8f7a-398f50d69d86] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:23:05.200032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:05.200598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:05.207954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:05.208458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:05.208921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:05.209843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:05.210145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:05.210595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:05.341711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:05.350220 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42caefed-f200-45a9-9426-9117f9e02286 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.154202 Oct 17 14:23:05.350800 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3854/7262] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:05 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:23:06.081131 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] [c8edc6c4-1d0a-4ec3-8f7a-398f50d69d86] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 55374. Oct 17 14:23:06.084024 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d8099179-d11c-4589-b829-8f3717ede5f4 req-1bfd5097-c7dc-4555-afe0-41cadbb738c7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.049934 Oct 17 14:23:06.084709 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3409/7263] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:06.372460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:06.373128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:06.380136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.380897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.381458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.382177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:06.382652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:06.383096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:06.511905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:06.520512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-847d5fd0-c290-43ff-afbf-411c2c0fe3f9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1363 microversion: 2.1 time: 0.151964 Oct 17 14:23:06.521023 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3855/7264] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:06 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:07.540226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:07.545254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:07.545959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:07.553649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.554163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.554550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.555242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.555696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.556117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.690536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:07.698774 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dc1e390a-89e6-462e-b080-ae210c88311e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1551 microversion: 2.1 time: 0.159355 Oct 17 14:23:07.699346 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3410/7265] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:07 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:07.722903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:07.723434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:07.725577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:07.726342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=10 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:07.732410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.732790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.733328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.734325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:07.735362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:07.735857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:07.819634 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a8d39e4-3a46-4bb1-99b6-9b9b736081b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100970 Oct 17 14:23:07.820249 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3856/7266] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 14:23:07 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:08.754492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-18871ff7-ed62-4a60-b342-d2d161ae8628 req-689a1452-72e9-49ba-876c-12a73ee7e3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:08.764191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-18871ff7-ed62-4a60-b342-d2d161ae8628 req-689a1452-72e9-49ba-876c-12a73ee7e3a9 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:08.764673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-18871ff7-ed62-4a60-b342-d2d161ae8628 req-689a1452-72e9-49ba-876c-12a73ee7e3a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:08.765111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-18871ff7-ed62-4a60-b342-d2d161ae8628 req-689a1452-72e9-49ba-876c-12a73ee7e3a9 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:08.777666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-18871ff7-ed62-4a60-b342-d2d161ae8628 req-689a1452-72e9-49ba-876c-12a73ee7e3a9 service nova] Creating event network-changed:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h1-854121-14 Oct 17 14:23:08.783069 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-18871ff7-ed62-4a60-b342-d2d161ae8628 req-689a1452-72e9-49ba-876c-12a73ee7e3a9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033619 Oct 17 14:23:08.783681 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3411/7267] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:23:44.006132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=11 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:44.007034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=38 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:44.011105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:44.011730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:44.018986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.019478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.019945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.020645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.021116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.021571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.157047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:44.165829 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-168dda2a-67ec-4769-ad2c-f28914a39e9b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1670 microversion: 2.1 time: 0.161764 Oct 17 14:23:44.166409 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3857/7268] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:44 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:44.186423 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:23:44.186971 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 (ip 10.222.0.65) !!! Oct 17 14:23:44.188271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:44.189032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=28 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:23:44.194069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:44.194778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:44.208272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.208770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.209237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.209953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.210417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.210850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.340723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:44.349184 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5466c9c0-0e74-46b3-819b-034331841874 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1670 microversion: 2.1 time: 0.164918 Oct 17 14:23:44.349780 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3412/7269] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:44 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:44.371550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:44.372183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:44.378835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.379335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.379790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.380770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.381271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.381718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.512859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:44.521942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01d9fb48-5523-4f63-90bd-0d20f0169c0e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1670 microversion: 2.1 time: 0.154280 Oct 17 14:23:44.522750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3858/7270] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:44 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:44.545007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:44.547235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:44.553535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.554017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.554448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.555135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.555593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.556007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.673149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:44.680234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Old instance type m1.heat2, new instance type m1.heat {{(pid=120698) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:23:44.687009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:23:44.687472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:23:44.687908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:23:44.688311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:23:44.688720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:23:44.760882 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54bb8ba0-58c8-4e6d-b9dd-31f0482c10e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507/action" status: 202 len: 0 microversion: 2.1 time: 0.219827 Oct 17 14:23:44.761546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3413/7271] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:23:44 2022] POST /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:23:44.769979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:44.770729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:44.776984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.777514 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.777962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.778675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:44.779133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:44.779568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:44.922463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:44.931315 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe0e5ad9-8992-4cdc-9d31-52d12061054c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1679 microversion: 2.1 time: 0.165443 Oct 17 14:23:44.931886 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3859/7272] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:44 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:45.956044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:45.956663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:45.963767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:45.964251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:45.964690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:45.965408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:45.965864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:45.966293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:46.098952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:46.107738 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b1d5d72-d52f-439f-989b-01a1cb967de3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1679 microversion: 2.1 time: 0.156735 Oct 17 14:23:46.108331 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3414/7273] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:45 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:47.131372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:47.132006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:47.139112 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:47.139617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:47.140078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:47.140790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:47.141300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:47.141746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:47.279667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:47.287729 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-434563ff-d178-4fff-b4b2-869281c6dfce tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.160626 Oct 17 14:23:47.288315 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3860/7274] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:47 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:48.311495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:48.312147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:48.319170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:48.319660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:48.320100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:48.320801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:48.321285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:48.321712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:48.452822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:48.461571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac18a90f-f2cc-44a2-9810-ca5d378dd117 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.153918 Oct 17 14:23:48.462161 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3415/7275] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:48 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:49.487398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:49.488046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:49.495073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:49.495582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:49.496040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:49.496796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:49.497271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:49.498587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:49.713028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:49.721580 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4f243e8-2b76-4c2c-b98b-268d9665dd6f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.240482 Oct 17 14:23:49.722168 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3861/7276] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:49 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:50.744726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:50.745371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:50.752453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:50.752938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:50.753792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:50.754497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:50.754949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:50.755372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:50.887965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:50.897797 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b03f7b51-cfd2-41b6-a341-05181429c83c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.156846 Oct 17 14:23:50.898402 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3416/7277] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:50 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:51.922276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:51.922820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:51.931149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:51.931650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:51.932107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:51.932815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:51.933317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:51.933758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:52.068614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:52.076700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2b71d5a-5edd-4ae6-a8c2-055223d6590f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.158529 Oct 17 14:23:52.077310 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3862/7278] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:51 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:53.100871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:53.101713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:53.108847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:53.109376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:53.109822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:53.110528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:53.111485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:53.111916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:53.258153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:53.266013 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc046dc1-89db-4a3d-83d8-895cfbb206b6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.169549 Oct 17 14:23:53.266596 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3417/7279] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:53 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:54.288801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:54.289485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:54.296492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:54.296997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:54.297488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:54.298204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:54.298770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:54.299219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:54.429801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:54.437684 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-add312b6-0b25-4f10-b122-fe4dab4d2d25 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.152951 Oct 17 14:23:54.438260 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3863/7280] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:54 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:55.461725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:55.462351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:55.469197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:55.469678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:55.470139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:55.470832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:55.471290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:55.471720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:55.605721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:55.613959 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c7c4b8e-da35-43b6-85a6-9b7598d25a52 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.156124 Oct 17 14:23:55.614548 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3418/7281] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:55 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:56.638579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:56.639213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:56.646915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:56.647420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:56.647881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:56.648606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:56.649110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:56.649581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:56.780300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:56.788816 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-558f752a-38c7-4837-942c-d9990ea9225d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.154219 Oct 17 14:23:56.789420 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3864/7282] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:56 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:57.812656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:57.813306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:57.820461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:57.820956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:57.821429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:57.822137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:57.822596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:57.823029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:57.964280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:57.973009 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ce52fa0-5ec2-4b67-99d0-dbb2afb07fd8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1684 microversion: 2.1 time: 0.164328 Oct 17 14:23:57.973631 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3419/7283] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:57 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:58.996282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:23:58.996913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:23:59.003904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:59.004410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:59.004865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:59.005861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:59.006333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:59.006779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:59.225241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:23:59.233109 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-62a5da65-b30b-4e71-b681-4d4517437d26 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1683 microversion: 2.1 time: 0.240843 Oct 17 14:23:59.233752 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3865/7284] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:23:58 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1683 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:23:59.287149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "name": "network-vif-unplugged", "status": "completed", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:23:59.298470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:23:59.298959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:23:59.299395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:23:59.315428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] Creating event network-vif-unplugged:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h2-854121-14 Oct 17 14:23:59.321008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] Instance 87afbbc6-1106-4f44-8dad-668ea596a507 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:23:59.333041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c0d3e8d1-f873-4498-8efe-9c61a339ad6f req-e947345f-f0c4-4c5c-9d9d-cc3be0f1ca8a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049835 Oct 17 14:23:59.333703 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3420/7285] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:00.258335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:00.258909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:00.265888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:00.266385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:00.266896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:00.267902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:00.268395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:00.268838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:00.412918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:00.420788 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c77cc01-54a9-492b-92e1-3759779d4307 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1683 microversion: 2.1 time: 0.166808 Oct 17 14:24:00.421407 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3866/7286] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:00 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:01.371184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:01.381968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:01.382450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:01.382892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:01.394513 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] Creating event network-changed:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h2-854121-14 Oct 17 14:24:01.399823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] Instance 87afbbc6-1106-4f44-8dad-668ea596a507 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:24:01.410953 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b1061895-c0ff-4298-9b98-1f6863ae3d6e req-e814660f-78ab-4b26-866d-103cfc8cf1cf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044711 Oct 17 14:24:01.411556 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3421/7287] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:01.445468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:01.446097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:01.453132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:01.453666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:01.454123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:01.454878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:01.455377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:01.455820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:01.696374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:01.704353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58e424a9-25ec-4d13-bd59-d6e3bfb41ebe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1681 microversion: 2.1 time: 0.262796 Oct 17 14:24:01.705555 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3867/7288] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:01 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:24:02.730365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:02.731071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:02.737938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:02.738436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:02.738878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:02.739571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:02.740026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:02.740456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:02.871711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:02.880286 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ae2070b-fc1c-40ed-a08e-176af0891716 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1681 microversion: 2.1 time: 0.155082 Oct 17 14:24:02.881132 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3422/7289] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:02 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:03.904111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:03.904691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:03.916116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:03.916963 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:03.917780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:03.919013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:03.919802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:03.920550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:04.156533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:04.164672 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9b620d9-7c0e-497f-aa84-357de9f39b44 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1678 microversion: 2.1 time: 0.264570 Oct 17 14:24:04.165289 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3868/7290] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:03 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:04.187944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:04.188519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:04.195955 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:04.196446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:04.196892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:04.197626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:04.198091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:04.198524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:04.259976 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b11c022d-e186-4766-b089-d1a930df4cc5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507/action" status: 204 len: 0 microversion: 2.1 time: 0.075829 Oct 17 14:24:04.260638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3423/7291] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:24:04 2022] POST /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:24:04.270468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:04.271110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:04.277829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:04.278506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:04.279063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:04.279931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:04.280742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:04.281355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:04.785992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:04.794320 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-002926da-016d-4530-b1ec-6d25a8d00379 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1678 microversion: 2.1 time: 0.529354 Oct 17 14:24:04.794910 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3869/7292] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:04 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1678 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:05.455336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "name": "network-vif-plugged", "status": "completed", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:05.466958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:05.467674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:05.468286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:05.480810 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] Creating event network-vif-plugged:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h2-854121-14 Oct 17 14:24:05.486826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] Instance 87afbbc6-1106-4f44-8dad-668ea596a507 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:24:05.498097 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-adde0ba4-553c-4bb4-bf0b-bd73472586e7 req-6af9648a-86c4-4e53-8e1c-93dd6a3bec53 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048124 Oct 17 14:24:05.498823 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3424/7293] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:05.818701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:05.819356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:05.826507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:05.827222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:05.827684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:05.828406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:05.828882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:05.829359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:05.975120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:05.983121 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-949de29b-6331-46a5-91d3-f1c138b81b53 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1670 microversion: 2.1 time: 0.168354 Oct 17 14:24:05.983705 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3870/7294] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:05 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:06.008548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:06.009296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:06.015543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.016039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.016492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.018306 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.018782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.019257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.157281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:06.165132 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a6ba486-b936-4f38-b343-5d82dc8fefd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1670 microversion: 2.1 time: 0.161115 Oct 17 14:24:06.165743 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3425/7295] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:06 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:06.187190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:06.187821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:06.194477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.194973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.195423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.196127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.196591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.197028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.333115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:06.340914 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c86aa33-fb4f-4a0b-9b3c-dfe518cd9bed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1670 microversion: 2.1 time: 0.157605 Oct 17 14:24:06.341521 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3871/7296] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:06 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:06.363624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:06.364059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:06.370116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.370606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.371048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.371752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.372207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.372638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.398825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:24:06.413250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:06.478251 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-53639226-9615-4da8-9522-596c91c26e6a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 204 len: 0 microversion: 2.1 time: 0.118947 Oct 17 14:24:06.479332 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3426/7297] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:24:06 2022] DELETE /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:24:06.489541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:06.490178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:06.496247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.496745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.497213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.497925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:06.498401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:06.498843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:06.630156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:06.638595 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-723dc5cb-f470-4ac1-9ad3-0811efcf5556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1676 microversion: 2.1 time: 0.153916 Oct 17 14:24:06.639186 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3872/7298] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:06 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:24:07.662713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:07.663461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:07.671443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:07.671941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:07.672388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:07.673180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:07.673785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:07.674227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:07.807801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:07.817013 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-78eb6f56-8909-4b4e-9a2e-0b32ed817b85 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1676 microversion: 2.1 time: 0.158864 Oct 17 14:24:07.817630 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3427/7299] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:07 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:08.841781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:08.842561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:08.850478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:08.850915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:08.851379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:08.852110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:08.852606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:08.853054 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:08.872421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:08.936770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:08.945523 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb200235-19d9-4fb0-a836-9339dfe78899 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 200 len: 1609 microversion: 2.1 time: 0.108164 Oct 17 14:24:08.946209 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3873/7300] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:08 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 1609 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:08.980790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-bbb7c64e-7abb-4d3f-9eff-2134f12762cc req-520f5441-30d3-4c20-8b67-5fad438cc21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87afbbc6-1106-4f44-8dad-668ea596a507", "name": "network-vif-deleted", "tag": "06e244b8-6045-4cec-9f07-da6bcd1d9d11"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:08.993836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bbb7c64e-7abb-4d3f-9eff-2134f12762cc req-520f5441-30d3-4c20-8b67-5fad438cc21b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:08.994422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bbb7c64e-7abb-4d3f-9eff-2134f12762cc req-520f5441-30d3-4c20-8b67-5fad438cc21b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:08.995243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-bbb7c64e-7abb-4d3f-9eff-2134f12762cc req-520f5441-30d3-4c20-8b67-5fad438cc21b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:09.008730 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-bbb7c64e-7abb-4d3f-9eff-2134f12762cc req-520f5441-30d3-4c20-8b67-5fad438cc21b service nova] Creating event network-vif-deleted:06e244b8-6045-4cec-9f07-da6bcd1d9d11 for instance 87afbbc6-1106-4f44-8dad-668ea596a507 on n-h2-854121-14 Oct 17 14:24:09.014094 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-bbb7c64e-7abb-4d3f-9eff-2134f12762cc req-520f5441-30d3-4c20-8b67-5fad438cc21b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039722 Oct 17 14:24:09.014278 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3428/7301] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:09.973565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:09.974447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:09.981816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:09.982573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:09.983089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:09.984063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:09.984539 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:09.984975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:10.000092 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 HTTP/1.1 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '87afbbc6-1106-4f44-8dad-668ea596a507'} Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:24:10.002094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-207d5480-8eae-4c47-bc2b-c5d389ba80fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 404 len: 111 microversion: 2.1 time: 0.035352 Oct 17 14:24:10.007426 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3874/7302] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:09 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:24:10.020841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:10.021691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:10.028138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:10.028625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:10.029061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:10.029788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:10.030261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:10.030671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:10.045082 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 HTTP/1.1 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '87afbbc6-1106-4f44-8dad-668ea596a507'} Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:24:10.046784 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f333acf8-5343-4261-b7a5-032f20c1bceb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 404 len: 111 microversion: 2.1 time: 0.032661 Oct 17 14:24:10.052508 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3429/7303] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:10 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:24:10.114164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1830841556", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "79d664e0-fda8-420d-91cd-80d4d061a144"}], "security_groups": [{"name": "tempest-securitygroup--363458275"}], "key_name": "tempest-keypair-2042768162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:10.220693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] validate_networks() for [('79d664e0-fda8-420d-91cd-80d4d061a144', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:24:10.595575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:24:10.596247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:24:10.596509 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:24:10.596935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:24:10.597391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:24:10.606435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:10.606934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:10.607421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:10.608163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:10.608643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:10.609091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:10.627038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:24:10.632640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:24:10.646206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:24:10.648546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:24:10.695817 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c6090b19-7795-4109-8632-84489fa00fbf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.585719 Oct 17 14:24:10.696478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3875/7304] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:24:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:24:10.708546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0911dd0f-0b65-4aaf-bbbc-87eb656780ee tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:10.709192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0911dd0f-0b65-4aaf-bbbc-87eb656780ee tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:10.762948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0911dd0f-0b65-4aaf-bbbc-87eb656780ee tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:10.770950 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0911dd0f-0b65-4aaf-bbbc-87eb656780ee tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1239 microversion: 2.1 time: 0.066842 Oct 17 14:24:10.771533 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3430/7305] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:10 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:11.796560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:11.797224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:11.804074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:11.804586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:11.805046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:11.805804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:11.806281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:11.806730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:11.880834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:11.889700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa5bbc2b-7dbd-494b-9400-6c88ba10a556 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1299 microversion: 2.1 time: 0.097731 Oct 17 14:24:11.890205 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3876/7306] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:11 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:12.917240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:12.918014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:12.926867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:12.927453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:12.927961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:12.928734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:12.929292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:12.929814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:13.185482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:13.194049 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25a8da27-1c23-4b1c-9241-da3f5f3138df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.280755 Oct 17 14:24:13.194638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3431/7307] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:12 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:13.388996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-baacfeab-bacb-45f2-88e8-a8bc9a4a456a req-8a60115d-bb67-45c6-8080-5a1bb5ccab42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:13.400576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-baacfeab-bacb-45f2-88e8-a8bc9a4a456a req-8a60115d-bb67-45c6-8080-5a1bb5ccab42 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:13.401221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-baacfeab-bacb-45f2-88e8-a8bc9a4a456a req-8a60115d-bb67-45c6-8080-5a1bb5ccab42 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:13.401766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-baacfeab-bacb-45f2-88e8-a8bc9a4a456a req-8a60115d-bb67-45c6-8080-5a1bb5ccab42 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:13.413899 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-baacfeab-bacb-45f2-88e8-a8bc9a4a456a req-8a60115d-bb67-45c6-8080-5a1bb5ccab42 service nova] Creating event network-changed:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h2-854121-14 Oct 17 14:24:13.418883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-baacfeab-bacb-45f2-88e8-a8bc9a4a456a req-8a60115d-bb67-45c6-8080-5a1bb5ccab42 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033736 Oct 17 14:24:13.419771 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3877/7308] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:14.218716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:14.219356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:14.222591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:14.228272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:14.228766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:14.229233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:14.229941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:14.230401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:14.230833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:14.365101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:14.372975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4403cd6-a778-4f01-8f02-98516fb9f9df tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.158237 Oct 17 14:24:14.373588 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3432/7309] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:14 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:15.398103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:15.398831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:15.400835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:15.407950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:15.408449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:15.408903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:15.409645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:15.410114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:15.410558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:15.541445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:15.549886 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb030845-7dc7-4676-833f-e94e0a308453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.157073 Oct 17 14:24:15.550463 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3878/7310] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:15 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:24:16.573627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:16.574398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:16.582182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:16.582668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:16.583106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:16.583801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:16.584252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:16.584700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:16.720668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:16.729440 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38d67bb2-a9c8-4979-8e83-c2bf9703c850 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.159621 Oct 17 14:24:16.730365 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3433/7311] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:16 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:17.753849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:17.754479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:17.761711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:17.762207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:17.762653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:17.763361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:17.763824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:17.764261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:17.901477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:17.910537 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c014211a-9689-43d0-8b98-17e80623195f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.161326 Oct 17 14:24:17.911137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3879/7312] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:17 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:18.934847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:18.935494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:18.943369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:18.943854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:18.944296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:18.944994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:18.945483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:18.945911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:19.078072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:19.086834 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87c4b711-ae97-4b47-a247-eb1683d44b3a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.155927 Oct 17 14:24:19.087408 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3434/7313] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:18 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:20.111044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:20.111681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:20.118939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:20.119444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:20.119900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:20.120624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:20.121099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:20.121579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:20.257912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:20.266168 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0d877fc-9907-493f-a442-e9dc9ce8c3f7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.159333 Oct 17 14:24:20.267530 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3880/7314] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:20 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:21.290430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:21.290967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:21.293692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:21.299933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:21.300417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:21.300861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:21.301691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:21.302050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:21.302479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:21.437856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:21.445967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48cebf1a-2d25-461e-a00a-cc6069119974 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.159485 Oct 17 14:24:21.446549 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3435/7315] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:21 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:21.529607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b7af19ed-546f-4964-bc96-0225ff5bdc1a req-ffbb3ed0-df85-4554-a400-85eac437f8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "name": "network-vif-plugged", "status": "completed", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:21.534916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:21.535623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:24:21.543515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7af19ed-546f-4964-bc96-0225ff5bdc1a req-ffbb3ed0-df85-4554-a400-85eac437f8f6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:21.543971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7af19ed-546f-4964-bc96-0225ff5bdc1a req-ffbb3ed0-df85-4554-a400-85eac437f8f6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:21.544402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7af19ed-546f-4964-bc96-0225ff5bdc1a req-ffbb3ed0-df85-4554-a400-85eac437f8f6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:21.556772 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b7af19ed-546f-4964-bc96-0225ff5bdc1a req-ffbb3ed0-df85-4554-a400-85eac437f8f6 service nova] Creating event network-vif-plugged:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h2-854121-14 Oct 17 14:24:21.561949 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b7af19ed-546f-4964-bc96-0225ff5bdc1a req-ffbb3ed0-df85-4554-a400-85eac437f8f6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 Oct 17 14:24:21.562587 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3881/7316] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:22.470618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:22.471266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:22.478175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:22.478656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:22.479095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:22.479890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:22.480239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:22.480659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:22.617024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:22.625066 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24dbaa69-0697-462d-a701-578ebb63cf62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1364 microversion: 2.1 time: 0.158486 Oct 17 14:24:22.625681 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3436/7317] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:22 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:23.657678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:23.658938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:23.665321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:23.665826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:23.666283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:23.666999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:23.667472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:23.667915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:23.801328 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:24:23.809542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-50b2607e-b9b1-4c22-9107-917f5dc3d040 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1551 microversion: 2.1 time: 0.157168 Oct 17 14:24:23.810131 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3882/7318] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:24:23 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:24:23.832831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:24:23.833397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:24:23.840273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:23.841070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:23.841241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:23.841910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:23.842371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:23.842803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:23.924583 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0aada0df-8bf8-4d38-8b1f-60cec3bd125d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096121 Oct 17 14:24:23.925202 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3437/7319] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 14:24:23 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:24:25.189289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e0412266-263e-426c-89d2-0ae9ec968bf9 req-3003c91a-dfd7-4e11-bc0a-e793b9a9b366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:24:25.199605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e0412266-263e-426c-89d2-0ae9ec968bf9 req-3003c91a-dfd7-4e11-bc0a-e793b9a9b366 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:24:25.200097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e0412266-263e-426c-89d2-0ae9ec968bf9 req-3003c91a-dfd7-4e11-bc0a-e793b9a9b366 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:24:25.200547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e0412266-263e-426c-89d2-0ae9ec968bf9 req-3003c91a-dfd7-4e11-bc0a-e793b9a9b366 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:24:25.212808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e0412266-263e-426c-89d2-0ae9ec968bf9 req-3003c91a-dfd7-4e11-bc0a-e793b9a9b366 service nova] Creating event network-changed:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h2-854121-14 Oct 17 14:24:25.217935 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e0412266-263e-426c-89d2-0ae9ec968bf9 req-3003c91a-dfd7-4e11-bc0a-e793b9a9b366 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032771 Oct 17 14:24:25.218571 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3883/7320] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:25:39.430892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:39.431665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:39.437872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5fa1ac7f-6026-4def-99e8-016fac744a6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:39.445023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fa1ac7f-6026-4def-99e8-016fac744a6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:39.445553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fa1ac7f-6026-4def-99e8-016fac744a6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:39.445998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fa1ac7f-6026-4def-99e8-016fac744a6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:39.471536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5fa1ac7f-6026-4def-99e8-016fac744a6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Going to try to stop instance {{(pid=120698) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 14:25:39.515077 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5fa1ac7f-6026-4def-99e8-016fac744a6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action" status: 202 len: 0 microversion: 2.1 time: 0.086408 Oct 17 14:25:39.515708 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3438/7321] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:25:39 2022] POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:25:39.523657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=11 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:39.524571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=42 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:25:39.532281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:39.533022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:39.540154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:39.540649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:39.541098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:39.541836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:39.542301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:39.542738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:39.770979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:39.778943 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc5bc413-16b7-418b-97b0-ae2bd1d1b451 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.258211 Oct 17 14:25:39.779554 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3884/7322] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:39 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:40.806024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:40.806733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:40.812985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:40.813508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:40.813949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:40.814646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:40.815104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:40.815533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:40.950772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:40.959353 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a43295aa-5404-4199-940f-168a6c4cedcd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.158741 Oct 17 14:25:40.959944 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3439/7323] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:40 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:41.982496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:41.983121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:41.990822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:41.991318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:41.991769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:41.992486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:41.992950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:41.993420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:42.128279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:42.136841 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-07316d45-eb3e-4883-bc8f-a719cff5e740 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.158273 Oct 17 14:25:42.137451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3885/7324] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:41 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:43.160821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:43.161468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:43.168383 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:43.168869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:43.169351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:43.170051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:43.170507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:43.170934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:43.300873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:43.308812 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8498cbb4-80cb-4c13-abf8-c4954f110c6e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.152570 Oct 17 14:25:43.309425 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3440/7325] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:43 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:44.333498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:44.334145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:44.340984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:44.341512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:44.341965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:44.342683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:44.343125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:44.343557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:44.473590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:44.481544 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70ac20f4-f325-4fb5-9d10-680dd50c16cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.152643 Oct 17 14:25:44.482121 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3886/7326] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:44 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:45.505558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:45.506552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:45.513188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:45.513684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:45.514127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:45.514827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:45.515283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:45.515713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:45.650524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:45.658301 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6df02c34-4623-447d-b39a-e0638b6835fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.157387 Oct 17 14:25:45.658870 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3441/7327] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:45 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:46.682643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:46.683290 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:46.690293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:46.690799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:46.691255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:46.691978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:46.693017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:46.693678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:46.828047 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:46.837107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-39b7359b-7d64-443b-903b-22007a56a14d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.158547 Oct 17 14:25:46.837726 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3887/7328] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:46 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:47.860673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:47.861311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:47.868313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:47.868793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:47.869257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:47.869950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:47.870397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:47.870821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:48.004214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:48.012973 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65adc78b-7ef0-4a17-98cb-1c5ddd7327fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.156283 Oct 17 14:25:48.013592 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3442/7329] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:47 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:49.036063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:49.037412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:49.044235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:49.044734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:49.045200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:49.045909 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:49.046373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:49.046810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:49.183635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:49.191761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41d7d8b8-4e88-4b48-8c32-4d407a131233 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.159692 Oct 17 14:25:49.192336 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3888/7330] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:49 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:50.215477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:50.216095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:50.223170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:50.223652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:50.224595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:50.225520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:50.225831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:50.226215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:50.356857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:50.365815 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c75edd2-a034-4d38-8157-dfe4f0d16f34 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1657 microversion: 2.1 time: 0.153638 Oct 17 14:25:50.366419 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3443/7331] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:50 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1657 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:50.389788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:50.392076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:50.400015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:50.400511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:50.400988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:50.401719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:50.402182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:50.402643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:50.431687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:50.437183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:25:50.444083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:25:50.444716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:25:50.445590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:25:50.446022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:25:50.446450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:25:50.512696 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4ea47757-bd77-43e0-b037-f70ecfc12100 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action" status: 202 len: 0 microversion: 2.1 time: 0.126856 Oct 17 14:25:50.513383 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3889/7332] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:25:50 2022] POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:25:50.522185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:50.522804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:50.529277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:50.529777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:50.530221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:50.530928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:50.531389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:50.531825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:50.677435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:50.685602 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f00a34e-643d-48f6-8e6c-de5f3844483f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.167687 Oct 17 14:25:50.686186 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3444/7333] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:50 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:51.710074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:51.710712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:51.717858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:51.718366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:51.718824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:51.719537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:51.720011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:51.720457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:51.852030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:51.860112 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c88b4bf-ef1f-437f-b64a-c2e0bb223468 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.155028 Oct 17 14:25:51.860689 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3890/7334] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:51 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:52.884796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:52.885460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:52.892749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:52.893194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:52.893638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:52.894350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:52.894809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:52.895238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:53.036343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:53.044811 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9bb74a3c-6013-4e39-b6e9-39540cea7bde tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.164841 Oct 17 14:25:53.045426 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3445/7335] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:52 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:54.068705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:54.069855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:54.076661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:54.077195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:54.077666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:54.078393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:54.078864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:54.079313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:54.290158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:54.298163 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e35aa2d7-ad20-451d-b6e5-3ac1ff1cc859 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1680 microversion: 2.1 time: 0.234076 Oct 17 14:25:54.298753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3891/7336] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:54 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:55.322762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:55.323369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:55.330241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:55.330757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:55.331199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:55.331894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:55.332351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:55.332802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:55.465950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:55.473955 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12f64efc-0e6a-4013-b873-148e678cd40f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1685 microversion: 2.1 time: 0.155921 Oct 17 14:25:55.474544 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3446/7337] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:55 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:56.497559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:56.498201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:56.505214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:56.505723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:56.506437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:56.507152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:56.507621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:56.508070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:56.642071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:56.650731 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6efcc410-2c96-403f-95cc-57ad69b67050 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1685 microversion: 2.1 time: 0.157232 Oct 17 14:25:56.651379 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3892/7338] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:56 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:57.389653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "name": "network-vif-unplugged", "status": "completed", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:57.399291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:57.399777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:57.400222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:57.412303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] Creating event network-vif-unplugged:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h1-854121-14 Oct 17 14:25:57.418014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:25:57.429953 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f63db03a-bb3e-4d73-a4b2-4fc9f19bad98 req-45810306-1c7c-46a1-9e78-e9a39d879c87 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101605 Oct 17 14:25:57.430582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3447/7339] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:25:57.674426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:57.675052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:57.682647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:57.683147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:57.683597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:57.684317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:57.684789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:57.685253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:57.932853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:57.942160 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ab186af-c8a7-4bd1-86c5-ed9d9d06d8e0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1684 microversion: 2.1 time: 0.271602 Oct 17 14:25:57.942758 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3893/7340] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:57 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1684 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:58.968661 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:25:58.969388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:25:58.975622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:58.976756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:58.977230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:58.977919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:58.978369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:58.978795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:59.115340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:25:59.123493 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-320a9cd1-3724-4dc2-a3cb-325508572f60 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1682 microversion: 2.1 time: 0.159994 Oct 17 14:25:59.124080 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3448/7341] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:25:58 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:25:59.448609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:25:59.459531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:25:59.460027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:25:59.460506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:25:59.472671 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] Creating event network-changed:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h1-854121-14 Oct 17 14:25:59.478154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:25:59.488971 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e2535543-1310-4f22-beb2-54dbc2d022b7 req-856cc7a7-5990-4b8b-a004-77820f4faabc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044703 Oct 17 14:25:59.489622 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3894/7342] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:00.148228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:00.148999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:00.156106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:00.156606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:00.157054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:00.157796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:00.158257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:00.158693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:00.439034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:00.448628 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3699509e-35a0-4517-a845-f22ebf9a71cb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1678 microversion: 2.1 time: 0.304914 Oct 17 14:26:00.449285 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3449/7343] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:00 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:00.473925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:00.474564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:00.481664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:00.482163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:00.482614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:00.483391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:00.483863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:00.484302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:00.545380 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc5d50af-0b60-481e-8725-fe6f50cf582a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action" status: 204 len: 0 microversion: 2.1 time: 0.076648 Oct 17 14:26:00.547228 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3895/7344] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:26:00 2022] POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:26:00.556582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:00.557579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:00.564611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:00.565202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:00.565914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:00.567897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:00.568416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:00.568905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:00.869683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:00.878619 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a358360-af8d-496d-b7e9-49f3c763756c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1678 microversion: 2.1 time: 0.326045 Oct 17 14:26:00.879307 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3450/7345] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:00 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1678 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:01.905820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:01.906689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:01.914141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:01.914800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:01.915334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:01.916181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:01.916784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:01.917362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:02.063841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:02.073295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da2029ba-dc3f-4f3c-9275-936e98f5e5ad tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1678 microversion: 2.1 time: 0.174179 Oct 17 14:26:02.073883 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3896/7346] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:01 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:03.097123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:03.097803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:03.105326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.105823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.106296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.107062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.107525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.107957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.238290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:03.246348 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad7a0fe8-684c-45b6-a745-2b87ad11b3da tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1657 microversion: 2.1 time: 0.153174 Oct 17 14:26:03.246929 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3451/7347] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:03 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:03.268993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:03.269591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:03.277052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.277592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.278048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.278766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.279242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.279684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.412183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:03.420968 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4584683-a3c0-49a6-b7af-823fe895c8fe tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1657 microversion: 2.1 time: 0.155906 Oct 17 14:26:03.421583 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3897/7348] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:03 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1657 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:03.443417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da4e4743-750b-4b62-88d5-2f59debd62d2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:03.449824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da4e4743-750b-4b62-88d5-2f59debd62d2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.450318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da4e4743-750b-4b62-88d5-2f59debd62d2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.450763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da4e4743-750b-4b62-88d5-2f59debd62d2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.476624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da4e4743-750b-4b62-88d5-2f59debd62d2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 14:26:03.517012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:03.528189 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da4e4743-750b-4b62-88d5-2f59debd62d2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action" status: 202 len: 0 microversion: 2.1 time: 0.088463 Oct 17 14:26:03.528723 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3452/7349] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:26:03 2022] POST /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:26:03.537482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:03.538347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:03.544709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.545370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.545914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.546865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.547407 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.547917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.564966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:03.674477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-73ebc0df-9bb9-4d23-a4f4-7a1c56befb44 req-c2839709-27f3-4e68-839f-153f3c1a1e0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "name": "network-vif-plugged", "status": "completed", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:03.684995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-73ebc0df-9bb9-4d23-a4f4-7a1c56befb44 req-c2839709-27f3-4e68-839f-153f3c1a1e0d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:03.685512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-73ebc0df-9bb9-4d23-a4f4-7a1c56befb44 req-c2839709-27f3-4e68-839f-153f3c1a1e0d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:03.686158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-73ebc0df-9bb9-4d23-a4f4-7a1c56befb44 req-c2839709-27f3-4e68-839f-153f3c1a1e0d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:03.699823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-73ebc0df-9bb9-4d23-a4f4-7a1c56befb44 req-c2839709-27f3-4e68-839f-153f3c1a1e0d service nova] Creating event network-vif-plugged:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h1-854121-14 Oct 17 14:26:03.704827 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-73ebc0df-9bb9-4d23-a4f4-7a1c56befb44 req-c2839709-27f3-4e68-839f-153f3c1a1e0d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109915 Oct 17 14:26:03.705497 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3453/7350] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:26:03.799811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:03.808456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-646f70da-e53c-4f88-88d2-296929298cdc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1666 microversion: 2.1 time: 0.275051 Oct 17 14:26:03.809287 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3898/7351] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:03 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1666 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:04.833660 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:04.834369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:04.841431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:04.841926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:04.842373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:04.843084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:04.843544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:04.843998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:04.977912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:04.985785 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66fbccfe-7d4c-407d-bb4b-edfdcd46cfab tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1670 microversion: 2.1 time: 0.157276 Oct 17 14:26:04.986357 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3454/7352] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:04 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:05.009137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:05.009692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:05.016631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.017142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.017632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.018374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.018840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.019289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.048607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:26:05.129449 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9377f070-01a8-4d2b-81bd-615aab1431b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 204 len: 0 microversion: 2.1 time: 0.124580 Oct 17 14:26:05.130153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3899/7353] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:26:05 2022] DELETE /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:26:05.139024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:05.139645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:05.145939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.146433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.146882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.147588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:05.148401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:05.149238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:05.283055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:05.291571 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0dc61ad0-5d26-4740-9316-848e9989b02b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1676 microversion: 2.1 time: 0.156624 Oct 17 14:26:05.292150 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3455/7354] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:05 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:06.316338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:06.317068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:06.324605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:06.325106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:06.325596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:06.326309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:06.326784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:06.327230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:06.535267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:06.544073 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d44827f8-a840-428c-a2bb-c1da86729bc6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 200 len: 1676 microversion: 2.1 time: 0.232128 Oct 17 14:26:06.544743 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3900/7355] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:06 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:07.284842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cfbeadb0-1256-4180-9a5d-3e9dd7cd97a2 req-e6140b95-e409-47cf-8a88-cc8c0490720d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8711bdef-b73d-4ca2-8e3f-c29503b5d27f", "name": "network-vif-deleted", "tag": "f18b3dce-3c46-4b91-9325-efd5467ddae4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:07.298839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cfbeadb0-1256-4180-9a5d-3e9dd7cd97a2 req-e6140b95-e409-47cf-8a88-cc8c0490720d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.299327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cfbeadb0-1256-4180-9a5d-3e9dd7cd97a2 req-e6140b95-e409-47cf-8a88-cc8c0490720d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.299756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cfbeadb0-1256-4180-9a5d-3e9dd7cd97a2 req-e6140b95-e409-47cf-8a88-cc8c0490720d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:07.314020 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cfbeadb0-1256-4180-9a5d-3e9dd7cd97a2 req-e6140b95-e409-47cf-8a88-cc8c0490720d service nova] Creating event network-vif-deleted:f18b3dce-3c46-4b91-9325-efd5467ddae4 for instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f on n-h1-854121-14 Oct 17 14:26:07.320974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cfbeadb0-1256-4180-9a5d-3e9dd7cd97a2 req-e6140b95-e409-47cf-8a88-cc8c0490720d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038985 Oct 17 14:26:07.321985 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3456/7356] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:07.568461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:07.569287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:07.576513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.577021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.577545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:07.578275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.578751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.579202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:07.594069 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f HTTP/1.1 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '8711bdef-b73d-4ca2-8e3f-c29503b5d27f'} Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:26:07.595798 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb24a97f-9573-4d8e-9099-8689acf0de33 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 404 len: 111 microversion: 2.1 time: 0.033010 Oct 17 14:26:07.600079 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3901/7357] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:07 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:26:07.613354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:07.614175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:07.621110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.621671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.622119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:07.622834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:07.623338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:07.623744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:07.639344 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f HTTP/1.1 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8711bdef-b73d-4ca2-8e3f-c29503b5d27f'} Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:26:07.641020 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09f57eeb-8c83-4fd4-a30a-effe4a7a8a7e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 404 len: 111 microversion: 2.1 time: 0.033696 Oct 17 14:26:07.645852 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3457/7358] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:07 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:26:07.692634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1955474415", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "79d664e0-fda8-420d-91cd-80d4d061a144"}], "security_groups": [{"name": "tempest-securitygroup--363458275"}], "key_name": "tempest-keypair-2042768162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:07.802578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] validate_networks() for [('79d664e0-fda8-420d-91cd-80d4d061a144', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:26:08.244977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:26:08.245523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:26:08.246195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:26:08.246629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:26:08.247091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:26:08.256412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:08.256920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:08.257923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:08.258782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:08.259264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:08.259717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:08.279690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:26:08.285679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:26:08.300653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:26:08.303105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:26:08.353570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0717aa9-6d9a-4b23-955b-9477ae4b49ec tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664847 Oct 17 14:26:08.354810 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3902/7359] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:26:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:26:08.368250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74c6d9ce-e517-40d9-b6b7-98eba1607d1f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:08.369536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74c6d9ce-e517-40d9-b6b7-98eba1607d1f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:08.425839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-74c6d9ce-e517-40d9-b6b7-98eba1607d1f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:08.435187 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74c6d9ce-e517-40d9-b6b7-98eba1607d1f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1239 microversion: 2.1 time: 0.073020 Oct 17 14:26:08.436115 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3458/7360] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:08 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:09.460300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:09.461049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:09.468918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:09.469617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:09.470079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:09.470825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:09.471291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:09.471759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:09.551094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:09.561019 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94eb98f8-fa8c-45f4-b432-cc9f330bc725 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1299 microversion: 2.1 time: 0.105614 Oct 17 14:26:09.561715 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3903/7361] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:09 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:10.586227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:10.586926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:10.589715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=45 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:10.595279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:10.595981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:10.596511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:10.597388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:10.597845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:10.598269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:10.847724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:10.857123 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84c9505e-2c43-44e6-8518-4050b183ed92 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.275641 Oct 17 14:26:10.857834 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3459/7362] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:10 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:11.358181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-63f7adbe-5f89-46da-9c76-a2ad0e13f9ae req-0cc143ab-ef5d-4e60-b612-301b763b2041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:11.368286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:11.370781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-63f7adbe-5f89-46da-9c76-a2ad0e13f9ae req-0cc143ab-ef5d-4e60-b612-301b763b2041 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:11.371357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-63f7adbe-5f89-46da-9c76-a2ad0e13f9ae req-0cc143ab-ef5d-4e60-b612-301b763b2041 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:11.371964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-63f7adbe-5f89-46da-9c76-a2ad0e13f9ae req-0cc143ab-ef5d-4e60-b612-301b763b2041 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:11.385700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-63f7adbe-5f89-46da-9c76-a2ad0e13f9ae req-0cc143ab-ef5d-4e60-b612-301b763b2041 service nova] Creating event network-changed:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h2-854121-14 Oct 17 14:26:11.391638 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-63f7adbe-5f89-46da-9c76-a2ad0e13f9ae req-0cc143ab-ef5d-4e60-b612-301b763b2041 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037243 Oct 17 14:26:11.392568 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3904/7363] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:11.880138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:11.880761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:11.888222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:11.888715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:11.889273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:11.889989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:11.890554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:11.890908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:12.024497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:12.032329 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60a22871-2a9c-453b-8354-8a980e8bf1c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.156239 Oct 17 14:26:12.032911 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3460/7364] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:11 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:13.058524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:13.059236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:13.065448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:13.065943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:13.066392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:13.067089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:13.067559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:13.067995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:13.203886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:13.211848 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54e859d5-2345-41e3-abb4-9239a1c05564 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.159307 Oct 17 14:26:13.212426 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3905/7365] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:13 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:14.236044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:14.236657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:14.243883 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:14.244366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:14.244801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:14.245947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:14.245947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:14.246373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:14.457541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:14.466146 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a3237cd-0bae-4e60-a155-b77682c517a2 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.234286 Oct 17 14:26:14.466739 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3461/7366] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:14 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:15.490341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:15.490980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:15.498184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:15.498693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:15.499152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:15.499877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:15.500384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:15.500799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:15.636286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:15.644588 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6783820-47a1-4d4b-9484-712a0dde7059 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.158198 Oct 17 14:26:15.645195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3906/7367] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:15 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:16.668672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:16.669308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:16.676195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:16.676723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:16.677125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:16.677836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:16.678292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:16.679219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:16.814197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:16.822205 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef8ccb9f-8135-4515-9495-1df2b9800397 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.157544 Oct 17 14:26:16.822788 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3462/7368] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:16 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:17.846241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:17.846901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:17.854036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:17.854540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:17.854993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:17.855705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:17.856173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:17.856614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:17.994393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:18.003104 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cfb70b52-1d65-4487-9da5-5613ab4b150c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.160794 Oct 17 14:26:18.003701 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3907/7369] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:17 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:18.033108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cc43463d-b807-486d-9543-e56d0d6ef8fc req-b929223f-cd39-4852-8a78-a1bac4ae5622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "name": "network-vif-plugged", "status": "completed", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:18.046397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cc43463d-b807-486d-9543-e56d0d6ef8fc req-b929223f-cd39-4852-8a78-a1bac4ae5622 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:18.047706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cc43463d-b807-486d-9543-e56d0d6ef8fc req-b929223f-cd39-4852-8a78-a1bac4ae5622 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:18.048501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cc43463d-b807-486d-9543-e56d0d6ef8fc req-b929223f-cd39-4852-8a78-a1bac4ae5622 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:18.063924 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cc43463d-b807-486d-9543-e56d0d6ef8fc req-b929223f-cd39-4852-8a78-a1bac4ae5622 service nova] Creating event network-vif-plugged:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h2-854121-14 Oct 17 14:26:18.069273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cc43463d-b807-486d-9543-e56d0d6ef8fc req-b929223f-cd39-4852-8a78-a1bac4ae5622 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040197 Oct 17 14:26:18.069942 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3463/7370] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:19.028630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:19.029440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:19.031361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:19.032180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:19.039862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:19.040375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:19.040830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:19.041725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:19.042194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:19.042638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:19.177709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:19.185578 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a79b16bb-eda1-4710-a8d6-c37a34de1a3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1364 microversion: 2.1 time: 0.160902 Oct 17 14:26:19.186221 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3908/7371] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:19 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:20.209647 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:20.210387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:20.212648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:26:20.219060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:20.219556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:20.220005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:20.220721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:20.221192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:20.221626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:20.361230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:26:20.370254 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-316aff16-8278-433c-85c9-33e81801016e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1551 microversion: 2.1 time: 0.164996 Oct 17 14:26:20.370839 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3464/7372] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:26:20 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:26:20.394220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:26:20.394761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:26:20.401856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:20.402348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:20.402796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:20.403497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:20.404002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:20.404421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:20.481508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60a0b214-f5d4-4fcf-910b-ff3a9a6f9b32 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091141 Oct 17 14:26:20.482120 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3909/7373] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 14:26:20 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:26:21.431179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-08fb3556-181b-4288-8b9e-aa8905b09727 req-875968c0-1e4f-4322-bb5d-3cefb5b70901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:26:21.442111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-08fb3556-181b-4288-8b9e-aa8905b09727 req-875968c0-1e4f-4322-bb5d-3cefb5b70901 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:26:21.442602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-08fb3556-181b-4288-8b9e-aa8905b09727 req-875968c0-1e4f-4322-bb5d-3cefb5b70901 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:26:21.443040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-08fb3556-181b-4288-8b9e-aa8905b09727 req-875968c0-1e4f-4322-bb5d-3cefb5b70901 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:26:21.455349 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-08fb3556-181b-4288-8b9e-aa8905b09727 req-875968c0-1e4f-4322-bb5d-3cefb5b70901 service nova] Creating event network-changed:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h2-854121-14 Oct 17 14:26:21.460546 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-08fb3556-181b-4288-8b9e-aa8905b09727 req-875968c0-1e4f-4322-bb5d-3cefb5b70901 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033506 Oct 17 14:26:21.461255 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3465/7374] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:35.609102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=11 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:35.610258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:35.617042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:35.619409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:35.627332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:35.627828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:35.628272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:35.628982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:35.629483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:35.629931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:35.661664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:35.668169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:27:35.674935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:27:35.675375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:27:35.675903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:27:35.676291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:27:35.676710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:27:35.741955 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33a047ac-9e40-4e89-8fac-4edd2322e531 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886/action" status: 202 len: 0 microversion: 2.1 time: 0.135712 Oct 17 14:27:35.742581 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3910/7375] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:27:35 2022] POST /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:27:35.751486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=13 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:35.752315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=52 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:27:35.753517 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:27:35.753970 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:27:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 (ip 10.222.0.65) !!! Oct 17 14:27:35.756040 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:27:35.756136 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:27:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 (ip 10.222.0.65) !!! Oct 17 14:27:35.767126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:35.767837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:35.783788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:35.784282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:35.784721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:35.785447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:35.785899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:35.786323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:35.930478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:35.939080 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5762dc44-a5b2-4cb1-9d59-6af4c77f1c63 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1679 microversion: 2.1 time: 0.191061 Oct 17 14:27:35.939655 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3466/7376] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:35 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:36.963140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:36.964358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:36.971446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:36.971938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:36.972385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:36.973089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:36.973580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:36.974041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:37.192105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:37.200894 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6701f15e-7efd-47c7-8f6d-b28825a8aecb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1679 microversion: 2.1 time: 0.242512 Oct 17 14:27:37.201589 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3911/7377] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:36 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1679 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:38.226607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:38.227227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:38.234217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:38.234712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:38.235158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:38.235853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:38.236315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:38.236746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:38.371422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:38.379322 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a296738-f77c-4ff3-be81-8171dca66f62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.156933 Oct 17 14:27:38.379893 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3467/7378] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:38 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:39.404097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:39.404653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:39.411567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:39.412058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:39.412507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:39.413225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:39.413691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:39.414128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:39.549757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:39.558433 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5bb8e57-ffd6-4d4a-a13d-c3af42860ac0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.158386 Oct 17 14:27:39.559017 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3912/7379] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:39 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:40.582800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:40.583567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:40.590550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:40.591032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:40.591470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:40.592159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:40.592614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:40.593037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:40.731171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:40.739036 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e215ab73-e855-437b-9352-cf55614e3369 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.160211 Oct 17 14:27:40.739621 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3468/7380] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:40 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:41.763548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:41.764194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:41.771155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:41.771655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:41.772113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:41.772833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:41.773384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:41.773836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:41.904862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:41.914646 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7155e057-0d79-454d-8582-21e90aac1b56 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.155187 Oct 17 14:27:41.915432 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3913/7381] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:41 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:42.939550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:42.940259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:42.948025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:42.948541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:42.949038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:42.949795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:42.950257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:42.950689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:43.082714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:43.093253 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb494cc9-fdbc-47ef-8e3b-4379f223c11f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.157981 Oct 17 14:27:43.093931 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3469/7382] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:42 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:44.117901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:44.118581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:44.126097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:44.126603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:44.127088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:44.127806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:44.128282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:44.128757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:44.264839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:44.272978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4542ea29-12ee-4c02-bd48-4cdec4b21166 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.159127 Oct 17 14:27:44.273591 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3914/7383] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:44 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:45.296468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:45.297089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:45.303740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:45.304220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:45.304658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:45.305374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:45.305826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:45.306247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:45.438469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:45.446362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9eb920c2-0c20-488f-9a3d-a81856d6aa46 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.153825 Oct 17 14:27:45.446941 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3470/7384] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:45 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:46.470298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:46.470929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:46.478090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:46.479206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:46.479666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:46.480387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:46.480861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:46.481340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:46.912478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:46.920761 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae76cb90-abee-4e33-8586-249892b8bb62 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.454464 Oct 17 14:27:46.921370 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3915/7385] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:46 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:47.944128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:47.944801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:47.951959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:47.952439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:47.952875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:47.953584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:47.954032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:47.954454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:48.084029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:48.092521 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80c45593-c4c4-46b0-9435-f96d821eeb89 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.152427 Oct 17 14:27:48.093093 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3471/7386] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:47 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:49.116569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:49.117250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:49.125258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:49.125756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:49.126205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:49.126917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:49.127384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:49.127823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:49.262351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:49.270252 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fad3750-f7ed-4f7f-b1f5-dc99cec6c87b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1684 microversion: 2.1 time: 0.157637 Oct 17 14:27:49.270829 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3916/7387] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:49 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:27:50.231090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "name": "network-vif-unplugged", "status": "completed", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:50.241709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:50.242237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:50.242689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:50.256288 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] Creating event network-vif-unplugged:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h1-854121-14 Oct 17 14:27:50.263106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] Instance 5443adb9-98e6-4016-a89f-c6c42645a886 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:27:50.274331 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-06368bfb-e0ba-43fe-81db-9e77fd703c5b req-dd067235-0ff3-41ad-9332-cff44c14db3f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047254 Oct 17 14:27:50.275155 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3472/7388] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:50.294232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:50.294973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:50.302682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:50.303272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:50.303824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:50.304607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:50.305193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:50.305879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:50.546778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:50.554897 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-43fd7a49-5ed0-40ff-9033-c5ce0530cbd5 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1683 microversion: 2.1 time: 0.265309 Oct 17 14:27:50.555484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3917/7389] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:50 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1683 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:51.581448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:51.582070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:51.588319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:51.588806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:51.589279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:51.589973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:51.590452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:51.590863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:51.724402 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:51.732848 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c015002-ea69-4a2c-b65f-8d6e17e20a57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1681 microversion: 2.1 time: 0.156765 Oct 17 14:27:51.733474 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3473/7390] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:51 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:52.309967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:52.320293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:52.320780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:52.321252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:52.336371 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] Creating event network-changed:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h1-854121-14 Oct 17 14:27:52.342462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] Instance 5443adb9-98e6-4016-a89f-c6c42645a886 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:27:52.353175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e041af87-4365-46b5-85c1-9fed4bf83a56 req-b13e2e2e-397b-4b87-81c0-270108e9c4bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047012 Oct 17 14:27:52.353926 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3918/7391] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:52.756885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:52.757605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:52.765766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:52.766256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:52.766898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:52.767606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:52.768058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:52.768475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:53.136872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:53.144878 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd00ae43-c6ac-4fea-8dbe-39589cf8962e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1681 microversion: 2.1 time: 0.392298 Oct 17 14:27:53.145430 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3474/7392] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:52 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1681 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:54.172749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:54.173511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:54.181097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.181706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.182161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.182892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.183365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.183807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.333472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:54.342243 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ef8dbff-5d87-403a-9b2f-2c86a8af139c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1678 microversion: 2.1 time: 0.176926 Oct 17 14:27:54.342829 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3919/7393] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:54 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:54.365476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:54.366075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:54.372911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.373451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.373966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.374670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.375124 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.375549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.415084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.415563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.416125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.416860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.417340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.417769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.441436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:27:54.446750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:27:54.552852 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-149076eb-3fc4-42bf-b5ab-f9714b1e7e08 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886/action" status: 202 len: 0 microversion: 2.1 time: 0.191042 Oct 17 14:27:54.553803 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3475/7394] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:27:54 2022] POST /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:27:54.562042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:54.562755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:54.569702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.570285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.570739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.571463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:54.571954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:54.572868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:54.782186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:54.790283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b0a54dd-8dfc-41a9-b6cb-87f49f1c22bd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.232174 Oct 17 14:27:54.791309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3920/7395] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:54 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:55.861114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:55.861849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:55.868181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:55.868671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:55.869144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:55.869845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:55.870302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:55.870735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:56.058219 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:56.066183 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7da61d73-ed06-4481-b45b-82f4b7493c43 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.256261 Oct 17 14:27:56.066764 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3476/7396] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:55 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:56.127986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "name": "network-vif-plugged", "status": "completed", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:56.139866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:56.140364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:56.140809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:56.154678 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] Creating event network-vif-plugged:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h1-854121-14 Oct 17 14:27:56.160571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] Instance 5443adb9-98e6-4016-a89f-c6c42645a886 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:27:56.172281 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5f118a10-1f86-429b-b18e-dec330643a89 req-4199abf9-20ba-496f-9dc9-b6f80c66af63 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048128 Oct 17 14:27:56.172922 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3921/7397] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:57.090898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:57.091548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:57.098464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:57.098948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:57.099395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:57.100099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:57.100559 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:57.100988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:57.241324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:57.252750 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05190167-abcf-4dca-9a1b-a7f2eb3bc638 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.166280 Oct 17 14:27:57.253384 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3477/7398] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:57 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:57.985286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "name": "network-vif-unplugged", "status": "completed", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:27:57.995410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:57.996009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:57.996370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:58.008995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] Creating event network-vif-unplugged:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h2-854121-14 Oct 17 14:27:58.015147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] Instance 5443adb9-98e6-4016-a89f-c6c42645a886 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:27:58.026489 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-64a7568a-c8ea-4018-818c-d0d73389cf20 req-b5c2123f-d077-4a43-b1bf-678c1b23edcb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046610 Oct 17 14:27:58.027110 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3922/7399] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:27:58.277879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:58.278509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:58.285594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:58.286096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:58.286541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:58.287251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:58.287903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:58.288340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:58.475550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:58.487282 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e270ce54-ad2b-4847-86f7-f583e046f5d0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.213709 Oct 17 14:27:58.487987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3478/7400] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:58 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:27:59.513964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:27:59.514687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:27:59.520957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:59.521492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:59.521969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:59.522934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:27:59.523411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:27:59.523851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:27:59.667618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:27:59.675767 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-25eee7f6-51b6-442a-a325-cb718c2b8fed tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.167175 Oct 17 14:27:59.676349 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3923/7401] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:27:59 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:00.065123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:00.076347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:00.076835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:00.077307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:00.089649 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] Creating event network-changed:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h2-854121-14 Oct 17 14:28:00.094933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] Instance 5443adb9-98e6-4016-a89f-c6c42645a886 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:28:00.105838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5db31dc7-564f-4d24-b12a-0e8a10350b07 req-bd8f1a29-35b1-4c46-a0e5-4e6fc59841ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044739 Oct 17 14:28:00.106442 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3479/7402] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:00.698456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:00.699082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:00.706085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:00.706580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:00.707031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:00.707738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:00.708201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:00.708641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:00.839656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:00.848378 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ddc323cf-8bc4-4d7e-a391-6f42bbde7db9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.154035 Oct 17 14:28:00.849214 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3924/7403] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:00 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:01.874141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:01.874872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:01.881185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:01.881916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:01.882345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:01.883038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:01.883488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:01.883913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:01.888446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:02.110492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:02.118773 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-96fe06fb-b9df-4008-a1a0-e2184311218b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1677 microversion: 2.1 time: 0.250404 Oct 17 14:28:02.120208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3480/7404] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:01 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1677 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:03.144695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:03.145367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:03.152814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.153356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.153855 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.154580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.155053 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.155499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.287734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:03.295721 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a99e43e-d96f-46f7-b592-e9114307a96c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1670 microversion: 2.1 time: 0.155058 Oct 17 14:28:03.296308 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3925/7405] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:03 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:03.320226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:03.320919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:03.328328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.328811 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.329280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.329966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.330417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.330839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.461621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:03.469990 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4375b09c-e177-4794-ad5c-912c4a2210dc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1670 microversion: 2.1 time: 0.153608 Oct 17 14:28:03.470568 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3481/7406] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:03 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:03.492990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:03.493682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:03.500458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.500964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.501451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.502167 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.502643 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.503088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.507770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:03.638944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:03.646800 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c91ee91-e73f-4887-8f2f-3c8a4867313c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1670 microversion: 2.1 time: 0.158024 Oct 17 14:28:03.647363 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3926/7407] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:03 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:03.670728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:03.671152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:03.677729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.678209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.678644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.679336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.679783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.680205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.706611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:28:03.782619 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9341ca01-d198-4c34-b098-401634573ac6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 204 len: 0 microversion: 2.1 time: 0.115884 Oct 17 14:28:03.783458 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3482/7408] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:28:03 2022] DELETE /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:28:03.793115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:03.793784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:03.799918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.800446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.801062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.801812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:03.802287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:03.802734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:03.934947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:03.943121 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-243c0b17-8ac3-4ee0-a05e-97a1daf2e999 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1676 microversion: 2.1 time: 0.154691 Oct 17 14:28:03.943706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3927/7409] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:03 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:04.968835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:04.969591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:04.972389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:04.978434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:04.979132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:04.979673 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:04.980389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:04.980844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:04.981302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:05.117581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:05.125579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f93faf4-14c9-4cb1-8f20-c916cb9d550d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1676 microversion: 2.1 time: 0.161103 Oct 17 14:28:05.126154 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3483/7410] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:04 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:06.151710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:06.152530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:06.155449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=41 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:06.160835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:06.161372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:06.161834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:06.162567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:06.163042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:06.163491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:06.391654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:06.399837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9f191d9-80e0-4c38-a841-3e96d252a9bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 200 len: 1676 microversion: 2.1 time: 0.253680 Oct 17 14:28:06.413196 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3928/7411] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:06 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 1676 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:06.618978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0392af91-4319-420f-bfc0-2e0d4d2d4cac req-e4f4986d-2dc7-410d-8c05-4de32f337b36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5443adb9-98e6-4016-a89f-c6c42645a886", "name": "network-vif-deleted", "tag": "596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:06.626541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:06.634305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0392af91-4319-420f-bfc0-2e0d4d2d4cac req-e4f4986d-2dc7-410d-8c05-4de32f337b36 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:06.634995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0392af91-4319-420f-bfc0-2e0d4d2d4cac req-e4f4986d-2dc7-410d-8c05-4de32f337b36 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:06.635530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0392af91-4319-420f-bfc0-2e0d4d2d4cac req-e4f4986d-2dc7-410d-8c05-4de32f337b36 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:06.650968 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0392af91-4319-420f-bfc0-2e0d4d2d4cac req-e4f4986d-2dc7-410d-8c05-4de32f337b36 service nova] Creating event network-vif-deleted:596f6d6a-f5fd-4b75-a9a6-0de7c11c5e8f for instance 5443adb9-98e6-4016-a89f-c6c42645a886 on n-h2-854121-14 Oct 17 14:28:06.657297 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0392af91-4319-420f-bfc0-2e0d4d2d4cac req-e4f4986d-2dc7-410d-8c05-4de32f337b36 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042104 Oct 17 14:28:06.657911 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3484/7412] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:07.425385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:07.426029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:07.433025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:07.433569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:07.434032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:07.434767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:07.435249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:07.435699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:07.450483 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 HTTP/1.1 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5443adb9-98e6-4016-a89f-c6c42645a886'} Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:07.452517 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:07.457667 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7bda693-61d2-4726-adbe-3005dc53bfd3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 404 len: 111 microversion: 2.1 time: 0.032836 Oct 17 14:28:07.458480 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3929/7413] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:07 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:07.474230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:07.474945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:07.483258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:07.483976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:07.484366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:07.485063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:07.485546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:07.485968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:07.500621 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 HTTP/1.1 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5443adb9-98e6-4016-a89f-c6c42645a886'} Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:28:07.502604 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b9f8fab-0bef-4274-9c3c-0b28449b6d1d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 404 len: 111 microversion: 2.1 time: 0.034821 Oct 17 14:28:07.507590 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3485/7414] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:07 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:28:07.556970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-904081174", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "79d664e0-fda8-420d-91cd-80d4d061a144"}], "security_groups": [{"name": "tempest-securitygroup--363458275"}], "key_name": "tempest-keypair-2042768162", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:07.671892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] validate_networks() for [('79d664e0-fda8-420d-91cd-80d4d061a144', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:28:08.347491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:28:08.347944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:28:08.348472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:28:08.348904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:28:08.349427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:28:08.359064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.359598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.360052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.360803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:08.361306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:08.361757 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:08.379348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:28:08.385631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:28:08.398196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:28:08.400661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:28:08.449978 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7107b41-087c-4b2a-96ba-6bae51d136f3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.897097 Oct 17 14:28:08.450803 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3930/7415] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:28:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:28:08.462347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c1edd21-ed32-4843-939f-1a4e6cea5cdf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:08.462888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5c1edd21-ed32-4843-939f-1a4e6cea5cdf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:08.519426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5c1edd21-ed32-4843-939f-1a4e6cea5cdf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:08.527546 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c1edd21-ed32-4843-939f-1a4e6cea5cdf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1238 microversion: 2.1 time: 0.069276 Oct 17 14:28:08.528181 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3486/7416] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:08 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:09.550393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:09.551360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:09.559809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:09.560485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:09.561265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:09.562249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:09.562760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:09.563263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:09.635793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:09.644869 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-882ac49e-33c1-4a31-ac9d-a3c364377470 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1308 microversion: 2.1 time: 0.098389 Oct 17 14:28:09.645583 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3931/7417] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:09 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:10.670751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:10.671547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:10.678564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:10.679077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:10.679528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:10.680248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:10.680707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:10.681309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:10.893572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:10.901939 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be2f3d5d-5fb1-48c7-9122-46a60b8936cd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1363 microversion: 2.1 time: 0.235776 Oct 17 14:28:10.902545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3487/7418] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:10 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:11.025911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-955e21f2-d421-49de-972f-8f454086ad84 req-517746bf-ec63-4f1d-ae0a-5a8172cc7327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:11.042376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-955e21f2-d421-49de-972f-8f454086ad84 req-517746bf-ec63-4f1d-ae0a-5a8172cc7327 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:11.042849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-955e21f2-d421-49de-972f-8f454086ad84 req-517746bf-ec63-4f1d-ae0a-5a8172cc7327 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:11.043312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-955e21f2-d421-49de-972f-8f454086ad84 req-517746bf-ec63-4f1d-ae0a-5a8172cc7327 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:11.055555 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-955e21f2-d421-49de-972f-8f454086ad84 req-517746bf-ec63-4f1d-ae0a-5a8172cc7327 service nova] Creating event network-changed:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h1-854121-14 Oct 17 14:28:11.061110 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-955e21f2-d421-49de-972f-8f454086ad84 req-517746bf-ec63-4f1d-ae0a-5a8172cc7327 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039687 Oct 17 14:28:11.061777 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3932/7419] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:11.925494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:11.926082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:11.933882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:11.934380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:11.934793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:11.935479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:11.935929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:11.936355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:12.072120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:12.080062 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c4030de-16ef-4177-b2a2-4f2fb8eaf023 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1363 microversion: 2.1 time: 0.158492 Oct 17 14:28:12.080683 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3488/7420] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:11 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:13.106019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:13.106735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:13.113081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:13.113615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:13.114069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:13.114800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:13.115256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:13.115700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:13.254957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:13.263418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fda4e1bd-76d3-4bf9-98c7-658cfedd13bf tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1363 microversion: 2.1 time: 0.163375 Oct 17 14:28:13.264001 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3933/7421] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:13 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:14.287517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:14.288156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:14.295096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:14.295578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:14.295999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:14.296686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:14.297134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:14.297576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:14.428531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:14.437367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-040017ce-3503-48a1-8c8f-58d037f82cc0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1363 microversion: 2.1 time: 0.153984 Oct 17 14:28:14.437972 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3489/7422] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:14 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:15.461826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:15.462468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:15.474666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.475181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.475637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.476360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:15.476833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:15.477312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:15.616470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:15.625182 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-18cb8a17-1bb7-4950-8b3d-e1403a00efc1 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1363 microversion: 2.1 time: 0.167345 Oct 17 14:28:15.625775 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3934/7423] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:15 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:16.180583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-7ae66e45-b18a-4c80-822d-c0e767118594 req-01a76bdc-ccd1-473c-b331-e817ba9b2395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "name": "network-vif-plugged", "status": "completed", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:16.191731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7ae66e45-b18a-4c80-822d-c0e767118594 req-01a76bdc-ccd1-473c-b331-e817ba9b2395 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:16.192225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7ae66e45-b18a-4c80-822d-c0e767118594 req-01a76bdc-ccd1-473c-b331-e817ba9b2395 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:16.192666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-7ae66e45-b18a-4c80-822d-c0e767118594 req-01a76bdc-ccd1-473c-b331-e817ba9b2395 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:16.204821 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-7ae66e45-b18a-4c80-822d-c0e767118594 req-01a76bdc-ccd1-473c-b331-e817ba9b2395 service nova] Creating event network-vif-plugged:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h1-854121-14 Oct 17 14:28:16.210155 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-7ae66e45-b18a-4c80-822d-c0e767118594 req-01a76bdc-ccd1-473c-b331-e817ba9b2395 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033256 Oct 17 14:28:16.210894 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3490/7424] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:16.649447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:16.650133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:16.657301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:16.657800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:16.658252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:16.658953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:16.659419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:16.659853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:16.796567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:16.804464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59778a81-dd9d-4f79-9209-0e1ac76d126d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1363 microversion: 2.1 time: 0.159678 Oct 17 14:28:16.805037 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3935/7425] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:16 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:17.831076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:17.831780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:17.838251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:17.838752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:17.839195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:17.839890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:17.840351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:17.840782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:17.972798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:17.981573 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da8e5485-4e01-4baf-9883-4d2d83762989 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1550 microversion: 2.1 time: 0.155685 Oct 17 14:28:17.982151 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3491/7426] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:17 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:18.004684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:18.005332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:18.012638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:18.013139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:18.013639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:18.014371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:18.014847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:18.015296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:18.094322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-610e6fca-8026-4b34-8a1a-a3700429f199 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093644 Oct 17 14:28:18.094961 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3936/7427] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 14:28:17 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:19.055360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-d5d25281-96ef-4802-a453-a112f984e1fb req-df9e9298-539e-4d1e-9db4-0439202492cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:19.060835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:19.068453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5d25281-96ef-4802-a453-a112f984e1fb req-df9e9298-539e-4d1e-9db4-0439202492cb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:19.068651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5d25281-96ef-4802-a453-a112f984e1fb req-df9e9298-539e-4d1e-9db4-0439202492cb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:19.069012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-d5d25281-96ef-4802-a453-a112f984e1fb req-df9e9298-539e-4d1e-9db4-0439202492cb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:19.082074 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-d5d25281-96ef-4802-a453-a112f984e1fb req-df9e9298-539e-4d1e-9db4-0439202492cb service nova] Creating event network-changed:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h1-854121-14 Oct 17 14:28:19.087104 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-d5d25281-96ef-4802-a453-a112f984e1fb req-df9e9298-539e-4d1e-9db4-0439202492cb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035353 Oct 17 14:28:19.088926 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3492/7428] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:28:53.331343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:53.332152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:53.335162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:53.335844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=50 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:53.340554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:28:53.341741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:53.350669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:53.351185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:53.351650 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:53.352385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:53.352860 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:53.353349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:53.858613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:28:53.866567 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7a2c835-c249-4b76-a1a9-3ce32a6e4819 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1669 microversion: 2.1 time: 0.536088 Oct 17 14:28:53.867149 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3937/7429] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:28:53 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1669 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:28:53.890503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=19 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:53.891253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:28:53.896110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a094286e-57cf-429f-82fa-596a94777aa3"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:28:53.898669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:28:53.906972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:53.907464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:53.907907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:53.908616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:28:53.909075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:28:53.909531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:28:54.268941 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7f30ab6-2072-4121-953a-9a95f14a0306 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380842 Oct 17 14:28:54.269808 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3493/7430] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 14:28:53 2022] POST /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:05.003898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:05.006360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:05.009500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:05.010174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:05.016381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.016881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.017377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.018095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.018581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.019031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.048815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:05.054364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:29:05.061435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:29:05.061882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:29:05.062900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:29:05.063334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:29:05.063786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:29:05.130431 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d22908c1-957c-480a-ad3d-4cc9af0fb1a6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/action" status: 202 len: 0 microversion: 2.1 time: 0.130602 Oct 17 14:29:05.131404 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3938/7431] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:29:04 2022] POST /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:29:05.141268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:05.142046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:05.145418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:05.145717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:05.152030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.152516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.152949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.153681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:05.154127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:05.154556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:05.297909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:05.306804 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9aad70d9-8708-4269-85e7-35e8d8dc52e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1724 microversion: 2.1 time: 0.170613 Oct 17 14:29:05.307389 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3494/7432] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:05 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:29:06.331347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:06.331978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:06.339875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:06.340374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:06.340889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:06.341565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:06.342029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:06.342467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:06.482920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:06.491509 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b902857-c2d8-4bf2-8df4-89688a261482 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1724 microversion: 2.1 time: 0.164929 Oct 17 14:29:06.492088 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3939/7433] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:06 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:07.519995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:07.520610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:07.527488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:07.527970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:07.528400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:07.529089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:07.529571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:07.529993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:07.665928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:07.675718 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52b0d6eb-79c1-48f1-a8b3-e66bcf5f1453 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.159580 Oct 17 14:29:07.676305 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3495/7434] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:07 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:08.699607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:08.700292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:08.707170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:08.707736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:08.708200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:08.708939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:08.709479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:08.709986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:08.839853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:08.849186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e34df4f1-6e64-4023-a9f4-05a2175620b8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.154170 Oct 17 14:29:08.849780 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3940/7435] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:08 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:09.873470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:09.873991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:09.880817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:09.881343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:09.881783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:09.885341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:09.885341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:09.885341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:10.019397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:10.028008 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54af085f-6864-4249-96b2-5937a3697d75 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.158586 Oct 17 14:29:10.028596 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3496/7436] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:09 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:11.052754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:11.053418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:11.060388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:11.060889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:11.061376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:11.062096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:11.062575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:11.063024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:11.201616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:11.210382 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f723844-af4e-4486-ad0a-1cf711601b39 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.161591 Oct 17 14:29:11.210992 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3941/7437] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:11 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:12.235804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:12.236544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:12.244005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:12.244529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:12.245002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:12.245827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:12.246354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:12.246843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:12.383229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:12.391541 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d747ce5-4ae7-4be3-bc10-6c709d5dae55 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.160845 Oct 17 14:29:12.392113 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3497/7438] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:12 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:13.414861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:13.415548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:13.422410 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:13.422906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:13.423351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.424051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:13.424519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:13.424958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:13.559845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:13.569092 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16ffd172-23f8-4fae-a00a-1f8851d7d420 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.158193 Oct 17 14:29:13.569830 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3942/7439] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:13 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:14.593172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:14.593866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:14.600905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:14.601705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:14.601943 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:14.602711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:14.603178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:14.603710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:14.749645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:14.759069 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4d79c50-6850-41a7-9e34-4621d62c5497 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.170090 Oct 17 14:29:14.759682 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3498/7440] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:14 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:15.781974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:15.782606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:15.786001 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:29:15.786143 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:29:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 (ip 10.222.0.65) !!! Oct 17 14:29:15.792531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:15.793099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:15.793593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:15.794310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:15.794778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:15.795219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:15.930188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:15.939681 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-41072686-00df-40b2-a1e6-42f685eecb71 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.161632 Oct 17 14:29:15.940275 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3943/7441] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:15 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:16.963949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:16.964561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:16.972447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:16.972931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:16.973470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:16.974168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:16.974622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:16.975049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:17.106051 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:17.115442 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d27555d6-ce23-44a3-b58d-0e944b8ecf0c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.155477 Oct 17 14:29:17.116021 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3499/7442] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:16 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:18.139620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:18.140245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:18.149881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:18.150384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:18.150839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:18.151550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:18.152016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:18.152453 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:18.290275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:18.299033 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3f73972-2da4-4c6f-9b82-d67a2188520f tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.163449 Oct 17 14:29:18.299635 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3944/7443] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:18 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:19.322596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:19.323209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:19.330831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:19.331310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:19.331747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:19.332438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:19.332891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:19.333353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:19.469197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:19.478334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dcb758eb-2210-4915-b03c-f15648101af9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.159642 Oct 17 14:29:19.478914 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3500/7444] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:19 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:20.502779 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:20.503555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:20.511171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:20.511767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:20.512234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:20.512959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:20.513462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:20.513912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:20.656330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:20.665987 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a3ab720-13e1-4966-a193-a38533085dc7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.167200 Oct 17 14:29:20.666586 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3945/7445] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:20 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:21.690119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:21.690740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:21.698056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:21.698554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:21.699044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:21.699754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:21.700240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:21.700700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:21.831332 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:21.839671 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a4ff068-0f8b-4d53-b8cd-39259879d99a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.153665 Oct 17 14:29:21.840257 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3501/7446] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:21 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:22.864621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:22.865333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:22.873072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:22.873724 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:22.874357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:22.875211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:22.875795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:22.876382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:23.012525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:23.021792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-231eceea-356f-4496-a82a-fe406d80f287 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.161556 Oct 17 14:29:23.022389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3946/7447] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:22 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:24.045558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:24.046664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:24.055436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:24.056155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:24.056789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:24.057793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:24.058379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:24.058956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:24.209421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:24.217767 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0533d314-2534-4cd1-986e-29782872ef27 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.176200 Oct 17 14:29:24.218360 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3502/7448] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:24 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:25.243454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:25.244078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:25.252237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:25.252753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:25.253351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:25.254091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:25.254567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:25.255017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:25.426696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:25.435700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-761ab1d7-451d-459f-a427-286879cfcd78 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1729 microversion: 2.1 time: 0.196824 Oct 17 14:29:25.436297 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3947/7449] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:25 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:26.465631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:26.466233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:26.473408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:26.473890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:26.474327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:26.475014 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:26.475478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:26.475888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:26.694022 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:26.702601 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-201a61b1-413f-465e-a50c-b0aa2445de81 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1728 microversion: 2.1 time: 0.241104 Oct 17 14:29:26.703408 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3503/7450] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:26 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:26.761485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "name": "network-vif-unplugged", "status": "completed", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:26.773677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:26.774186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:26.774636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:26.787175 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] Creating event network-vif-unplugged:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h2-854121-14 Oct 17 14:29:26.793586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:26.805812 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bab4e7b9-9009-4a8b-8da7-9231d6fb1825 req-4c6ae62a-d575-4e3e-8b4c-2a5818d4bb43 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048322 Oct 17 14:29:26.806442 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3948/7451] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:27.728743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:27.729438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:27.737309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:27.737807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:27.738246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:27.738978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:27.739436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:27.739866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:27.879291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:27.888181 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be982a39-7524-4ef6-9a5d-c694bd0c6aca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1728 microversion: 2.1 time: 0.163743 Oct 17 14:29:27.888775 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3504/7452] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:27 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:28.849374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:28.860467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:28.861520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:28.862044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:28.874993 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] Creating event network-changed:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h2-854121-14 Oct 17 14:29:28.881693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:28.893809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7581c9e6-abd9-4a17-86d4-bb69e7a464ca req-3460818a-520c-4c94-bc2e-e768c5764be1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049003 Oct 17 14:29:28.894388 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3949/7453] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:28.913469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:28.914214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:28.922269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:28.923115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:28.924269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:28.925472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:28.926106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:28.926854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:29.300616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:29.310656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79ee08b6-2c16-40ef-838b-5b6164869bdd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.402205 Oct 17 14:29:29.312313 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3505/7454] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:28 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:30.340680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:30.341437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:30.349943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:30.350458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:30.350915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:30.351654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:30.352127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:30.352606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:30.507017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:30.515868 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6bf07c3-bba8-4615-877c-788fcd132091 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.180657 Oct 17 14:29:30.516452 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3950/7455] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:30 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:31.539962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:31.540581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:31.547819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:31.548305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:31.550000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:31.550707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:31.551164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:31.551586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:31.690407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:31.700970 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b60def07-8c63-471c-af95-a4bf37cdd33b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.164655 Oct 17 14:29:31.701656 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3506/7456] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:31 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:32.725383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:32.726066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:32.734479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:32.734980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:32.735434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:32.736202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:32.736664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:32.737106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:32.872817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:32.881975 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d786d1d0-7712-4397-86f8-f4f88bb88449 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.160653 Oct 17 14:29:32.882822 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3951/7457] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:32 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:33.906090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:33.906741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:33.913898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:33.914376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:33.914813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:33.915502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:33.915949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:33.916369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:34.048411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:34.056963 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d928f2c5-9089-4235-99d0-07335319cf47 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.154822 Oct 17 14:29:34.057561 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3507/7458] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:33 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:35.081549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:35.082213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:35.085013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=33 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:35.091257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:35.091817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:35.092274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:35.093000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:35.093495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:35.093951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:35.096891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:35.229093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:35.238078 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f20570e-41f1-47e3-b85c-1ffd422ed8fc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.161415 Oct 17 14:29:35.238667 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3952/7459] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:35 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:36.262121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:36.262739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:36.265453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=29 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:36.271689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:36.272174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:36.272608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:36.273322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:36.273776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:36.274199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:36.276964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=85 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:36.711768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:36.720735 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-816cd9b7-74db-4df6-9b6c-cfb8e22af9e4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.462524 Oct 17 14:29:36.721479 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3508/7460] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:36 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:37.744193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:37.744848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:37.751434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:37.751866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:37.752315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:37.753017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:37.753506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:37.753945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:37.881846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:37.890898 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af697c5b-1fe0-488d-bf77-3b698dd6b3e6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.150565 Oct 17 14:29:37.891492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3953/7461] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:37 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:38.915223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:38.915995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:38.924178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:38.925695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:38.926148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:38.926858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:38.927316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:38.927750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:39.063987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:39.072727 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c37bb5e6-280d-47d7-89ad-548cc6df6bb3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.161612 Oct 17 14:29:39.073329 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3509/7462] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:38 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:40.096387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:40.097023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:40.104212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:40.104725 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:40.105208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:40.105944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:40.106420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:40.106870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:40.244141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:40.252615 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9616d8c5-6a4a-47fe-afef-e57e471d65e7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.160183 Oct 17 14:29:40.253491 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3954/7463] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:40 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:41.276243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:41.276864 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:41.284043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:41.284539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:41.284980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:41.285712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:41.286176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:41.286608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:41.431878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:41.440465 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-693cac9e-780d-4d5e-9071-be08ae06f7a4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1726 microversion: 2.1 time: 0.168175 Oct 17 14:29:41.441045 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3510/7464] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:41 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:42.464866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:42.465534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:42.473265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.473777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.474234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.474957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.475430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.475920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.609971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:42.619508 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c055c8f5-7055-47ad-b91f-9996ee29d803 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1723 microversion: 2.1 time: 0.158615 Oct 17 14:29:42.620100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3955/7465] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:42 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:42.643433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:42.644119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:42.651068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.651550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.652023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.652754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.653271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.653692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.696984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.697492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.697924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.698642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.699088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.699513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.724829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:29:42.730476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Getting quotas for user 87deedfe0e814a18b118ede09028de89 and project 0c7690ff0f4542c5b02b6b432d813d17. Resources: {'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:29:42.842823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a4ddfb1-1df6-4f4d-849f-e62ad3291315 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "POST /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/action" status: 202 len: 0 microversion: 2.1 time: 0.203475 Oct 17 14:29:42.843450 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3511/7466] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:29:42 2022] POST /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:29:42.852630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:42.853299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:42.859534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.860163 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.860593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:42.861428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:42.862011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:42.862609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:43.073320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:43.082709 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-60a8492e-d2bc-42eb-836c-0c8f29a80412 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.233985 Oct 17 14:29:43.083295 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3956/7467] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:42 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:44.108293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:44.109001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:44.116009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:44.116506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:44.116949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:44.117686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:44.118149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:44.118580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:44.252265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:44.260966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a0b0adf-e01e-48b2-88be-1e42ee8199fd tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.158022 Oct 17 14:29:44.261580 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3512/7468] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:44 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:44.879853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "name": "network-vif-plugged", "status": "completed", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:44.891088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:44.891499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:44.892003 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:44.905758 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] Creating event network-vif-plugged:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h2-854121-14 Oct 17 14:29:44.911866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:44.923467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e95eaea2-594b-449b-bcbf-5584f0d2eb3f req-40517802-61c2-4b9a-9789-a28f03c653e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047880 Oct 17 14:29:44.924872 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3957/7469] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:29:45.284545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:45.285217 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:45.292172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:45.292656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:45.293097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:45.293817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:45.294277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:45.294705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:45.429507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:45.437863 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6440193-c8ed-4b5d-9e28-b34c016b444b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.157309 Oct 17 14:29:45.438429 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3513/7470] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:45 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:46.466960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:46.467681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:46.474684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:46.475184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:46.475637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:46.476378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:46.476850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:46.477320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:46.613701 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:46.622466 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f2936a6a-6732-4617-8880-ce461e9a8d66 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.160622 Oct 17 14:29:46.623138 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3958/7471] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:46 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:47.646421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:47.647317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:47.656935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:47.658038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:47.658731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:47.659828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:47.660937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:47.661419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:47.804234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:47.813292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ceb94f6-36be-4956-afd1-36decda297de tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.170967 Oct 17 14:29:47.813911 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3514/7472] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:47 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:48.336777 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "name": "network-vif-unplugged", "status": "completed", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:48.349491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:48.350065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:48.350580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:48.363784 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] Creating event network-vif-unplugged:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h1-854121-14 Oct 17 14:29:48.369405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:48.381074 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ab8068af-3c2a-4d6f-bdf3-663ada74f998 req-4d300e41-f634-41ac-9481-153e937a63aa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048704 Oct 17 14:29:48.382390 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3959/7473] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:48.837917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:48.838623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:48.846417 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:48.847038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:48.847554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:48.848339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:48.849649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:48.850500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:49.080949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:49.089404 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-363b21fe-9b3d-4f4b-a244-5101dd95bb67 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.255495 Oct 17 14:29:49.089993 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3515/7474] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:48 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:50.117550 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:50.118448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:50.125844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.126346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.126808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.128268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.128741 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.129209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.267618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:50.277051 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6096e8ac-6db1-4d34-a5c7-61ed5c5fa72a tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.166815 Oct 17 14:29:50.277659 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3960/7475] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:50 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:50.426307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:29:50.437065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:50.437585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:50.438017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:50.450832 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] Creating event network-changed:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h1-854121-14 Oct 17 14:29:50.458038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:29:50.469196 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9fcf56e5-43ce-4ba5-8882-607c884954df req-b8c911af-0d00-45ae-a442-377dd765d070 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047355 Oct 17 14:29:50.470022 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3516/7476] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:29:51.302185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:51.302728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:51.309953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:51.310537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:51.311238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:51.311976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:51.312645 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:51.313101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:51.453955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:51.462743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-215a9b9d-2d45-4e0b-8cb3-899ae16cb8b3 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.165503 Oct 17 14:29:51.463325 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3961/7477] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:51 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:52.490198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:52.491209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:52.498600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:52.499093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:52.499535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:52.500242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:52.500698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:52.501128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:52.646677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:52.659166 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6381ac9c-4889-4c1c-b56e-55cf40fef7c0 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.175510 Oct 17 14:29:52.659926 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3517/7478] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:52 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:53.684076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:53.684711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:53.692201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:53.692723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:53.693195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:53.693937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:53.694549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:53.695006 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:53.845340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:53.856053 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c5684f4-0bee-4879-a07e-2c88c14b84b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.176845 Oct 17 14:29:53.856948 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3962/7479] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:53 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:54.883361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:54.883986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:54.886213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:29:54.893072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:54.893072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:54.893662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:54.893927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:54.894387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:54.894816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:55.328260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:55.336757 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9654b913-7b0b-4d80-9740-89e176241594 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.457641 Oct 17 14:29:55.337385 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3518/7480] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:54 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:56.360042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:56.360680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:56.367754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:56.368254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:56.368712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:56.369482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:56.369958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:56.370405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:56.506166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:56.514876 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53c2b02a-e970-4d6b-a7d6-bc9220046c2d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.158818 Oct 17 14:29:56.515465 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3963/7481] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:56 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:57.539766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:57.540826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:57.548059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:57.548538 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:57.549656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:57.550489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:57.550945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:57.551376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:57.687745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:57.696735 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7571a1dc-7861-44a9-b4f1-a64dbdbf5e36 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.160920 Oct 17 14:29:57.697362 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3519/7482] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:57 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:58.720715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:58.721569 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:58.728694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:58.729222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:58.729683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:58.730393 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:58.730865 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:58.731308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:58.860984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:29:58.870569 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53a40ff9-a0a3-479e-9b5f-b7fa25be0804 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.153874 Oct 17 14:29:58.871354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3964/7483] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:58 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:29:59.896088 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:29:59.896651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:29:59.903694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:59.904212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:59.904656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:29:59.905387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:29:59.905847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:29:59.906277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:00.041128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:00.049506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-489c5bcd-806a-42a1-863d-f0816f08aa3b tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1722 microversion: 2.1 time: 0.158125 Oct 17 14:30:00.050083 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3520/7484] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:29:59 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:01.074310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:01.074922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:01.084148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.084652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.085107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.085852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.086324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.086767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.220700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:01.229620 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-220d2055-dd0c-4ee2-a1c7-b050530c2905 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1715 microversion: 2.1 time: 0.159289 Oct 17 14:30:01.230214 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3965/7485] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:01 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1715 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:01.253521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:01.254167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:01.261354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.261844 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.262289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.262985 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.263441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.263869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.393464 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:01.401851 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-198974f2-54c0-4d5a-bc45-c3a788f6a9a7 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1715 microversion: 2.1 time: 0.152953 Oct 17 14:30:01.402434 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3521/7486] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:01 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:01.424883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:01.425546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:01.431838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.432342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.432797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.433538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.434009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.434530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.569478 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:01.577896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e235fd0b-5624-4fe6-b803-62fd6ffa7b14 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1715 microversion: 2.1 time: 0.157361 Oct 17 14:30:01.578472 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3966/7487] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:01 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:01.658486 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:01.658914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:01.664971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.665494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.665934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.666629 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.667091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.667519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.670184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:01.697298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:30:01.777196 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eff94c1d-e6fd-4fb0-bf58-52b90fec0c57 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 204 len: 0 microversion: 2.1 time: 0.122258 Oct 17 14:30:01.777727 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3522/7488] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:01 2022] DELETE /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:30:01.786311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:01.786940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:01.792956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.793522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.793976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.794684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:01.795154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:01.795596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:01.927349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:01.935921 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8dc1064b-626f-4057-8291-4df47d0189ca tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1721 microversion: 2.1 time: 0.153589 Oct 17 14:30:01.936506 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3967/7489] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:01 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:02.960665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:02.961454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:02.968359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:02.968842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:02.969424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:02.970123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:02.971076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:02.971500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:03.113298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:03.122998 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e53027b7-1cfd-432b-849e-b4653740b918 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1721 microversion: 2.1 time: 0.166610 Oct 17 14:30:03.123582 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3523/7490] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:02 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:04.148072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:04.148617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:04.155383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:04.155893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:04.156343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:04.157055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:04.157554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:04.158825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:04.170296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4e7c23b7-85ad-43af-93de-fac539db0c4d req-aaf0081e-da5b-4ff3-b6bd-4c388e3ef4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "652a3c4a-4aa5-4484-b567-8b4d0beab535", "name": "network-vif-deleted", "tag": "7cfe1a71-8eab-4920-84d4-6671b2093e60"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:04.196541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4e7c23b7-85ad-43af-93de-fac539db0c4d req-aaf0081e-da5b-4ff3-b6bd-4c388e3ef4d1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:04.197378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4e7c23b7-85ad-43af-93de-fac539db0c4d req-aaf0081e-da5b-4ff3-b6bd-4c388e3ef4d1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:04.197966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4e7c23b7-85ad-43af-93de-fac539db0c4d req-aaf0081e-da5b-4ff3-b6bd-4c388e3ef4d1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:04.215497 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4e7c23b7-85ad-43af-93de-fac539db0c4d req-aaf0081e-da5b-4ff3-b6bd-4c388e3ef4d1 service nova] Creating event network-vif-deleted:7cfe1a71-8eab-4920-84d4-6671b2093e60 for instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 on n-h1-854121-14 Oct 17 14:30:04.220910 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4e7c23b7-85ad-43af-93de-fac539db0c4d req-aaf0081e-da5b-4ff3-b6bd-4c388e3ef4d1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054421 Oct 17 14:30:04.221908 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3524/7491] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:04.239889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:04.248808 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c8feec1-8778-43a6-b96c-8f9895533d49 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1654 microversion: 2.1 time: 0.104651 Oct 17 14:30:04.249652 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3968/7492] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:04 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1654 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:05.275093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:05.275800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:05.283604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:05.284146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:05.284594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:05.285335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:05.285798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:05.286228 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:05.354566 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:05.364268 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e56d14ea-86fd-4cda-b668-988bd5d5af6d tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1369 microversion: 2.1 time: 0.093490 Oct 17 14:30:05.364944 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3525/7493] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:05 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:06.388199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:06.388845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:06.391924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=34 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:06.397966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:06.398481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:06.398935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:06.399663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:06.400138 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:06.400582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:06.403600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:06.470985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:06.479792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6cff0175-2817-4d4a-aaff-2596cafabdc8 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1369 microversion: 2.1 time: 0.095516 Oct 17 14:30:06.480456 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3969/7494] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:06 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:07.502929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:07.503706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:07.506607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:07.512760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:07.513379 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:07.513886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:07.514664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:07.515193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:07.515628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:07.584134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:07.592843 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3c68d56-4727-4c75-b04a-d36598255cda tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1369 microversion: 2.1 time: 0.093842 Oct 17 14:30:07.593450 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3526/7495] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:07 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:08.617344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:08.617933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:08.624280 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:08.624785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:08.625277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:08.625997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:08.627156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:08.627611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:08.661114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:08.661658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:08.662120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:08.662595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lazy-loading 'fault' on Instance uuid 652a3c4a-4aa5-4484-b567-8b4d0beab535 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:30:08.715182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87deedfe0e814a18b118ede09028de89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c7690ff0f4542c5b02b6b432d813d17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:08.726570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6f8ba303-b2c9-4cec-a109-d01f00d773d4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 200 len: 1374 microversion: 2.1 time: 0.113470 Oct 17 14:30:08.727347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3970/7496] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:08 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 1374 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:09.750317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:09.750929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.758975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.759471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.759918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.760617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.761077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.761537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.776855 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 HTTP/1.1 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '652a3c4a-4aa5-4484-b567-8b4d0beab535'} Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:09.778531 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4916601-6d71-4c6e-bd25-2e9e81963ea6 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 404 len: 111 microversion: 2.1 time: 0.033948 Oct 17 14:30:09.783421 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3527/7497] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:09 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:09.843401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:09.846002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:09.852987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.853525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.853982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.854688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:09.855160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:09.855592 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:09.870219 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-volume_attachments HTTP/1.1 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': '652a3c4a-4aa5-4484-b567-8b4d0beab535'} Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:09.871927 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16b80dc1-6705-4427-9a27-fd19820195b4 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034111 Oct 17 14:30:09.876628 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3971/7498] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:30:09 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.211656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.212175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.219471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.219965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.220408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.221934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.222550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.222986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.237120 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 HTTP/1.1 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '652a3c4a-4aa5-4484-b567-8b4d0beab535'} Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.238710 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6967062-5428-4b3b-93f1-54443a89e95c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 404 len: 111 microversion: 2.1 time: 0.032743 Oct 17 14:30:13.243814 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3528/7499] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:13 2022] DELETE /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.248753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.249421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 652a3c4a-4aa5-4484-b567-8b4d0beab535] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.256887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.257688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.258146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.258896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.259379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.259821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.274471 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 HTTP/1.1 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '652a3c4a-4aa5-4484-b567-8b4d0beab535'} Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.276033 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 652a3c4a-4aa5-4484-b567-8b4d0beab535 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45e4ffbb-9806-4601-b2a8-908a66cfe039 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535" status: 404 len: 111 microversion: 2.1 time: 0.032636 Oct 17 14:30:13.280179 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3972/7500] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:13 2022] GET /compute/v2.1/servers/652a3c4a-4aa5-4484-b567-8b4d0beab535 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.286099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.286605 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.292645 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.293132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.293615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.294305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.294760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.295187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.308844 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 HTTP/1.1 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '5443adb9-98e6-4016-a89f-c6c42645a886'} Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.310424 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-358232a1-18bf-46eb-bfe3-c3a6900f340e tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 404 len: 111 microversion: 2.1 time: 0.029634 Oct 17 14:30:13.315684 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3529/7501] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:13 2022] DELETE /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.321717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.322381 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 5443adb9-98e6-4016-a89f-c6c42645a886] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.329355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.329945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.330503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.332444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.333034 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.333615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.352038 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 HTTP/1.1 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '5443adb9-98e6-4016-a89f-c6c42645a886'} Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.353778 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 5443adb9-98e6-4016-a89f-c6c42645a886 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49a8a958-f764-4974-9108-351bca6febe9 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886" status: 404 len: 111 microversion: 2.1 time: 0.037743 Oct 17 14:30:13.358375 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3973/7502] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:13 2022] GET /compute/v2.1/servers/5443adb9-98e6-4016-a89f-c6c42645a886 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.364827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.365368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.372021 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.372509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.372945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.373676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.374131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.374550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.390248 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f HTTP/1.1 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '8711bdef-b73d-4ca2-8e3f-c29503b5d27f'} Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.391826 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e94d9bb-b9e1-4a9c-b639-3c75078c37bb tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 404 len: 111 microversion: 2.1 time: 0.032656 Oct 17 14:30:13.397819 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3530/7503] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:13 2022] DELETE /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.404311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.404951 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 8711bdef-b73d-4ca2-8e3f-c29503b5d27f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.411439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.411949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.412414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.413145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.413661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.414114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.428702 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f HTTP/1.1 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '8711bdef-b73d-4ca2-8e3f-c29503b5d27f'} Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.430367 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 8711bdef-b73d-4ca2-8e3f-c29503b5d27f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1662e6c3-798c-41d8-87ae-e740878ca9ea tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f" status: 404 len: 111 microversion: 2.1 time: 0.031546 Oct 17 14:30:13.438122 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3974/7504] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:13 2022] GET /compute/v2.1/servers/8711bdef-b73d-4ca2-8e3f-c29503b5d27f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.440833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.441372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.447763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.448253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.448699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.449425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.449886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.450337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.465300 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 HTTP/1.1 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '87afbbc6-1106-4f44-8dad-668ea596a507'} Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.467631 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.473140 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1d106a3-3347-4275-bdf4-1add445b803c tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 404 len: 111 microversion: 2.1 time: 0.032680 Oct 17 14:30:13.475288 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3531/7505] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:13 2022] DELETE /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:30:13.479750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.480384 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] [instance: 87afbbc6-1106-4f44-8dad-668ea596a507] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:13.488268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.488903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.489553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.490389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:13.491245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:13.491897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:13.507743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] HTTP exception thrown: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Request method failure captured: Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 HTTP/1.1 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWU-PgvkKHEbK15leoPvhUxCO8WxD0w5vsXkFo-eLfzFg5s0jUgmN8QUDsrKF8CXsUI5VqaLcD_MnNfJjtAXAoORMlXdAnYtbo1ynBCubQaWK87ZXcrKw0nRhgGp8ParOIU-Z94cnf_vxdzPyyhaL9nj3mvtw3TO-07zXR13lBPB1eQ Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_0c7690ff0f4542c5b02b6b432d813d17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 0c7690ff0f4542c5b02b6b432d813d17 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerActionsTestJSON-1784725043 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 87deedfe0e814a18b118ede09028de89 Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServerActionsTestJSON-1784725043-project Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '87afbbc6-1106-4f44-8dad-668ea596a507'} Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:13.509390 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Returning 404 to user: Instance 87afbbc6-1106-4f44-8dad-668ea596a507 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e373d37e-c13a-49f7-b242-c97699791afc tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507" status: 404 len: 111 microversion: 2.1 time: 0.035861 Oct 17 14:30:13.513893 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3975/7506] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:13 2022] GET /compute/v2.1/servers/87afbbc6-1106-4f44-8dad-668ea596a507 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:13.520731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6ec09ca-120e-4722-906e-c640cd57c009 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] Calling method '.version_select at 0x7f41a20ac5e0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:13.546478 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6ec09ca-120e-4722-906e-c640cd57c009 tempest-ServerActionsTestJSON-1784725043 tempest-ServerActionsTestJSON-1784725043-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042768162" status: 202 len: 0 microversion: 2.1 time: 0.030034 Oct 17 14:30:13.547088 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3532/7507] 10.222.0.65 () {58 vars in 1221 bytes} [Mon Oct 17 14:30:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042768162 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:30:23.326411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1713457016", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "78288c5f-f3cb-4004-ab82-bafc4b0695d8"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:23.381811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] validate_networks() for [('78288c5f-f3cb-4004-ab82-bafc4b0695d8', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:30:23.501196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=23 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:23.775448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:30:23.775886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:30:23.776375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:30:23.776800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:30:23.777250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:30:23.787599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:23.788093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:23.788541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:23.789370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:23.789800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:23.790237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:23.808198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Getting quotas for project 3ae349073b4b4c5490de33ed7e269a1f. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:30:23.813903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Getting quotas for user f08fd896a1564bee8244195d3770130b and project 3ae349073b4b4c5490de33ed7e269a1f. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:30:23.830171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:30:23.833948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:30:23.882279 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-468dfe72-fe61-4361-bb94-c1d088e08b5a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686460 Oct 17 14:30:23.883381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3976/7508] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:30:23.898269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbeab53e-e5b2-4054-bc81-b4d464a80fc2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:23.899619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbeab53e-e5b2-4054-bc81-b4d464a80fc2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:23.903712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:23.905254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:23.968732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbeab53e-e5b2-4054-bc81-b4d464a80fc2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:23.976237 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbeab53e-e5b2-4054-bc81-b4d464a80fc2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1217 microversion: 2.1 time: 0.081927 Oct 17 14:30:23.977017 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3533/7509] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:23 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:25.001416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:25.003547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:25.011849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:25.012317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:25.014251 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:25.015171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:25.015810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:25.016414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:25.136246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:25.146585 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc325dd3-1f4c-4ee3-a585-f2012149a86d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1287 microversion: 2.1 time: 0.150665 Oct 17 14:30:25.147725 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3977/7510] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:24 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:26.174781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:26.176280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:26.183513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:26.184292 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:26.184887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:26.185853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:26.186549 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:26.187126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:26.448199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:26.457809 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc7e2282-ceaf-4bcf-aaa0-631720ecbe20 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1317 microversion: 2.1 time: 0.287660 Oct 17 14:30:26.458423 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3534/7511] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:26 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1317 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:26.691088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a71e418d-9d0b-4f1d-9483-f98aee1fe025 req-0a9b65d8-7c43-4368-a6ae-25455a72d9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016aacfa-8319-44a0-ae5d-aadbff940e73", "tag": "e210b1e6-6d44-46b4-b6cd-e541040dcc67"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:26.703447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a71e418d-9d0b-4f1d-9483-f98aee1fe025 req-0a9b65d8-7c43-4368-a6ae-25455a72d9ca service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:26.703826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a71e418d-9d0b-4f1d-9483-f98aee1fe025 req-0a9b65d8-7c43-4368-a6ae-25455a72d9ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:26.704285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a71e418d-9d0b-4f1d-9483-f98aee1fe025 req-0a9b65d8-7c43-4368-a6ae-25455a72d9ca service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:26.724820 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a71e418d-9d0b-4f1d-9483-f98aee1fe025 req-0a9b65d8-7c43-4368-a6ae-25455a72d9ca service nova] Creating event network-changed:e210b1e6-6d44-46b4-b6cd-e541040dcc67 for instance 016aacfa-8319-44a0-ae5d-aadbff940e73 on n-h1-854121-14 Oct 17 14:30:26.730498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a71e418d-9d0b-4f1d-9483-f98aee1fe025 req-0a9b65d8-7c43-4368-a6ae-25455a72d9ca service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043226 Oct 17 14:30:26.731121 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3978/7512] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:27.481808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:27.482424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:27.489380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:27.489861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:27.490297 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:27.490981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:27.491433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:27.491847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:27.635553 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:27.644538 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-203f94af-89e1-4c53-b9e3-120ea725c6a0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1317 microversion: 2.1 time: 0.166532 Oct 17 14:30:27.645111 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3535/7513] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:27 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:28.671197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:28.671935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:28.679339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:28.679871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:28.680325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:28.681042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:28.681545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:28.681984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:28.821229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:28.829484 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49806ce5-5e90-4fe5-8e89-4d4c368ff7fc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1317 microversion: 2.1 time: 0.164378 Oct 17 14:30:28.844625 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3979/7514] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:28 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:29.852303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:29.852927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:29.859954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:29.860754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:29.861226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:29.862795 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:29.863260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:29.863692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:29.999894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:30.008783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-026954d9-2095-4592-a0be-49bba25347ad tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1317 microversion: 2.1 time: 0.160472 Oct 17 14:30:30.009403 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3536/7515] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:29 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:30.843457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8f285dd8-cd5b-46e5-a533-27d7fa09cdce req-06d7da57-40ea-42ac-bf19-d7d0be16ad46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016aacfa-8319-44a0-ae5d-aadbff940e73", "name": "network-vif-plugged", "status": "completed", "tag": "e210b1e6-6d44-46b4-b6cd-e541040dcc67"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:30.855957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f285dd8-cd5b-46e5-a533-27d7fa09cdce req-06d7da57-40ea-42ac-bf19-d7d0be16ad46 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:30.856512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f285dd8-cd5b-46e5-a533-27d7fa09cdce req-06d7da57-40ea-42ac-bf19-d7d0be16ad46 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:30.857051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8f285dd8-cd5b-46e5-a533-27d7fa09cdce req-06d7da57-40ea-42ac-bf19-d7d0be16ad46 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:30.871468 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8f285dd8-cd5b-46e5-a533-27d7fa09cdce req-06d7da57-40ea-42ac-bf19-d7d0be16ad46 service nova] Creating event network-vif-plugged:e210b1e6-6d44-46b4-b6cd-e541040dcc67 for instance 016aacfa-8319-44a0-ae5d-aadbff940e73 on n-h1-854121-14 Oct 17 14:30:30.876557 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8f285dd8-cd5b-46e5-a533-27d7fa09cdce req-06d7da57-40ea-42ac-bf19-d7d0be16ad46 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036939 Oct 17 14:30:30.877267 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3980/7516] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:31.032007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:31.032632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:31.039689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:31.040172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:31.040615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:31.041354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:31.041812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:31.042242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:31.177062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:31.184934 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-168de481-b3c8-40a4-9549-52b2e5600836 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1317 microversion: 2.1 time: 0.157111 Oct 17 14:30:31.185545 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3537/7517] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:31 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:32.211303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:32.212027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:32.219468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:32.219948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:32.220406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:32.221768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:32.222238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:32.222716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:32.352400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:32.360453 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67cad39b-c141-4cda-8924-6b2a930004c1 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.155697 Oct 17 14:30:32.361039 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3981/7518] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:32 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:32.424425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1871350778", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "78288c5f-f3cb-4004-ab82-bafc4b0695d8"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:32.479763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] validate_networks() for [('78288c5f-f3cb-4004-ab82-bafc4b0695d8', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:30:33.219707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:30:33.220133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:30:33.221113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:30:33.221567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:30:33.221986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:30:33.231060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:33.231543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:33.231983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:33.232708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:33.233175 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:33.233610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:33.250898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Getting quotas for project 3ae349073b4b4c5490de33ed7e269a1f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:30:33.256147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Getting quotas for user f08fd896a1564bee8244195d3770130b and project 3ae349073b4b4c5490de33ed7e269a1f. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:30:33.269430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:30:33.271691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:30:33.319023 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-beedf5ef-e59a-4aba-bb50-49dba58c6a2e tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899212 Oct 17 14:30:33.319721 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3538/7519] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:30:33.330612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-36baa9c6-4b05-4eff-977e-2cbc4144bd8c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:33.331245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-36baa9c6-4b05-4eff-977e-2cbc4144bd8c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:33.390240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-36baa9c6-4b05-4eff-977e-2cbc4144bd8c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:33.400072 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-36baa9c6-4b05-4eff-977e-2cbc4144bd8c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1217 microversion: 2.1 time: 0.073215 Oct 17 14:30:33.400677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3982/7520] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:33 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:34.427144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:34.427774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:34.434678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:34.435483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:34.435924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:34.436632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:34.437087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:34.437548 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:34.518612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:34.528108 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0880bcc-b7dc-4a1c-a148-3a87c38b638f tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1277 microversion: 2.1 time: 0.106638 Oct 17 14:30:34.529076 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3539/7521] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:34 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:35.551927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:35.552563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:35.554594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:35.562250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:35.562812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:35.563249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:35.563965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:35.565444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:35.565902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:35.820480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:35.828672 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c0dd7a0-a799-4ea7-91e2-aebe767680fb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.281008 Oct 17 14:30:35.829274 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3983/7522] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:35 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:36.021419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c6ddffaf-2d29-4368-99ec-c7b505e7c78f req-5f6be314-40f6-46bb-a788-83d1b6319859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c390d7-d6dc-4166-9c8d-ad4d332e2340", "tag": "ad669ec1-d24d-496d-976b-71ead309dcd2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:36.034007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c6ddffaf-2d29-4368-99ec-c7b505e7c78f req-5f6be314-40f6-46bb-a788-83d1b6319859 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:36.035523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c6ddffaf-2d29-4368-99ec-c7b505e7c78f req-5f6be314-40f6-46bb-a788-83d1b6319859 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:36.036055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c6ddffaf-2d29-4368-99ec-c7b505e7c78f req-5f6be314-40f6-46bb-a788-83d1b6319859 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:36.048236 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c6ddffaf-2d29-4368-99ec-c7b505e7c78f req-5f6be314-40f6-46bb-a788-83d1b6319859 service nova] Creating event network-changed:ad669ec1-d24d-496d-976b-71ead309dcd2 for instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 on n-h2-854121-14 Oct 17 14:30:36.054198 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c6ddffaf-2d29-4368-99ec-c7b505e7c78f req-5f6be314-40f6-46bb-a788-83d1b6319859 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036834 Oct 17 14:30:36.054831 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3540/7523] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:36.853255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:36.853890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:36.855768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:36.861984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:36.862490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:36.862947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:36.863665 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:36.864134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:36.864577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:37.006746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:37.014936 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad545d2f-927c-4d7a-8a25-f8185cf41a66 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.166630 Oct 17 14:30:37.015528 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3984/7524] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:36 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:38.039736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:38.040445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:38.047604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:38.048094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:38.048534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:38.049766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:38.050225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:38.050658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:38.192850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:38.201288 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94345368-fa87-41e2-adff-61c621358bd0 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.165695 Oct 17 14:30:38.201963 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3541/7525] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:38 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:39.225838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:39.226683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:39.233154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:39.233687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:39.234146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:39.234872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:39.235343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:39.235790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:39.371076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:39.379414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96babb37-4203-404d-bbb2-1b950af6e2a2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.157560 Oct 17 14:30:39.380000 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3985/7526] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:39 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:40.403307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:40.403923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:40.410892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:40.411376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:40.411812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:40.412514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:40.412968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:40.413433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:40.543263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:40.551565 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1364d0f-50f4-444a-8891-f5f8f381c0dc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.152250 Oct 17 14:30:40.552144 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3542/7527] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:40 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:41.575391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:41.576018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:41.583708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:41.584214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:41.584669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:41.585463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:41.585932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:41.586374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:41.771595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:41.779757 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2ea1ee1-beac-4d04-9924-6a0163beb5d2 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.208471 Oct 17 14:30:41.780337 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3986/7528] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:41 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:42.804194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:42.805571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:42.812908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:42.813433 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:42.813898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:42.814608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:42.815257 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:42.815682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:42.961665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:42.969837 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-caade7e5-42fb-4f7e-a2db-a2fdbab168fd tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.170522 Oct 17 14:30:42.970525 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3543/7529] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:42 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:43.072605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2fbb4752-fe52-4b62-8e3d-223d1a0f35a7 req-68e1cc2a-a61c-4b8c-a4ad-bfdda4b2527f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c390d7-d6dc-4166-9c8d-ad4d332e2340", "name": "network-vif-plugged", "status": "completed", "tag": "ad669ec1-d24d-496d-976b-71ead309dcd2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:43.084752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fbb4752-fe52-4b62-8e3d-223d1a0f35a7 req-68e1cc2a-a61c-4b8c-a4ad-bfdda4b2527f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:43.085369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fbb4752-fe52-4b62-8e3d-223d1a0f35a7 req-68e1cc2a-a61c-4b8c-a4ad-bfdda4b2527f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:43.085888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2fbb4752-fe52-4b62-8e3d-223d1a0f35a7 req-68e1cc2a-a61c-4b8c-a4ad-bfdda4b2527f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:43.100662 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2fbb4752-fe52-4b62-8e3d-223d1a0f35a7 req-68e1cc2a-a61c-4b8c-a4ad-bfdda4b2527f service nova] Creating event network-vif-plugged:ad669ec1-d24d-496d-976b-71ead309dcd2 for instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 on n-h2-854121-14 Oct 17 14:30:43.106099 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2fbb4752-fe52-4b62-8e3d-223d1a0f35a7 req-68e1cc2a-a61c-4b8c-a4ad-bfdda4b2527f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037687 Oct 17 14:30:43.107202 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3987/7530] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:30:43.992941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:43.993540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:43.995448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:43.996103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:44.003424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:44.003913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:44.004375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:44.005066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:44.005542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:44.005965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:44.140638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:44.148703 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8ab2f84-3e5c-4709-bd45-c68570b78d27 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1317 microversion: 2.1 time: 0.159753 Oct 17 14:30:44.149305 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3544/7531] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:43 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:45.168889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:45.175172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:45.175912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:45.182709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.183209 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.183666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.184383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.184854 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.185327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.320256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:45.328352 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb323133-9905-499c-a9bc-093763ebb6c5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1506 microversion: 2.1 time: 0.160503 Oct 17 14:30:45.328935 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3988/7532] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:45 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:45.351363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:45.351900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:45.358874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.359361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.359827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.360519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.360978 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.361425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.387454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:30:45.464529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8793e851-082a-4c7d-9d20-b1a100834c4d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 204 len: 0 microversion: 2.1 time: 0.116434 Oct 17 14:30:45.465395 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3545/7533] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:45 2022] DELETE /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:30:45.473949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:45.474573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:45.480584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.481079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.481555 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.482258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:45.482720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:45.483156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:45.614084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:45.622283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2ef301f-c385-4030-ab4c-b711c2a7d050 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1512 microversion: 2.1 time: 0.152298 Oct 17 14:30:45.622863 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3989/7534] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:45 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:46.647195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:46.647979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:46.655274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:46.655792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:46.656248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:46.656976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:46.657489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:46.658435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:46.796279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:46.804884 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8e2b29fa-4c18-42ff-94fe-db863c4ca7cb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1512 microversion: 2.1 time: 0.162302 Oct 17 14:30:46.805495 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3546/7535] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:46 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:47.492799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f0be081a-e4fb-49a1-a5b7-c92353c59516 req-f3f65efc-d776-4210-a985-be15e635ec16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c390d7-d6dc-4166-9c8d-ad4d332e2340", "name": "network-vif-deleted", "tag": "ad669ec1-d24d-496d-976b-71ead309dcd2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:47.508032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0be081a-e4fb-49a1-a5b7-c92353c59516 req-f3f65efc-d776-4210-a985-be15e635ec16 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:47.508688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0be081a-e4fb-49a1-a5b7-c92353c59516 req-f3f65efc-d776-4210-a985-be15e635ec16 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:47.509143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f0be081a-e4fb-49a1-a5b7-c92353c59516 req-f3f65efc-d776-4210-a985-be15e635ec16 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:47.530219 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f0be081a-e4fb-49a1-a5b7-c92353c59516 req-f3f65efc-d776-4210-a985-be15e635ec16 service nova] Creating event network-vif-deleted:ad669ec1-d24d-496d-976b-71ead309dcd2 for instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 on n-h2-854121-14 Oct 17 14:30:47.538626 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f0be081a-e4fb-49a1-a5b7-c92353c59516 req-f3f65efc-d776-4210-a985-be15e635ec16 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053078 Oct 17 14:30:47.539669 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3990/7536] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:47.827980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:47.828505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:47.836122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:47.836618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:47.837057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:47.837793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:47.838253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:47.838960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:47.871203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:47.871694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:47.872135 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:47.872590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lazy-loading 'fault' on Instance uuid 60c390d7-d6dc-4166-9c8d-ad4d332e2340 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:30:47.915329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:47.923195 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-da7a2978-711e-4ff1-8c59-28574f75bad4 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 200 len: 1307 microversion: 2.1 time: 0.099176 Oct 17 14:30:47.923988 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3547/7537] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:47 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:48.948406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:48.949069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:48.957437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.957954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.958413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.959149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.959699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.960101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.974399 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] HTTP exception thrown: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 HTTP/1.1 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '60c390d7-d6dc-4166-9c8d-ad4d332e2340'} Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:48.976095 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 404 to user: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f340e0d5-0a75-492b-9f96-0985743e0a3c tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 404 len: 111 microversion: 2.1 time: 0.034868 Oct 17 14:30:48.981603 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3991/7538] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:48 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:48.987349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:48.987996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:48.994909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.995407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.995816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:48.996504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:48.996951 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:48.997400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.133261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:49.141727 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-824b5b23-1642-47d0-8d29-ea2cf8b23c24 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.158343 Oct 17 14:30:49.143132 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3548/7539] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:48 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:30:49.165991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3749083f-6fb9-4181-94a8-fa525c4633df tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:49.168327 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3749083f-6fb9-4181-94a8-fa525c4633df tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: cd735562-1ae7-4553-849a-eed8fc7931ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.174359 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3749083f-6fb9-4181-94a8-fa525c4633df tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] HTTP exception thrown: Instance cd735562-1ae7-4553-849a-eed8fc7931ad could not be found. Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3749083f-6fb9-4181-94a8-fa525c4633df tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/cd735562-1ae7-4553-849a-eed8fc7931ad/action HTTP/1.1 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 32 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: {"resize": {"flavorRef": "452"}} Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance cd735562-1ae7-4553-849a-eed8fc7931ad could not be found. Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'cd735562-1ae7-4553-849a-eed8fc7931ad', 'body': {'resize': {'flavorRef': '452'}}} Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd735562-1ae7-4553-849a-eed8fc7931ad could not be found. Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:49.175953 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd735562-1ae7-4553-849a-eed8fc7931ad could not be found. Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd735562-1ae7-4553-849a-eed8fc7931ad could not be found. Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3749083f-6fb9-4181-94a8-fa525c4633df tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 404 to user: Instance cd735562-1ae7-4553-849a-eed8fc7931ad could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3749083f-6fb9-4181-94a8-fa525c4633df tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "POST /compute/v2.1/servers/cd735562-1ae7-4553-849a-eed8fc7931ad/action" status: 404 len: 111 microversion: 2.1 time: 0.015499 Oct 17 14:30:49.181027 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3992/7540] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:30:49 2022] POST /compute/v2.1/servers/cd735562-1ae7-4553-849a-eed8fc7931ad/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:49.186028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:49.186707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.193246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.193736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.194179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.194876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.195334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.195765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.329739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:49.333413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:49.338569 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae2c4335-aa07-4859-9fa7-a6398a464401 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.156391 Oct 17 14:30:49.339146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3549/7541] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:49 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:49.362446 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:49.363079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.370220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.370720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.371174 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.371915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.372349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.372790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.503361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:49.511595 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-058afb5a-f8ad-4cc8-b2d0-502e9d04aece tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.154087 Oct 17 14:30:49.512175 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3993/7542] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:49 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:49.536515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "5b24e47c-dfc5-4ef3-8744-536c41741db1"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:49.539824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.546936 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.547381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.547821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.549045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.549530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.549970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.580849 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:49.585856 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] HTTP exception thrown: Flavor 5b24e47c-dfc5-4ef3-8744-536c41741db1 could not be found. Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73/action HTTP/1.1 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 65 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: {"resize": {"flavorRef": "5b24e47c-dfc5-4ef3-8744-536c41741db1"}} Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: exception: Flavor 5b24e47c-dfc5-4ef3-8744-536c41741db1 could not be found. Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '016aacfa-8319-44a0-ae5d-aadbff940e73', 'body': {'resize': {'flavorRef': '5b24e47c-dfc5-4ef3-8744-536c41741db1'}}} Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:49.587775 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5b24e47c-dfc5-4ef3-8744-536c41741db1 could not be found. Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 5b24e47c-dfc5-4ef3-8744-536c41741db1 could not be found. Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5b24e47c-dfc5-4ef3-8744-536c41741db1 could not be found. Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 400 to user: Flavor 5b24e47c-dfc5-4ef3-8744-536c41741db1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eba5ea78-4fd6-46e8-a089-cb9c9121c560 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "POST /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73/action" status: 400 len: 107 microversion: 2.1 time: 0.058320 Oct 17 14:30:49.592528 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3550/7543] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:30:49 2022] POST /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73/action => generated 107 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:30:49.598329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:49.598969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.605092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.605635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.606089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.606807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.607278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.607762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.740704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:49.748613 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e130c9e9-19d0-4536-ace5-1b43c4552afb tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.154382 Oct 17 14:30:49.749220 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3994/7544] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:49 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:49.772023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:49.772644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.778726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.779168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.779602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.780279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.780727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.781147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.916252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:49.925035 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6a63b1af-842a-44b0-b6b5-eb3d34362fd5 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.156794 Oct 17 14:30:49.925755 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3551/7545] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:49 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:49.948364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b75475e7-22c7-4b8f-a8c9-16a2ef735e18 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b75475e7-22c7-4b8f-a8c9-16a2ef735e18 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73/action HTTP/1.1 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 29 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: {"resize": {"flavorRef": ""}} Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '016aacfa-8319-44a0-ae5d-aadbff940e73', 'body': {'resize': {'flavorRef': ''}}} Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '' Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.952009 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b75475e7-22c7-4b8f-a8c9-16a2ef735e18 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b75475e7-22c7-4b8f-a8c9-16a2ef735e18 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "POST /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73/action" status: 400 len: 113 microversion: 2.1 time: 0.009114 Oct 17 14:30:49.958613 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3995/7546] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:30:49 2022] POST /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 17 14:30:49.962156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:49.962775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:49.968806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.969329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.969766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:49.971177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:49.971638 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:49.972061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.105879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:50.114327 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad376ece-987b-4698-8d24-0a0e4016c981 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1506 microversion: 2.1 time: 0.155904 Oct 17 14:30:50.115030 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3552/7547] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:49 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:50.141255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:50.141780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:50.149834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.150348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.150809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.151565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.152046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.152495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.166665 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] HTTP exception thrown: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 HTTP/1.1 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '60c390d7-d6dc-4166-9c8d-ad4d332e2340'} Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:50.168294 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 404 to user: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71457abf-c028-44bc-afef-7a2bfeaade2a tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 404 len: 111 microversion: 2.1 time: 0.033523 Oct 17 14:30:50.173102 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3996/7548] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:50 2022] DELETE /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:30:50.178618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:50.179233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 60c390d7-d6dc-4166-9c8d-ad4d332e2340] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:50.185310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.185814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.186247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.186929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.187378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.187798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.201193 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] HTTP exception thrown: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 HTTP/1.1 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '60c390d7-d6dc-4166-9c8d-ad4d332e2340'} Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:50.202860 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 404 to user: Instance 60c390d7-d6dc-4166-9c8d-ad4d332e2340 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-28d4423d-f53c-490b-b96b-4149e39b29f3 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340" status: 404 len: 111 microversion: 2.1 time: 0.029546 Oct 17 14:30:50.209208 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3553/7549] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:50 2022] GET /compute/v2.1/servers/60c390d7-d6dc-4166-9c8d-ad4d332e2340 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:30:50.213492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:50.214014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:50.220212 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.220711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.221278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.221992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.222459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.222901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.252166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:30:50.331660 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2412f02a-add1-40c7-affb-b669d37b458d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 204 len: 0 microversion: 2.1 time: 0.121707 Oct 17 14:30:50.332204 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3997/7550] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:30:50 2022] DELETE /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:30:50.340632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:50.341287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:50.347821 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.348317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.348758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.349498 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:50.349953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:50.350380 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:50.491762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:50.499756 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f6a512f-cb62-4a4e-85d9-49414a134f8d tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1512 microversion: 2.1 time: 0.163204 Oct 17 14:30:50.500335 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3554/7551] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:50 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:51.524679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:51.525454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:51.532397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:51.532904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:51.533463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:51.534187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:51.534660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:51.535109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:51.554910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:30:51.699624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08fd896a1564bee8244195d3770130b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ae349073b4b4c5490de33ed7e269a1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:30:51.707788 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-adf052c1-9034-4c9f-8432-eec2379091bc tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 200 len: 1512 microversion: 2.1 time: 0.187580 Oct 17 14:30:51.708395 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3998/7552] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:51 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:30:52.143998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6aea6096-a499-47a7-85c7-6df545abe3f5 req-833b8843-6892-414d-a040-bb2616ea7ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016aacfa-8319-44a0-ae5d-aadbff940e73", "name": "network-vif-deleted", "tag": "e210b1e6-6d44-46b4-b6cd-e541040dcc67"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:30:52.156516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6aea6096-a499-47a7-85c7-6df545abe3f5 req-833b8843-6892-414d-a040-bb2616ea7ebf service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:52.157123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6aea6096-a499-47a7-85c7-6df545abe3f5 req-833b8843-6892-414d-a040-bb2616ea7ebf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:52.159105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6aea6096-a499-47a7-85c7-6df545abe3f5 req-833b8843-6892-414d-a040-bb2616ea7ebf service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:52.175655 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6aea6096-a499-47a7-85c7-6df545abe3f5 req-833b8843-6892-414d-a040-bb2616ea7ebf service nova] Creating event network-vif-deleted:e210b1e6-6d44-46b4-b6cd-e541040dcc67 for instance 016aacfa-8319-44a0-ae5d-aadbff940e73 on n-h1-854121-14 Oct 17 14:30:52.181395 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6aea6096-a499-47a7-85c7-6df545abe3f5 req-833b8843-6892-414d-a040-bb2616ea7ebf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041307 Oct 17 14:30:52.181991 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3555/7553] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:30:52.731275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:30:52.731971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] [instance: 016aacfa-8319-44a0-ae5d-aadbff940e73] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:30:52.739302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:52.739814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:52.740306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:52.741036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:30:52.741548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:30:52.741996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:30:52.756567 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] HTTP exception thrown: Instance 016aacfa-8319-44a0-ae5d-aadbff940e73 could not be found. Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Request method failure captured: Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 HTTP/1.1 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWb_JDCjmBKSudg-bBEf6ryZuOO24wiFrXrx6UrKtgLQzUKhtmtAmPPfW6FXTTl4MERlr8lACLqF4HfLbuGvBKo0ai6I--2by4R7R8_WppaZUIjQ17LTQPWPQxIB59whrbWxnQh98Dlhd-wkH71otp_UJ_A8ulHqx5liYeqaU1t-Jes Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_3ae349073b4b4c5490de33ed7e269a1f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 3ae349073b4b4c5490de33ed7e269a1f Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543008150 Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: f08fd896a1564bee8244195d3770130b Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-ServersNegativeTestJSON-543008150-project Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 016aacfa-8319-44a0-ae5d-aadbff940e73 could not be found. Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '016aacfa-8319-44a0-ae5d-aadbff940e73'} Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016aacfa-8319-44a0-ae5d-aadbff940e73 could not be found. Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016aacfa-8319-44a0-ae5d-aadbff940e73 could not be found. Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:30:52.758562 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016aacfa-8319-44a0-ae5d-aadbff940e73 could not be found. Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] Returning 404 to user: Instance 016aacfa-8319-44a0-ae5d-aadbff940e73 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42790055-ded2-489e-803f-6b27cabf7df8 tempest-ServersNegativeTestJSON-543008150 tempest-ServersNegativeTestJSON-543008150-project] 10.222.0.65 "GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73" status: 404 len: 111 microversion: 2.1 time: 0.033186 Oct 17 14:30:52.763687 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3999/7554] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:30:52 2022] GET /compute/v2.1/servers/016aacfa-8319-44a0-ae5d-aadbff940e73 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:31:24.104344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:24.105091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=26 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:24.301540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e4117a1-92ee-4a36-b953-80988649149d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: .version_select at 0x7f419cf6bd30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-71663713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMS6CNtmkcXdznzJ/LvQ/eQdsF6pBSEP1e88QyLdWXIav7K9yw6lxD/a7kCuBTRb9rIKwjKbi637Y3ufK/VftbhFuD8im8j0Qi/Bft0H9MKTbzclHApAbwGOzfnybxwycQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:24.318799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4e4117a1-92ee-4a36-b953-80988649149d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:31:24.324481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-4e4117a1-92ee-4a36-b953-80988649149d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for user 4dbfd69c23624cdf87f0b4e7c627b4e5 and project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:31:24.353227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e4117a1-92ee-4a36-b953-80988649149d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.251798 Oct 17 14:31:24.354038 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3556/7555] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:31:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:24.437311 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2046613946", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-71663713", "networks": [{"uuid": "3cfbe38a-cc58-4a25-8e78-ae2547a7c28e"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:24.467809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:24.469379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:24.536294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] validate_networks() for [('3cfbe38a-cc58-4a25-8e78-ae2547a7c28e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:31:25.085804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:31:25.086240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:31:25.086726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:31:25.087145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:31:25.087565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:31:25.097463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:25.097878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:25.098325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:25.099070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:25.099564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:25.100005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:25.117666 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:31:25.122978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for user 4dbfd69c23624cdf87f0b4e7c627b4e5 and project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:31:25.135971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:31:25.138369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:31:25.185577 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1f0dcfac-b6c0-4f76-b087-26f511dfab49 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753452 Oct 17 14:31:25.186247 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4000/7556] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:31:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:31:25.198024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7a0caa4-85e4-40c8-b51f-1d277d9c50f1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:25.198772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7a0caa4-85e4-40c8-b51f-1d277d9c50f1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:25.258567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7a0caa4-85e4-40c8-b51f-1d277d9c50f1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:25.265529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7a0caa4-85e4-40c8-b51f-1d277d9c50f1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1261 microversion: 2.1 time: 0.072249 Oct 17 14:31:25.266148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3557/7557] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:25 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:26.291670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:26.292348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:26.306079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:26.306596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:26.307267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:26.307803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:26.308276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:26.308838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:26.775008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:26.783272 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d08ffda-9c7c-442b-9589-94f94d16d8ac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1321 microversion: 2.1 time: 0.498579 Oct 17 14:31:26.797579 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4001/7558] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:26 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:27.808500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:27.809731 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:27.821828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:27.824260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:27.824746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:27.825618 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:27.826096 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:27.829740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:28.083076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:28.092703 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65955586-827f-4827-a0e5-a71297bfc6bc tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1361 microversion: 2.1 time: 0.288667 Oct 17 14:31:28.093350 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3558/7559] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:27 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:28.480005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f4028b74-e0bc-45c4-9693-1f5025dcbb9b req-7fe58475-e984-4de2-a7d8-21d92dd034fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6177bfe4-3809-4618-bd4b-63b65fdef986", "tag": "d874c82d-c01e-4b46-adf0-2079a0d90c07"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:28.491856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4028b74-e0bc-45c4-9693-1f5025dcbb9b req-7fe58475-e984-4de2-a7d8-21d92dd034fa service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:28.492363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4028b74-e0bc-45c4-9693-1f5025dcbb9b req-7fe58475-e984-4de2-a7d8-21d92dd034fa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:28.493122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4028b74-e0bc-45c4-9693-1f5025dcbb9b req-7fe58475-e984-4de2-a7d8-21d92dd034fa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:28.506458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f4028b74-e0bc-45c4-9693-1f5025dcbb9b req-7fe58475-e984-4de2-a7d8-21d92dd034fa service nova] Creating event network-changed:d874c82d-c01e-4b46-adf0-2079a0d90c07 for instance 6177bfe4-3809-4618-bd4b-63b65fdef986 on n-h1-854121-14 Oct 17 14:31:28.512008 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f4028b74-e0bc-45c4-9693-1f5025dcbb9b req-7fe58475-e984-4de2-a7d8-21d92dd034fa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118567 Oct 17 14:31:28.512631 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4002/7560] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:29.118501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:29.119024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:29.126126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:29.126613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:29.127059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:29.129743 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:29.130224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:29.130663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:29.278817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:29.286974 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-702ae6be-c48c-4c25-af42-af7b9bc3beac tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1361 microversion: 2.1 time: 0.172464 Oct 17 14:31:29.287561 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3559/7561] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:29 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:30.312503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:30.313398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:30.321116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:30.321655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:30.322110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:30.322872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:30.323350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:30.323790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:30.467139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:30.475356 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16a7d5a9-3872-4b41-9519-a4e2a4548e12 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1361 microversion: 2.1 time: 0.168269 Oct 17 14:31:30.475944 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4003/7562] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:30 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:31.499155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:31.499716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:31.507188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:31.507675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:31.508536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:31.509286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:31.509744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:31.510174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:31.646207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:31.654034 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8aa8d33c-73a5-46dd-9857-def8d9b4208b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1361 microversion: 2.1 time: 0.158911 Oct 17 14:31:31.654611 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3560/7563] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:31 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:32.679398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:32.680021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:32.687073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:32.687570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:32.688025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:32.688739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:32.689231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:32.689676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:32.834658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:32.842544 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3e9103f-5bf4-4732-9971-75da84abfb29 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1361 microversion: 2.1 time: 0.168696 Oct 17 14:31:32.843150 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4004/7564] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:32 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:33.008304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e1d07853-6339-4874-b839-e103752e0e00 req-a7b3943a-b90a-4de8-8024-fffcaa930112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6177bfe4-3809-4618-bd4b-63b65fdef986", "name": "network-vif-plugged", "status": "completed", "tag": "d874c82d-c01e-4b46-adf0-2079a0d90c07"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:33.020165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e1d07853-6339-4874-b839-e103752e0e00 req-a7b3943a-b90a-4de8-8024-fffcaa930112 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:33.020649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e1d07853-6339-4874-b839-e103752e0e00 req-a7b3943a-b90a-4de8-8024-fffcaa930112 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:33.021080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e1d07853-6339-4874-b839-e103752e0e00 req-a7b3943a-b90a-4de8-8024-fffcaa930112 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:33.035405 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e1d07853-6339-4874-b839-e103752e0e00 req-a7b3943a-b90a-4de8-8024-fffcaa930112 service nova] Creating event network-vif-plugged:d874c82d-c01e-4b46-adf0-2079a0d90c07 for instance 6177bfe4-3809-4618-bd4b-63b65fdef986 on n-h1-854121-14 Oct 17 14:31:33.040529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e1d07853-6339-4874-b839-e103752e0e00 req-a7b3943a-b90a-4de8-8024-fffcaa930112 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099134 Oct 17 14:31:33.041206 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3561/7565] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:33.867390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:33.867947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:33.875068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:33.875573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:33.876029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:33.876753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:33.877243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:33.877813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:34.013759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:34.021743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-902a756d-a1ff-4c86-a5cb-ab9168ac65da tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1361 microversion: 2.1 time: 0.158551 Oct 17 14:31:34.022478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4005/7566] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:33 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:35.045995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:35.046693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:35.054521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.054999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.055434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.056119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.056567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.056991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.188751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:35.197528 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c165d0fa-13b7-496a-b65f-5c146bdf758e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1554 microversion: 2.1 time: 0.155784 Oct 17 14:31:35.198118 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3562/7567] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:35 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:35.220685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:35.221439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:35.224325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:35.225026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:35.230919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.231423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.231883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.232613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:35.233083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:35.233554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:35.367098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:35.375072 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77ce427a-3c5d-4338-a1bc-43a423b3827d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1554 microversion: 2.1 time: 0.158571 Oct 17 14:31:35.375658 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4006/7568] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:35 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:37.022247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d4b8f36-3b93-409b-9e8a-d47bf6c4de60"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:37.024662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:37.026721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:37.032810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.033316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.033783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.034517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:37.034965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:37.035401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:37.276124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88d32b5b-787c-4a76-b0d3-7fa46dc6e443 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258526 Oct 17 14:31:37.276918 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3563/7569] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 14:31:37 2022] POST /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:48.002440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:48.002980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:48.004999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:48.005812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=34 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:48.012068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:48.012566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:48.013019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:48.013833 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:48.014299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:48.014738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:48.097219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lazy-loading 'services' on Instance uuid 6177bfe4-3809-4618-bd4b-63b65fdef986 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:31:48.171526 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-20dee4e1-3ef5-4ae1-a304-2309cbe5911d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments/7d4b8f36-3b93-409b-9e8a-d47bf6c4de60" status: 202 len: 0 microversion: 2.1 time: 0.173152 Oct 17 14:31:48.172156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4007/7570] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:31:47 2022] DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments/7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:31:48.179009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:48.180004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:31:48.184572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:48.187447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:48.196008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:48.196535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:48.196991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:48.197712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:48.198167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:48.198589 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:48.233997 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-52edcf63-f7b1-4500-8c6b-3b8af302eec9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057041 Oct 17 14:31:48.234574 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3564/7571] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:31:48 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:49.248773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:49.251270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:49.258646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:49.259154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:49.259616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:49.260333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:49.260804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:49.261279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:49.292540 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9c39446-430e-4ceb-b5fc-cb759ba931b9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048982 Oct 17 14:31:49.293446 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4008/7572] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:31:49 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:50.306074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:50.308287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:50.316164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:50.317283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:50.317735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:50.318438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:50.318895 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:50.319324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:50.351633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f491729-4b24-45cd-94a7-03ceda8cfd06 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049601 Oct 17 14:31:50.352469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3565/7573] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:31:50 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:51.365253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:51.367501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:51.374522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:51.375017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:51.375469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:51.376178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:51.376640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:51.377077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:51.408106 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05b1a2df-9dcf-45c3-b109-7975eb740928 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048005 Oct 17 14:31:51.408682 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4009/7574] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:31:51 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:52.421530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:52.423740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:52.431401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:52.431919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:52.432355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:52.433054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:52.433526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:52.433948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:52.465827 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-459823bf-ee2e-4dc2-ae02-bd942e1ad3ae tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048361 Oct 17 14:31:52.466410 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3566/7575] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:31:52 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:53.478117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:53.480338 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:53.487306 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:53.487804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:53.488291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:53.489077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:53.489573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:53.490020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:53.523522 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7843c57d-833a-47fc-8e36-052f165f30f0 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049469 Oct 17 14:31:53.524097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4010/7576] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:31:53 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:31:53.534742 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:53.535520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:53.542418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:53.542907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:53.543359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:53.544067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:53.544530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:53.544969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:53.624661 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] HTTP exception thrown: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 is not attached to volume 7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Request method failure captured: Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments/7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 HTTP/1.1 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWc2XXbXE7mmrlMrNv0M5NuZI_kpbkC0JKI7w0VoCzP7jUOaIt2RplqQ3onRTkyNVRvt69egjbaotvdKG08XMH-wV8-I42XyyNEJHLdzFnpjaE42uUP8BAeayhBfle7qjUuZokHmSHCkm_BzaPb5x08FzX8YHlbq6KARUshJ_po0uas Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4dbfd69c23624cdf87f0b4e7c627b4e5 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 is not attached to volume 7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': '6177bfe4-3809-4618-bd4b-63b65fdef986', 'id': '7d4b8f36-3b93-409b-9e8a-d47bf6c4de60'} Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7d4b8f36-3b93-409b-9e8a-d47bf6c4de60. Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 is not attached to volume 7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:31:53.632807 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 is not attached to volume 7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Returning 404 to user: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 is not attached to volume 7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-245a7c56-8a02-4f71-b527-6650f172a0cf tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments/7d4b8f36-3b93-409b-9e8a-d47bf6c4de60" status: 404 len: 154 microversion: 2.1 time: 0.103952 Oct 17 14:31:53.638529 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3567/7577] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:31:53 2022] DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986/os-volume_attachments/7d4b8f36-3b93-409b-9e8a-d47bf6c4de60 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:31:56.997799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:56.998388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:57.006506 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:57.007106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:57.007637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:57.008691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:57.009182 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:57.009628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:57.039419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:31:57.127561 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dff3b2d0-a522-481f-a9b6-64629d1b9aec tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 204 len: 0 microversion: 2.1 time: 0.133340 Oct 17 14:31:57.128688 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4011/7578] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:31:56 2022] DELETE /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:31:57.137470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:57.138644 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:57.145872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:57.146301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:57.146740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:57.147442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:57.147899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:57.148326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:57.286180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:57.294311 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0bcdfd4-5bf5-46e2-8a26-346ffb6e0d47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1560 microversion: 2.1 time: 0.160743 Oct 17 14:31:57.294884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3568/7579] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:57 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:58.319561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:58.320269 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:58.327273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:58.327768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:58.328227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:58.328934 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:58.329430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:58.329873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:58.461737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:58.469798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-173e5b6c-d8a7-4635-8ff2-d519e56fae9f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1560 microversion: 2.1 time: 0.155330 Oct 17 14:31:58.470381 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4012/7580] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:58 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:31:59.123971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-69047822-94ad-4ee6-939c-3c6541c71324 req-f4e7a4af-4a13-42f8-8775-95f49af68556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6177bfe4-3809-4618-bd4b-63b65fdef986", "name": "network-vif-deleted", "tag": "d874c82d-c01e-4b46-adf0-2079a0d90c07"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:31:59.136283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-69047822-94ad-4ee6-939c-3c6541c71324 req-f4e7a4af-4a13-42f8-8775-95f49af68556 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:59.136772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-69047822-94ad-4ee6-939c-3c6541c71324 req-f4e7a4af-4a13-42f8-8775-95f49af68556 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:59.137239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-69047822-94ad-4ee6-939c-3c6541c71324 req-f4e7a4af-4a13-42f8-8775-95f49af68556 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:59.150002 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-69047822-94ad-4ee6-939c-3c6541c71324 req-f4e7a4af-4a13-42f8-8775-95f49af68556 service nova] Creating event network-vif-deleted:d874c82d-c01e-4b46-adf0-2079a0d90c07 for instance 6177bfe4-3809-4618-bd4b-63b65fdef986 on n-h1-854121-14 Oct 17 14:31:59.155238 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-69047822-94ad-4ee6-939c-3c6541c71324 req-f4e7a4af-4a13-42f8-8775-95f49af68556 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Oct 17 14:31:59.155847 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3569/7581] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:31:59.494275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:31:59.494913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:31:59.502853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:59.503406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:59.503801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:59.504708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:59.505207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:59.505664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:59.544142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:31:59.544606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:31:59.545121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:31:59.545626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lazy-loading 'fault' on Instance uuid 6177bfe4-3809-4618-bd4b-63b65fdef986 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:31:59.596764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:31:59.606323 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a478a3b-72d2-4ed0-9e70-dbfb441ab75a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 200 len: 1351 microversion: 2.1 time: 0.116759 Oct 17 14:31:59.607013 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4013/7582] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:31:59 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:00.634307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:00.635026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 6177bfe4-3809-4618-bd4b-63b65fdef986] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:00.641459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:00.641952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:00.642397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:00.643108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:00.643567 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:00.644001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:00.658366 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] HTTP exception thrown: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 could not be found. Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Request method failure captured: Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 HTTP/1.1 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWc2XXbXE7mmrlMrNv0M5NuZI_kpbkC0JKI7w0VoCzP7jUOaIt2RplqQ3onRTkyNVRvt69egjbaotvdKG08XMH-wV8-I42XyyNEJHLdzFnpjaE42uUP8BAeayhBfle7qjUuZokHmSHCkm_BzaPb5x08FzX8YHlbq6KARUshJ_po0uas Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 4dbfd69c23624cdf87f0b4e7c627b4e5 Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 could not be found. Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '6177bfe4-3809-4618-bd4b-63b65fdef986'} Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 could not be found. Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 could not be found. Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:32:00.660123 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 could not be found. Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Returning 404 to user: Instance 6177bfe4-3809-4618-bd4b-63b65fdef986 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3b125cca-d5e8-4418-9685-806274bfdc43 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986" status: 404 len: 111 microversion: 2.1 time: 0.033509 Oct 17 14:32:00.665607 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3570/7583] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:00 2022] GET /compute/v2.1/servers/6177bfe4-3809-4618-bd4b-63b65fdef986 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:32:00.670675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e5fd3880-f61f-4c82-824e-2ca29cc0f160 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '.version_select at 0x7f419c7414c0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:00.698059 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e5fd3880-f61f-4c82-824e-2ca29cc0f160 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-71663713" status: 202 len: 0 microversion: 2.1 time: 0.031262 Oct 17 14:32:00.698667 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4014/7584] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 14:32:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-71663713 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:32:00.715890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5de642b-ec1f-4f7f-aa76-8f5a3facaf51 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: .version_select at 0x7f419ca651f0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-670689049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdAy17pyzsoau65T5xgh9/0+aNWzrvAq6oUSp6K8uc25D6Xl7cNafVYBejJuncGr2LrwaHWKjY0+HJjiXcDTG9k6aLpBqJS3Zh1pqpjzQZFYNJXIA01EXIDHXhxC45HsQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:00.731558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-c5de642b-ec1f-4f7f-aa76-8f5a3facaf51 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:32:00.736753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-c5de642b-ec1f-4f7f-aa76-8f5a3facaf51 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for user 4dbfd69c23624cdf87f0b4e7c627b4e5 and project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:32:00.762275 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5de642b-ec1f-4f7f-aa76-8f5a3facaf51 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050244 Oct 17 14:32:00.762882 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3571/7585] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:32:00 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:00.813271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-869338560", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-670689049", "networks": [{"uuid": "3cfbe38a-cc58-4a25-8e78-ae2547a7c28e"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:00.868273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] validate_networks() for [('3cfbe38a-cc58-4a25-8e78-ae2547a7c28e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:32:01.244176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:32:01.244619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:32:01.245151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:32:01.245635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:32:01.246068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:32:01.255206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:01.255702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:01.256155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:01.256901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:01.257434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:01.257856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:01.276014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:32:01.281479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for user 4dbfd69c23624cdf87f0b4e7c627b4e5 and project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:32:01.294923 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:32:01.297314 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:32:01.345459 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99331709-3b3b-405e-ac23-2a826d3a463e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536045 Oct 17 14:32:01.346128 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4015/7586] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:32:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 17 14:32:01.359640 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-34f70473-581a-4b7c-bfdc-15b51569e0d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:01.360428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-34f70473-581a-4b7c-bfdc-15b51569e0d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:01.422480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-34f70473-581a-4b7c-bfdc-15b51569e0d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:01.431873 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-34f70473-581a-4b7c-bfdc-15b51569e0d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1261 microversion: 2.1 time: 0.076833 Oct 17 14:32:01.432445 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3572/7587] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:01 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1261 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:02.456076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:02.457882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:02.464597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:02.465109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:02.465597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:02.466318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:02.466791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:02.467240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:02.564749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:02.574405 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4c3d7fdf-376e-4456-98a0-d7c4f2ed59e5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1321 microversion: 2.1 time: 0.123244 Oct 17 14:32:02.575251 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4016/7588] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:02 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1321 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:32:03.597893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:03.600060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:03.606262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:03.606756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:03.607193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:03.607937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:03.613838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:03.615109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:03.858342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:03.866931 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3684b2e3-8e5a-48e0-ae27-cf79acfdae7d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.272928 Oct 17 14:32:03.881198 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3573/7589] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:03 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:04.049675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7d9d2ed4-3942-46c7-8d1e-44582765f2af req-41d83aaf-0ea4-4b26-a797-a06b124b7d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c", "tag": "01599de5-e603-485e-8403-078aff5e0350"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:04.063373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7d9d2ed4-3942-46c7-8d1e-44582765f2af req-41d83aaf-0ea4-4b26-a797-a06b124b7d35 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:04.064028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7d9d2ed4-3942-46c7-8d1e-44582765f2af req-41d83aaf-0ea4-4b26-a797-a06b124b7d35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:04.064749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7d9d2ed4-3942-46c7-8d1e-44582765f2af req-41d83aaf-0ea4-4b26-a797-a06b124b7d35 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:04.081199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7d9d2ed4-3942-46c7-8d1e-44582765f2af req-41d83aaf-0ea4-4b26-a797-a06b124b7d35 service nova] Creating event network-changed:01599de5-e603-485e-8403-078aff5e0350 for instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c on n-h2-854121-14 Oct 17 14:32:04.086756 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7d9d2ed4-3942-46c7-8d1e-44582765f2af req-41d83aaf-0ea4-4b26-a797-a06b124b7d35 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041082 Oct 17 14:32:04.087601 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4017/7590] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:32:04.891828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:04.892378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:04.899871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:04.900356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:04.900801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:04.901542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:04.901989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:04.902416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:05.032622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:05.040640 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f888c58e-ab52-4a9a-b441-ad926d58948a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.152922 Oct 17 14:32:05.041235 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3574/7591] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:04 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:06.064536 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:06.065281 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:06.073086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:06.073621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:06.074086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:06.074803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:06.075283 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:06.075730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:06.207530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:06.216103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dec770dc-5c67-4b29-8d77-0c4ceeedc092 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.155966 Oct 17 14:32:06.216680 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4018/7592] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:06 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:07.239061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:07.239789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:07.246678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:07.247165 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:07.247607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:07.248310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:07.248763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:07.249208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:07.469991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:07.479006 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-857cad53-5e18-4eb7-8cac-3e47a19a4ca7 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.243704 Oct 17 14:32:07.479361 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3575/7593] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:07 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:08.501843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:08.502472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:08.509301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:08.509816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:08.510275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:08.511000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:08.511764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:08.512223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:08.643527 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:08.652311 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3e732d1a-a552-4005-9189-babcb693bfef tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.154499 Oct 17 14:32:08.652895 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4019/7594] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:08 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:09.675866 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:09.676529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:09.684275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:09.684757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:09.685223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:09.685925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:09.686377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:09.686800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:09.827512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:09.835808 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32db0d15-f6b6-43e4-9f2d-e61b4f5f294d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.163846 Oct 17 14:32:09.836407 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3576/7595] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:09 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:10.859572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:10.860164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:10.867151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:10.867647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:10.868093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:10.868799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:10.869296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:10.869737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:11.001391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:11.010264 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd5a4973-ddc9-4b72-8541-0c179ac1ecaa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.154723 Oct 17 14:32:11.010853 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4020/7596] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:10 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:11.665900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:11.671229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-afd4f0a4-be50-429b-9e74-d97ea412ec55 req-bc8a4b58-60ac-4245-8a95-c34c40fd970c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c", "name": "network-vif-plugged", "status": "completed", "tag": "01599de5-e603-485e-8403-078aff5e0350"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:11.682240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afd4f0a4-be50-429b-9e74-d97ea412ec55 req-bc8a4b58-60ac-4245-8a95-c34c40fd970c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:11.682846 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afd4f0a4-be50-429b-9e74-d97ea412ec55 req-bc8a4b58-60ac-4245-8a95-c34c40fd970c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:11.683278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-afd4f0a4-be50-429b-9e74-d97ea412ec55 req-bc8a4b58-60ac-4245-8a95-c34c40fd970c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:11.695044 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-afd4f0a4-be50-429b-9e74-d97ea412ec55 req-bc8a4b58-60ac-4245-8a95-c34c40fd970c service nova] Creating event network-vif-plugged:01599de5-e603-485e-8403-078aff5e0350 for instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c on n-h2-854121-14 Oct 17 14:32:11.700205 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-afd4f0a4-be50-429b-9e74-d97ea412ec55 req-bc8a4b58-60ac-4245-8a95-c34c40fd970c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 Oct 17 14:32:11.700819 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3577/7597] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:12.034080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:12.034717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:12.036964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:12.037687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:12.044880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:12.045414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:12.045874 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:12.046591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:12.047065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:12.047516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:12.180377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:12.189535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-89733209-cd9b-481a-b9e8-eb60314b71bb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.159226 Oct 17 14:32:12.190142 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4021/7598] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:12 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:13.215707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:13.216419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:13.222775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:13.223259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:13.224262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:13.224963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:13.225443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:13.225873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:13.364010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:13.372500 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1257ad99-c78b-4be8-bf2f-5b8f6a25a79f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1361 microversion: 2.1 time: 0.161857 Oct 17 14:32:13.373084 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3578/7599] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:13 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:32:14.396117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:14.396742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:14.403772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:14.404278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:14.404734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:14.405489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:14.405957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:14.406398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:14.541181 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:14.549106 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5576f4b0-6379-4349-a88a-06d870730992 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1554 microversion: 2.1 time: 0.157042 Oct 17 14:32:14.549709 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4022/7600] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:14 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:14.571537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:14.572160 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:14.578875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:14.579356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:14.579793 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:14.580479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:14.580930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:14.581385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:14.713831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:14.722362 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3d4bd3a-bce0-47f2-acb6-da664f19c634 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1554 microversion: 2.1 time: 0.154671 Oct 17 14:32:14.722960 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3579/7601] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:14 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:16.230894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d5a3f6b-6e48-4cf3-8236-e292020bcdde"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:16.233469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:16.240952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:16.241480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:16.241933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:16.242648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:16.243115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:16.243557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:16.247392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:16.508699 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c03708b4-5783-4ecd-911c-0047febe1340 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281434 Oct 17 14:32:16.509976 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4023/7602] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 14:32:16 2022] POST /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:32:27.247492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:27.248047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:27.251037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:27.251703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=72 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:27.259591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:27.260070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:27.260502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:27.261212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:27.261669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:27.262093 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:27.350750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lazy-loading 'services' on Instance uuid 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:32:27.424506 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-157544a8-f475-4b75-8ab6-05f2442c3b2a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments/5d5a3f6b-6e48-4cf3-8236-e292020bcdde" status: 202 len: 0 microversion: 2.1 time: 0.180740 Oct 17 14:32:27.425108 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3580/7603] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:32:27 2022] DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments/5d5a3f6b-6e48-4cf3-8236-e292020bcdde => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:32:27.434993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:27.437436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:27.440385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:27.441082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:27.448922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:27.449499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:27.449994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:27.450752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:27.451268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:27.451750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:27.486387 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fc6da7e5-c8f7-47b1-9d6f-d59a06bb1f61 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055783 Oct 17 14:32:27.486965 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4024/7604] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:32:27 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:28.501745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:28.504140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:28.511384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:28.511894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:28.512333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:28.513050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:28.513523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:28.513941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:28.546242 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d112effa-8ee4-4a38-9cb9-8beda1e4a2d9 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049955 Oct 17 14:32:28.546825 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3581/7605] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:32:28 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:29.559457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:29.561744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:29.569575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:29.570071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:29.570532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:29.571257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:29.571731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:29.572178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:29.608953 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ebdfbdf-d914-48f8-8884-74cb43e99c23 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053529 Oct 17 14:32:29.609993 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4025/7606] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:32:29 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:30.622449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:30.624772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:30.632431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:30.633011 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:30.633855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:30.634726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:30.635260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:30.635756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:30.671252 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-29a5a72e-714b-49f1-9985-dc8f83858c54 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052842 Oct 17 14:32:30.671864 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3582/7607] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:32:30 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:31.684747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:31.687012 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:31.694273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:31.694726 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:31.695179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:31.695885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:31.696351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:31.696788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:31.728164 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3cb7a83c-3356-4776-9300-05515585b8cb tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047410 Oct 17 14:32:31.728715 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4026/7608] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:32:31 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:32.741059 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:32.743249 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:32.750151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:32.750632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:32.751063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:32.751809 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:32.752255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:32.752672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:32.782701 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-35c87bc3-877d-46dc-9488-d7ff96cad697 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045761 Oct 17 14:32:32.783258 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3583/7609] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:32:32 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:32:32.795049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:32.795583 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:32.803494 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:32.804015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:32.804579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:32.805369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:32.805849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:32.806325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:32.887754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] HTTP exception thrown: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c is not attached to volume 5d5a3f6b-6e48-4cf3-8236-e292020bcdde Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Request method failure captured: Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments/5d5a3f6b-6e48-4cf3-8236-e292020bcdde HTTP/1.1 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWc2XXbXE7mmrlMrNv0M5NuZI_kpbkC0JKI7w0VoCzP7jUOaIt2RplqQ3onRTkyNVRvt69egjbaotvdKG08XMH-wV8-I42XyyNEJHLdzFnpjaE42uUP8BAeayhBfle7qjUuZokHmSHCkm_BzaPb5x08FzX8YHlbq6KARUshJ_po0uas Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4dbfd69c23624cdf87f0b4e7c627b4e5 Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c is not attached to volume 5d5a3f6b-6e48-4cf3-8236-e292020bcdde Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': '2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c', 'id': '5d5a3f6b-6e48-4cf3-8236-e292020bcdde'} Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5d5a3f6b-6e48-4cf3-8236-e292020bcdde. Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c is not attached to volume 5d5a3f6b-6e48-4cf3-8236-e292020bcdde Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:32:32.889942 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c is not attached to volume 5d5a3f6b-6e48-4cf3-8236-e292020bcdde Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Returning 404 to user: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c is not attached to volume 5d5a3f6b-6e48-4cf3-8236-e292020bcdde {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c076650-8f60-4bf1-a7fd-acfba6851b10 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments/5d5a3f6b-6e48-4cf3-8236-e292020bcdde" status: 404 len: 154 microversion: 2.1 time: 0.101020 Oct 17 14:32:32.894628 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4027/7610] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:32:32 2022] DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c/os-volume_attachments/5d5a3f6b-6e48-4cf3-8236-e292020bcdde => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:32:36.246967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:36.247593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:36.254723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:36.255225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:36.255706 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:36.256510 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:36.257039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:36.257508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:36.286041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:32:36.368828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a96a818-32e3-4d54-ab58-fed35e9ea701 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 204 len: 0 microversion: 2.1 time: 0.125455 Oct 17 14:32:36.369801 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3584/7611] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:32:36 2022] DELETE /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:32:36.378432 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:36.379615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:36.387565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:36.388064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:36.388522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:36.389278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:36.389748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:36.390191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:36.529361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:36.538203 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-513590b5-5c8f-41fe-8b94-0e96ca80b7fe tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1560 microversion: 2.1 time: 0.163773 Oct 17 14:32:36.538718 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4028/7612] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:36 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:37.562611 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:37.563315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:37.570524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:37.571008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:37.571468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:37.572153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:37.572607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:37.573042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:37.707724 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:37.716260 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8fcca1ec-c836-4e84-8aee-b3e7174186d8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1560 microversion: 2.1 time: 0.157939 Oct 17 14:32:37.716840 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3585/7613] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:37 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:32:38.739803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:38.740698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:38.747444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.747952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.748430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.749125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.749623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.750077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.824272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:38.833039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6493aaaa-d868-472d-9c0a-210c310244c5 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 200 len: 1518 microversion: 2.1 time: 0.097278 Oct 17 14:32:38.834880 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4029/7614] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:38 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 1518 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:38.904723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-653058de-a280-4df3-890a-4ecc4803c81a req-5373244f-f0bb-4488-855a-30b3710d3beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c", "name": "network-vif-deleted", "tag": "01599de5-e603-485e-8403-078aff5e0350"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:38.917513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-653058de-a280-4df3-890a-4ecc4803c81a req-5373244f-f0bb-4488-855a-30b3710d3beb service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:38.917993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-653058de-a280-4df3-890a-4ecc4803c81a req-5373244f-f0bb-4488-855a-30b3710d3beb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:38.918419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-653058de-a280-4df3-890a-4ecc4803c81a req-5373244f-f0bb-4488-855a-30b3710d3beb service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:38.931204 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-653058de-a280-4df3-890a-4ecc4803c81a req-5373244f-f0bb-4488-855a-30b3710d3beb service nova] Creating event network-vif-deleted:01599de5-e603-485e-8403-078aff5e0350 for instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c on n-h2-854121-14 Oct 17 14:32:38.936710 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-653058de-a280-4df3-890a-4ecc4803c81a req-5373244f-f0bb-4488-855a-30b3710d3beb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035698 Oct 17 14:32:38.937677 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3586/7615] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:39.857905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:39.858519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:39.866084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:39.866578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:39.867028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:39.867731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:39.868193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:39.868630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:39.885714 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] HTTP exception thrown: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c could not be found. Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Request method failure captured: Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c HTTP/1.1 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWc2XXbXE7mmrlMrNv0M5NuZI_kpbkC0JKI7w0VoCzP7jUOaIt2RplqQ3onRTkyNVRvt69egjbaotvdKG08XMH-wV8-I42XyyNEJHLdzFnpjaE42uUP8BAeayhBfle7qjUuZokHmSHCkm_BzaPb5x08FzX8YHlbq6KARUshJ_po0uas Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4dbfd69c23624cdf87f0b4e7c627b4e5 Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c could not be found. Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c'} Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c could not be found. Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c could not be found. Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:39.887378 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c could not be found. Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Returning 404 to user: Instance 2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-46988b91-089f-4fdc-a604-5bfe50217653 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c" status: 404 len: 111 microversion: 2.1 time: 0.034808 Oct 17 14:32:39.892347 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4030/7616] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:39 2022] GET /compute/v2.1/servers/2f3a6d25-ee2c-49bf-b5e5-6b7395c52b2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:32:39.899009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41c6095d-96b1-48fb-98c7-63f85536143a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '.version_select at 0x7f41a1facc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:39.920622 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41c6095d-96b1-48fb-98c7-63f85536143a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-670689049" status: 202 len: 0 microversion: 2.1 time: 0.025943 Oct 17 14:32:39.921277 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3587/7617] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 14:32:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-670689049 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:32:39.940349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7365a5dc-febd-4664-abf0-08609b32d856 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: .version_select at 0x7f41a2068ca0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-137767603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXixVgUbPcxCvENPlDKk4q9kTZPOYG3wdo76FjAtBS/liiGUK/7yJC9sFju7PV4ThYwVU8BgcHsssWPhLGDFLbG2vluzoyzagmPi/Pk9tUnDhizGEA2xoadVMIGXzBn5A=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:39.956064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7365a5dc-febd-4664-abf0-08609b32d856 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:32:39.961621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-7365a5dc-febd-4664-abf0-08609b32d856 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for user 4dbfd69c23624cdf87f0b4e7c627b4e5 and project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:32:39.985347 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7365a5dc-febd-4664-abf0-08609b32d856 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049076 Oct 17 14:32:39.985947 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4031/7618] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:32:39 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:40.035493 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1603692803", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-137767603", "networks": [{"uuid": "3cfbe38a-cc58-4a25-8e78-ae2547a7c28e"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:40.090438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] validate_networks() for [('3cfbe38a-cc58-4a25-8e78-ae2547a7c28e', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:32:40.465462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:32:40.465898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:32:40.466384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:32:40.466805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:32:40.467224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:32:40.476785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:40.477304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:40.477746 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:40.478479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:40.478938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:40.479367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:40.497180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:32:40.502444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Getting quotas for user 4dbfd69c23624cdf87f0b4e7c627b4e5 and project 182b63325d3f444da62014bb4bfc1f6b. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:32:40.515603 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:32:40.518089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:32:40.562749 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [fc48a327-c986-49a1-8d75-720ede214e94] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:32:41.570921 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [fc48a327-c986-49a1-8d75-720ede214e94] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 56976. Oct 17 14:32:41.575034 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd29d9a7-739f-4978-9a64-9b1a1d267d74 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543533 Oct 17 14:32:41.575699 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3588/7619] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:32:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:32:41.588632 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8ef4577-dc6d-4cb6-9e12-5aad2f213bf2 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:41.589301 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8ef4577-dc6d-4cb6-9e12-5aad2f213bf2 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:41.650961 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8ef4577-dc6d-4cb6-9e12-5aad2f213bf2 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:41.658126 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8ef4577-dc6d-4cb6-9e12-5aad2f213bf2 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1262 microversion: 2.1 time: 0.075027 Oct 17 14:32:41.658712 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4032/7620] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:41 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1262 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:42.683717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:42.684343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:42.691610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:42.692504 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:42.693701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:42.694786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:42.695496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:42.696110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:42.777814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:42.786119 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-978c5b9e-7541-4529-94c0-7103bc4f8916 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1332 microversion: 2.1 time: 0.108422 Oct 17 14:32:42.787218 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3589/7621] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:42 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:43.810627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:43.811380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:43.818664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:43.819169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:43.819626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:43.820556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:43.821010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:43.821491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:44.031994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-19678433-216f-4043-8902-be0f843e42e3 req-5b623144-3f69-490b-aa29-d06713622596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb786daa-d6bc-4f86-80f7-67bd4cccc980", "tag": "5ad311b4-4a38-4d24-a807-e38eae5c0722"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:44.036380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:44.045759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-19678433-216f-4043-8902-be0f843e42e3 req-5b623144-3f69-490b-aa29-d06713622596 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:44.046238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-19678433-216f-4043-8902-be0f843e42e3 req-5b623144-3f69-490b-aa29-d06713622596 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:44.046389 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94a48688-ee46-4e22-91d9-0785f81b660e tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1362 microversion: 2.1 time: 0.239874 Oct 17 14:32:44.046883 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4033/7622] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:43 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:44.047247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-19678433-216f-4043-8902-be0f843e42e3 req-5b623144-3f69-490b-aa29-d06713622596 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:44.062975 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-19678433-216f-4043-8902-be0f843e42e3 req-5b623144-3f69-490b-aa29-d06713622596 service nova] Creating event network-changed:5ad311b4-4a38-4d24-a807-e38eae5c0722 for instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 on n-h1-854121-14 Oct 17 14:32:44.070369 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-19678433-216f-4043-8902-be0f843e42e3 req-5b623144-3f69-490b-aa29-d06713622596 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042395 Oct 17 14:32:44.071011 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3590/7623] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:45.070366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:45.070997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:45.078068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:45.078566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:45.079051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:45.079767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:45.080236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:45.080680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:45.214390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:45.222460 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbd98548-1dbd-4708-a15e-ab4a34547920 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1362 microversion: 2.1 time: 0.156062 Oct 17 14:32:45.223063 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4034/7624] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:45 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:46.247888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:46.248595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:46.254920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:46.256125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:46.256557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:46.257358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:46.257819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:46.258247 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:46.386419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:46.394309 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-099763e2-6d1f-4bee-9eb6-fe791a24c1ab tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1362 microversion: 2.1 time: 0.151537 Oct 17 14:32:46.394890 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3591/7625] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:46 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:47.417106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:47.417769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:47.424838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:47.425385 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:47.425864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:47.426559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:47.427039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:47.427524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:47.567561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:47.575997 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9abaf618-6da9-44b3-9a51-8cc930e80d82 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1362 microversion: 2.1 time: 0.162847 Oct 17 14:32:47.584354 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4035/7626] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:47 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:48.600282 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:48.600875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:48.607875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:48.608356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:48.608799 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:48.609521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:48.609996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:48.610416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:48.741057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:48.749070 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b379cd01-4c4d-4004-aa2a-086f37ca47aa tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1362 microversion: 2.1 time: 0.153436 Oct 17 14:32:48.749689 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3592/7627] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:48 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:49.321173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-63f85908-7948-4b74-8007-da80e5c5af7f req-a362b68f-1413-4668-b02f-3194946af45e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb786daa-d6bc-4f86-80f7-67bd4cccc980", "name": "network-vif-plugged", "status": "completed", "tag": "5ad311b4-4a38-4d24-a807-e38eae5c0722"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:49.333613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-63f85908-7948-4b74-8007-da80e5c5af7f req-a362b68f-1413-4668-b02f-3194946af45e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:49.334128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-63f85908-7948-4b74-8007-da80e5c5af7f req-a362b68f-1413-4668-b02f-3194946af45e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:49.334593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-63f85908-7948-4b74-8007-da80e5c5af7f req-a362b68f-1413-4668-b02f-3194946af45e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:49.346773 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-63f85908-7948-4b74-8007-da80e5c5af7f req-a362b68f-1413-4668-b02f-3194946af45e service nova] Creating event network-vif-plugged:5ad311b4-4a38-4d24-a807-e38eae5c0722 for instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 on n-h1-854121-14 Oct 17 14:32:49.351875 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-63f85908-7948-4b74-8007-da80e5c5af7f req-a362b68f-1413-4668-b02f-3194946af45e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035226 Oct 17 14:32:49.352566 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4036/7628] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:32:49.773256 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:49.773855 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:49.780974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:49.781478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:49.781911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:49.782615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:49.783061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:49.783477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:49.919624 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:49.927993 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-285feacf-432b-4a57-b44c-2dcb1d64b38f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1362 microversion: 2.1 time: 0.158385 Oct 17 14:32:49.928581 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3593/7629] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:49 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:50.953389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:50.954032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:50.960997 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:50.961533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:50.961993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:50.962712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:50.963187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:50.963637 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:51.094558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:51.102899 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1cc18546-6ff7-482b-9f60-2b28f2c7df3f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1554 microversion: 2.1 time: 0.154769 Oct 17 14:32:51.103483 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4037/7630] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:50 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:51.124941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:32:51.125586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:51.127535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:51.128391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:51.135755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:51.136234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:51.136666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:51.137414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:51.137842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:51.138260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:51.270509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:32:51.279044 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23989485-2b1e-4dd4-a47d-e504d0e7d243 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1554 microversion: 2.1 time: 0.157923 Oct 17 14:32:51.279628 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3594/7631] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:32:51 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:32:52.795098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee1378c5-4a74-4f0a-a38b-4cd075bec739"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:32:52.797521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:32:52.799529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:32:52.806256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:52.806752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:52.807197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:52.807897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:32:52.808426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:32:52.808868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:32:53.057437 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a27ec5a7-832e-44b8-b870-bbbdf7a6bc5a tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "POST /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266085 Oct 17 14:32:53.058297 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4038/7632] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 14:32:52 2022] POST /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:03.789535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:03.790099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:03.792483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:03.793334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:03.801202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:03.801692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:03.802189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:03.803524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:03.804000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:03.804434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:03.940028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lazy-loading 'services' on Instance uuid eb786daa-d6bc-4f86-80f7-67bd4cccc980 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:33:04.012823 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d533fa56-8506-43ac-bb18-b8600cd3ad47 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments/ee1378c5-4a74-4f0a-a38b-4cd075bec739" status: 202 len: 0 microversion: 2.1 time: 0.228054 Oct 17 14:33:04.013446 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3595/7633] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:33:03 2022] DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments/ee1378c5-4a74-4f0a-a38b-4cd075bec739 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:33:04.020286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:04.021492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:04.027238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:04.030123 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:04.039545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:04.040062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:04.040529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:04.041291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:04.041768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:04.042216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:04.083154 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4568e935-78ed-4eb0-89ab-f9c2fdad5622 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064466 Oct 17 14:33:04.084875 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4039/7634] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:33:04 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:05.098699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:05.101805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:05.112935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:05.113471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:05.113911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:05.114613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:05.115141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:05.115791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:05.147777 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d859e646-a50f-4b4c-be7a-569e2755c6b8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054403 Oct 17 14:33:05.148297 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3596/7635] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:33:05 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:06.160361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:06.162768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:06.170435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:06.170941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:06.171404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:06.172121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:06.172595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:06.173042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:06.204845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aae15572-684a-44d3-8df6-6989b9c64209 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048559 Oct 17 14:33:06.205466 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4040/7636] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:33:06 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:07.218449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:07.220750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:07.228454 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:07.228948 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:07.229700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:07.230420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:07.230886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:07.231326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:07.262810 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5646fab3-1144-4dab-baff-79cd3d5535e6 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048421 Oct 17 14:33:07.263400 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3597/7637] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:33:07 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:08.275627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:08.277911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:08.284517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:08.285008 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:08.285505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:08.286221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:08.286691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:08.287668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:08.319136 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fd54dfc1-733c-4e4c-917f-17db1550372d tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047972 Oct 17 14:33:08.319724 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4041/7638] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:33:08 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:09.331875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:09.334627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:09.341440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:09.341929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:09.342357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:09.343042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:09.343492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:09.343909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:09.373654 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0a6f777-97c2-4d15-8794-91f922a33434 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045836 Oct 17 14:33:09.374215 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3598/7639] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:33:09 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:33:09.386059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:09.386590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:09.393670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:09.394177 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:09.394668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:09.395387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:09.395864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:09.396413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:09.477487 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] HTTP exception thrown: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 is not attached to volume ee1378c5-4a74-4f0a-a38b-4cd075bec739 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Request method failure captured: Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments/ee1378c5-4a74-4f0a-a38b-4cd075bec739 HTTP/1.1 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWc2XXbXE7mmrlMrNv0M5NuZI_kpbkC0JKI7w0VoCzP7jUOaIt2RplqQ3onRTkyNVRvt69egjbaotvdKG08XMH-wV8-I42XyyNEJHLdzFnpjaE42uUP8BAeayhBfle7qjUuZokHmSHCkm_BzaPb5x08FzX8YHlbq6KARUshJ_po0uas Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4dbfd69c23624cdf87f0b4e7c627b4e5 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 is not attached to volume ee1378c5-4a74-4f0a-a38b-4cd075bec739 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'server_id': 'eb786daa-d6bc-4f86-80f7-67bd4cccc980', 'id': 'ee1378c5-4a74-4f0a-a38b-4cd075bec739'} Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ee1378c5-4a74-4f0a-a38b-4cd075bec739. Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 is not attached to volume ee1378c5-4a74-4f0a-a38b-4cd075bec739 Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:09.479137 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 is not attached to volume ee1378c5-4a74-4f0a-a38b-4cd075bec739 Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Returning 404 to user: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 is not attached to volume ee1378c5-4a74-4f0a-a38b-4cd075bec739 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a364fe8-de4c-4538-b611-211413ba48bd tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments/ee1378c5-4a74-4f0a-a38b-4cd075bec739" status: 404 len: 154 microversion: 2.1 time: 0.099844 Oct 17 14:33:09.483357 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4042/7640] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:33:09 2022] DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980/os-volume_attachments/ee1378c5-4a74-4f0a-a38b-4cd075bec739 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:33:12.841823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:12.842946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:12.850468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:12.850877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:12.851324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:12.852209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:12.852672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:12.853102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:12.881886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:33:12.962893 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3a3b604-553d-431e-a06f-3631bbc51eb1 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 204 len: 0 microversion: 2.1 time: 0.124901 Oct 17 14:33:12.963459 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3599/7641] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:33:12 2022] DELETE /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:33:12.973142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:12.973801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:12.981580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:12.982076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:12.982524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:12.983230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:12.983692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:12.984125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:13.124069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:13.132714 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3b335a14-068f-4f82-bc6b-f1dbb2e70d2f tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1560 microversion: 2.1 time: 0.164566 Oct 17 14:33:13.133461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4043/7642] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:12 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:14.158698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:14.159318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:14.166243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:14.166729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:14.167169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:14.167869 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:14.168325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:14.168771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:14.300797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:14.310085 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac68d40d-9491-4605-a469-99f4c0f25da8 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1560 microversion: 2.1 time: 0.155351 Oct 17 14:33:14.310673 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3600/7643] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:14 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:14.980791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b085f48f-0b60-4fd1-afd8-62ab956770b1 req-f6a87733-346e-410d-8ffc-89505888adff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb786daa-d6bc-4f86-80f7-67bd4cccc980", "name": "network-vif-deleted", "tag": "5ad311b4-4a38-4d24-a807-e38eae5c0722"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:14.993189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b085f48f-0b60-4fd1-afd8-62ab956770b1 req-f6a87733-346e-410d-8ffc-89505888adff service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:14.993772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b085f48f-0b60-4fd1-afd8-62ab956770b1 req-f6a87733-346e-410d-8ffc-89505888adff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:14.994420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b085f48f-0b60-4fd1-afd8-62ab956770b1 req-f6a87733-346e-410d-8ffc-89505888adff service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:15.010183 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b085f48f-0b60-4fd1-afd8-62ab956770b1 req-f6a87733-346e-410d-8ffc-89505888adff service nova] Creating event network-vif-deleted:5ad311b4-4a38-4d24-a807-e38eae5c0722 for instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 on n-h1-854121-14 Oct 17 14:33:15.016762 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b085f48f-0b60-4fd1-afd8-62ab956770b1 req-f6a87733-346e-410d-8ffc-89505888adff service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039691 Oct 17 14:33:15.017793 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4044/7644] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:15.333285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:15.333903 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:15.340988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:15.341524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:15.341969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:15.342665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:15.343120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:15.343555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:15.382573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:15.383062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:15.383501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:15.384212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lazy-loading 'fault' on Instance uuid eb786daa-d6bc-4f86-80f7-67bd4cccc980 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:33:15.425293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dbfd69c23624cdf87f0b4e7c627b4e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182b63325d3f444da62014bb4bfc1f6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:15.433896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-259ce1ae-fdaa-441f-a1df-d9708711638c tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 200 len: 1352 microversion: 2.1 time: 0.104443 Oct 17 14:33:15.434492 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3601/7645] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:15 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:16.460502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:16.461246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] [instance: eb786daa-d6bc-4f86-80f7-67bd4cccc980] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:16.468990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:16.469524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:16.469982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:16.470706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:16.471179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:16.471626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:16.485682 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] HTTP exception thrown: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 could not be found. Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Request method failure captured: Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 HTTP/1.1 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWc2XXbXE7mmrlMrNv0M5NuZI_kpbkC0JKI7w0VoCzP7jUOaIt2RplqQ3onRTkyNVRvt69egjbaotvdKG08XMH-wV8-I42XyyNEJHLdzFnpjaE42uUP8BAeayhBfle7qjUuZokHmSHCkm_BzaPb5x08FzX8YHlbq6KARUshJ_po0uas Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_182b63325d3f444da62014bb4bfc1f6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 182b63325d3f444da62014bb4bfc1f6b Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2055251105 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 4dbfd69c23624cdf87f0b4e7c627b4e5 Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestEncryptedCinderVolumes-2055251105-project Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 could not be found. Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'eb786daa-d6bc-4f86-80f7-67bd4cccc980'} Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 could not be found. Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 could not be found. Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:16.487382 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 could not be found. Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Returning 404 to user: Instance eb786daa-d6bc-4f86-80f7-67bd4cccc980 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ae868d55-5737-4a25-b65a-a9e2be03951b tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980" status: 404 len: 111 microversion: 2.1 time: 0.034232 Oct 17 14:33:16.493195 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4045/7646] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:16 2022] GET /compute/v2.1/servers/eb786daa-d6bc-4f86-80f7-67bd4cccc980 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:33:16.497968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a630cf16-6023-406f-8ba8-2e34019a7761 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] Calling method '.version_select at 0x7f41a20acf70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:16.518616 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a630cf16-6023-406f-8ba8-2e34019a7761 tempest-TestEncryptedCinderVolumes-2055251105 tempest-TestEncryptedCinderVolumes-2055251105-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-137767603" status: 202 len: 0 microversion: 2.1 time: 0.024368 Oct 17 14:33:16.519204 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3602/7647] 10.222.0.65 () {58 vars in 1275 bytes} [Mon Oct 17 14:33:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-137767603 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:33:44.419206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8ac50f0-7164-4e7e-b845-35b77fec3d7c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'create', calling method: .version_select at 0x7f41a1fde8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1364836299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5Mp7EW39+NoFNxt2rOOVdBHieInmx0hSnymIHPul8VYrUNXJFf0/5uVUereJEBm+r58ACMgNzk4Bu++9gj/RKm7JmbVdWxR0DJLFzLuHIRZ8Za+rab32TS+mCT0Fd6tQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:44.425113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=14 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:44.425810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=34 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:44.437900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a8ac50f0-7164-4e7e-b845-35b77fec3d7c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:33:44.447017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-a8ac50f0-7164-4e7e-b845-35b77fec3d7c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for user 1497f9ec19b74b17836f5269f51d3da4 and project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:33:44.471543 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8ac50f0-7164-4e7e-b845-35b77fec3d7c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056075 Oct 17 14:33:44.472332 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4046/7648] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:33:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:44.522119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:44.522932 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:44.527374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-691726794", "imageRef": "e75a8ca5-b34d-4874-85a9-215047dbd33f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1364836299", "networks": [{"uuid": "0bbb4f97-6993-45ad-911e-bd38657bab3c"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:44.581813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] validate_networks() for [('0bbb4f97-6993-45ad-911e-bd38657bab3c', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:33:44.968229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:33:44.968671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:33:44.969129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:33:44.969575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:33:44.969967 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:33:44.979495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:44.979968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:44.980403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:44.981120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:44.981614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:44.982034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:44.999047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:33:45.004148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for user 1497f9ec19b74b17836f5269f51d3da4 and project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:33:45.016545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:33:45.018754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e75a8ca5-b34d-4874-85a9-215047dbd33f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:33:45.064991 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-943bbd33-c1a1-4e10-ad12-cbbfd98ee643 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545690 Oct 17 14:33:45.065672 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3603/7649] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:33:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:33:45.076848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82da244f-a809-4cfc-beb2-46628de9ac4a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:45.077505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82da244f-a809-4cfc-beb2-46628de9ac4a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:45.133687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-82da244f-a809-4cfc-beb2-46628de9ac4a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:45.141238 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82da244f-a809-4cfc-beb2-46628de9ac4a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1258 microversion: 2.1 time: 0.068277 Oct 17 14:33:45.141832 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4047/7650] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:45 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:46.165245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:46.166658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:46.174262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:46.174753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:46.175301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:46.176037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:46.176668 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:46.177119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:46.248170 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:46.257227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6375d2fe-e84b-4b0b-a4a8-56092936ce93 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1318 microversion: 2.1 time: 0.096855 Oct 17 14:33:46.257835 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3604/7651] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:46 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:47.282510 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:47.283918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:47.297104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:47.300367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:47.300882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:47.301708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:47.302194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:47.302768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:47.476107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:47.484922 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-039c248b-67df-4b9b-b289-fed9f8b9afd7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.206466 Oct 17 14:33:47.497849 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4048/7652] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:47 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:48.511005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:48.511614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:48.520235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:48.520868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:48.522427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:48.523481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:48.524071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:48.524613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:48.671802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:48.692787 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bae13af1-9bad-436a-9e82-66aff3cec908 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.185690 Oct 17 14:33:48.694877 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3605/7653] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:48 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:33:49.717651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:49.718206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:49.729750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:49.730271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:49.730733 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:49.731469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:49.731946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:49.732395 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:49.878041 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:49.887592 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4b5d717-9b79-452d-8790-b2cf2f4bcfa0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.174353 Oct 17 14:33:49.888508 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4049/7654] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:49 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:50.911405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:50.912532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:50.919438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:50.919928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:50.920366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:50.921060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:50.921540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:50.921968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:51.077693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:51.086995 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c02d9682-567e-4c8d-ab9b-0a48f6f4efdc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.179547 Oct 17 14:33:51.087973 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3606/7655] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:50 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:52.111944 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:52.113664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:52.123552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:52.124474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:52.125255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:52.126259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:52.126810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:52.127262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:52.282785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:52.291587 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc906c1e-328d-4399-be62-9558a728b357 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.184479 Oct 17 14:33:52.292181 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4050/7656] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:52 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:53.315449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:53.316067 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:53.323745 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:53.324236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:53.324680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:53.325490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:53.325965 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:53.326377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:53.471049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:53.480128 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0d935cd-23e6-4930-9652-f886c7d2d112 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.168490 Oct 17 14:33:53.492128 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3607/7657] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:53 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:54.507716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:54.508340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:54.515853 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.516360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.516820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.517559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:54.518036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:54.518484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:54.651581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:54.659326 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7612cf78-727e-4d6d-85f9-5b5ba0ffff9c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.156338 Oct 17 14:33:54.659899 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4051/7658] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:54 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:55.683825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:55.684446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:55.686787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:55.687450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:55.693122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:55.693837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:55.694284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:55.694976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:55.695424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:55.695847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:55.828775 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:55.837297 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d53d910-9fc0-452a-97da-e6c1ec284dcb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.157462 Oct 17 14:33:55.837878 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3608/7659] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:55 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:56.860943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:56.861586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:56.863473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:33:56.870719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:56.871260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:56.871722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:56.872452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:56.872994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:56.873481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:57.011655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:57.019726 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29861df0-7f94-4e19-b440-8b1ea06d6beb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.162692 Oct 17 14:33:57.020314 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4052/7660] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:56 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:58.043902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:58.044521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:58.051334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:58.051815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:58.052803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:58.053701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:58.054156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:58.054576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:58.191250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:58.200684 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-218642e5-e1d9-4aab-9e41-b196db6e5a61 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.160594 Oct 17 14:33:58.201336 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3609/7661] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:58 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:33:58.887760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9400851a-dd7a-4af4-856c-cdf60abd23fe req-40e4a17e-6840-4d1d-aeb2-ecf32730318f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:33:58.901107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9400851a-dd7a-4af4-856c-cdf60abd23fe req-40e4a17e-6840-4d1d-aeb2-ecf32730318f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:58.902882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9400851a-dd7a-4af4-856c-cdf60abd23fe req-40e4a17e-6840-4d1d-aeb2-ecf32730318f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:58.903430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9400851a-dd7a-4af4-856c-cdf60abd23fe req-40e4a17e-6840-4d1d-aeb2-ecf32730318f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:58.915950 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9400851a-dd7a-4af4-856c-cdf60abd23fe req-40e4a17e-6840-4d1d-aeb2-ecf32730318f service nova] Creating event network-changed:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:33:58.921050 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9400851a-dd7a-4af4-856c-cdf60abd23fe req-40e4a17e-6840-4d1d-aeb2-ecf32730318f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043892 Oct 17 14:33:58.922587 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4053/7662] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:33:59.223874 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:33:59.224875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:33:59.231832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:59.232327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:59.232772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:59.233517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:33:59.233974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:33:59.234406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:33:59.400428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:33:59.408272 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b63c55a-40ff-452a-8f3f-0e654f12364f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.188573 Oct 17 14:33:59.408843 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3610/7663] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:33:59 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:00.433722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:00.434581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:00.440868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:00.441416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:00.441883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:00.442600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:00.443970 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:00.444454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:00.575574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:00.583435 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f1f6e59d-cf55-45e7-b722-926576f85265 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.155101 Oct 17 14:34:00.584106 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4054/7664] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:00 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:01.606239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:01.606834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:01.614423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.615097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.615495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.616237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:01.616689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:01.617106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:01.843403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:01.851828 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-336a9411-5a90-4522-9ed7-d9b80c9f38a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.249390 Oct 17 14:34:01.852443 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3611/7665] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:01 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:02.876056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:02.876876 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:02.885184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:02.885695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:02.886153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:02.886892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:02.888468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:02.888468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:03.027428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:03.035482 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-52ee0ba5-9cdd-448b-ba06-7d69f5e5e972 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.163786 Oct 17 14:34:03.036061 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4055/7666] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:02 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:04.057992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:04.058619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:04.065676 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.066169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.066613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.067321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:04.068411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:04.068845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:04.208803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:04.216849 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-772332a2-8cdd-415f-992c-c919e819ee7b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.162817 Oct 17 14:34:04.217455 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3612/7667] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:04 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:05.240873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:05.241554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:05.248707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:05.249238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:05.249703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:05.250425 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:05.250998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:05.251354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:05.384396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:05.392265 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-47e2527b-22cf-41f3-81ef-9e24684164e0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.156178 Oct 17 14:34:05.392932 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4056/7668] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:05 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:06.147155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2ae73617-8895-4829-9c66-aa9b1fb7c340 req-3235a00f-7efc-4df1-9a68-ef2cb6a53d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "name": "network-vif-plugged", "status": "completed", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:06.160375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2ae73617-8895-4829-9c66-aa9b1fb7c340 req-3235a00f-7efc-4df1-9a68-ef2cb6a53d68 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:06.160897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2ae73617-8895-4829-9c66-aa9b1fb7c340 req-3235a00f-7efc-4df1-9a68-ef2cb6a53d68 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:06.161358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2ae73617-8895-4829-9c66-aa9b1fb7c340 req-3235a00f-7efc-4df1-9a68-ef2cb6a53d68 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:06.173313 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2ae73617-8895-4829-9c66-aa9b1fb7c340 req-3235a00f-7efc-4df1-9a68-ef2cb6a53d68 service nova] Creating event network-vif-plugged:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:34:06.178607 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2ae73617-8895-4829-9c66-aa9b1fb7c340 req-3235a00f-7efc-4df1-9a68-ef2cb6a53d68 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036189 Oct 17 14:34:06.179219 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3613/7669] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:06.415038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:06.415669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:06.422590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:06.423086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:06.423545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:06.424258 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:06.424729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:06.425185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:06.558229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:06.566119 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6986c560-3b55-469f-ba60-4abc9fd9b77c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.155020 Oct 17 14:34:06.566640 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4057/7670] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:06 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:07.591764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:07.592488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:07.601964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.602461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.602908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.603612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:07.604074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:07.604526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:07.736027 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:07.744739 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c5c4a7a-5280-4d0b-8461-14202682c978 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1358 microversion: 2.1 time: 0.158425 Oct 17 14:34:07.745342 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3614/7671] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:07 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:08.768221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:08.768878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:08.776263 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:08.777030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:08.777367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:08.778083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:08.778664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:08.779115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:08.915417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:08.923458 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59a32569-1861-429a-8c73-ba0776618e68 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1547 microversion: 2.1 time: 0.159362 Oct 17 14:34:08.924051 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4058/7672] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:08 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:08.946637 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:08.947258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:08.954199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:08.954693 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:08.955137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:08.955868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:08.956324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:08.956757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.094575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:09.102785 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-51b2f752-ab8e-43a8-bca3-ce5667fdeea3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1547 microversion: 2.1 time: 0.160978 Oct 17 14:34:09.103374 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3615/7673] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:08 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1547 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:09.124956 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:09.129784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:09.131346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Searching by: {'deleted': False, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 14:34:09.136937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:09.137466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:09.137942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.138678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:09.139146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:09.139586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.165412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 14:34:09.193216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-84fe93f5-cdf6-4535-b79a-0ef6eba93d43 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071607 Oct 17 14:34:09.194082 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4059/7674] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 14:34:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:09.205641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:09.206251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:09.213196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:09.213681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:09.214114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.214797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:09.215241 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:09.215659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:09.345521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:09.353573 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9bf3121-5d62-4b98-8fb9-7179ffb179a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1547 microversion: 2.1 time: 0.151710 Oct 17 14:34:09.354146 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3616/7675] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:09 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:10.905268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffb655df-ace8-4986-a584-1718f5a348af"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:10.907686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:10.915262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:10.915800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:10.916266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:10.916988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:10.917493 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:10.917945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:11.188072 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf6b2f10-c187-45c0-88e3-10836466414c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286855 Oct 17 14:34:11.188784 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4060/7676] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 14:34:10 2022] POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:24.257823 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:24.258420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:24.261414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:24.262069 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=76 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:24.268034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:24.268517 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:24.268949 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:24.269670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:24.270122 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:24.270543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:24.404032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:24.412365 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-469b7e6b-469f-4a9d-9e98-7b7011b7bde0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1593 microversion: 2.1 time: 0.158983 Oct 17 14:34:24.412933 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3617/7677] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:24 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1593 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:26.419932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:26.420735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:26.421595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:34:26.425835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-461a37f4-b830-479a-890d-0f3c320b0f86 req-2825a95c-dead-4f44-8417-520b4750b555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:26.440231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-461a37f4-b830-479a-890d-0f3c320b0f86 req-2825a95c-dead-4f44-8417-520b4750b555 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:26.440769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-461a37f4-b830-479a-890d-0f3c320b0f86 req-2825a95c-dead-4f44-8417-520b4750b555 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:26.441315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-461a37f4-b830-479a-890d-0f3c320b0f86 req-2825a95c-dead-4f44-8417-520b4750b555 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:26.454466 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-461a37f4-b830-479a-890d-0f3c320b0f86 req-2825a95c-dead-4f44-8417-520b4750b555 service nova] Creating event network-changed:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:34:26.460103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-461a37f4-b830-479a-890d-0f3c320b0f86 req-2825a95c-dead-4f44-8417-520b4750b555 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041865 Oct 17 14:34:26.460882 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4061/7678] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:34:27.708353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-552238501"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:27.709192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:27.716239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:27.716727 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:27.717215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:27.717891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:27.718350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:27.718779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:27.946221 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Adding security group 6203e88e-f334-4d87-b69b-15bc1fb9fc5e to port bd16bb8f-4cef-4c57-a4d4-6102f757a258 Oct 17 14:34:28.296772 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2ab9d3e-b61d-4927-bbd7-e941f78cec92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action" status: 202 len: 0 microversion: 2.1 time: 0.592395 Oct 17 14:34:28.297426 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3618/7679] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:34:27 2022] POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:34:28.307456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:34:28.308184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:34:28.315084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:28.316674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:28.317139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:28.318080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:28.318577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:28.319195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:28.477060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-67404fdc-8cc7-4c4e-9acc-27091fe739e5 req-6ba2aa3c-43c1-40bf-8ce8-5f813968dcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:34:28.499497 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-67404fdc-8cc7-4c4e-9acc-27091fe739e5 req-6ba2aa3c-43c1-40bf-8ce8-5f813968dcf4 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:34:28.499900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-67404fdc-8cc7-4c4e-9acc-27091fe739e5 req-6ba2aa3c-43c1-40bf-8ce8-5f813968dcf4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:34:28.500345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-67404fdc-8cc7-4c4e-9acc-27091fe739e5 req-6ba2aa3c-43c1-40bf-8ce8-5f813968dcf4 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:34:28.511878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:34:28.525120 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99eb2032-65cf-4810-9830-408367b8ea53 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1758 microversion: 2.1 time: 0.222930 Oct 17 14:34:28.526547 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-67404fdc-8cc7-4c4e-9acc-27091fe739e5 req-6ba2aa3c-43c1-40bf-8ce8-5f813968dcf4 service nova] Creating event network-changed:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:34:28.534578 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4062/7680] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:34:28 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1758 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:34:28.544351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-67404fdc-8cc7-4c4e-9acc-27091fe739e5 req-6ba2aa3c-43c1-40bf-8ce8-5f813968dcf4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070224 Oct 17 14:34:28.547207 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3619/7681] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:36:49.540124 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:36:49.541087 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:36:49.541619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:49.542392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:49.543475 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:36:49.543620 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action (ip 10.222.0.65) !!! Oct 17 14:36:49.545074 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:36:49.545273 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action (ip 10.222.0.65) !!! Oct 17 14:36:49.549488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:36:49.551873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:49.563530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:49.564035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:49.564492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:49.565250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:49.565727 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:49.566176 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:49.641146 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48112b90-b87e-4315-9f24-3f92e311f32a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action" status: 202 len: 0 microversion: 2.1 time: 0.103497 Oct 17 14:36:49.641881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4063/7682] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:36:49 2022] POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:36:49.651882 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:36:49.652444 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:36:49.652781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:49.653642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:36:49.655713 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:36:49.655713 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 (ip 10.222.0.65) !!! Oct 17 14:36:49.658342 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:36:49.658499 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 (ip 10.222.0.65) !!! Oct 17 14:36:49.677646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:49.678360 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:49.686525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:49.687046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:49.687496 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:49.688271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:49.688725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:49.689190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:49.930730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:49.939201 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff306306-6801-4f68-be8b-4d5479653686 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1760 microversion: 2.1 time: 0.290479 Oct 17 14:36:49.939792 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3620/7683] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:49 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1760 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:36:50.967936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:36:50.968656 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:36:50.981288 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:50.981795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:50.982253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:50.983045 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:36:50.983515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:36:50.983959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:36:50.985782 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57512. Oct 17 14:36:50.993252 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57510. Oct 17 14:36:51.260120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:36:51.268844 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b505ab64-576b-452e-866f-c7cac0c6afdb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1758 microversion: 2.1 time: 0.308262 Oct 17 14:36:51.269461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4064/7684] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:36:50 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1758 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:35.999594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:36.000347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:36.002047 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:38:36.002281 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action (ip 10.222.0.65) !!! Oct 17 14:38:36.015057 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57544. Oct 17 14:38:36.015994 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57546. Oct 17 14:38:36.054368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-552238501"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:36.054938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:36.061933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:36.062414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:36.062850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:36.063542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:36.063996 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:36.064421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:36.248182 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Removing security group 6203e88e-f334-4d87-b69b-15bc1fb9fc5e from port bd16bb8f-4cef-4c57-a4d4-6102f757a258 Oct 17 14:38:36.554069 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8c2231c-ece0-4261-bd31-36e514ae0cbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action" status: 202 len: 0 microversion: 2.1 time: 0.562588 Oct 17 14:38:36.554869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3621/7685] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:38:35 2022] POST /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:38:36.561756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:36.562577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:36.669503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c26d9a35-8691-4909-9d1b-1a50252ba920 req-35ff4b88-d54f-4d8f-b332-fc74750d3750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:36.679439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c26d9a35-8691-4909-9d1b-1a50252ba920 req-35ff4b88-d54f-4d8f-b332-fc74750d3750 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:36.679950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c26d9a35-8691-4909-9d1b-1a50252ba920 req-35ff4b88-d54f-4d8f-b332-fc74750d3750 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:36.680941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c26d9a35-8691-4909-9d1b-1a50252ba920 req-35ff4b88-d54f-4d8f-b332-fc74750d3750 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:36.692975 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c26d9a35-8691-4909-9d1b-1a50252ba920 req-35ff4b88-d54f-4d8f-b332-fc74750d3750 service nova] Creating event network-changed:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:38:36.699095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c26d9a35-8691-4909-9d1b-1a50252ba920 req-35ff4b88-d54f-4d8f-b332-fc74750d3750 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140275 Oct 17 14:38:36.699951 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4065/7686] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:38:38.020316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:38.020838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:38.027126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:38.027616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:38.028055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:38.028757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:38.029232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:38.029663 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:38.113481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lazy-loading 'services' on Instance uuid 6b10f816-e38a-4aee-bc01-b38ed2fa2896 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:38:38.191013 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ecdbf7f-9289-4dbf-8976-ceddde6f3411 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments/ffb655df-ace8-4986-a584-1718f5a348af" status: 202 len: 0 microversion: 2.1 time: 0.175326 Oct 17 14:38:38.191647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3622/7687] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:38:38 2022] DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments/ffb655df-ace8-4986-a584-1718f5a348af => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:38:38.202097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:38.204636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:38.212613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:38.213119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:38.213807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:38.214812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:38.215452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:38.216231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:38.251507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f99cf861-7508-4ae9-bf43-679049bf0f60 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054002 Oct 17 14:38:38.252095 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4066/7688] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:38:38 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:38:38.714716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a0df9bfd-2bb6-44ee-8bf1-a20b3617a651 req-83cda5b3-43b0-4ee2-820e-a4905f5e1e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:38.724607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a0df9bfd-2bb6-44ee-8bf1-a20b3617a651 req-83cda5b3-43b0-4ee2-820e-a4905f5e1e06 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:38.725084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a0df9bfd-2bb6-44ee-8bf1-a20b3617a651 req-83cda5b3-43b0-4ee2-820e-a4905f5e1e06 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:38.726203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a0df9bfd-2bb6-44ee-8bf1-a20b3617a651 req-83cda5b3-43b0-4ee2-820e-a4905f5e1e06 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:38.740179 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a0df9bfd-2bb6-44ee-8bf1-a20b3617a651 req-83cda5b3-43b0-4ee2-820e-a4905f5e1e06 service nova] Creating event network-changed:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:38:38.747111 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a0df9bfd-2bb6-44ee-8bf1-a20b3617a651 req-83cda5b3-43b0-4ee2-820e-a4905f5e1e06 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036531 Oct 17 14:38:38.747898 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3623/7689] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:39.264717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:39.266957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:39.275071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:39.275577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:39.276035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:39.276856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:39.277367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:39.277808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:39.310188 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-12b4c66e-2517-45c1-8787-fb8eeee47f82 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049892 Oct 17 14:38:39.310755 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4067/7690] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:38:39 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:40.323700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:40.326129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:40.332958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:40.333466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:40.333910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:40.334614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:40.335183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:40.335619 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:40.368109 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58cd84dd-905b-4e0a-87a8-12ddb8abde07 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048778 Oct 17 14:38:40.368109 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3624/7691] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:38:40 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:41.381019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:41.383466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:41.390995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:41.391492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:41.391957 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:41.392672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:41.393150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:41.393611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:41.424631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4dcc7b12-4a6e-44f2-a29c-725bc534b7f5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047696 Oct 17 14:38:41.425225 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4068/7692] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:38:41 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:42.437748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:42.439884 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:42.447434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:42.447914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:42.448348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:42.449038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:42.449526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:42.449945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:42.481073 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80a5d0a6-8668-4c9b-9bf3-a4adb5efccbf tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047406 Oct 17 14:38:42.481668 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3625/7693] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:38:42 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:43.494011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:43.496253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:43.503193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:43.503690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:43.504142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:43.504858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:43.505353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:43.505794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:43.538116 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5868558-a269-48df-9437-0f88af28debb tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048630 Oct 17 14:38:43.538697 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4069/7694] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:38:43 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:38:43.550203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:43.550713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:43.558233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:43.558716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:43.559169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:43.559847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:43.560302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:43.560825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:43.638237 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] HTTP exception thrown: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 is not attached to volume ffb655df-ace8-4986-a584-1718f5a348af Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Request method failure captured: Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments/ffb655df-ace8-4986-a584-1718f5a348af HTTP/1.1 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWe5L7vIeCC8FO97eVoREMkZsQflrwfrhkU_aCdu036bPMsc7-3VfewRuAwBLd6euu_hIX3I7FxF3ftUvQzr_f55tq_qLBfUnnF3jtTpGUm2IOOpzq7jvunydj4-O0Hlh6Q5RVT4vo929hPds5AIrAE-vCiqTfALVgf1rmJWcqlL0t4 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1497f9ec19b74b17836f5269f51d3da4 Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 is not attached to volume ffb655df-ace8-4986-a584-1718f5a348af Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': '6b10f816-e38a-4aee-bc01-b38ed2fa2896', 'id': 'ffb655df-ace8-4986-a584-1718f5a348af'} Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ffb655df-ace8-4986-a584-1718f5a348af. Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 is not attached to volume ffb655df-ace8-4986-a584-1718f5a348af Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:43.639872 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 is not attached to volume ffb655df-ace8-4986-a584-1718f5a348af Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Returning 404 to user: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 is not attached to volume ffb655df-ace8-4986-a584-1718f5a348af {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb2ece94-c5b3-47e2-a9d0-a1772cb0e03d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments/ffb655df-ace8-4986-a584-1718f5a348af" status: 404 len: 154 microversion: 2.1 time: 0.095277 Oct 17 14:38:43.644677 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3626/7695] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:38:43 2022] DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896/os-volume_attachments/ffb655df-ace8-4986-a584-1718f5a348af => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:38:46.912081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:46.912575 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:46.919657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:46.920150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:46.920608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:46.921339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:46.921805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:46.922243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:46.948321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:38:47.032034 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4aa98204-6efa-4e45-a6f4-0796ce41db15 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 204 len: 0 microversion: 2.1 time: 0.123490 Oct 17 14:38:47.036683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4070/7696] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:38:46 2022] DELETE /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:38:47.041675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:47.042295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:47.050319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:47.050808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:47.051244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:47.051941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:47.052390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:47.052840 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:47.195077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:47.205313 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50b5dbe5-b7c0-4de1-b7b9-e6dcc71e6c0c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1553 microversion: 2.1 time: 0.167618 Oct 17 14:38:47.206166 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3627/7697] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:47 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:38:48.230995 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:48.231716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:48.239559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:48.240068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:48.240519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:48.241266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:48.241753 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:48.242189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:48.371689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:48.380149 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e34785f-cdbf-4fac-a36a-db728fc0cf17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1553 microversion: 2.1 time: 0.153531 Oct 17 14:38:48.380732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4071/7698] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:48 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:49.404927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:49.405571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:49.412450 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:49.412930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:49.413393 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:49.414131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:49.415141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:49.415558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:49.495337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8e4ea3e5-8ba1-4636-9bb4-8c1f05a0a05c req-4c5ba8be-ff6b-4964-81a7-273bb604b93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b10f816-e38a-4aee-bc01-b38ed2fa2896", "name": "network-vif-deleted", "tag": "bd16bb8f-4cef-4c57-a4d4-6102f757a258"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:49.506905 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e4ea3e5-8ba1-4636-9bb4-8c1f05a0a05c req-4c5ba8be-ff6b-4964-81a7-273bb604b93d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:49.507300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e4ea3e5-8ba1-4636-9bb4-8c1f05a0a05c req-4c5ba8be-ff6b-4964-81a7-273bb604b93d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:49.508148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8e4ea3e5-8ba1-4636-9bb4-8c1f05a0a05c req-4c5ba8be-ff6b-4964-81a7-273bb604b93d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:49.510867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:38:49.520745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd940514-2785-4975-8f71-7d4f4c4a5596 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 200 len: 1511 microversion: 2.1 time: 0.119691 Oct 17 14:38:49.521770 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3628/7699] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:49 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:38:49.528186 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8e4ea3e5-8ba1-4636-9bb4-8c1f05a0a05c req-4c5ba8be-ff6b-4964-81a7-273bb604b93d service nova] Creating event network-vif-deleted:bd16bb8f-4cef-4c57-a4d4-6102f757a258 for instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 on n-h2-854121-14 Oct 17 14:38:49.535156 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8e4ea3e5-8ba1-4636-9bb4-8c1f05a0a05c req-4c5ba8be-ff6b-4964-81a7-273bb604b93d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044035 Oct 17 14:38:49.535801 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4072/7700] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:38:50.546907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:50.547565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: 6b10f816-e38a-4aee-bc01-b38ed2fa2896] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:38:50.554460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:50.554947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:50.555389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:50.556968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:38:50.557457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:38:50.557890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:38:50.571683 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] HTTP exception thrown: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 could not be found. Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Request method failure captured: Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 HTTP/1.1 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWe5L7vIeCC8FO97eVoREMkZsQflrwfrhkU_aCdu036bPMsc7-3VfewRuAwBLd6euu_hIX3I7FxF3ftUvQzr_f55tq_qLBfUnnF3jtTpGUm2IOOpzq7jvunydj4-O0Hlh6Q5RVT4vo929hPds5AIrAE-vCiqTfALVgf1rmJWcqlL0t4 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1497f9ec19b74b17836f5269f51d3da4 Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 could not be found. Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '6b10f816-e38a-4aee-bc01-b38ed2fa2896'} Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 could not be found. Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 could not be found. Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:38:50.573258 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 could not be found. Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Returning 404 to user: Instance 6b10f816-e38a-4aee-bc01-b38ed2fa2896 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bccc2466-e8ad-4908-9d92-e555f88e66a0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896" status: 404 len: 111 microversion: 2.1 time: 0.031805 Oct 17 14:38:50.578648 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3629/7701] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:38:50 2022] GET /compute/v2.1/servers/6b10f816-e38a-4aee-bc01-b38ed2fa2896 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:38:50.584896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92dfbca8-6a3f-4416-a69a-1413d5f961dd tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '.version_select at 0x7f419cc29af0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:38:50.608304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92dfbca8-6a3f-4416-a69a-1413d5f961dd tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1364836299" status: 202 len: 0 microversion: 2.1 time: 0.028389 Oct 17 14:38:50.608910 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4073/7702] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 14:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1364836299 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:38:59.875615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2e8b11d9-d774-4ee0-85d3-9b5edc82cca5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'create', calling method: .version_select at 0x7f419ce5b160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1721809345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKU6EOqR/sGE+XeUCa+WYoYLxbE9vRt6/lgau3jbGb6rPB8SW2kfgFcg8kmsNJOYmm/4myGCXqKwGIrlM4YhaNz46GvsuvxIW/ob52ZFamnGshiQtT+oFRted7JbCOeigA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:38:59.894653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2e8b11d9-d774-4ee0-85d3-9b5edc82cca5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:38:59.900026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-2e8b11d9-d774-4ee0-85d3-9b5edc82cca5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for user 1497f9ec19b74b17836f5269f51d3da4 and project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:38:59.928960 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2e8b11d9-d774-4ee0-85d3-9b5edc82cca5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057198 Oct 17 14:38:59.929596 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3630/7703] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:38:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:38:59.979179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:38:59.984931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1071826196", "imageRef": "26ce7be7-444a-4c62-adc6-5812663823ba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1721809345", "networks": [{"uuid": "0bbb4f97-6993-45ad-911e-bd38657bab3c"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:00.038675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] validate_networks() for [('0bbb4f97-6993-45ad-911e-bd38657bab3c', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:39:00.770246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:39:00.770688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:39:00.771175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:39:00.771601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:39:00.772027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:39:00.781329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:00.781820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:00.782266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:00.783005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:00.783468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:00.783902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:00.805152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:39:00.811016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Getting quotas for user 1497f9ec19b74b17836f5269f51d3da4 and project 151ce9bd25ce48e0a2631ed5a8719670. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:39:00.825197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:39:00.827744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='26ce7be7-444a-4c62-adc6-5812663823ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:39:00.876438 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd12f03b-50ca-4b4a-b4fe-f7233765a8c5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899266 Oct 17 14:39:00.877502 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4074/7704] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:38:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:39:00.885757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:00.891767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4e3506f4-ee7d-445f-aa62-76ea6c95fda3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:00.892323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4e3506f4-ee7d-445f-aa62-76ea6c95fda3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:00.949463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4e3506f4-ee7d-445f-aa62-76ea6c95fda3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:00.956698 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4e3506f4-ee7d-445f-aa62-76ea6c95fda3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1259 microversion: 2.1 time: 0.071849 Oct 17 14:39:00.957356 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3631/7705] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:00 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:01.981193 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:01.981988 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:01.988497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:01.989237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:01.989612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:01.990502 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:01.991022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:01.991551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:02.078761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:02.086867 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-277ade27-73bc-46e1-8875-16f362ae869d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1329 microversion: 2.1 time: 0.110718 Oct 17 14:39:02.087533 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4075/7706] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:01 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1329 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:03.110612 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:03.111946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:03.124283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:03.125244 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:03.125703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:03.126502 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:03.127245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:03.127876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:03.290585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:03.298664 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5c5e436c-f540-445b-923c-3cc6efb6e709 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.192205 Oct 17 14:39:03.299252 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3632/7707] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:03 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:04.323474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:04.324110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:04.331063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:04.331567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:04.332027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:04.332742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:04.333254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:04.333705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:04.475740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:04.484995 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6b02d9d-26dd-43ac-9918-08537f1fb237 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.165904 Oct 17 14:39:04.485461 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4076/7708] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:04 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:05.507927 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:05.508616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:05.515641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:05.516126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:05.516568 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:05.517289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:05.517749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:05.518177 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:05.659176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:05.674400 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-82c6fe3d-e711-4f4e-8578-b1b92b1af394 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.170322 Oct 17 14:39:05.675369 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3633/7709] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:05 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:06.698714 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:06.700127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:06.703524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:06.709962 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:06.710470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:06.710925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:06.711697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:06.712479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:06.712804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:06.857914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:06.866570 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1cb81f7-fff3-4067-a35e-716921dc22f3 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.172141 Oct 17 14:39:06.867561 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4077/7710] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:06 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:07.890988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:07.892134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:07.893525 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:07.899258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:07.899758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:07.900202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:07.900939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:07.901431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:07.901863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:08.050097 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:08.060112 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e9b9860-036f-423d-82a9-e872af0b7776 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.173689 Oct 17 14:39:08.060708 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3634/7711] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:07 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:09.084451 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:09.085229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:09.105602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:09.106133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:09.106596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:09.107342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:09.107818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:09.108275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:09.249767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:09.259213 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c92aec52-b1ee-4273-9f30-40bd2dbc645d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.178430 Oct 17 14:39:09.260014 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4078/7712] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:09 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:39:10.283990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:10.284642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:10.293395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:10.294235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:10.295870 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:10.296617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:10.297074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:10.297537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:10.431607 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:10.439558 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be76970d-d58e-45e0-a081-cd7b01eea3db tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.159569 Oct 17 14:39:10.440148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3635/7713] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:10 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:11.404195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5360e90c-2c73-4c8c-bc85-ac86b65b6387 req-b131282a-3eb8-4b4e-8625-1514807a5979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:11.414270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:11.415067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:11.418715 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5360e90c-2c73-4c8c-bc85-ac86b65b6387 req-b131282a-3eb8-4b4e-8625-1514807a5979 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:11.419275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5360e90c-2c73-4c8c-bc85-ac86b65b6387 req-b131282a-3eb8-4b4e-8625-1514807a5979 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:11.419805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5360e90c-2c73-4c8c-bc85-ac86b65b6387 req-b131282a-3eb8-4b4e-8625-1514807a5979 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:11.432598 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5360e90c-2c73-4c8c-bc85-ac86b65b6387 req-b131282a-3eb8-4b4e-8625-1514807a5979 service nova] Creating event network-changed:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:39:11.437700 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5360e90c-2c73-4c8c-bc85-ac86b65b6387 req-b131282a-3eb8-4b4e-8625-1514807a5979 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038334 Oct 17 14:39:11.438319 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4079/7714] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:11.463331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:11.464032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:11.466026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:11.473085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:11.473758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:11.474215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:11.474935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:11.475389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:11.475820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:11.702033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:11.709978 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4fd97884-80f3-4f4b-9de3-673e467568e2 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.251145 Oct 17 14:39:11.710557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3636/7715] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:11 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:12.735974 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:12.736702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:12.743300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:12.743812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:12.745276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:12.746037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:12.746563 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:12.747017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:12.973918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:12.982621 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1d379231-d628-401b-9abb-fe6c5d0bcf50 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.252070 Oct 17 14:39:12.983208 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4080/7716] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:12 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:39:14.005503 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:14.006150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:14.013956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:14.014447 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:14.014890 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:14.015585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:14.016043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:14.016474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:14.149606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:14.158370 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f66ed64-79d7-4482-858c-7becf8a5d98d tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.157093 Oct 17 14:39:14.158948 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3637/7717] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:14 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:15.181391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:15.182106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:15.189275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:15.189789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:15.190249 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:15.190972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:15.191437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:15.191877 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:15.333429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:15.341438 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7b271edb-91be-4cc0-ae85-b98abb0b02b5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.163965 Oct 17 14:39:15.342040 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4081/7718] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:15 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:16.364634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:16.365316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:16.372974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:16.373487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:16.373935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:16.374631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:16.375089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:16.375514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:16.508980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:16.517491 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca23dd14-5eda-4c94-8633-d05b9ba63759 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.157033 Oct 17 14:39:16.518076 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3638/7719] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:16 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:39:17.399285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f7309d4e-bf8f-4f24-88b8-b39644bdf4ba req-c31da21b-3a18-4698-9891-342a90bc4ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "name": "network-vif-plugged", "status": "completed", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:17.409766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f7309d4e-bf8f-4f24-88b8-b39644bdf4ba req-c31da21b-3a18-4698-9891-342a90bc4ee7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:17.410272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f7309d4e-bf8f-4f24-88b8-b39644bdf4ba req-c31da21b-3a18-4698-9891-342a90bc4ee7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:17.410722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f7309d4e-bf8f-4f24-88b8-b39644bdf4ba req-c31da21b-3a18-4698-9891-342a90bc4ee7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:17.423267 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f7309d4e-bf8f-4f24-88b8-b39644bdf4ba req-c31da21b-3a18-4698-9891-342a90bc4ee7 service nova] Creating event network-vif-plugged:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:39:17.428528 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f7309d4e-bf8f-4f24-88b8-b39644bdf4ba req-c31da21b-3a18-4698-9891-342a90bc4ee7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088301 Oct 17 14:39:17.429153 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4082/7720] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:17.539989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:17.540590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:17.548286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:17.548766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:17.549214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:17.549908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:17.550354 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:17.550770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:17.687130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:17.695116 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84fc0179-eec7-4cc0-b72b-84d3f9d715ec tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1359 microversion: 2.1 time: 0.158969 Oct 17 14:39:17.695707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3639/7721] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:17 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:18.723356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:18.724118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:18.731276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:18.731793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:18.732224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:18.732937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:18.733629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:18.734125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:18.869764 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:18.877565 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f47b36e1-0258-46a0-aafa-9c6f6f33028b tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1549 microversion: 2.1 time: 0.159743 Oct 17 14:39:18.878136 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4083/7722] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:18 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:18.901317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:18.901998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:18.908933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:18.909446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:18.909882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:18.910581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:18.911018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:18.911442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.048063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:19.056041 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-246321b5-1b17-4c3e-9299-b132003ecaf9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1549 microversion: 2.1 time: 0.159574 Oct 17 14:39:19.056619 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3640/7723] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:18 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:19.077869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:19.082697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:19.083503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Searching by: {'deleted': False, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 17 14:39:19.089676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:19.090178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:19.090634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.091377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:19.091848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:19.092292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.117124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 17 14:39:19.145012 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3f3f051-5d96-43cb-9d23-1718d9afa01a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070961 Oct 17 14:39:19.145643 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4084/7724] 10.222.0.65 () {58 vars in 1125 bytes} [Mon Oct 17 14:39:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:19.158018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:19.158571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:19.164709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:19.165231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:19.166358 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.167004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:19.167453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:19.167879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:19.297153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:19.304967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec509e08-44da-4f93-9552-be2412a7387a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1549 microversion: 2.1 time: 0.150978 Oct 17 14:39:19.305604 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3641/7725] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:19 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:20.834152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b0ed6a-8156-4e4d-952e-bd42034d982c"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:20.836566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:20.844646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:20.845137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:20.845617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:20.846329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:20.846791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:20.847226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:21.092850 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72f80e0e-875d-4685-8dc4-0ed4633eee08 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262502 Oct 17 14:39:21.093526 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4085/7726] 10.222.0.65 () {60 vars in 1323 bytes} [Mon Oct 17 14:39:20 2022] POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:31.896648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:31.897293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:31.900171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=15 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:31.901691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=60 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:31.907357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:31.907839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:31.908276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:31.908971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:31.909451 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:31.909886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:32.043857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:32.052198 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-93a22459-1a02-4fc4-a9ed-60a3db32f938 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1595 microversion: 2.1 time: 0.159428 Oct 17 14:39:32.052771 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3642/7727] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:31 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:33.750234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:33.751590 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=17 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:33.752790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:33.819800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-158a2a94-f359-48e2-8c82-5defa69bcc4e req-35484c6d-6776-48ab-ada2-6fe6b32ac870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:33.832042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-158a2a94-f359-48e2-8c82-5defa69bcc4e req-35484c6d-6776-48ab-ada2-6fe6b32ac870 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:33.832552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-158a2a94-f359-48e2-8c82-5defa69bcc4e req-35484c6d-6776-48ab-ada2-6fe6b32ac870 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:33.833324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-158a2a94-f359-48e2-8c82-5defa69bcc4e req-35484c6d-6776-48ab-ada2-6fe6b32ac870 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:33.846750 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-158a2a94-f359-48e2-8c82-5defa69bcc4e req-35484c6d-6776-48ab-ada2-6fe6b32ac870 service nova] Creating event network-changed:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:39:33.852464 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-158a2a94-f359-48e2-8c82-5defa69bcc4e req-35484c6d-6776-48ab-ada2-6fe6b32ac870 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103996 Oct 17 14:39:33.853415 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4086/7728] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:34.900814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-532226804"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:34.901413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:34.909047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:34.909583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:34.910026 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:34.910739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:34.911199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:34.912136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:35.060016 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Adding security group 8877b0b1-f271-4b01-89ba-3dbd9738016a to port 61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 Oct 17 14:39:35.424913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b34cbb6-4c50-4887-a45b-28b3137550f4 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action" status: 202 len: 0 microversion: 2.1 time: 0.528745 Oct 17 14:39:35.425899 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3643/7729] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:39:34 2022] POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:39:35.438857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:35.438857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:35.451381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a38458c3-24d9-4500-9dea-94ae5b36de28 req-0b9eae0d-885c-4689-8a7e-336c635e3a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:35.465829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:35.466412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:35.466875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:35.467602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:35.468772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:35.468772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:35.471090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a38458c3-24d9-4500-9dea-94ae5b36de28 req-0b9eae0d-885c-4689-8a7e-336c635e3a8a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:35.472118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a38458c3-24d9-4500-9dea-94ae5b36de28 req-0b9eae0d-885c-4689-8a7e-336c635e3a8a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:35.472575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a38458c3-24d9-4500-9dea-94ae5b36de28 req-0b9eae0d-885c-4689-8a7e-336c635e3a8a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:35.489095 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a38458c3-24d9-4500-9dea-94ae5b36de28 req-0b9eae0d-885c-4689-8a7e-336c635e3a8a service nova] Creating event network-changed:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:39:35.495635 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a38458c3-24d9-4500-9dea-94ae5b36de28 req-0b9eae0d-885c-4689-8a7e-336c635e3a8a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053514 Oct 17 14:39:35.497586 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3644/7730] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:39:35.746122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:35.756234 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16f1efa3-d347-4690-9cea-1ecd1adc1da5 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1759 microversion: 2.1 time: 0.324612 Oct 17 14:39:35.766342 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4087/7731] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:35 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1759 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:39:58.452545 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:58.453327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:58.457928 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:39:58.460263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:58.467803 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:58.468291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:58.468736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:58.469467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:58.469923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:58.470364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:58.544724 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8885d138-7c1e-4099-99d6-c8c7a17776ce tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action" status: 202 len: 0 microversion: 2.1 time: 0.094348 Oct 17 14:39:58.545383 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3645/7732] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:39:58 2022] POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:39:58.554232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:39:58.554869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:39:58.557077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:58.557787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:39:58.563403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:58.563919 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:58.564442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:58.565343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:39:58.565822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:39:58.566346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:39:59.111840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:39:59.120467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b9c4e889-58ac-4e49-a953-6889e86a17c0 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1751 microversion: 2.1 time: 0.570552 Oct 17 14:39:59.122199 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4088/7733] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:39:58 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1751 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:00.145922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:00.146615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:00.154514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:00.154994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:00.155427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:00.156112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:00.156558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:00.156976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:00.301716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:00.310323 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-70c749f5-3df3-4ed9-b7f0-7d721597e3ef tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.168701 Oct 17 14:40:00.310901 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3646/7734] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:00 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:01.334964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:01.335631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:01.343389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:01.343887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:01.344350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:01.345057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:01.345552 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:01.345996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:01.493773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:01.502606 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c617ffb-a166-432e-aa55-9569ed397964 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.171912 Oct 17 14:40:01.503184 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4089/7735] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:01 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:02.526990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:02.527717 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:02.534613 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:02.535094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:02.535530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:02.536220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:02.536665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:02.537094 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:02.684642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:02.693199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae07bcad-5f8a-47be-9292-4026f817a481 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.170087 Oct 17 14:40:02.693776 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3647/7736] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:02 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:03.716205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:03.716823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:03.723878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:03.724374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:03.724821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:03.725675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:03.726147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:03.726585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:03.874166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:03.882911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8116364f-a97e-47ea-be9c-4ae5e6663c17 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.170618 Oct 17 14:40:03.883344 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4090/7737] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:03 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:04.909689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:04.910322 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:04.917153 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:04.917664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:04.918113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:04.918802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:04.919250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:04.919665 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:05.064592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:05.074801 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb709c9a-65ad-4ceb-8756-7c6955fbdb8c tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.171700 Oct 17 14:40:05.075282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3648/7738] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:04 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:06.101740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:06.102406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:06.109761 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:06.110344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:06.111831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:06.113027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:06.113566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:06.114020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:06.265099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:06.273718 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-354dcb89-8e00-435c-ac5d-29a202e87973 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.176092 Oct 17 14:40:06.274306 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4091/7739] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:06 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:07.298738 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:07.299367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:07.305777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:07.306265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:07.306709 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:07.307400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:07.307860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:07.308289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:07.454722 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:07.463118 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7b8f82be-5fa0-4ce1-9347-ec2a1b61537e tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.168357 Oct 17 14:40:07.463688 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3649/7740] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:07 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:08.487294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:08.487850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:08.494867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:08.495357 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:08.495845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:08.497104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:08.497591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:08.498032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:08.648454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:08.657556 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91ba146b-1245-42a1-b5b8-8d1da82aab86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.174372 Oct 17 14:40:08.658137 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4092/7741] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:08 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:09.681649 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:09.682296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:09.689569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:09.690057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:09.690501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:09.691193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:09.691648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:09.692074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:09.839710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:09.848410 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7ab64f8-41f6-41dc-80aa-3e1c6eb8e9a6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.170816 Oct 17 14:40:09.848987 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3650/7742] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:09 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:40:10.872770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:10.873449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:10.880470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:10.880989 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:10.881457 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:10.882206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:10.882684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:10.883135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:11.032278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:11.040849 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2356cc8-5dde-4bd2-805f-3ca1bfac4e92 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.172604 Oct 17 14:40:11.041462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4093/7743] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:10 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:12.065557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:12.066214 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:12.073398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:12.074004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:12.074514 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:12.075216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:12.075679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:12.076109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:12.218817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:12.227286 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6888b2d8-6fbd-4b04-9242-792abb6f6693 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.165728 Oct 17 14:40:12.227862 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3651/7744] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:12 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:13.252162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:13.252817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:13.260132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:13.260748 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:13.262030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:13.263151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:13.263680 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:13.264226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:13.419162 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:13.428282 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebd35370-9871-411e-a994-fea2d752ff86 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.180268 Oct 17 14:40:13.428923 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4094/7745] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:13 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:40:14.450902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:14.451512 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:14.458478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:14.458952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:14.459382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:14.460064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:14.460508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:14.460925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:14.606944 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:14.615861 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-346b2223-c711-4133-aa60-4c0c97c9413a tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1756 microversion: 2.1 time: 0.168803 Oct 17 14:40:14.616445 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3652/7746] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:14 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:40:15.640843 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:15.641498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:15.648495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:15.648992 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:15.649479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:15.650211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:15.650687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:15.651128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:15.802332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:15.811897 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb59290b-2dff-4ece-a971-52a1f38f8c12 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1759 microversion: 2.1 time: 0.175999 Oct 17 14:40:15.812492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4095/7747] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:15 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1759 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:40:48.734110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-532226804"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:48.734783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:48.737258 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:40:48.737397 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:40:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action (ip 10.222.0.65) !!! Oct 17 14:40:48.738656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:48.739315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:48.746694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:48.747168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:48.747596 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:48.748283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:48.748756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:48.749187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:48.878512 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Removing security group 8877b0b1-f271-4b01-89ba-3dbd9738016a from port 61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 Oct 17 14:40:49.194059 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae923757-54f2-4171-b690-c48504956336 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action" status: 202 len: 0 microversion: 2.1 time: 0.463836 Oct 17 14:40:49.195219 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3653/7748] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:40:48 2022] POST /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:40:49.207577 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0bb838fa-ce8f-4e75-bbea-069876628855 req-8eff72ad-fa06-449e-822d-5b6e39b46791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:49.214404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:49.215105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=48 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:40:49.240329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0bb838fa-ce8f-4e75-bbea-069876628855 req-8eff72ad-fa06-449e-822d-5b6e39b46791 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:49.240835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0bb838fa-ce8f-4e75-bbea-069876628855 req-8eff72ad-fa06-449e-822d-5b6e39b46791 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:49.241323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0bb838fa-ce8f-4e75-bbea-069876628855 req-8eff72ad-fa06-449e-822d-5b6e39b46791 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:49.260830 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0bb838fa-ce8f-4e75-bbea-069876628855 req-8eff72ad-fa06-449e-822d-5b6e39b46791 service nova] Creating event network-changed:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:40:49.267703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0bb838fa-ce8f-4e75-bbea-069876628855 req-8eff72ad-fa06-449e-822d-5b6e39b46791 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065058 Oct 17 14:40:49.272459 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4096/7749] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:50.556790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:50.557915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:50.564362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:50.564945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:50.565470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:50.566265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:50.566785 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:50.567276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:50.659340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lazy-loading 'services' on Instance uuid d3e24b6c-c2ff-4337-b826-c07406f4cec1 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:40:50.739555 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75eb3fb6-e756-43c1-b2e6-7566b718793f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments/43b0ed6a-8156-4e4d-952e-bd42034d982c" status: 202 len: 0 microversion: 2.1 time: 0.187501 Oct 17 14:40:50.740368 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3654/7750] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:40:50 2022] DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments/43b0ed6a-8156-4e4d-952e-bd42034d982c => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:40:50.750132 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:50.752682 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:50.761405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:50.762032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:50.762581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:50.763591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:50.764055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:50.764495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:50.815197 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ae1c728-dafc-4d39-aec7-60df4e274c24 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069672 Oct 17 14:40:50.816208 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4097/7751] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:50 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:51.324187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e9a0523c-2f1a-4248-b89b-72765e5dad3d req-21cf6535-802b-4af9-bf38-d327ec7e4095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:40:51.345269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e9a0523c-2f1a-4248-b89b-72765e5dad3d req-21cf6535-802b-4af9-bf38-d327ec7e4095 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:51.345760 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e9a0523c-2f1a-4248-b89b-72765e5dad3d req-21cf6535-802b-4af9-bf38-d327ec7e4095 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:51.346192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e9a0523c-2f1a-4248-b89b-72765e5dad3d req-21cf6535-802b-4af9-bf38-d327ec7e4095 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:51.359108 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e9a0523c-2f1a-4248-b89b-72765e5dad3d req-21cf6535-802b-4af9-bf38-d327ec7e4095 service nova] Creating event network-changed:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:40:51.366507 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e9a0523c-2f1a-4248-b89b-72765e5dad3d req-21cf6535-802b-4af9-bf38-d327ec7e4095 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046360 Oct 17 14:40:51.367898 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3655/7752] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:51.828428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:51.831157 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:51.837537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:51.838134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:51.839185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:51.840156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:51.840705 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:51.841266 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:51.874311 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-279ff9cd-7d83-405f-8588-a315b12e6ee9 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049803 Oct 17 14:40:51.874750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4098/7753] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:51 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:52.888862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:52.891129 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:52.897772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:52.898267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:52.898707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:52.899414 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:52.899868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:52.900289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:52.931939 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1ca1b64-ab83-40dc-a5f2-8f5c33374275 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049672 Oct 17 14:40:52.933085 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3656/7754] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:52 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:53.944199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:53.946497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:53.953698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:53.954203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:53.954658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:53.955373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:53.955846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:53.956319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:53.987707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a895b94-56ec-4d78-a598-5ff5333ea267 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Oct 17 14:40:53.988286 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4099/7755] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:53 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:55.000238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:55.002516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:55.009436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:55.009929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:55.010400 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:55.011105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:55.011562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:55.011994 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:55.043293 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-464aba3a-0c99-41f1-82d7-992aad7dc795 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047100 Oct 17 14:40:55.043872 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3657/7756] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:54 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:40:56.056065 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:56.059158 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:56.066154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:56.066660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:56.067122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:56.067840 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:56.068309 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:56.068755 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:56.098069 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3457e47-240f-43fc-b1a7-d20624115550 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046022 Oct 17 14:40:56.098662 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4100/7757] 10.222.0.65 () {58 vars in 1302 bytes} [Mon Oct 17 14:40:56 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 17 14:40:56.111786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:56.112350 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:56.120213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:56.120542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:56.120980 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:56.121704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:56.122149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:56.122569 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:56.199906 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] HTTP exception thrown: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 is not attached to volume 43b0ed6a-8156-4e4d-952e-bd42034d982c Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Request method failure captured: Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments/43b0ed6a-8156-4e4d-952e-bd42034d982c HTTP/1.1 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWe5L7vIeCC8FO97eVoREMkZsQflrwfrhkU_aCdu036bPMsc7-3VfewRuAwBLd6euu_hIX3I7FxF3ftUvQzr_f55tq_qLBfUnnF3jtTpGUm2IOOpzq7jvunydj4-O0Hlh6Q5RVT4vo929hPds5AIrAE-vCiqTfALVgf1rmJWcqlL0t4 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1497f9ec19b74b17836f5269f51d3da4 Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 is not attached to volume 43b0ed6a-8156-4e4d-952e-bd42034d982c Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'server_id': 'd3e24b6c-c2ff-4337-b826-c07406f4cec1', 'id': '43b0ed6a-8156-4e4d-952e-bd42034d982c'} Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 43b0ed6a-8156-4e4d-952e-bd42034d982c. Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 is not attached to volume 43b0ed6a-8156-4e4d-952e-bd42034d982c Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:40:56.201521 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 is not attached to volume 43b0ed6a-8156-4e4d-952e-bd42034d982c Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Returning 404 to user: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 is not attached to volume 43b0ed6a-8156-4e4d-952e-bd42034d982c {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a3d6bdd-a51d-41a5-ad95-e3370dbaac3f tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments/43b0ed6a-8156-4e4d-952e-bd42034d982c" status: 404 len: 154 microversion: 2.1 time: 0.095302 Oct 17 14:40:56.206444 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3658/7758] 10.222.0.65 () {58 vars in 1416 bytes} [Mon Oct 17 14:40:56 2022] DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1/os-volume_attachments/43b0ed6a-8156-4e4d-952e-bd42034d982c => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:40:59.467654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:59.468211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:59.475273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:59.475773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:59.476231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:59.476978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:59.477481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:59.477932 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:59.506350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:40:59.594465 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7a5ed277-d54b-44eb-8911-b6d4af9eeb23 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 204 len: 0 microversion: 2.1 time: 0.131445 Oct 17 14:40:59.595437 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4101/7759] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:40:59 2022] DELETE /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:40:59.604181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:40:59.605981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:40:59.621926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:59.622465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:59.623107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:59.624384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:40:59.624878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:40:59.625339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:40:59.773287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:40:59.782227 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4404c8c5-22cc-45c9-a563-8fa080b442d7 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1555 microversion: 2.1 time: 0.182447 Oct 17 14:40:59.782958 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3659/7760] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:40:59 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:00.807547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:00.808282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:00.815242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:00.815743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:00.816200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:00.816921 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:00.817423 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:00.817873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:00.954431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:00.962355 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-85c9def0-4a62-4323-9abe-68c9df9293fc tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1555 microversion: 2.1 time: 0.159710 Oct 17 14:41:00.962984 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4102/7761] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:00 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:01.703455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-30d7688c-32cf-4bcf-9b08-074fcb9cd7a8 req-d7e7fdcb-25c7-4be9-9829-f1de672b652c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e24b6c-c2ff-4337-b826-c07406f4cec1", "name": "network-vif-deleted", "tag": "61933cb6-e13e-4657-ba5e-4a4f6c20cfb2"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:01.715714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-30d7688c-32cf-4bcf-9b08-074fcb9cd7a8 req-d7e7fdcb-25c7-4be9-9829-f1de672b652c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:01.716201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-30d7688c-32cf-4bcf-9b08-074fcb9cd7a8 req-d7e7fdcb-25c7-4be9-9829-f1de672b652c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:01.716639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-30d7688c-32cf-4bcf-9b08-074fcb9cd7a8 req-d7e7fdcb-25c7-4be9-9829-f1de672b652c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:01.729764 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-30d7688c-32cf-4bcf-9b08-074fcb9cd7a8 req-d7e7fdcb-25c7-4be9-9829-f1de672b652c service nova] Creating event network-vif-deleted:61933cb6-e13e-4657-ba5e-4a4f6c20cfb2 for instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 on n-h1-854121-14 Oct 17 14:41:01.734931 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-30d7688c-32cf-4bcf-9b08-074fcb9cd7a8 req-d7e7fdcb-25c7-4be9-9829-f1de672b652c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035354 Oct 17 14:41:01.735540 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3660/7762] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:01.986397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:01.987135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:01.995189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:01.995908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:01.996450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:01.997308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:01.997859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:01.998377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:02.031832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:02.032339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:02.032827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:02.033284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lazy-loading 'fault' on Instance uuid d3e24b6c-c2ff-4337-b826-c07406f4cec1 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:41:02.080237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1497f9ec19b74b17836f5269f51d3da4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ce9bd25ce48e0a2631ed5a8719670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:02.089779 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e75d059-ff34-4845-9522-ab9efbdba742 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 200 len: 1349 microversion: 2.1 time: 0.107345 Oct 17 14:41:02.090391 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4103/7763] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:01 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 1349 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:03.115374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:03.116087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] [instance: d3e24b6c-c2ff-4337-b826-c07406f4cec1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:03.123156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:03.123651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:03.124090 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:03.124794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:03.125428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:03.125757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:03.142353 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] HTTP exception thrown: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 could not be found. Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Request method failure captured: Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 HTTP/1.1 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWe5L7vIeCC8FO97eVoREMkZsQflrwfrhkU_aCdu036bPMsc7-3VfewRuAwBLd6euu_hIX3I7FxF3ftUvQzr_f55tq_qLBfUnnF3jtTpGUm2IOOpzq7jvunydj4-O0Hlh6Q5RVT4vo929hPds5AIrAE-vCiqTfALVgf1rmJWcqlL0t4 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_151ce9bd25ce48e0a2631ed5a8719670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 151ce9bd25ce48e0a2631ed5a8719670 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1882884833 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 1497f9ec19b74b17836f5269f51d3da4 Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestMinimumBasicScenario-1882884833-project Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 could not be found. Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'd3e24b6c-c2ff-4337-b826-c07406f4cec1'} Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 could not be found. Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 could not be found. Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:41:03.144034 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 could not be found. Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Returning 404 to user: Instance d3e24b6c-c2ff-4337-b826-c07406f4cec1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-840a5887-cc81-4f0f-bf94-946119d1e864 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1" status: 404 len: 111 microversion: 2.1 time: 0.035243 Oct 17 14:41:03.149121 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3661/7764] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:03 2022] GET /compute/v2.1/servers/d3e24b6c-c2ff-4337-b826-c07406f4cec1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:41:03.154626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57cb8754-342e-4621-b6f7-ee41de290fe6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] Calling method '.version_select at 0x7f419ce14310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:03.175302 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57cb8754-342e-4621-b6f7-ee41de290fe6 tempest-TestMinimumBasicScenario-1882884833 tempest-TestMinimumBasicScenario-1882884833-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1721809345" status: 202 len: 0 microversion: 2.1 time: 0.024801 Oct 17 14:41:03.175880 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4104/7765] 10.222.0.65 () {58 vars in 1272 bytes} [Mon Oct 17 14:41:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1721809345 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:41:13.027446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0a92506-0f11-47e4-83d0-e64f7b0044f6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: .version_select at 0x7f419cfdc700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-181209213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFxSKU9owJPIcx3k3DhDQvyeTMNz3PCOTGL9lEeB6EfYTODXEzFAS6Ajbkd7M5hmX5h+2/ZHJBe1KDVyHERwp2XNFOYJeWaHN6HpmmuaiGgcPY0B3oq1nGATpAclS+keA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:13.042842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f0a92506-0f11-47e4-83d0-e64f7b0044f6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:41:13.047935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-f0a92506-0f11-47e4-83d0-e64f7b0044f6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:41:13.074043 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0a92506-0f11-47e4-83d0-e64f7b0044f6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.229501 Oct 17 14:41:13.074647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3662/7766] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:41:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:19.062574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:19.064036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:19.069470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1431612940", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "859e096c-68b2-4ec8-91fb-cd1a6c65d2b3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-181209213", "security_groups": [{"name": "tempest-secgroup-smoke-556103992"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:19.195142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] validate_networks() for [('859e096c-68b2-4ec8-91fb-cd1a6c65d2b3', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:41:19.680734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:41:19.680734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:41:19.680734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:41:19.681025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:41:19.681893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:41:19.695036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:19.695658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:19.696133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:19.697098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:19.697851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:19.698307 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:19.731291 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:41:19.741107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:41:19.756973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:41:19.759797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:41:19.840035 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af838c74-d1dc-4ec0-8741-dfbc20786b7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.779833 Oct 17 14:41:19.847052 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4105/7767] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:41:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:41:19.849303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:19.855893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4791f14-ea2c-4425-af9d-0a29a67034c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:19.856518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4791f14-ea2c-4425-af9d-0a29a67034c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:19.860159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:19.980577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4791f14-ea2c-4425-af9d-0a29a67034c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:19.993516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4791f14-ea2c-4425-af9d-0a29a67034c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1266 microversion: 2.1 time: 0.140698 Oct 17 14:41:20.010891 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3663/7768] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:19 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:21.020984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:21.021652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:21.029203 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:21.030344 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:21.030814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:21.031553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:21.032029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:21.032485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:21.096558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:21.105375 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-807cd9df-0261-421d-b7da-40d83ff658e2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1318 microversion: 2.1 time: 0.089640 Oct 17 14:41:21.105978 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4106/7769] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:21 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:22.129453 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:22.130083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:22.138826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:22.139353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:22.140000 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:22.140966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:22.141627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:22.142252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:22.444236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:22.455323 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-51897bcb-35bb-4d4b-8aca-c922d885348c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1391 microversion: 2.1 time: 0.330755 Oct 17 14:41:22.455942 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3664/7770] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:22 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1391 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:22.876228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f37963ce-5324-46d8-9db3-6d50c5e1c21d req-caf64ac0-27b2-4888-956b-4119e86da895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bc23a9-9ff7-4bf1-a7c3-5336bd96b415", "tag": "98ba212e-fbed-423c-a287-ee9a7598a6ff"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:22.893102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f37963ce-5324-46d8-9db3-6d50c5e1c21d req-caf64ac0-27b2-4888-956b-4119e86da895 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:22.893653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f37963ce-5324-46d8-9db3-6d50c5e1c21d req-caf64ac0-27b2-4888-956b-4119e86da895 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:22.894113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f37963ce-5324-46d8-9db3-6d50c5e1c21d req-caf64ac0-27b2-4888-956b-4119e86da895 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:22.907367 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f37963ce-5324-46d8-9db3-6d50c5e1c21d req-caf64ac0-27b2-4888-956b-4119e86da895 service nova] Creating event network-changed:98ba212e-fbed-423c-a287-ee9a7598a6ff for instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 on n-h1-854121-14 Oct 17 14:41:22.912743 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f37963ce-5324-46d8-9db3-6d50c5e1c21d req-caf64ac0-27b2-4888-956b-4119e86da895 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041904 Oct 17 14:41:22.913975 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4107/7771] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:41:23.479735 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:23.480348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:23.487430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:23.487910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:23.488353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:23.489050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:23.489533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:23.489958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:23.623959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:23.631936 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8d1ef898-d8cc-4f62-95f5-7dbd885eec6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1391 microversion: 2.1 time: 0.156300 Oct 17 14:41:23.632521 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3665/7772] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:23 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:24.655985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:24.656702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:24.663952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:24.664450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:24.664913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:24.665664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:24.666624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:24.667069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:24.810952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:24.819048 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2cda8260-78e8-4507-9cd4-1cd6f673b038 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1391 microversion: 2.1 time: 0.167332 Oct 17 14:41:24.819645 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4108/7773] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:24 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:25.841281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:25.841813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:25.848777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:25.849302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:25.849748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:25.850449 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:25.850901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:25.851324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:26.009684 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:26.020075 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2821e12f-dca2-45b8-b5e8-34daa18ebbb1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1391 microversion: 2.1 time: 0.182781 Oct 17 14:41:26.020996 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3666/7774] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:25 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1391 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:27.044431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:27.045056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:27.051987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:27.052490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:27.052943 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:27.053675 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:27.054147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:27.054585 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:27.189973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:27.197874 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63cac853-388f-47be-9a7c-58fc69eb21bb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1391 microversion: 2.1 time: 0.157965 Oct 17 14:41:27.198466 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4109/7775] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:27 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:27.751236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3a9c2947-63c6-4041-a93e-05e2264fd832 req-42329ec4-4e16-49d1-9178-f21cce1fe5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bc23a9-9ff7-4bf1-a7c3-5336bd96b415", "name": "network-vif-plugged", "status": "completed", "tag": "98ba212e-fbed-423c-a287-ee9a7598a6ff"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:27.763832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3a9c2947-63c6-4041-a93e-05e2264fd832 req-42329ec4-4e16-49d1-9178-f21cce1fe5a3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:27.764307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3a9c2947-63c6-4041-a93e-05e2264fd832 req-42329ec4-4e16-49d1-9178-f21cce1fe5a3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:27.764737 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3a9c2947-63c6-4041-a93e-05e2264fd832 req-42329ec4-4e16-49d1-9178-f21cce1fe5a3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:27.776346 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3a9c2947-63c6-4041-a93e-05e2264fd832 req-42329ec4-4e16-49d1-9178-f21cce1fe5a3 service nova] Creating event network-vif-plugged:98ba212e-fbed-423c-a287-ee9a7598a6ff for instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 on n-h1-854121-14 Oct 17 14:41:27.781495 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3a9c2947-63c6-4041-a93e-05e2264fd832 req-42329ec4-4e16-49d1-9178-f21cce1fe5a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034241 Oct 17 14:41:27.782282 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3667/7776] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:41:28.220800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:28.221468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:28.229071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:28.229815 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:28.230228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:28.230960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:28.231438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:28.231893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:28.370109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:28.378154 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb25ba92-7856-42e6-94ce-5feb1d6584cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1391 microversion: 2.1 time: 0.161288 Oct 17 14:41:28.378747 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4110/7777] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:28 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:29.403808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:29.404408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:29.410707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:29.411191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:29.411621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:29.412310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:29.412763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:29.413201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:29.560319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:29.568238 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8bbbe16a-02cc-4081-b126-416d4d319099 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1563 microversion: 2.1 time: 0.170244 Oct 17 14:41:29.568832 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3668/7778] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:29 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:29.591064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:29.591746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:29.598653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:29.599154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:29.599612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:29.600378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:29.600850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:29.601335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:29.712617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:29.735893 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:29.744026 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d4f12682-bbb3-45cc-85c7-23af303aabb7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1563 microversion: 2.1 time: 0.157440 Oct 17 14:41:29.745145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4111/7779] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:29 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:31.701103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:41:31.701767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:31.703734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:31.704631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a04be440-ce01-42e7-a09d-92d1f44da3fa req-86aa3760-d97b-4f89-87ca-d1f1f9ff82b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bc23a9-9ff7-4bf1-a7c3-5336bd96b415", "tag": "98ba212e-fbed-423c-a287-ee9a7598a6ff"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:31.710036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:31.711128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:31.711617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:31.712623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:31.714314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:31.715185 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:31.715878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:31.718491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a04be440-ce01-42e7-a09d-92d1f44da3fa req-86aa3760-d97b-4f89-87ca-d1f1f9ff82b3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:31.719382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a04be440-ce01-42e7-a09d-92d1f44da3fa req-86aa3760-d97b-4f89-87ca-d1f1f9ff82b3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:31.719835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a04be440-ce01-42e7-a09d-92d1f44da3fa req-86aa3760-d97b-4f89-87ca-d1f1f9ff82b3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:31.735040 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a04be440-ce01-42e7-a09d-92d1f44da3fa req-86aa3760-d97b-4f89-87ca-d1f1f9ff82b3 service nova] Creating event network-changed:98ba212e-fbed-423c-a287-ee9a7598a6ff for instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 on n-h1-854121-14 Oct 17 14:41:31.741295 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a04be440-ce01-42e7-a09d-92d1f44da3fa req-86aa3760-d97b-4f89-87ca-d1f1f9ff82b3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040308 Oct 17 14:41:31.742646 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4112/7780] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:41:31.942212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:41:31.951007 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f1056c2a-b5fd-42db-9141-ef94f87e416d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1563 microversion: 2.1 time: 0.253775 Oct 17 14:41:31.951601 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3669/7781] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:41:31 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:41:55.224631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:55.225511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:41:55.230199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:41:55.232518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:41:55.241086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:55.241881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:55.242352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:55.243084 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:41:55.243560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:41:55.244014 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:41:55.297841 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45d6cdfc-2301-42a1-9374-144fc1fab3cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action" status: 200 len: 24569 microversion: 2.1 time: 0.075717 Oct 17 14:41:55.298538 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4113/7782] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:41:55 2022] POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action => generated 24569 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:42:06.338995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:06.339595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:06.341681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=15 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:06.342403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=32 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:06.349323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:06.349816 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:06.350259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:06.350962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:06.351421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:06.351854 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:06.418753 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d21051ab-64d3-4874-bc31-3917b0b59bd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action" status: 202 len: 0 microversion: 2.1 time: 0.084087 Oct 17 14:42:06.421193 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3670/7783] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:42:06 2022] POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:42:06.430152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:06.430866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:06.433940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:06.434620 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:06.441427 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:06.442482 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:06.442985 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:06.443653 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:06.444122 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:06.444562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:06.649452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:06.657442 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9646b96e-0113-461c-8053-a8c674f6fa6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1687 microversion: 2.1 time: 0.232103 Oct 17 14:42:06.658095 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4114/7784] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:06 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:42:07.683169 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:07.683875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:07.690149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:07.690641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:07.691114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:07.692392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:07.692856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:07.693311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:07.833467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:07.841370 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ced05e18-6cf9-451d-900c-9c7e6fa47470 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1667 microversion: 2.1 time: 0.163589 Oct 17 14:42:07.841932 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3671/7785] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:07 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:08.939729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:08.941939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:08.952780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:08.953316 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:08.953778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:08.954501 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:08.954979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:08.955428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:09.008882 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac9c5ee3-fe3a-4f79-8ded-ff5ea6cdf6ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action" status: 200 len: 32638 microversion: 2.1 time: 0.073053 Oct 17 14:42:09.009594 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4115/7786] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:42:08 2022] POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action => generated 32638 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:42:09.021822 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:09.022384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:09.029275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:09.029769 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:09.030209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:09.030911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:09.031371 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:09.031802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:09.098628 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33de02b1-daae-4c5a-a5e4-3a30a496ab91 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action" status: 202 len: 0 microversion: 2.1 time: 0.079987 Oct 17 14:42:09.099264 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3672/7787] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:42:09 2022] POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:42:09.108593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:09.109348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:09.118027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:09.118543 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:09.119019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:09.119744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:09.120236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:09.120685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:09.258315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:09.267429 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ed9b1c7-39a8-4971-a8b2-ff42d69d9977 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1674 microversion: 2.1 time: 0.162565 Oct 17 14:42:09.267683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4116/7788] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:09 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:10.294034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:10.294674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:10.300800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:10.302159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:10.302522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:10.303206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:10.303657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:10.304074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:10.442856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:10.451060 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eccd58c4-9502-48eb-ab58-dd517e7b7c8c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1682 microversion: 2.1 time: 0.162172 Oct 17 14:42:10.451643 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3673/7789] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:10 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:10.552796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:10.555050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:10.562848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:10.563352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:10.563810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:10.564526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:10.565000 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:10.565538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:10.617512 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75d6381a-453a-4240-ad41-42295170ac20 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action" status: 200 len: 38391 microversion: 2.1 time: 0.069284 Oct 17 14:42:10.618286 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4117/7790] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:42:10 2022] POST /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415/action => generated 38391 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:42:11.620468 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:11.621102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:11.622931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-10473fa1-db61-4d4d-a67d-31e0db64c34f req-657b7a70-2f30-4811-a447-46db8bf00125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01bc23a9-9ff7-4bf1-a7c3-5336bd96b415", "tag": "98ba212e-fbed-423c-a287-ee9a7598a6ff"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:11.628210 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:11.628698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:11.629428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:11.630341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:11.631252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:11.631907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:11.640948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10473fa1-db61-4d4d-a67d-31e0db64c34f req-657b7a70-2f30-4811-a447-46db8bf00125 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:11.641490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10473fa1-db61-4d4d-a67d-31e0db64c34f req-657b7a70-2f30-4811-a447-46db8bf00125 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:11.642127 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-10473fa1-db61-4d4d-a67d-31e0db64c34f req-657b7a70-2f30-4811-a447-46db8bf00125 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:11.655446 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-10473fa1-db61-4d4d-a67d-31e0db64c34f req-657b7a70-2f30-4811-a447-46db8bf00125 service nova] Creating event network-changed:98ba212e-fbed-423c-a287-ee9a7598a6ff for instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 on n-h1-854121-14 Oct 17 14:42:11.661383 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-10473fa1-db61-4d4d-a67d-31e0db64c34f req-657b7a70-2f30-4811-a447-46db8bf00125 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042294 Oct 17 14:42:11.662512 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4118/7791] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:42:11.666479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:42:11.757297 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00e39391-b7fc-4c51-bea1-a5f3d6625960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 204 len: 0 microversion: 2.1 time: 0.142333 Oct 17 14:42:11.758637 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3674/7792] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:42:11 2022] DELETE /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:42:11.776489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:11.777867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:11.793153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:11.794142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:11.795824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:11.797945 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:11.799614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:11.800456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:11.943636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:11.951649 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c1ef7f6-1a0f-4299-abb3-56bc36fdd7c3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1688 microversion: 2.1 time: 0.185416 Oct 17 14:42:11.952234 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4119/7793] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:11 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:12.976577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:12.977296 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:12.985208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:12.985701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:12.986136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:12.986843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:12.987293 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:12.987716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:13.163163 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:13.170920 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61579135-760b-4738-a2af-9214c53164b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1688 microversion: 2.1 time: 0.198671 Oct 17 14:42:13.171486 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3675/7794] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:12 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:13.769960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f8ae5608-169a-48aa-8d16-e8ed73ef8f1b req-ffa04bb1-07c8-4eba-b594-b0540cc09108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01bc23a9-9ff7-4bf1-a7c3-5336bd96b415", "name": "network-vif-deleted", "tag": "98ba212e-fbed-423c-a287-ee9a7598a6ff"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:13.781238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8ae5608-169a-48aa-8d16-e8ed73ef8f1b req-ffa04bb1-07c8-4eba-b594-b0540cc09108 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:13.781765 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8ae5608-169a-48aa-8d16-e8ed73ef8f1b req-ffa04bb1-07c8-4eba-b594-b0540cc09108 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:13.782246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f8ae5608-169a-48aa-8d16-e8ed73ef8f1b req-ffa04bb1-07c8-4eba-b594-b0540cc09108 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:13.794664 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f8ae5608-169a-48aa-8d16-e8ed73ef8f1b req-ffa04bb1-07c8-4eba-b594-b0540cc09108 service nova] Creating event network-vif-deleted:98ba212e-fbed-423c-a287-ee9a7598a6ff for instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 on n-h1-854121-14 Oct 17 14:42:13.799622 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f8ae5608-169a-48aa-8d16-e8ed73ef8f1b req-ffa04bb1-07c8-4eba-b594-b0540cc09108 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Oct 17 14:42:13.800239 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4120/7795] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:42:14.198347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:14.199436 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:14.208573 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:14.209109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:14.209579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:14.210283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:14.210739 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:14.211172 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:14.244600 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:14.245215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:14.245664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:14.246126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lazy-loading 'fault' on Instance uuid 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:42:14.292068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:14.299714 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f7c0f62-6de5-4269-958d-8308f256a9a4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 200 len: 1356 microversion: 2.1 time: 0.108609 Oct 17 14:42:14.300225 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3676/7796] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:14 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:42:15.324492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:15.325222 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:15.331416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:15.331908 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:15.332356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:15.333050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:15.334033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:15.334465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:15.347806 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] HTTP exception thrown: Instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 could not be found. Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Request method failure captured: Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 HTTP/1.1 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWmIjD4meV5MrLtAhIOzZ6LOjFI3UMt0z1GIRPVutxI-ohLoPM1P_-cC2jOANVgh1S79zoAcRM6KvOhl3Uf7HvsBPnQQX6YTHjtvujMHEbL-0V011PHjecJsb7BrdpeayfWAE_82K6KrBgyMEpk_0Mrp5TwpsmB4TCrKe48Gqcd2eIA Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 5f80f8463b2e4e1a86f4c2ba67f2205a Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 could not be found. Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '01bc23a9-9ff7-4bf1-a7c3-5336bd96b415'} Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 could not be found. Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 could not be found. Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:42:15.350094 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 could not be found. Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Returning 404 to user: Instance 01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6050f261-f452-4035-8a4e-016598eea6b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415" status: 404 len: 111 microversion: 2.1 time: 0.032217 Oct 17 14:42:15.355767 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4121/7797] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:15 2022] GET /compute/v2.1/servers/01bc23a9-9ff7-4bf1-a7c3-5336bd96b415 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 17 14:42:18.956105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ed8951d-2864-4e4c-92a2-f51536777543 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '.version_select at 0x7f419c898f70>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:18.979280 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ed8951d-2864-4e4c-92a2-f51536777543 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181209213" status: 202 len: 0 microversion: 2.1 time: 0.026787 Oct 17 14:42:18.980233 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3677/7798] 10.222.0.65 () {58 vars in 1281 bytes} [Mon Oct 17 14:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-181209213 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:42:19.012036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8412731b-e3a0-4f19-9790-88d28d11ab66 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: .version_select at 0x7f419de5aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1210890476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIslO9y/6rRnkyLpwP/J/VKuVMwWP15cFQ4R/VvF544ySDxXfCLBxE5oqoI62j/DvYmtvHeTHxXzHU/V2yWOmR3UXAouF5z2wa75r4dIKWvqSNseILuCSBbQUmHX+S4SOw=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:19.031649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-8412731b-e3a0-4f19-9790-88d28d11ab66 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:42:19.037064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-8412731b-e3a0-4f19-9790-88d28d11ab66 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:42:19.061036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8412731b-e3a0-4f19-9790-88d28d11ab66 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053383 Oct 17 14:42:19.061698 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4122/7799] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:42:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:42:25.105242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:25.109992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-375821350", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "2ff7ec89-7447-4ff8-a472-79e2cdb3907c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1210890476", "security_groups": [{"name": "tempest-secgroup-smoke-1101352911"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:25.235254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] validate_networks() for [('2ff7ec89-7447-4ff8-a472-79e2cdb3907c', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:42:25.711950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:42:25.712456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:42:25.713013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:42:25.713457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:42:25.713875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:42:25.725641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:25.726138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:25.726582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:25.727323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:25.727808 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:25.728236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:25.746188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:42:25.751488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:42:25.764669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:42:25.767058 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:42:25.816710 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e86d9104-6680-4b15-9ef5-9dacbe3f9212 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713298 Oct 17 14:42:25.817704 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3678/7800] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:42:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:42:25.829540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bd768d0-3cd8-4ca7-a875-6dc45676fe54 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:25.830348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bd768d0-3cd8-4ca7-a875-6dc45676fe54 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:25.837403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=32 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:25.896046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bd768d0-3cd8-4ca7-a875-6dc45676fe54 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:25.905187 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bd768d0-3cd8-4ca7-a875-6dc45676fe54 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1266 microversion: 2.1 time: 0.079748 Oct 17 14:42:25.905786 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4123/7801] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:25 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:26.930305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:26.930933 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:26.938604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:26.939223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:26.939669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:26.940376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:26.940836 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:26.941291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:27.027046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:27.039932 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6bd556af-ca57-4f16-bf23-2d4643e6e222 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1318 microversion: 2.1 time: 0.115726 Oct 17 14:42:27.041481 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3679/7802] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:26 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1318 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:28.068044 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:28.068693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:28.078005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:28.078707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:28.079473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:28.080821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:28.081435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:28.082331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:28.315781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:28.325626 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0ba1770-a817-454b-84da-26b34d70ecd9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.265153 Oct 17 14:42:28.327158 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4124/7803] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:28 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:28.683429 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cba6e838-ba12-4690-aefc-c228cb2a2064 req-0ff85b90-11d7-4b19-95e8-d0414218b8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e8a5b7-2ba1-43fb-b645-77ed709f450c", "tag": "817447e6-82ad-4d6a-9fe3-ce2bf1fe5802"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:28.695562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cba6e838-ba12-4690-aefc-c228cb2a2064 req-0ff85b90-11d7-4b19-95e8-d0414218b8f7 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:28.696049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cba6e838-ba12-4690-aefc-c228cb2a2064 req-0ff85b90-11d7-4b19-95e8-d0414218b8f7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:28.696473 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cba6e838-ba12-4690-aefc-c228cb2a2064 req-0ff85b90-11d7-4b19-95e8-d0414218b8f7 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:28.708487 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cba6e838-ba12-4690-aefc-c228cb2a2064 req-0ff85b90-11d7-4b19-95e8-d0414218b8f7 service nova] Creating event network-changed:817447e6-82ad-4d6a-9fe3-ce2bf1fe5802 for instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c on n-h2-854121-14 Oct 17 14:42:28.713581 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cba6e838-ba12-4690-aefc-c228cb2a2064 req-0ff85b90-11d7-4b19-95e8-d0414218b8f7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034100 Oct 17 14:42:28.714386 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3680/7804] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:42:29.351629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:29.352262 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:29.360189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:29.360697 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:29.361183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:29.361917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:29.362392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:29.362841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:29.496910 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:29.505094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c482f04-f20c-414d-bcd5-4d9ed1052b48 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.158740 Oct 17 14:42:29.505714 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4125/7805] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:29 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:30.531301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:30.532012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:30.539442 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:30.539926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:30.540357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:30.541042 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:30.541515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:30.542072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:30.692437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:30.700656 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-944bfaf4-df93-4f91-8f56-57ae12a3c9fd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.174878 Oct 17 14:42:30.701328 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3681/7806] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:30 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:31.722926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:31.723604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:31.730758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:31.731298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:31.731754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:31.732469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:31.732941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:31.733414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:31.888586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:31.898096 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-369e7743-7987-4976-972c-a1f16a14830b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.179044 Oct 17 14:42:31.898815 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4126/7807] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:31 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:32.923351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:32.923913 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:32.931575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:32.932052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:32.932500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:32.933230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:32.933695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:32.934126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:33.071408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:33.079228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-150b37fc-b476-441a-8730-5dd6a425b424 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.160155 Oct 17 14:42:33.079790 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3682/7808] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:32 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:34.103520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:34.104137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:34.111043 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:34.111531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:34.111982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:34.112681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:34.113151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:34.113807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:34.252549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:34.260554 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a99c2c0-babc-4f0e-be34-a667c3debac3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.161597 Oct 17 14:42:34.261139 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4127/7809] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:34 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:35.284539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:35.285179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:35.292216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:35.292700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:35.293139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:35.293860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:35.294318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:35.294749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:35.426757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:35.435228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f8e75ac-ecc0-45e8-9a6e-5155aa4cd137 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.154616 Oct 17 14:42:35.435809 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3683/7810] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:35 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:36.460206 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9011c3a7-e7d5-445b-a904-cebc7acc5cf6 req-d81b9918-66ac-423d-a72e-4d8897ebf619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e8a5b7-2ba1-43fb-b645-77ed709f450c", "name": "network-vif-plugged", "status": "completed", "tag": "817447e6-82ad-4d6a-9fe3-ce2bf1fe5802"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:36.468362 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:36.468977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:36.469126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:36.470016 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:36.472969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9011c3a7-e7d5-445b-a904-cebc7acc5cf6 req-d81b9918-66ac-423d-a72e-4d8897ebf619 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:36.473674 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9011c3a7-e7d5-445b-a904-cebc7acc5cf6 req-d81b9918-66ac-423d-a72e-4d8897ebf619 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:36.474275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9011c3a7-e7d5-445b-a904-cebc7acc5cf6 req-d81b9918-66ac-423d-a72e-4d8897ebf619 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:36.476700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:36.477430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:36.478196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:42:36.480284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:36.481272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:36.481699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:36.483330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:36.483916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:36.484409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:36.489888 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9011c3a7-e7d5-445b-a904-cebc7acc5cf6 req-d81b9918-66ac-423d-a72e-4d8897ebf619 service nova] Creating event network-vif-plugged:817447e6-82ad-4d6a-9fe3-ce2bf1fe5802 for instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c on n-h2-854121-14 Oct 17 14:42:36.496497 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9011c3a7-e7d5-445b-a904-cebc7acc5cf6 req-d81b9918-66ac-423d-a72e-4d8897ebf619 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041189 Oct 17 14:42:36.497542 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4128/7811] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:42:36.667095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:36.675212 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d7bb7db-4384-4b64-8cf1-ae9d0511e0b2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.211396 Oct 17 14:42:36.675795 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3684/7812] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:36 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:37.700935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:37.701673 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:37.708139 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:37.708639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:37.709091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:37.710366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:37.710366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:37.710793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:37.864031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:37.872948 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e73f2a72-ead8-49e1-bf28-0735424d4e12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1392 microversion: 2.1 time: 0.177791 Oct 17 14:42:37.873615 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4129/7813] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:37 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:38.897516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:38.898082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:38.905533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:38.906025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:38.906470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:38.907173 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:38.907625 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:38.908056 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:39.043789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:39.051643 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ddede2ab-0194-49e5-9e9b-d13a49e1e611 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1564 microversion: 2.1 time: 0.158237 Oct 17 14:42:39.052212 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3685/7814] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:38 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:39.074515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:39.075142 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:39.082075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:39.082597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:39.083050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:39.083754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:39.084219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:39.084654 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:39.220857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:39.229068 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1127fd2a-1126-4a8d-9b24-c533e08f95fb tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1564 microversion: 2.1 time: 0.159073 Oct 17 14:42:39.229704 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4130/7815] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:39 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:42:41.116334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:42:41.117326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:42:41.119479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0f658d51-f883-4858-9dbb-c59ca6606582 req-a40bbce4-dd10-47f5-9653-3b5b678f2cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e8a5b7-2ba1-43fb-b645-77ed709f450c", "tag": "817447e6-82ad-4d6a-9fe3-ce2bf1fe5802"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:42:41.125083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:41.125609 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:41.126049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:41.126792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:41.127276 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:41.127703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:41.131324 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f658d51-f883-4858-9dbb-c59ca6606582 req-a40bbce4-dd10-47f5-9653-3b5b678f2cc6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:42:41.134431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f658d51-f883-4858-9dbb-c59ca6606582 req-a40bbce4-dd10-47f5-9653-3b5b678f2cc6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:42:41.135308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0f658d51-f883-4858-9dbb-c59ca6606582 req-a40bbce4-dd10-47f5-9653-3b5b678f2cc6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:42:41.148792 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0f658d51-f883-4858-9dbb-c59ca6606582 req-a40bbce4-dd10-47f5-9653-3b5b678f2cc6 service nova] Creating event network-changed:817447e6-82ad-4d6a-9fe3-ce2bf1fe5802 for instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c on n-h2-854121-14 Oct 17 14:42:41.155279 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0f658d51-f883-4858-9dbb-c59ca6606582 req-a40bbce4-dd10-47f5-9653-3b5b678f2cc6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039989 Oct 17 14:42:41.156198 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4131/7816] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:42:41.320530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:42:41.328838 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8340a48-a64a-46af-a458-9a34d7ee2fd6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1564 microversion: 2.1 time: 0.216941 Oct 17 14:42:41.329728 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3686/7817] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:42:41 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1564 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:43:20.632551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:20.633449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=40 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:20.638626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:43:20.641098 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:20.648809 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:20.649936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:20.650512 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:20.651237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:20.651704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:20.652143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:20.721870 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8a2b8c5-d74f-4ac0-a3f6-00351d5858fe tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c/action" status: 200 len: 24569 microversion: 2.1 time: 0.091202 Oct 17 14:43:20.722770 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4132/7818] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:43:20 2022] POST /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c/action => generated 24569 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:43:59.728396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=5 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:59.729220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=46 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:59.734500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:43:59.736798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:59.743509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:59.743984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:59.744418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:59.745103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:59.745576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:59.745997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:59.824780 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bdcb2fa7-b567-442d-b048-d022c7a01ef7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c/action" status: 202 len: 0 microversion: 2.1 time: 0.098077 Oct 17 14:43:59.825598 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3687/7819] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:43:59 2022] POST /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:43:59.835199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:43:59.836005 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:43:59.838435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:59.839194 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:43:59.846508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:59.847013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:59.847477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:43:59.848195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:43:59.848663 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:43:59.849106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:00.076215 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:00.084322 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4213b88a-538c-45c1-82e2-d650e5e032a0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1675 microversion: 2.1 time: 0.253638 Oct 17 14:44:00.084915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4133/7820] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:43:59 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:01.110929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:01.111617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:01.118007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:01.118509 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:01.118952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:01.119682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:01.120145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:01.120604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:01.301802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:01.309833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9f40337-c801-47a7-aeaf-ac00849b414c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.204864 Oct 17 14:44:01.310411 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3688/7821] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:01 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:02.332969 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:02.333657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:02.341270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:02.341687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:02.342144 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:02.342904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:02.343348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:02.343924 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:02.484069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:02.492095 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e34e9b12-59c2-46eb-87dc-494f4789b66f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.163067 Oct 17 14:44:02.492677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4134/7822] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:02 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:03.517627 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:03.518225 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:03.525202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:03.525692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:03.526131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:03.526826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:03.527278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:03.528227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:03.662197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:03.670030 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6da5ca3-a2e3-42c5-bde8-e69a71619704 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.156898 Oct 17 14:44:03.670631 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3689/7823] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:03 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:04.693631 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:04.694271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:04.701528 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:04.702035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:04.702496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:04.703221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:04.703695 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:04.704146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:04.844319 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:04.852187 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75f04cee-d1b9-4903-bf15-718d911fca8f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.162632 Oct 17 14:44:04.852758 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4135/7824] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:04 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:05.875518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:05.876168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:05.883275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:05.883642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:05.884089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:05.884792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:05.885280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:05.885714 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:06.021921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:06.030428 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21297829-dc00-4dd5-8641-956152480008 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.159096 Oct 17 14:44:06.031019 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3690/7825] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:05 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:07.054564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:07.055188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:07.062396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:07.062898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:07.063347 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:07.064052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:07.064518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:07.064953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:07.198796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:07.206781 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-229c04d2-92db-4916-9c3a-0a8edf6381bc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.156163 Oct 17 14:44:07.207360 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4136/7826] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:07 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:08.231308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:08.232037 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:08.238961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:08.239445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:08.239885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:08.240579 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:08.241039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:08.241494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:08.379578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:08.388603 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1f1d7eb9-3a8e-41a7-9bd2-c8b7b7416ba8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.161421 Oct 17 14:44:08.389214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3691/7827] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:08 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:09.413418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:09.413998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:09.417378 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:44:09.417542 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c (ip 10.222.0.65) !!! Oct 17 14:44:09.424732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:09.425310 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:09.425729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:09.426642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:09.427236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:09.427861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:09.568376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:09.576564 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59b89a07-78b3-4b23-a9fa-1004b4f34ce2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.167135 Oct 17 14:44:09.577303 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4137/7828] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:09 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:10.601918 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:10.602572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:10.611221 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:10.611712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:10.612171 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:10.612861 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:10.613387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:10.613820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:10.754867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:10.767709 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-651e0e64-4a46-4795-999d-220700836f95 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.169646 Oct 17 14:44:10.768287 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3692/7829] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:10 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:11.791870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:11.792500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:11.799883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:11.800383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:11.800848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:11.801595 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:11.802075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:11.802526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:11.936101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:11.943956 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f4e2599c-d8e3-4202-96ca-6e10335f2c9d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.156173 Oct 17 14:44:11.944528 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4138/7830] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:11 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:44:12.967755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:12.968438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:12.975516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:12.976004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:12.976443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:12.977138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:12.977623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:12.978050 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:13.119145 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:13.127949 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37e02236-d61a-4185-a4a4-0de9d055ec04 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.164676 Oct 17 14:44:13.128538 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3693/7831] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:12 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:14.152676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:14.153341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:14.160658 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:14.161195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:14.161667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:14.162409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:14.162885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:14.163414 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:14.296519 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:14.304456 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3dd22eb4-adc5-47d7-b405-6e91219f319c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.155849 Oct 17 14:44:14.305041 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4139/7832] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:14 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:15.328991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:15.329658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:15.336481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:15.336958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:15.337423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:15.338115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:15.338572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:15.338999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:15.472530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:15.480631 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69c91dea-d6e0-4a16-8b24-144d74d54f43 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1680 microversion: 2.1 time: 0.155543 Oct 17 14:44:15.481835 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3694/7833] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:15 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:16.505227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:44:16.506188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:16.514136 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:16.514914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:16.515375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:16.516128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:16.517346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:16.517906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:16.658937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:44:16.667020 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f30c3e44-3d3e-483b-803d-bc3158a3712b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1683 microversion: 2.1 time: 0.166198 Oct 17 14:44:16.667641 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4140/7834] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:44:16 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:44:52.904952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:44:52.907157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:44:52.909622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:52.910418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:44:52.916030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:52.916523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:52.916995 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:52.918363 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:44:52.918814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:44:52.919240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:44:52.993981 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-537b2803-d9f6-4329-867d-818ebeb7eb12 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c/action" status: 200 len: 69060 microversion: 2.1 time: 0.093932 Oct 17 14:44:52.994812 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3695/7835] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:44:52 2022] POST /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c/action => generated 69060 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:45:16.884829 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:16.885661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=48 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:16.893908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:16.895530 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:16.898038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:16.898839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:16.909286 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:16.910107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:16.910568 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:16.911553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:16.912027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:16.912476 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:16.942614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:45:16.952898 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-58ee9ba8-47a6-46ef-a0df-3e5e0897d2b9 req-6ff9d7e9-514c-4144-9fb2-df0f78042353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1e8a5b7-2ba1-43fb-b645-77ed709f450c", "tag": "817447e6-82ad-4d6a-9fe3-ce2bf1fe5802"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:16.964838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-58ee9ba8-47a6-46ef-a0df-3e5e0897d2b9 req-6ff9d7e9-514c-4144-9fb2-df0f78042353 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:16.965471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-58ee9ba8-47a6-46ef-a0df-3e5e0897d2b9 req-6ff9d7e9-514c-4144-9fb2-df0f78042353 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:16.966001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-58ee9ba8-47a6-46ef-a0df-3e5e0897d2b9 req-6ff9d7e9-514c-4144-9fb2-df0f78042353 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:16.980303 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-58ee9ba8-47a6-46ef-a0df-3e5e0897d2b9 req-6ff9d7e9-514c-4144-9fb2-df0f78042353 service nova] Creating event network-changed:817447e6-82ad-4d6a-9fe3-ce2bf1fe5802 for instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c on n-h2-854121-14 Oct 17 14:45:16.986292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-58ee9ba8-47a6-46ef-a0df-3e5e0897d2b9 req-6ff9d7e9-514c-4144-9fb2-df0f78042353 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100535 Oct 17 14:45:16.987128 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3696/7836] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:45:17.029884 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f02e9401-a36f-41e4-ba46-19046f6edb3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 204 len: 0 microversion: 2.1 time: 0.147174 Oct 17 14:45:17.030700 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4141/7837] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:45:16 2022] DELETE /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 17 14:45:17.039984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:17.041047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:17.048678 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:17.049216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:17.049926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:17.050634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:17.051304 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:17.051899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:17.209259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:17.217457 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1e38158-8809-49ab-96fa-32200dc8c322 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1689 microversion: 2.1 time: 0.182168 Oct 17 14:45:17.218041 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3697/7838] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:17 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:18.243524 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:18.244231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:18.252986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:18.253522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:18.253981 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:18.254703 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:18.255185 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:18.255633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:18.449075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:18.457760 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e82c7215-207d-4fe9-b8b4-8c066ca324ac tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1689 microversion: 2.1 time: 0.219167 Oct 17 14:45:18.458346 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4142/7839] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:18 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1689 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:19.468390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9f1e8486-d70d-4e33-9d63-d49c9e050d13 req-e171772d-0cbe-4c86-83b0-ccb601f13c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1e8a5b7-2ba1-43fb-b645-77ed709f450c", "name": "network-vif-deleted", "tag": "817447e6-82ad-4d6a-9fe3-ce2bf1fe5802"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:19.479804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9f1e8486-d70d-4e33-9d63-d49c9e050d13 req-e171772d-0cbe-4c86-83b0-ccb601f13c41 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:19.480378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9f1e8486-d70d-4e33-9d63-d49c9e050d13 req-e171772d-0cbe-4c86-83b0-ccb601f13c41 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:19.481043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9f1e8486-d70d-4e33-9d63-d49c9e050d13 req-e171772d-0cbe-4c86-83b0-ccb601f13c41 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:19.483857 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:19.484769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:19.492883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:19.493776 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:19.494588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:19.495531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:19.496208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:19.496771 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9f1e8486-d70d-4e33-9d63-d49c9e050d13 req-e171772d-0cbe-4c86-83b0-ccb601f13c41 service nova] Creating event network-vif-deleted:817447e6-82ad-4d6a-9fe3-ce2bf1fe5802 for instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c on n-h2-854121-14 Oct 17 14:45:19.496936 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:19.505228 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9f1e8486-d70d-4e33-9d63-d49c9e050d13 req-e171772d-0cbe-4c86-83b0-ccb601f13c41 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096383 Oct 17 14:45:19.505989 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3698/7840] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:45:19.537980 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:19.538597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:19.539140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:19.539681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lazy-loading 'fault' on Instance uuid b1e8a5b7-2ba1-43fb-b645-77ed709f450c {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:45:19.584190 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:19.593407 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c03a168b-1724-4040-88ce-d6a1a8e9f2f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 200 len: 1356 microversion: 2.1 time: 0.114902 Oct 17 14:45:19.594006 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4143/7841] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:19 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 1356 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:45:20.618956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:20.619659 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: b1e8a5b7-2ba1-43fb-b645-77ed709f450c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:20.627422 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:20.627901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:20.628344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:20.629036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:20.629518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:20.629975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:20.644882 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] HTTP exception thrown: Instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c could not be found. Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Request method failure captured: Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c HTTP/1.1 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWmIjD4meV5MrLtAhIOzZ6LOjFI3UMt0z1GIRPVutxI-ohLoPM1P_-cC2jOANVgh1S79zoAcRM6KvOhl3Uf7HvsBPnQQX6YTHjtvujMHEbL-0V011PHjecJsb7BrdpeayfWAE_82K6KrBgyMEpk_0Mrp5TwpsmB4TCrKe48Gqcd2eIA Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 5f80f8463b2e4e1a86f4c2ba67f2205a Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c could not be found. Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'b1e8a5b7-2ba1-43fb-b645-77ed709f450c'} Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c could not be found. Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c could not be found. Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:45:20.646588 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c could not be found. Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Returning 404 to user: Instance b1e8a5b7-2ba1-43fb-b645-77ed709f450c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-caaaf1c7-bbde-4906-bc34-6b168c87d992 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c" status: 404 len: 111 microversion: 2.1 time: 0.033370 Oct 17 14:45:20.653278 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3699/7842] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:20 2022] GET /compute/v2.1/servers/b1e8a5b7-2ba1-43fb-b645-77ed709f450c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:45:23.732805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1ac57ebd-a92f-401f-b836-13f5991a3292 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '.version_select at 0x7f419d121430>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:23.759491 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1ac57ebd-a92f-401f-b836-13f5991a3292 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1210890476" status: 202 len: 0 microversion: 2.1 time: 0.031269 Oct 17 14:45:23.761868 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4144/7843] 10.222.0.65 () {58 vars in 1284 bytes} [Mon Oct 17 14:45:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1210890476 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:45:23.794010 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-629176bc-b6a7-452a-b2f6-a150793c0b9a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: .version_select at 0x7f419cde8b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1139006631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKF/MFXn+AatBRYJNrUfT2ozXwdZmEyRlgBdTlK2u7yGVLehjzcpPgKguMXTHykQmlmknI/a4EmJHJXGgOvMLP7Fs+jx0gN+UpDpRbgqfmlaanoZAhy/DHIC/FwzWvCDXA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:23.814528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-629176bc-b6a7-452a-b2f6-a150793c0b9a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:45:23.820030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-629176bc-b6a7-452a-b2f6-a150793c0b9a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:45:23.844097 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-629176bc-b6a7-452a-b2f6-a150793c0b9a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054165 Oct 17 14:45:23.844710 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3700/7844] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:45:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:29.665660 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-823511673", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "ae077b0d-f972-425e-804c-9a9d0a44b73f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1139006631", "security_groups": [{"name": "tempest-secgroup-smoke-2013049629"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:29.677492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:29.785946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] validate_networks() for [('ae077b0d-f972-425e-804c-9a9d0a44b73f', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:45:30.319819 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:45:30.320275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:45:30.320811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:45:30.321273 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:45:30.322168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:45:30.334699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:30.335211 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:30.335683 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:30.337297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:30.337784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:30.338232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:30.362094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:45:30.369320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:45:30.388927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:45:30.392196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:45:30.477276 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-79a85339-1608-4e18-b237-d400c0b17a70 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815649 Oct 17 14:45:30.479326 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4145/7845] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:45:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:45:30.492471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-efadbef4-c8d1-45e9-9ebe-8257c2f2db05 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:30.493320 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-efadbef4-c8d1-45e9-9ebe-8257c2f2db05 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:30.584303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-efadbef4-c8d1-45e9-9ebe-8257c2f2db05 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:30.593197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-efadbef4-c8d1-45e9-9ebe-8257c2f2db05 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1266 microversion: 2.1 time: 0.106086 Oct 17 14:45:30.597742 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3701/7846] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:30 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:31.624704 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:31.626912 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:31.642416 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:31.643147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:31.645579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:31.646571 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:31.647224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:31.648770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:31.720699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:31.729430 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8572d03d-cb19-47f6-b996-5ea798d5419d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1326 microversion: 2.1 time: 0.112037 Oct 17 14:45:31.735860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4146/7847] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:31 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:32.756396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:32.758104 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:32.766991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:32.771636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:32.772430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:32.773484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:32.774540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:32.775560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:32.776391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:32.931583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:32.940396 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e19f04db-4c1d-44dd-be32-1dc17f410d3e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.188227 Oct 17 14:45:32.941489 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3702/7848] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:32 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:33.245785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-26d36d56-428d-4674-b8b4-9fe2a80f1f95 req-108b8e8f-1fd7-4a6b-a802-3b395a8448ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:33.259582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-26d36d56-428d-4674-b8b4-9fe2a80f1f95 req-108b8e8f-1fd7-4a6b-a802-3b395a8448ed service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:33.260101 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-26d36d56-428d-4674-b8b4-9fe2a80f1f95 req-108b8e8f-1fd7-4a6b-a802-3b395a8448ed service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:33.260614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-26d36d56-428d-4674-b8b4-9fe2a80f1f95 req-108b8e8f-1fd7-4a6b-a802-3b395a8448ed service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:33.273837 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-26d36d56-428d-4674-b8b4-9fe2a80f1f95 req-108b8e8f-1fd7-4a6b-a802-3b395a8448ed service nova] Creating event network-changed:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h1-854121-14 Oct 17 14:45:33.279103 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-26d36d56-428d-4674-b8b4-9fe2a80f1f95 req-108b8e8f-1fd7-4a6b-a802-3b395a8448ed service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037124 Oct 17 14:45:33.279753 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4147/7849] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:45:33.965382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:33.966075 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:33.972962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:33.973475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:33.973919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:33.974631 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:33.975089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:33.975523 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:34.112542 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:34.120371 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b6bccc6-9a8a-4691-8045-e3ddb9afe051 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.158950 Oct 17 14:45:34.120947 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3703/7850] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:33 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:35.146448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:35.147150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:35.153946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:35.154530 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:35.154982 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:35.155690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:35.156154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:35.156588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:35.290089 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:35.298244 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94ea4ae9-b49c-49df-82f2-cd1662e6eef1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.156951 Oct 17 14:45:35.298828 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4148/7851] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:35 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:36.321361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:36.321991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:36.328370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:36.328850 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:36.329309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:36.329993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:36.330439 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:36.330858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:36.460837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:36.469218 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e769a04-6057-4e49-be8e-0176e6426928 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.151751 Oct 17 14:45:36.469793 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3704/7852] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:36 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:37.492079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:37.492686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:37.499617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:37.500118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:37.500597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:37.501340 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:37.501803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:37.502243 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:37.643207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:37.651283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ca592f73-949e-48ba-ac94-3602424f891c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.163268 Oct 17 14:45:37.651860 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4149/7853] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:37 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:38.675478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:38.676120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:38.683045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:38.683524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:38.683986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:38.684892 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:38.685387 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:38.685812 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:38.822438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:38.831610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eea92a0f-dd44-498a-a38a-7cede11b760d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.160001 Oct 17 14:45:38.832214 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3705/7854] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:38 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:38.966791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6d765a05-94ff-4520-a94d-76e367d366be req-bce87c22-bc26-47ba-bbd0-a8c84dbf2b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "name": "network-vif-plugged", "status": "completed", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:38.976896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6d765a05-94ff-4520-a94d-76e367d366be req-bce87c22-bc26-47ba-bbd0-a8c84dbf2b91 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:38.977517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6d765a05-94ff-4520-a94d-76e367d366be req-bce87c22-bc26-47ba-bbd0-a8c84dbf2b91 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:38.977891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6d765a05-94ff-4520-a94d-76e367d366be req-bce87c22-bc26-47ba-bbd0-a8c84dbf2b91 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:38.990207 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6d765a05-94ff-4520-a94d-76e367d366be req-bce87c22-bc26-47ba-bbd0-a8c84dbf2b91 service nova] Creating event network-vif-plugged:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h1-854121-14 Oct 17 14:45:38.996247 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6d765a05-94ff-4520-a94d-76e367d366be req-bce87c22-bc26-47ba-bbd0-a8c84dbf2b91 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102746 Oct 17 14:45:38.997903 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4150/7855] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:39.854964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:39.856555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:39.864515 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:39.865007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:39.865476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:39.866184 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:39.866635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:39.867060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:40.023294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:40.032408 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8066725e-1786-4640-ba5f-c63b7d863939 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1392 microversion: 2.1 time: 0.181629 Oct 17 14:45:40.033136 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3706/7856] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:39 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:41.061153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:41.061895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:41.064739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:41.065459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:41.071572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:41.072072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:41.072548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:41.073289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:41.073762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:41.074201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:41.208466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:41.216526 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61633e97-4e67-4b99-8505-85a95b1a5131 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1563 microversion: 2.1 time: 0.160563 Oct 17 14:45:41.217108 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4151/7857] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:41 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:41.239335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:41.239942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:41.241856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:45:41.248753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:41.249262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:41.249701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:41.250390 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:41.250853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:41.251250 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:41.385835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:41.394648 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0dd7b169-5bbb-4f40-a35c-415e883bac2a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1563 microversion: 2.1 time: 0.159199 Oct 17 14:45:41.395231 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3707/7858] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:41 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:45:43.288441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:45:43.289852 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:45:43.290166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-52ff4d9d-be17-4e7d-ad9f-cede42adab28 req-cade68d2-f893-4eab-bee0-71c8b972b81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:45:43.297806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.298402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.298938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.299739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.300454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.300901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.301041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-52ff4d9d-be17-4e7d-ad9f-cede42adab28 req-cade68d2-f893-4eab-bee0-71c8b972b81d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:45:43.301506 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-52ff4d9d-be17-4e7d-ad9f-cede42adab28 req-cade68d2-f893-4eab-bee0-71c8b972b81d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:45:43.301942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-52ff4d9d-be17-4e7d-ad9f-cede42adab28 req-cade68d2-f893-4eab-bee0-71c8b972b81d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:45:43.314813 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-52ff4d9d-be17-4e7d-ad9f-cede42adab28 req-cade68d2-f893-4eab-bee0-71c8b972b81d service nova] Creating event network-changed:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h1-854121-14 Oct 17 14:45:43.320328 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-52ff4d9d-be17-4e7d-ad9f-cede42adab28 req-cade68d2-f893-4eab-bee0-71c8b972b81d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033957 Oct 17 14:45:43.321732 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3708/7859] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:45:43.456688 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:45:43.466081 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0f137c2-0f36-431b-a5d5-a0eaee17c588 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1563 microversion: 2.1 time: 0.180903 Oct 17 14:45:43.467451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4152/7860] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:45:43 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:06.718388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:06.721438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:06.724364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:06.725302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=38 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:06.732682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:06.733245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:06.733919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:06.734819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:06.735467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:06.736047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:06.791901 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47d92899-508f-497d-9011-134acb1d48c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action" status: 200 len: 24569 microversion: 2.1 time: 0.078894 Oct 17 14:46:06.792847 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3709/7861] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:46:06 2022] POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action => generated 24569 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:46:17.822046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:17.822990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:17.874818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:17.877317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:17.883436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:17.883953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:17.884706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:17.885475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:17.885954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:17.886403 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:17.928500 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:17.934615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Old instance type m1.heat2, new instance type m1.heat {{(pid=120697) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 17 14:46:17.942110 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:46:17.942551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:46:17.943039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:46:17.943488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:46:17.943915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:46:18.009933 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8dfb42fe-ade2-47c7-9648-34e02be7e502 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action" status: 202 len: 0 microversion: 2.1 time: 0.193341 Oct 17 14:46:18.010706 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4153/7862] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:46:17 2022] POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:46:18.020002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:18.020792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:18.023575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:18.024372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:46:18.030798 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:18.031283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:18.031723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:18.032428 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:18.033040 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:18.033388 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:18.185511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:18.194513 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5fafee6f-f01a-4cf9-bf2e-3c940e299c4d tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1690 microversion: 2.1 time: 0.179022 Oct 17 14:46:18.195100 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3710/7863] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:18 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:46:19.223954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:19.224602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:19.231929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:19.232437 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:19.232898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:19.234434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:19.234931 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:19.235379 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:19.372538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:19.380887 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9d383ea-5ecf-4ed6-b538-c41f72966312 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1690 microversion: 2.1 time: 0.162155 Oct 17 14:46:19.381513 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4154/7864] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:19 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:20.404103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:20.404834 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:20.412716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:20.413223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:20.413664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:20.414365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:20.414820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:20.415243 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:20.554956 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:20.562896 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1aab2d0f-d7d7-471a-9033-19171e8093ae tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.162926 Oct 17 14:46:20.563469 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3711/7865] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:20 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:21.587140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:21.587784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:21.594972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:21.595499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:21.595959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:21.596679 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:21.597153 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:21.597638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:21.738869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:21.746795 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-79db0d95-e98e-4b92-ab9c-e18c10c81af7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.163851 Oct 17 14:46:21.747397 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4155/7866] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:21 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:22.771470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:22.772230 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:22.780423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:22.780801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:22.781265 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:22.781972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:22.782423 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:22.782845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:22.917682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:22.926367 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cfb22ddc-f4ea-454e-a0cb-262d3f712c89 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.158859 Oct 17 14:46:22.926938 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3712/7867] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:22 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:23.951626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:23.952169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:23.959872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:23.960375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:23.960841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:23.961582 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:23.962057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:23.962508 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:24.098772 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:24.106780 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb4cc607-a353-4dc1-a2e1-dba229203b4a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.159226 Oct 17 14:46:24.107366 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4156/7868] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:23 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:25.130419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:25.131150 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:25.138254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:25.138732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:25.139158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:25.139906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:25.140356 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:25.141034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:25.276641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:25.285522 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b574e70-597b-4491-b0e8-dc17f670baf6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.159113 Oct 17 14:46:25.286177 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3713/7869] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:25 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:26.309099 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:26.309751 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:26.318019 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:26.318518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:26.318966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:26.319678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:26.320141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:26.320581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:26.455056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:26.463051 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fef2d469-8201-4759-b555-fa570607b80f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.157909 Oct 17 14:46:26.463630 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4157/7870] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:26 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:27.488286 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:27.488899 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:27.495773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:27.496262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:27.496700 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:27.497419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:27.497908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:27.498317 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:27.632847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:27.641298 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a81c7c25-839a-46d5-9bf6-6714651aa0a2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.157491 Oct 17 14:46:27.641883 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3714/7871] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:27 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:28.665386 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:28.666023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:28.673383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:28.673892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:28.674360 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:28.675113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:28.675584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:28.676031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:28.820898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:28.829107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f71afa71-1bd2-45c2-85b6-db9e87f58497 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.167597 Oct 17 14:46:28.829679 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4158/7872] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:28 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:29.852827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:29.853487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:29.861565 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:29.862080 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:29.862511 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:29.863208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:29.863656 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:29.864077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:30.012105 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:30.020804 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2c9a08a-81da-4990-ad28-e3e00468ada7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.171929 Oct 17 14:46:30.021441 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3715/7873] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:29 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:31.043930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:31.044562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:31.052013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:31.052518 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:31.052978 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:31.053723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:31.054201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:31.054647 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:31.192897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:31.200809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8438f346-395c-4a3b-a7b4-21be9e5f1ca2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.160835 Oct 17 14:46:31.201478 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4159/7874] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:31 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:32.224835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:32.225507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:32.232357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:32.232845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:32.233321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:32.234023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:32.234478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:32.234909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:32.368291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:32.376881 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4d11c84-5b9f-4dd0-8742-988752856726 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.155944 Oct 17 14:46:32.377505 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3716/7875] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:32 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:33.401861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:33.402480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:33.409463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:33.409960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:33.410411 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:33.411118 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:33.411586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:33.412026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:33.548831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:33.557170 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63dfc121-50cb-4bfd-b441-5b114da93dfa tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.159178 Oct 17 14:46:33.557750 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4160/7876] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:33 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:34.581586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:34.582201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:34.589149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:34.589669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:34.590111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:34.590804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:34.591255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:34.591707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:34.724130 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:34.732079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ff5f78e-711f-4659-b0bb-d76f56af26b7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.155235 Oct 17 14:46:34.732650 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3717/7877] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:34 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:35.757690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:35.758282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:35.764935 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:35.765479 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:35.766205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:35.767096 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:35.767574 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:35.768026 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:35.905544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:35.913519 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-678e1494-4e6c-4f21-b907-6f74f5e01d31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.161046 Oct 17 14:46:35.914100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4161/7878] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:35 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:36.938273 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:36.938835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:36.945630 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:36.946112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:36.946551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:36.947594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:36.947726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:36.948108 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:37.083527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:37.091383 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-500e3193-26de-4b46-99de-4703a323940f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1695 microversion: 2.1 time: 0.157658 Oct 17 14:46:37.091959 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3718/7879] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:36 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:37.973415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:37.984817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:37.985387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:37.985850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:37.998485 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] Creating event network-vif-unplugged:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h2-854121-14 Oct 17 14:46:38.005382 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120697) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:46:38.017506 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-625230cd-a089-4a9d-9b2e-3ac1de69915b req-a7cd1204-70b4-44cf-9777-d2dc0e15b087 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047756 Oct 17 14:46:38.018451 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4162/7880] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:38.116017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:38.116763 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:38.123773 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:38.124264 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:38.124704 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:38.126099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:38.126779 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:38.127220 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:38.272539 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:38.280728 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d76ce228-e2bc-4665-bed1-0640dd32074b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1694 microversion: 2.1 time: 0.168671 Oct 17 14:46:38.281990 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3719/7881] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:38 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:39.308449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:39.309180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:39.316364 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:39.316864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:39.317354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:39.318064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:39.318535 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:39.318977 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:39.452037 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:39.460498 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-be933613-eb87-4131-8fad-01dc46682d2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1692 microversion: 2.1 time: 0.157372 Oct 17 14:46:39.461083 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4163/7882] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:39 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:40.033397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:40.043778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:40.044260 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:40.044702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:40.057151 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] Creating event network-changed:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h2-854121-14 Oct 17 14:46:40.063044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854121-14', 'n-h2-854121-14'} {{(pid=120698) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 17 14:46:40.074097 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-31c81e53-ac69-46ea-879a-48d418a40977 req-e2972473-d122-4bbe-95f9-b05bcac2ef4d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044491 Oct 17 14:46:40.074703 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3720/7883] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:46:40.484760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:40.485586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:40.492570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:40.493070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:40.493557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:40.494271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:40.494762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:40.495200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:40.640308 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:40.649507 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c3d8fc81-6154-41ce-a591-b9b72c330612 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1692 microversion: 2.1 time: 0.168709 Oct 17 14:46:40.650099 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4164/7884] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:40 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:41.676307 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:41.677001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:41.685789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:41.686274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:41.686705 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:41.687687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:41.688140 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:41.688562 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:41.836925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:41.846913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2858323-b8c9-4558-96cc-56dbc82e68d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1692 microversion: 2.1 time: 0.176964 Oct 17 14:46:41.847810 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3721/7885] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:41 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:42.871811 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:42.872420 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:42.879734 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:42.880265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:42.880723 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:42.881473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:42.881952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:42.882400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.024029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:43.033004 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-652930e7-0c0e-49b7-a8c7-3475ea123d39 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1689 microversion: 2.1 time: 0.165186 Oct 17 14:46:43.033626 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4165/7886] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:42 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:43.060283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:43.061032 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:43.067931 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:43.068401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:43.068828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.069591 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:43.070034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:43.070452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.133189 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37cea5e7-f814-4cf3-b1ee-f2f068c1db84 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action" status: 204 len: 0 microversion: 2.1 time: 0.076500 Oct 17 14:46:43.133998 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3722/7887] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:46:43 2022] POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:46:43.143352 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:43.144260 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:43.150250 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:43.150782 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:43.151196 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.152018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:43.152486 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:43.152991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.299678 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:43.307940 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eadf0fd2-a997-4633-a8d5-cbf7b5f200c2 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1689 microversion: 2.1 time: 0.169468 Oct 17 14:46:43.308732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4166/7888] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:43 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:43.331602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:43.332391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:43.338915 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:43.339481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:43.340024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.340787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:43.341385 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:43.341881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:43.482278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:43.491526 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8bf892e4-1072-493e-8f40-d7286f4655d7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1689 microversion: 2.1 time: 0.164246 Oct 17 14:46:43.492826 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3723/7889] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:43 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:44.516559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:46:44.517210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:46:44.524480 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:44.525011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:44.525497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:44.526216 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:44.526700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:44.527137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:44.666953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:46:44.675050 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b2a958cb-04b2-4dbf-9e6e-e4daa0e081bf tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1681 microversion: 2.1 time: 0.162870 Oct 17 14:46:44.675655 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4167/7890] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:46:44 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:46:45.638521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-518df87e-b464-4774-a712-b15188d325c7 req-c32646e7-b37f-4b01-954a-777013cd471e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "name": "network-vif-plugged", "status": "completed", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:46:45.650205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-518df87e-b464-4774-a712-b15188d325c7 req-c32646e7-b37f-4b01-954a-777013cd471e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:46:45.650761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-518df87e-b464-4774-a712-b15188d325c7 req-c32646e7-b37f-4b01-954a-777013cd471e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:46:45.651572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-518df87e-b464-4774-a712-b15188d325c7 req-c32646e7-b37f-4b01-954a-777013cd471e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:46:45.664005 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-518df87e-b464-4774-a712-b15188d325c7 req-c32646e7-b37f-4b01-954a-777013cd471e service nova] Creating event network-vif-plugged:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h2-854121-14 Oct 17 14:46:45.668967 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-518df87e-b464-4774-a712-b15188d325c7 req-c32646e7-b37f-4b01-954a-777013cd471e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034490 Oct 17 14:46:45.669835 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3724/7891] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:47:18.902184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:18.904421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:18.906955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=34 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:18.907651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:18.913587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:18.914097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:18.914561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:18.915285 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:18.915760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:18.916208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:18.987802 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-887f07bf-d6c7-4235-a199-1bdc9c96e5e0 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action" status: 200 len: 24578 microversion: 2.1 time: 0.089473 Oct 17 14:47:18.988482 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4168/7892] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:47:18 2022] POST /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396/action => generated 24578 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:47:42.997316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=30 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:42.998139 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:43.004491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:43.004886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-06fa3dea-296f-4b28-b4c7-ae0546fc82ff req-519bf51f-e170-4093-8438-223074bd7242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:43.005552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:43.014757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.015246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.015822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:43.016807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.017254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:43.018092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.018575 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.019489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.025769 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-06fa3dea-296f-4b28-b4c7-ae0546fc82ff req-519bf51f-e170-4093-8438-223074bd7242 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.026602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-06fa3dea-296f-4b28-b4c7-ae0546fc82ff req-519bf51f-e170-4093-8438-223074bd7242 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.027644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-06fa3dea-296f-4b28-b4c7-ae0546fc82ff req-519bf51f-e170-4093-8438-223074bd7242 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.047831 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-06fa3dea-296f-4b28-b4c7-ae0546fc82ff req-519bf51f-e170-4093-8438-223074bd7242 service nova] Creating event network-changed:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h2-854121-14 Oct 17 14:47:43.053934 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-06fa3dea-296f-4b28-b4c7-ae0546fc82ff req-519bf51f-e170-4093-8438-223074bd7242 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056409 Oct 17 14:47:43.055037 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4169/7893] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:47:43.057982 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:47:43.169999 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c986cb7-af1a-4df1-ba15-dbfb7f18dd35 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 204 len: 0 microversion: 2.1 time: 0.175101 Oct 17 14:47:43.170601 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3725/7894] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:47:42 2022] DELETE /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:47:43.180621 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:43.181804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:43.193693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.194373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.194849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.195604 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:43.196085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:43.196685 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:43.410375 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:43.420167 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce333756-83f5-46dd-a76b-f5b289873918 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1687 microversion: 2.1 time: 0.244141 Oct 17 14:47:43.420774 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4170/7895] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:43 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1687 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:44.448764 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:44.449469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:44.456959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:44.457470 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:44.457912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:44.458608 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:44.459062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:44.459518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:44.596181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:44.604076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a7456049-10f4-4d92-a275-56c93a727a26 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1687 microversion: 2.1 time: 0.159786 Oct 17 14:47:44.604647 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3726/7896] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:44 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:45.279950 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7e2db736-aba7-417a-accb-ce0ad93a5986 req-3b31d5cc-ecef-43d7-9b1b-69749e374c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da4d6d6-2854-45d8-846a-85792c2ff396", "name": "network-vif-deleted", "tag": "c4b8542e-f5fb-4742-9811-f9a0447677d0"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:45.292766 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7e2db736-aba7-417a-accb-ce0ad93a5986 req-3b31d5cc-ecef-43d7-9b1b-69749e374c64 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.293363 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7e2db736-aba7-417a-accb-ce0ad93a5986 req-3b31d5cc-ecef-43d7-9b1b-69749e374c64 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.293812 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7e2db736-aba7-417a-accb-ce0ad93a5986 req-3b31d5cc-ecef-43d7-9b1b-69749e374c64 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:45.307732 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7e2db736-aba7-417a-accb-ce0ad93a5986 req-3b31d5cc-ecef-43d7-9b1b-69749e374c64 service nova] Creating event network-vif-deleted:c4b8542e-f5fb-4742-9811-f9a0447677d0 for instance 4da4d6d6-2854-45d8-846a-85792c2ff396 on n-h2-854121-14 Oct 17 14:47:45.314223 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7e2db736-aba7-417a-accb-ce0ad93a5986 req-3b31d5cc-ecef-43d7-9b1b-69749e374c64 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038002 Oct 17 14:47:45.314843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4171/7897] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:45.629537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:45.630181 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:45.637687 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.638187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.638632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:45.639344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.639801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.640235 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:45.676490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:45.676976 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:45.677452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:45.677908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lazy-loading 'fault' on Instance uuid 4da4d6d6-2854-45d8-846a-85792c2ff396 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:47:45.724136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:45.732029 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfb939b2-c7da-4066-9d20-3a07a00c1569 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 200 len: 1356 microversion: 2.1 time: 0.106536 Oct 17 14:47:45.732663 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3727/7898] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:45 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:46.757256 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:46.757983 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 4da4d6d6-2854-45d8-846a-85792c2ff396] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:46.765079 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:46.765610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:46.766069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:46.767040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:46.767580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:46.768540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:46.785090 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] HTTP exception thrown: Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 could not be found. Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Request method failure captured: Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 HTTP/1.1 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWmIjD4meV5MrLtAhIOzZ6LOjFI3UMt0z1GIRPVutxI-ohLoPM1P_-cC2jOANVgh1S79zoAcRM6KvOhl3Uf7HvsBPnQQX6YTHjtvujMHEbL-0V011PHjecJsb7BrdpeayfWAE_82K6KrBgyMEpk_0Mrp5TwpsmB4TCrKe48Gqcd2eIA Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 5f80f8463b2e4e1a86f4c2ba67f2205a Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 could not be found. Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '4da4d6d6-2854-45d8-846a-85792c2ff396'} Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 could not be found. Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 could not be found. Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:47:46.786789 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 could not be found. Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Returning 404 to user: Instance 4da4d6d6-2854-45d8-846a-85792c2ff396 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a1bfad94-bbb2-4660-acf3-421c5524094b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396" status: 404 len: 111 microversion: 2.1 time: 0.035973 Oct 17 14:47:46.792470 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4172/7899] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:46 2022] GET /compute/v2.1/servers/4da4d6d6-2854-45d8-846a-85792c2ff396 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:47:50.170667 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:47:50.171260 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1139006631 (ip 10.222.0.65) !!! Oct 17 14:47:50.172306 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:47:50.172433 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1139006631 (ip 10.222.0.65) !!! Oct 17 14:47:50.177223 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd4ef7d8-5fe7-4878-accb-c2770231ba85 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '.version_select at 0x7f419c936670>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:50.216970 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd4ef7d8-5fe7-4878-accb-c2770231ba85 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1139006631" status: 202 len: 0 microversion: 2.1 time: 0.048134 Oct 17 14:47:50.217626 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3728/7900] 10.222.0.65 () {58 vars in 1284 bytes} [Mon Oct 17 14:47:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1139006631 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:47:50.240125 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08db974e-972e-488b-bd02-6ebbb607e38e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: .version_select at 0x7f419e4f53a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-236899238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWRC4oezJkGfTK4tHfsayh8nBXQOfQ3xhE3NWBo6ri4OSrfkVJ/c44O+gS+idfLh7Rcyvw9wIcQ+6wUhYoMCSSoWeJE00ifaMLqD983jn/TfFKE7bQlVavTbhIf3CvurQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:50.261616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-08db974e-972e-488b-bd02-6ebbb607e38e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:47:50.268322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-08db974e-972e-488b-bd02-6ebbb607e38e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:47:50.286820 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08db974e-972e-488b-bd02-6ebbb607e38e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [661d870a-e61f-4b3f-b903-130bd3e92676] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:47:51.292756 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [None req-08db974e-972e-488b-bd02-6ebbb607e38e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [661d870a-e61f-4b3f-b903-130bd3e92676] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 58784. Oct 17 14:47:51.308413 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08db974e-972e-488b-bd02-6ebbb607e38e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.073015 Oct 17 14:47:51.309031 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4173/7901] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:47:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:47:57.229732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:57.236061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-826861239", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "b6ad13c0-3a5a-4f80-8746-354877bf8ace"}], "key_name": "tempest-TestNetworkAdvancedServerOps-236899238", "security_groups": [{"name": "tempest-secgroup-smoke-722447319"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:47:57.370174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] validate_networks() for [('b6ad13c0-3a5a-4f80-8746-354877bf8ace', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:47:57.829606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:47:57.830061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:47:57.830546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:47:57.830959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:47:57.831690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:47:57.841395 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:57.841882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:57.842321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:57.843765 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:57.844229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:57.844662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:57.863076 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:47:57.868518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:47:57.882110 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:47:57.884500 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:47:57.934816 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f84e25e-d59d-4565-8934-e8ccbb5b1770 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.706831 Oct 17 14:47:57.940928 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3729/7902] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:47:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:47:57.945611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:47:57.950265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-989b3a1d-1fb0-402f-9d49-dc528a4ca8e3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:57.950889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-989b3a1d-1fb0-402f-9d49-dc528a4ca8e3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:58.015166 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-989b3a1d-1fb0-402f-9d49-dc528a4ca8e3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:58.025364 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-989b3a1d-1fb0-402f-9d49-dc528a4ca8e3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1265 microversion: 2.1 time: 0.080599 Oct 17 14:47:58.026427 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4174/7903] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:57 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:47:59.051551 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:47:59.052842 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:47:59.060688 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:59.061187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:59.061633 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:59.062491 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:47:59.062787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:47:59.063207 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:47:59.157998 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:47:59.183078 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8977d0f-960d-4446-9c98-bd31f49069f7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1325 microversion: 2.1 time: 0.136887 Oct 17 14:47:59.197400 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3730/7904] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:47:59 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:00.208415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:00.209075 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:00.218093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:00.218616 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:00.219086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:00.220197 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:00.220622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:00.221066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:00.384767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:00.394794 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-50d2c8f9-80c8-49d9-b1b2-fbd1f69ae467 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1390 microversion: 2.1 time: 0.191958 Oct 17 14:48:00.410100 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4175/7905] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:00 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1390 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:00.669456 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f562be0e-f96d-4678-994c-84ee8b1b032b req-35b15912-035c-4c96-bf1c-2125858ab128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda7dc40-8f6a-4a66-82af-9be7a967450f", "tag": "4931cb57-87a2-42f9-ab6b-1911e09bc6bf"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:00.684262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f562be0e-f96d-4678-994c-84ee8b1b032b req-35b15912-035c-4c96-bf1c-2125858ab128 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:00.684756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f562be0e-f96d-4678-994c-84ee8b1b032b req-35b15912-035c-4c96-bf1c-2125858ab128 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:00.685227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f562be0e-f96d-4678-994c-84ee8b1b032b req-35b15912-035c-4c96-bf1c-2125858ab128 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:00.697784 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f562be0e-f96d-4678-994c-84ee8b1b032b req-35b15912-035c-4c96-bf1c-2125858ab128 service nova] Creating event network-changed:4931cb57-87a2-42f9-ab6b-1911e09bc6bf for instance cda7dc40-8f6a-4a66-82af-9be7a967450f on n-h1-854121-14 Oct 17 14:48:00.702703 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f562be0e-f96d-4678-994c-84ee8b1b032b req-35b15912-035c-4c96-bf1c-2125858ab128 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039653 Oct 17 14:48:00.703320 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3731/7906] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:48:01.419335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:01.420093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:01.428195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:01.428699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:01.429191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:01.429918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:01.430396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:01.430847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:01.563369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:01.572206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b89b9ce-1ecd-4c0d-8fec-9ad98bf3e6f3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1390 microversion: 2.1 time: 0.156906 Oct 17 14:48:01.572804 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4176/7907] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:01 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:02.597188 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:02.598034 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:02.604234 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:02.604712 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:02.605144 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:02.605916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:02.606364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:02.606780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:02.740084 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:02.749095 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-198b581f-4d78-454a-b4a8-71b3c059c23a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1390 microversion: 2.1 time: 0.157027 Oct 17 14:48:02.749707 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3732/7908] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:02 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:03.773145 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:03.773820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:03.779898 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:03.780396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:03.780848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:03.781607 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:03.782077 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:03.782520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:03.920207 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:03.929000 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b25084f-6fc4-4811-9700-94ecce474a65 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1390 microversion: 2.1 time: 0.160633 Oct 17 14:48:03.929629 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4177/7909] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:03 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:48:04.952524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:04.953118 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:04.960352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:04.960839 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:04.961310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:04.962008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:04.962887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:04.963326 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:05.100695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:05.108627 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94974f45-ad6a-4120-b3cf-2474ba02101a tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1390 microversion: 2.1 time: 0.160184 Oct 17 14:48:05.109218 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3733/7910] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:04 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:05.619374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-00f0eec8-2b57-4f14-9463-1fd042cc0264 req-1b8e88f0-8222-48f7-83ac-d84428c6ad6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda7dc40-8f6a-4a66-82af-9be7a967450f", "name": "network-vif-plugged", "status": "completed", "tag": "4931cb57-87a2-42f9-ab6b-1911e09bc6bf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:05.638419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-00f0eec8-2b57-4f14-9463-1fd042cc0264 req-1b8e88f0-8222-48f7-83ac-d84428c6ad6a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:05.638770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-00f0eec8-2b57-4f14-9463-1fd042cc0264 req-1b8e88f0-8222-48f7-83ac-d84428c6ad6a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:05.639228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-00f0eec8-2b57-4f14-9463-1fd042cc0264 req-1b8e88f0-8222-48f7-83ac-d84428c6ad6a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:05.652072 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-00f0eec8-2b57-4f14-9463-1fd042cc0264 req-1b8e88f0-8222-48f7-83ac-d84428c6ad6a service nova] Creating event network-vif-plugged:4931cb57-87a2-42f9-ab6b-1911e09bc6bf for instance cda7dc40-8f6a-4a66-82af-9be7a967450f on n-h1-854121-14 Oct 17 14:48:05.657081 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-00f0eec8-2b57-4f14-9463-1fd042cc0264 req-1b8e88f0-8222-48f7-83ac-d84428c6ad6a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041476 Oct 17 14:48:05.657719 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4178/7911] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:48:06.133183 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:06.133862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:06.139901 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:06.140384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:06.140832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:06.141804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:06.142254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:06.142681 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:06.278017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:06.285966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ac61cb8-0527-4867-8331-378aae0cb566 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1390 microversion: 2.1 time: 0.157875 Oct 17 14:48:06.286577 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3734/7912] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:06 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:07.310994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:07.311717 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:07.318146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:07.318651 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:07.319108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:07.319828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:07.320302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:07.320747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:07.456861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:07.464846 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72450b66-a938-4838-8f2f-e2a326732195 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1561 microversion: 2.1 time: 0.159121 Oct 17 14:48:07.465463 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4179/7913] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:07 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:07.487648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:07.488255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:07.494993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:07.495469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:07.495902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:07.496588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:07.497036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:07.497485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:07.630825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:07.638908 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cda74378-13f3-4a53-b9dd-eb5de3df59cd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1561 microversion: 2.1 time: 0.155135 Oct 17 14:48:07.639492 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3735/7914] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:07 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:09.529351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:09.535330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3c140cb1-ae3e-4fd2-8b92-ae31ce4345f0 req-526be92d-c73f-4fd7-a1fc-74e82daa29bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda7dc40-8f6a-4a66-82af-9be7a967450f", "tag": "4931cb57-87a2-42f9-ab6b-1911e09bc6bf"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:09.536095 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:09.540852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:09.543210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:09.549579 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:09.550318 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:09.550866 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:09.551599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:09.552074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:09.552520 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:09.554001 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:09.568483 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c140cb1-ae3e-4fd2-8b92-ae31ce4345f0 req-526be92d-c73f-4fd7-a1fc-74e82daa29bd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:09.568968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c140cb1-ae3e-4fd2-8b92-ae31ce4345f0 req-526be92d-c73f-4fd7-a1fc-74e82daa29bd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:09.569435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3c140cb1-ae3e-4fd2-8b92-ae31ce4345f0 req-526be92d-c73f-4fd7-a1fc-74e82daa29bd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:09.581943 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3c140cb1-ae3e-4fd2-8b92-ae31ce4345f0 req-526be92d-c73f-4fd7-a1fc-74e82daa29bd service nova] Creating event network-changed:4931cb57-87a2-42f9-ab6b-1911e09bc6bf for instance cda7dc40-8f6a-4a66-82af-9be7a967450f on n-h1-854121-14 Oct 17 14:48:09.590346 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3c140cb1-ae3e-4fd2-8b92-ae31ce4345f0 req-526be92d-c73f-4fd7-a1fc-74e82daa29bd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059148 Oct 17 14:48:09.592083 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3736/7915] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:48:09.718062 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:09.728878 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d9ba8b65-43e7-4c7a-b36e-6ca773466ccd tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1561 microversion: 2.1 time: 0.203693 Oct 17 14:48:09.729514 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4180/7916] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:09 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:32.975494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:32.976355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=36 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:32.980885 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:32.983200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:32.991744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:32.992227 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:32.992655 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:32.993405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:32.993859 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:32.994283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:33.047298 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e3a5cf3-e3d6-4769-b29b-451b640bfd44 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action" status: 200 len: 24567 microversion: 2.1 time: 0.073365 Oct 17 14:48:33.047950 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3737/7917] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:48:32 2022] POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action => generated 24567 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:48:44.108818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe53b849-3281-4ec1-a78f-4605f4058ad1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:44.111229 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:44.111967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=32 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:44.118028 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe53b849-3281-4ec1-a78f-4605f4058ad1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:44.118548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe53b849-3281-4ec1-a78f-4605f4058ad1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:44.119018 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe53b849-3281-4ec1-a78f-4605f4058ad1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:44.143329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe53b849-3281-4ec1-a78f-4605f4058ad1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 17 14:48:44.185114 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe53b849-3281-4ec1-a78f-4605f4058ad1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action" status: 202 len: 0 microversion: 2.1 time: 0.080103 Oct 17 14:48:44.185881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4181/7918] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:48:44 2022] POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:48:44.195843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:44.196583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:44.199484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:44.200323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:48:44.208327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:44.209672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:44.210180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:44.211266 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:44.211778 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:44.212208 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:44.350782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:44.358761 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7217d7e9-de26-4acf-b902-cb8dd6a32d87 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.167170 Oct 17 14:48:44.359369 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3738/7919] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:44 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:45.385102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:45.385836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:45.392808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:45.393335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:45.393784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:45.394485 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:45.394947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:45.395383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:45.532334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:45.541011 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-528b9f41-1ca1-4926-ba73-7fc876852b74 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.161175 Oct 17 14:48:45.541629 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4182/7920] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:45 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:46.565268 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:46.565825 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:46.572801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:46.573392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:46.573835 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:46.575174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:46.575174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:46.575448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:46.709416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:46.717376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b95b42f4-9505-4f87-a63a-efb401425d6b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.156665 Oct 17 14:48:46.717945 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3739/7921] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:46 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:47.741521 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:47.742183 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:47.750630 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:47.751418 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:47.752424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:47.753320 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:47.753796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:47.754270 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:47.891964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:47.901584 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-83673957-9267-48be-88d6-acf65a7e1738 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.163928 Oct 17 14:48:47.902206 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4183/7922] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:47 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:48.925670 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:48.926255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:48.932959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:48.933480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:48.933912 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:48.934594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:48.935045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:48.935461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:49.071311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:49.079393 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1121427d-d1e5-4214-b8c8-668e679152d1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.157990 Oct 17 14:48:49.080085 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3740/7923] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:48 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:50.103488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:50.104201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:50.111844 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:50.112818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:50.113313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:50.114038 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:50.114513 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:50.114959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:50.253794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:50.261755 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6b3c3ac9-d4f0-4e7c-8611-0743ae8e2aa7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.162343 Oct 17 14:48:50.262324 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4184/7924] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:50 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:51.286309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:51.287005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:51.293875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:51.294359 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:51.294797 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:51.295489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:51.295947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:51.296378 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:51.428028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:51.435877 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39c3b06b-9a16-4532-ae56-f088a5852558 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.154092 Oct 17 14:48:51.436479 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3741/7925] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:51 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:52.461120 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:52.461882 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:52.468020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:52.468540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:52.468973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:52.469706 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:52.470248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:52.470676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:52.602467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:52.610642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d801a554-f557-4896-a968-3acad0b3b623 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.153656 Oct 17 14:48:52.611927 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4185/7926] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:52 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:53.636492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:53.637116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:53.644459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:53.644946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:53.645421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:53.646123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:53.646582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:53.647009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:53.783481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:53.791850 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de1e297b-bbb9-43c1-932a-de9dc7f865ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1690 microversion: 2.1 time: 0.159279 Oct 17 14:48:53.792433 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3742/7927] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:53 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:54.816601 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:54.817228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:54.824208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:54.824735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:54.825210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:54.825920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:54.826387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:54.826828 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:54.965141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:54.973653 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21266ca3-a76b-4444-ab93-80e201a621f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1667 microversion: 2.1 time: 0.160982 Oct 17 14:48:54.974242 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4186/7928] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:54 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:56.073734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:56.075987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:56.083434 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:56.083921 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:56.084357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:56.085053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:56.085557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:56.085983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:56.141056 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e30fe36e-175d-4a2f-ae96-d8617003bf72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action" status: 200 len: 38366 microversion: 2.1 time: 0.071180 Oct 17 14:48:56.142052 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3743/7929] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:48:56 2022] POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action => generated 38366 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:48:56.154586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-70942578-c336-4d2b-8a24-b78ae223859e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:48:56.162517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70942578-c336-4d2b-8a24-b78ae223859e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:56.163009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70942578-c336-4d2b-8a24-b78ae223859e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:56.163456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-70942578-c336-4d2b-8a24-b78ae223859e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:56.187879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-70942578-c336-4d2b-8a24-b78ae223859e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Going to try to start instance {{(pid=120697) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 17 14:48:56.231470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-70942578-c336-4d2b-8a24-b78ae223859e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action" status: 202 len: 0 microversion: 2.1 time: 0.080624 Oct 17 14:48:56.232090 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4187/7930] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:48:56 2022] POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:48:56.241876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:56.242584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:56.251025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:56.251025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:56.251614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:56.252730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:56.253278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:56.253698 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:56.398550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:56.406321 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8731f7a1-fe31-40b5-84f0-70cbfaec8f7f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1676 microversion: 2.1 time: 0.169084 Oct 17 14:48:56.406889 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3744/7931] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:56 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:48:57.431667 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:48:57.432473 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:48:57.438922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:57.439612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:57.440068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:57.440784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:48:57.441287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:48:57.441739 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:48:57.574648 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:48:57.583261 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68a3d3ef-403d-402c-a4e8-6be62659cd97 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1680 microversion: 2.1 time: 0.156735 Oct 17 14:48:57.583843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4188/7932] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:48:57 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:23.783767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:23.786061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:23.788896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:23.789580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=40 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:23.795527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.796013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.796448 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.797190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:23.798136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:23.798564 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:23.863397 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30bf6516-e6c0-4368-91a4-d8add00c94a8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action" status: 200 len: 62927 microversion: 2.1 time: 0.083790 Oct 17 14:49:23.864050 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3745/7933] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:49:23 2022] POST /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f/action => generated 62927 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:49:30.943346 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:30.944001 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:30.946659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=16 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:30.947330 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:30.951937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fe623d87-5a33-400a-9bcf-80bbd9a284c8 req-1fc9eaef-b521-4dad-847e-12096bf4aaee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda7dc40-8f6a-4a66-82af-9be7a967450f", "tag": "4931cb57-87a2-42f9-ab6b-1911e09bc6bf"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:30.954558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:30.955093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:30.955545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:30.956612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:30.956744 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:30.957150 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:30.968425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fe623d87-5a33-400a-9bcf-80bbd9a284c8 req-1fc9eaef-b521-4dad-847e-12096bf4aaee service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:30.969886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fe623d87-5a33-400a-9bcf-80bbd9a284c8 req-1fc9eaef-b521-4dad-847e-12096bf4aaee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:30.969886 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fe623d87-5a33-400a-9bcf-80bbd9a284c8 req-1fc9eaef-b521-4dad-847e-12096bf4aaee service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:30.983745 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fe623d87-5a33-400a-9bcf-80bbd9a284c8 req-1fc9eaef-b521-4dad-847e-12096bf4aaee service nova] Creating event network-changed:4931cb57-87a2-42f9-ab6b-1911e09bc6bf for instance cda7dc40-8f6a-4a66-82af-9be7a967450f on n-h1-854121-14 Oct 17 14:49:30.986573 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:49:30.993015 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fe623d87-5a33-400a-9bcf-80bbd9a284c8 req-1fc9eaef-b521-4dad-847e-12096bf4aaee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049579 Oct 17 14:49:30.993527 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3746/7934] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:31.083376 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-660d88b2-fff9-4b6e-b788-d87b0080fb64 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 204 len: 0 microversion: 2.1 time: 0.143608 Oct 17 14:49:31.084209 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4189/7935] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:49:30 2022] DELETE /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:49:31.093911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:31.095074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:31.101651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:31.102231 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:31.102747 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:31.103528 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:31.104060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:31.104561 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:31.300114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:31.308114 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a91f37a-1cb1-470e-9e26-329a5f477689 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1686 microversion: 2.1 time: 0.218991 Oct 17 14:49:31.308690 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3747/7936] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:31 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1686 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:32.335626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:32.336440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:32.343845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:32.344771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:32.345331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:32.346128 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:32.346664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:32.347173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:32.491435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:32.500979 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-183e0f88-e443-41c4-942c-ecb72de54015 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1686 microversion: 2.1 time: 0.169026 Oct 17 14:49:32.502723 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4190/7937] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:32 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:33.093770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ed7b83ec-654e-4fef-94f8-088f374791b7 req-cb6504fb-88f6-421c-a4f2-a193f34ae36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda7dc40-8f6a-4a66-82af-9be7a967450f", "name": "network-vif-deleted", "tag": "4931cb57-87a2-42f9-ab6b-1911e09bc6bf"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:33.107880 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed7b83ec-654e-4fef-94f8-088f374791b7 req-cb6504fb-88f6-421c-a4f2-a193f34ae36a service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:33.108399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed7b83ec-654e-4fef-94f8-088f374791b7 req-cb6504fb-88f6-421c-a4f2-a193f34ae36a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:33.108805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ed7b83ec-654e-4fef-94f8-088f374791b7 req-cb6504fb-88f6-421c-a4f2-a193f34ae36a service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:33.122388 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ed7b83ec-654e-4fef-94f8-088f374791b7 req-cb6504fb-88f6-421c-a4f2-a193f34ae36a service nova] Creating event network-vif-deleted:4931cb57-87a2-42f9-ab6b-1911e09bc6bf for instance cda7dc40-8f6a-4a66-82af-9be7a967450f on n-h1-854121-14 Oct 17 14:49:33.128594 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ed7b83ec-654e-4fef-94f8-088f374791b7 req-cb6504fb-88f6-421c-a4f2-a193f34ae36a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038585 Oct 17 14:49:33.129272 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3748/7938] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:33.527074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:33.527722 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:33.535042 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:33.535554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:33.536009 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:33.536736 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:33.537292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:33.537745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:33.571770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:33.572276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:33.572731 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:33.573275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lazy-loading 'fault' on Instance uuid cda7dc40-8f6a-4a66-82af-9be7a967450f {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:49:33.618808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:33.626327 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1d32a5fa-cc5a-470e-ab71-904f4f0cc896 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 200 len: 1355 microversion: 2.1 time: 0.103799 Oct 17 14:49:33.626986 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4191/7939] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:33 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:34.650946 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:34.651648 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: cda7dc40-8f6a-4a66-82af-9be7a967450f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:34.659435 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:34.659916 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:34.660353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:34.661047 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:34.661527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:34.661960 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:34.676199 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] HTTP exception thrown: Instance cda7dc40-8f6a-4a66-82af-9be7a967450f could not be found. Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Request method failure captured: Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f HTTP/1.1 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWmIjD4meV5MrLtAhIOzZ6LOjFI3UMt0z1GIRPVutxI-ohLoPM1P_-cC2jOANVgh1S79zoAcRM6KvOhl3Uf7HvsBPnQQX6YTHjtvujMHEbL-0V011PHjecJsb7BrdpeayfWAE_82K6KrBgyMEpk_0Mrp5TwpsmB4TCrKe48Gqcd2eIA Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 5f80f8463b2e4e1a86f4c2ba67f2205a Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance cda7dc40-8f6a-4a66-82af-9be7a967450f could not be found. Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': 'cda7dc40-8f6a-4a66-82af-9be7a967450f'} Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cda7dc40-8f6a-4a66-82af-9be7a967450f could not be found. Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cda7dc40-8f6a-4a66-82af-9be7a967450f could not be found. Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:49:34.677900 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cda7dc40-8f6a-4a66-82af-9be7a967450f could not be found. Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Returning 404 to user: Instance cda7dc40-8f6a-4a66-82af-9be7a967450f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a10ab9d-096e-41c2-a081-83e38e48ea2f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f" status: 404 len: 111 microversion: 2.1 time: 0.032664 Oct 17 14:49:34.683881 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3749/7940] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:34 2022] GET /compute/v2.1/servers/cda7dc40-8f6a-4a66-82af-9be7a967450f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:49:38.135231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-895cba30-7d33-46af-9899-6f757801f91b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '.version_select at 0x7f419dd80550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:38.142390 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:49:38.142733 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:49:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-236899238 (ip 10.222.0.65) !!! Oct 17 14:49:38.162151 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-895cba30-7d33-46af-9899-6f757801f91b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-236899238" status: 202 len: 0 microversion: 2.1 time: 0.030554 Oct 17 14:49:38.166588 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4192/7941] 10.222.0.65 () {58 vars in 1281 bytes} [Mon Oct 17 14:49:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-236899238 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:49:38.193200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-562d82c1-c348-4cef-9db0-7ea5396d80f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: .version_select at 0x7f419cc6cdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-113226255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOobwNGZG7WF/Pm4NEeKQ106zH69vDJa2iQap2/xWx6zxUyojaFLiKM6PiBapswm1p3i+p/uB037dWaWsuxZNyhMTfsDbsBxQTf8TA30M7uX5cfeGixCLPnXDi3qjoJRmw=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:38.209407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-562d82c1-c348-4cef-9db0-7ea5396d80f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:49:38.215308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-562d82c1-c348-4cef-9db0-7ea5396d80f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:49:38.241190 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-562d82c1-c348-4cef-9db0-7ea5396d80f9 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051961 Oct 17 14:49:38.241805 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3750/7942] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:49:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:43.787916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:43.792803 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-89151005", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "networks": [{"uuid": "2318fc0c-a473-430e-a6ca-a01f00ef3f4b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-113226255", "security_groups": [{"name": "tempest-secgroup-smoke-673911443"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:43.947299 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] validate_networks() for [('2318fc0c-a473-430e-a6ca-a01f00ef3f4b', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:49:44.468511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:49:44.469370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:49:44.470090 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:49:44.470778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:49:44.471417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:49:44.481605 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:44.482639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:44.483339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:44.484370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:44.485086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:44.485885 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:44.511342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:49:44.525033 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Getting quotas for user 5f80f8463b2e4e1a86f4c2ba67f2205a and project 2d3ab84edbcc4295b8d667a74adde470. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:49:44.543208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:49:44.546466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:49:44.619827 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cfaf7987-c696-4408-9164-015bea129889 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832634 Oct 17 14:49:44.626378 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4193/7943] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:49:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:49:44.637494 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05890ec8-7963-4510-80c8-e399b4d2cd2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:44.639005 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05890ec8-7963-4510-80c8-e399b4d2cd2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:44.680275 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:44.737740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-05890ec8-7963-4510-80c8-e399b4d2cd2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:44.757945 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05890ec8-7963-4510-80c8-e399b4d2cd2e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1264 microversion: 2.1 time: 0.123934 Oct 17 14:49:44.760574 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3751/7944] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:44 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1264 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:49:45.783636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:45.784296 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:45.791767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:45.792272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:45.792732 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:45.794342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:45.794859 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:45.795780 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:45.867011 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:45.883232 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1d46e68-4feb-407a-b941-faf661bc4be8 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1316 microversion: 2.1 time: 0.103950 Oct 17 14:49:45.883870 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4194/7945] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:45 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1316 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:46.910427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:46.913353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:46.929550 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:46.931571 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:46.932200 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:46.934127 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:46.936408 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:46.937043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:47.164182 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:47.172473 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-afd7bbff-34bc-46bc-97f7-1edb8ae224d6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.266436 Oct 17 14:49:47.173570 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3752/7946] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:46 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:47.578195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-45c58df1-90c4-4f5b-8495-6136f03530fc req-c98f112a-a041-4a92-8629-bf47f51e2dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500eac70-8d5b-48d1-8400-1bc9fe8d433e", "tag": "954d9da8-b082-40e3-8a0b-d0b11e97e797"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:47.589135 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45c58df1-90c4-4f5b-8495-6136f03530fc req-c98f112a-a041-4a92-8629-bf47f51e2dda service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:47.589668 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45c58df1-90c4-4f5b-8495-6136f03530fc req-c98f112a-a041-4a92-8629-bf47f51e2dda service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:47.590109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45c58df1-90c4-4f5b-8495-6136f03530fc req-c98f112a-a041-4a92-8629-bf47f51e2dda service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:47.601907 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-45c58df1-90c4-4f5b-8495-6136f03530fc req-c98f112a-a041-4a92-8629-bf47f51e2dda service nova] Creating event network-changed:954d9da8-b082-40e3-8a0b-d0b11e97e797 for instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e on n-h2-854121-14 Oct 17 14:49:47.606908 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-45c58df1-90c4-4f5b-8495-6136f03530fc req-c98f112a-a041-4a92-8629-bf47f51e2dda service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032760 Oct 17 14:49:47.607523 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4195/7947] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:49:48.197420 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:48.198052 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:48.205391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:48.205868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:48.206302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:48.206991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:48.207462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:48.207879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:48.347756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:48.355781 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8893033f-5194-4f5b-88ba-aa561af0a314 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.162246 Oct 17 14:49:48.356380 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3753/7948] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:48 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:49.381534 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:49.382170 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:49.388691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:49.389271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:49.389690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:49.390458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:49.391013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:49.391450 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:49.527869 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:49.535911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc8e193b-7ebd-4d33-a65d-41970e30747f tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.160498 Oct 17 14:49:49.536492 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4196/7949] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:49 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:50.558900 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:50.559543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:50.566669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:50.567162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:50.567606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:50.568311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:50.568767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:50.569222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:50.774942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:50.783610 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-afaec7e6-1892-4f8f-8d79-a1d0e3e8f28c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.228765 Oct 17 14:49:50.784421 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3754/7950] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:50 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:51.806996 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:51.807681 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:51.813911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:51.814409 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:51.814861 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:51.815566 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:51.816035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:51.816474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:51.948321 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:51.956294 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af80dd50-5bdc-4fd1-8435-256b78a26021 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.153519 Oct 17 14:49:51.956865 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4197/7951] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:51 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:52.980366 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:52.981083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:52.988748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:52.989305 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:52.989752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:52.990463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:52.990917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:52.991343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:53.131240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:53.139116 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c271b99-7bc8-4462-a5ea-62f420cb33da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.162765 Oct 17 14:49:53.139689 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3755/7952] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:52 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:54.162824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:54.163405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:54.170549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:54.171091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:54.171614 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:54.172447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:54.172922 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:54.173398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:54.310114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:54.318915 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-47febf27-3c08-4ec8-baeb-e92c53042102 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.160074 Oct 17 14:49:54.319559 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4198/7953] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:54 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:54.437787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-56553c93-ef76-4a2a-a91f-6b32ba90c532 req-9346aae1-3a82-4f80-a252-3be746ef0eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500eac70-8d5b-48d1-8400-1bc9fe8d433e", "name": "network-vif-plugged", "status": "completed", "tag": "954d9da8-b082-40e3-8a0b-d0b11e97e797"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:54.443741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:54.450441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56553c93-ef76-4a2a-a91f-6b32ba90c532 req-9346aae1-3a82-4f80-a252-3be746ef0eaa service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:54.450925 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56553c93-ef76-4a2a-a91f-6b32ba90c532 req-9346aae1-3a82-4f80-a252-3be746ef0eaa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:54.451365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56553c93-ef76-4a2a-a91f-6b32ba90c532 req-9346aae1-3a82-4f80-a252-3be746ef0eaa service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:54.463541 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-56553c93-ef76-4a2a-a91f-6b32ba90c532 req-9346aae1-3a82-4f80-a252-3be746ef0eaa service nova] Creating event network-vif-plugged:954d9da8-b082-40e3-8a0b-d0b11e97e797 for instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e on n-h2-854121-14 Oct 17 14:49:54.469334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-56553c93-ef76-4a2a-a91f-6b32ba90c532 req-9346aae1-3a82-4f80-a252-3be746ef0eaa service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035534 Oct 17 14:49:54.470133 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3756/7954] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:49:55.344230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:55.344787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:55.346825 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:55.347655 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:55.354700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:55.355200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:55.355684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:55.356404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:55.356879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:55.357362 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:55.487383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:55.495952 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-47f51982-c2a1-4861-8e14-ff707a1456c7 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.156742 Oct 17 14:49:55.496528 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4199/7955] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:55 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:56.518361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:49:56.523488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:56.524198 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:56.531337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:56.531847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:56.532283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:56.532979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:56.533458 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:56.533891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:56.675382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:56.683192 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ea1492e-3254-40a3-8c4e-8710ce5aa2ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1389 microversion: 2.1 time: 0.166070 Oct 17 14:49:56.683775 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3757/7956] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:56 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:57.707154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:57.707788 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:57.715063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:57.715700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:57.716171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:57.717356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:57.717516 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:57.717845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:57.856046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:57.864703 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96b17140-f20d-447d-87a1-407ddcb36be3 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1560 microversion: 2.1 time: 0.161882 Oct 17 14:49:57.865335 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4200/7957] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:57 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:57.887331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:57.887888 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:57.895287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:57.895776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:57.896213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:57.896908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:57.897392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:57.897815 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:58.030277 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:58.038842 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b32f8c3c-cb4d-4bdc-aeb0-6535b4ff13ed tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1560 microversion: 2.1 time: 0.155513 Oct 17 14:49:58.039415 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3758/7958] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:57 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:49:59.637641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:49:59.639431 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:49:59.639867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9a70a8fc-6844-4c75-9013-b4fe00802999 req-158d686e-6940-4d24-a737-c3bca81db6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500eac70-8d5b-48d1-8400-1bc9fe8d433e", "tag": "954d9da8-b082-40e3-8a0b-d0b11e97e797"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:49:59.646942 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:59.647448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:59.647901 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:59.648615 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:59.649325 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:59.649774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:59.651205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9a70a8fc-6844-4c75-9013-b4fe00802999 req-158d686e-6940-4d24-a737-c3bca81db6bc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:49:59.652041 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9a70a8fc-6844-4c75-9013-b4fe00802999 req-158d686e-6940-4d24-a737-c3bca81db6bc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:49:59.652547 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9a70a8fc-6844-4c75-9013-b4fe00802999 req-158d686e-6940-4d24-a737-c3bca81db6bc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:49:59.665076 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9a70a8fc-6844-4c75-9013-b4fe00802999 req-158d686e-6940-4d24-a737-c3bca81db6bc service nova] Creating event network-changed:954d9da8-b082-40e3-8a0b-d0b11e97e797 for instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e on n-h2-854121-14 Oct 17 14:49:59.670868 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9a70a8fc-6844-4c75-9013-b4fe00802999 req-158d686e-6940-4d24-a737-c3bca81db6bc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034549 Oct 17 14:49:59.672319 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3759/7959] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:49:59.884613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:49:59.896942 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9da28f66-f64a-4da1-8535-6ea9ceb45105 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1560 microversion: 2.1 time: 0.263598 Oct 17 14:49:59.909189 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4201/7960] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:49:59 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:50:35.481194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:35.482060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=40 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:50:35.487401 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:50:35.489701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:50:35.496791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:35.497314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:35.497756 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:35.499009 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:50:35.499462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:50:35.499876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:50:35.572704 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30e9b8e4-3205-441c-83ca-a16754ad83d5 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action" status: 200 len: 24563 microversion: 2.1 time: 0.093734 Oct 17 14:50:35.573402 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3760/7961] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:50:35 2022] POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action => generated 24563 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:51:14.307448 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:14.308228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=46 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:14.313282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:14.313867 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:14.322241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:14.322241 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:14.322827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:14.323591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:14.324365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:14.324511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:14.350862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lazy-loading 'flavor' on Instance uuid 500eac70-8d5b-48d1-8400-1bc9fe8d433e {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:51:14.421527 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7acf612f-e738-4178-b11e-5646e514fa31 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action" status: 202 len: 0 microversion: 2.1 time: 0.115653 Oct 17 14:51:14.422201 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4202/7962] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:51:14 2022] POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:51:14.431690 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:14.432240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:14.434581 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:14.435258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:14.437188 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:51:14.437344 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:51:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e (ip 10.222.0.65) !!! Oct 17 14:51:14.446159 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:14.446807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:14.447168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:14.447881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:14.448339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:14.448845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:14.584938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:14.592939 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff351a41-ee05-4cee-9946-9d8162d69198 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1687 microversion: 2.1 time: 0.166018 Oct 17 14:51:14.593551 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3761/7963] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:14 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:15.620219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:15.620965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:15.628057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:15.628391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:15.628802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:15.629635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:15.630133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:15.630580 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:15.771083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:15.779216 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e63d8bb-7b45-4f4f-a777-e7cc21f95960 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1687 microversion: 2.1 time: 0.164358 Oct 17 14:51:15.779835 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4203/7964] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:15 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:17.008154 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:17.008771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:17.016270 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:17.016789 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:17.017259 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:17.018215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:17.018672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:17.019103 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:17.156572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:17.164458 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f486c7d-838c-4c25-bb2d-7ac5a79f0f08 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1670 microversion: 2.1 time: 0.365309 Oct 17 14:51:17.165038 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3762/7965] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:16 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1670 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:18.262109 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:18.265152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:18.273061 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.273584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.274049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.274800 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.275271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.275718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.338769 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7de8a155-ce03-4b7b-b10f-8791a5bb474e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action" status: 200 len: 38217 microversion: 2.1 time: 0.080355 Oct 17 14:51:18.339645 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4204/7966] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:51:18 2022] POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action => generated 38217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:51:18.352908 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:18.353658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:18.360416 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.360902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.361375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.362070 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.362526 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.362962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.431334 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfff75f5-2f76-47d6-a8d0-bb67020cb59c tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action" status: 202 len: 0 microversion: 2.1 time: 0.082204 Oct 17 14:51:18.432063 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3763/7967] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:51:18 2022] POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:51:18.442367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:18.443086 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:18.450958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.451987 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.452442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.453303 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:18.453781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:18.454294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:18.648255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:18.657154 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95d9f763-e832-42a4-a5bd-4c1e295334c1 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1676 microversion: 2.1 time: 0.219050 Oct 17 14:51:18.657764 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4205/7968] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:18 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:19.682495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:19.683202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:19.690343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:19.690771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:19.691203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:19.691902 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:19.692440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:19.692792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:19.832594 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:19.840599 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa68cc12-e26c-46ba-aec6-c9c761be98f4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1676 microversion: 2.1 time: 0.163229 Oct 17 14:51:19.841184 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3764/7969] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:19 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:20.864796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:20.865495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:20.873179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:20.873720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:20.874178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:20.874891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:20.875366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:20.875827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:21.011984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:21.020107 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-687e1eca-9894-4e4c-a9da-6d17b710f6ef tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1679 microversion: 2.1 time: 0.159301 Oct 17 14:51:21.020683 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4206/7970] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:20 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:21.119942 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:21.122298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:21.129480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:21.129972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:21.130412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:21.131111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:21.131574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:21.131999 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:21.197312 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-405f18cf-c16b-4704-9c65-f24c413619fc tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action" status: 200 len: 38217 microversion: 2.1 time: 0.081042 Oct 17 14:51:21.197980 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3765/7971] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:51:21 2022] POST /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e/action => generated 38217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 17 14:51:22.205967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:22.206503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:22.222276 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:22.222796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:22.223257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:22.224189 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:22.224851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:22.225336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:22.256958 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:51:22.275868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-88bfc602-41ea-467b-a294-295f79f77c81 req-a2d72be2-780f-4e7e-bf10-e544e5b536a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "500eac70-8d5b-48d1-8400-1bc9fe8d433e", "tag": "954d9da8-b082-40e3-8a0b-d0b11e97e797"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:22.287826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-88bfc602-41ea-467b-a294-295f79f77c81 req-a2d72be2-780f-4e7e-bf10-e544e5b536a2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:22.288319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-88bfc602-41ea-467b-a294-295f79f77c81 req-a2d72be2-780f-4e7e-bf10-e544e5b536a2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:22.288749 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-88bfc602-41ea-467b-a294-295f79f77c81 req-a2d72be2-780f-4e7e-bf10-e544e5b536a2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:22.300158 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-88bfc602-41ea-467b-a294-295f79f77c81 req-a2d72be2-780f-4e7e-bf10-e544e5b536a2 service nova] Creating event network-changed:954d9da8-b082-40e3-8a0b-d0b11e97e797 for instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e on n-h2-854121-14 Oct 17 14:51:22.305365 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-88bfc602-41ea-467b-a294-295f79f77c81 req-a2d72be2-780f-4e7e-bf10-e544e5b536a2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094515 Oct 17 14:51:22.306226 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3766/7972] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:22.355739 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a15c832-2acb-4c61-853f-27a44b636c72 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 204 len: 0 microversion: 2.1 time: 0.154301 Oct 17 14:51:22.356735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4207/7973] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:51:22 2022] DELETE /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:51:22.376505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:22.377254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:22.384563 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:22.385347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:22.385783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:22.386482 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:22.387116 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:22.387702 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:22.533584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:22.541762 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-535c8c05-3c8c-4d4f-a3ff-eefc122e656e tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1685 microversion: 2.1 time: 0.179561 Oct 17 14:51:22.542357 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3767/7974] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:22 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:23.567880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:23.568622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:23.575664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:23.576155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:23.576640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:23.577462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:23.577930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:23.578368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:23.711350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:23.720380 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2f78ae0c-2e69-491c-abbb-817e8d417da4 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1685 microversion: 2.1 time: 0.156756 Oct 17 14:51:23.720965 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4208/7975] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:23 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:24.658602 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-51fa4637-868a-4f32-bb5d-440d58636a01 req-72ddd8df-09c0-4719-8769-2a8d260a69d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "500eac70-8d5b-48d1-8400-1bc9fe8d433e", "name": "network-vif-deleted", "tag": "954d9da8-b082-40e3-8a0b-d0b11e97e797"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:24.669487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-51fa4637-868a-4f32-bb5d-440d58636a01 req-72ddd8df-09c0-4719-8769-2a8d260a69d3 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:24.669997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-51fa4637-868a-4f32-bb5d-440d58636a01 req-72ddd8df-09c0-4719-8769-2a8d260a69d3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:24.670431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-51fa4637-868a-4f32-bb5d-440d58636a01 req-72ddd8df-09c0-4719-8769-2a8d260a69d3 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:24.682722 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-51fa4637-868a-4f32-bb5d-440d58636a01 req-72ddd8df-09c0-4719-8769-2a8d260a69d3 service nova] Creating event network-vif-deleted:954d9da8-b082-40e3-8a0b-d0b11e97e797 for instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e on n-h2-854121-14 Oct 17 14:51:24.689003 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-51fa4637-868a-4f32-bb5d-440d58636a01 req-72ddd8df-09c0-4719-8769-2a8d260a69d3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034183 Oct 17 14:51:24.689650 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3768/7976] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:24.744458 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:24.745087 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:24.752231 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:24.752737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:24.753227 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:24.753959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:24.754435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:24.754883 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:24.823684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f80f8463b2e4e1a86f4c2ba67f2205a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3ab84edbcc4295b8d667a74adde470', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:24.833410 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f489a52-8b9e-4c49-b80c-3abdd936c10b tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 200 len: 1349 microversion: 2.1 time: 0.093165 Oct 17 14:51:24.834156 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4209/7977] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:24 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:25.858412 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:25.859115 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] [instance: 500eac70-8d5b-48d1-8400-1bc9fe8d433e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:25.865278 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:25.865754 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:25.866233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:25.866872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:25.867324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:25.867741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:25.881388 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] HTTP exception thrown: Instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e could not be found. Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Request method failure captured: Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e HTTP/1.1 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWmIjD4meV5MrLtAhIOzZ6LOjFI3UMt0z1GIRPVutxI-ohLoPM1P_-cC2jOANVgh1S79zoAcRM6KvOhl3Uf7HvsBPnQQX6YTHjtvujMHEbL-0V011PHjecJsb7BrdpeayfWAE_82K6KrBgyMEpk_0Mrp5TwpsmB4TCrKe48Gqcd2eIA Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_2d3ab84edbcc4295b8d667a74adde470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 2d3ab84edbcc4295b8d667a74adde470 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-997751150 Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 5f80f8463b2e4e1a86f4c2ba67f2205a Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestNetworkAdvancedServerOps-997751150-project Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e could not be found. Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '500eac70-8d5b-48d1-8400-1bc9fe8d433e'} Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e could not be found. Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e could not be found. Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:51:25.883024 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e could not be found. Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Returning 404 to user: Instance 500eac70-8d5b-48d1-8400-1bc9fe8d433e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-914b245d-8a54-499a-a882-56aa511a64da tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e" status: 404 len: 111 microversion: 2.1 time: 0.031348 Oct 17 14:51:25.894421 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3769/7978] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:25 2022] GET /compute/v2.1/servers/500eac70-8d5b-48d1-8400-1bc9fe8d433e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:51:29.349051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a25a4b4-a44e-4375-9d8c-00ee14a228c6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] Calling method '.version_select at 0x7f419de84940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:29.372068 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a25a4b4-a44e-4375-9d8c-00ee14a228c6 tempest-TestNetworkAdvancedServerOps-997751150 tempest-TestNetworkAdvancedServerOps-997751150-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-113226255" status: 202 len: 0 microversion: 2.1 time: 0.027359 Oct 17 14:51:29.372881 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4210/7979] 10.222.0.65 () {58 vars in 1281 bytes} [Mon Oct 17 14:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-113226255 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:51:41.122057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=18 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:41.124615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:41.321585 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b65486b9-dadb-4963-88d7-f48945feaaf4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'create', calling method: .version_select at 0x7f419c7f5dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1083169156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJDNZbEs7t0HeL7kY3oEj3NW/WdZciSlHj0Hx/EtgB89IBlhDHvBBPI0WykJpRuvimE8s9adWNSFxYowOQq4Tf/03pGRpCCdWIxNjSrgb/hGHpOzS1vL8lPzsf6fHVSSA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:41.342328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b65486b9-dadb-4963-88d7-f48945feaaf4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:51:41.348409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-b65486b9-dadb-4963-88d7-f48945feaaf4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for user 134b54c3cf4347f4a151d32eb657e2db and project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:51:41.377870 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b65486b9-dadb-4963-88d7-f48945feaaf4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.261304 Oct 17 14:51:41.378468 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3770/7980] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:51:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:42.357832 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-242862077", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1083169156", "security_groups": [{"name": "tempest-secgroup-smoke-295340562"}], "networks": [{"uuid": "47269859-01c6-4753-83a8-94f1628d6d67"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:42.372594 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:42.378063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:42.500430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] validate_networks() for [('47269859-01c6-4753-83a8-94f1628d6d67', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:51:43.010716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:51:43.011235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:51:43.011847 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:51:43.012492 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:51:43.012937 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:51:43.025816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:43.026525 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:43.027611 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:43.028798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:43.029699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:43.030091 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:43.049738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:51:43.055345 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for user 134b54c3cf4347f4a151d32eb657e2db and project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:51:43.069972 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:51:43.072351 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:51:43.121101 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c464a9fe-3aeb-4279-9e06-297517afacc7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.767446 Oct 17 14:51:43.122046 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4211/7981] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:51:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:51:43.134726 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b764908-5019-4494-9b43-a4c6fa8cb510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:43.135349 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b764908-5019-4494-9b43-a4c6fa8cb510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:43.204195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b764908-5019-4494-9b43-a4c6fa8cb510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:43.211476 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b764908-5019-4494-9b43-a4c6fa8cb510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1246 microversion: 2.1 time: 0.081490 Oct 17 14:51:43.212600 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3771/7982] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:43 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:44.236698 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:44.237371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:44.244444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:44.244947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:44.245424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:44.249770 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:44.250484 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:44.251111 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:44.355618 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:44.371740 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a8af2a7-ebc3-4b5c-ab6d-2740fdf6f9e7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1306 microversion: 2.1 time: 0.140951 Oct 17 14:51:44.372230 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4212/7983] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:44 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1306 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:45.400787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:45.401446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:45.409555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:45.410002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:45.410443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:45.411209 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:45.411703 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:45.412134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:45.701740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:45.709770 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c9d1ad0-cbf8-4392-bc9b-a075ec17d56e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1371 microversion: 2.1 time: 0.316617 Oct 17 14:51:45.710355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3772/7984] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:45 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1371 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:46.234399 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3bc1d7d9-aebe-497e-b118-615f238a8800 req-be00c810-3a6c-4410-8449-922cdb5c9bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:46.244659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3bc1d7d9-aebe-497e-b118-615f238a8800 req-be00c810-3a6c-4410-8449-922cdb5c9bdd service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:46.245191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3bc1d7d9-aebe-497e-b118-615f238a8800 req-be00c810-3a6c-4410-8449-922cdb5c9bdd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:46.245644 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3bc1d7d9-aebe-497e-b118-615f238a8800 req-be00c810-3a6c-4410-8449-922cdb5c9bdd service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:46.264910 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3bc1d7d9-aebe-497e-b118-615f238a8800 req-be00c810-3a6c-4410-8449-922cdb5c9bdd service nova] Creating event network-changed:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h1-854121-14 Oct 17 14:51:46.273642 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3bc1d7d9-aebe-497e-b118-615f238a8800 req-be00c810-3a6c-4410-8449-922cdb5c9bdd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132635 Oct 17 14:51:46.274708 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4213/7985] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:46.734733 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:46.735364 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:46.742374 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:46.742879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:46.743321 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:46.744106 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:46.744499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:46.744926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:47.035680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:47.044021 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6dd9fe3b-0863-4ff1-9698-7c959d6e5f97 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1371 microversion: 2.1 time: 0.314216 Oct 17 14:51:47.045209 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3773/7986] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:46 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:48.074294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:48.075466 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:48.081897 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:48.082401 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:48.082858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:48.083735 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:48.084242 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:48.084694 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:48.297926 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:48.306199 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48924896-229d-449a-9b37-d020f2c31509 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1371 microversion: 2.1 time: 0.241440 Oct 17 14:51:48.306789 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4214/7987] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:48 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:51:49.330167 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:49.330730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:49.337599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:49.338082 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:49.338524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:49.339218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:49.339674 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:49.340100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:49.478462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:49.486481 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ddde7d9a-0831-4bbf-94ed-00c3d44e92ed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1371 microversion: 2.1 time: 0.161108 Oct 17 14:51:49.487050 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3774/7988] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:49 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:50.509365 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:50.510040 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:50.517148 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:50.517884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:50.518599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:50.519317 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:50.519792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:50.520237 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:50.659390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:50.667625 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e1b9168-fd2b-49af-a25e-cbaf615071cd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1371 microversion: 2.1 time: 0.162169 Oct 17 14:51:50.668225 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4215/7989] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:50 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:50.806302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-ec029e96-973b-43a1-8f79-789cf9c36ea3 req-8507bdc9-1693-4318-974c-a719785553d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "name": "network-vif-plugged", "status": "completed", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:50.817641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ec029e96-973b-43a1-8f79-789cf9c36ea3 req-8507bdc9-1693-4318-974c-a719785553d6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:50.818432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ec029e96-973b-43a1-8f79-789cf9c36ea3 req-8507bdc9-1693-4318-974c-a719785553d6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:50.818971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-ec029e96-973b-43a1-8f79-789cf9c36ea3 req-8507bdc9-1693-4318-974c-a719785553d6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:50.831037 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-ec029e96-973b-43a1-8f79-789cf9c36ea3 req-8507bdc9-1693-4318-974c-a719785553d6 service nova] Creating event network-vif-plugged:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h1-854121-14 Oct 17 14:51:50.835963 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-ec029e96-973b-43a1-8f79-789cf9c36ea3 req-8507bdc9-1693-4318-974c-a719785553d6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095666 Oct 17 14:51:50.836547 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3775/7990] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:51:51.691868 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:51.692498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:51.699131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:51.699640 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:51.700093 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:51.700968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:51.702063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:51.702586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:51.835826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:51.844157 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4aa4ff3c-66f0-4307-96f9-d17b59dea7b0 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1371 microversion: 2.1 time: 0.156263 Oct 17 14:51:51.844745 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4216/7991] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:51 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:52.869524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:52.870255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:52.877300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:52.877780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:52.878215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:52.878914 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:52.879368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:52.879794 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:53.016478 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:53.024486 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fdb6c215-6eee-4597-a16f-83f146134f09 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1555 microversion: 2.1 time: 0.160305 Oct 17 14:51:53.025058 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3776/7992] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:52 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:53.047558 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:51:53.048188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:51:53.051052 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:53.056599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:53.057104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:53.057586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:53.058300 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:53.058773 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:53.059219 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:53.064133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:53.196559 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:51:53.204470 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-24d1400d-e34b-4d63-8ab4-fa2a637b4571 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1555 microversion: 2.1 time: 0.161402 Oct 17 14:51:53.205055 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4217/7993] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:51:53 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:51:54.861560 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1cd5d9e7-0adb-4404-a736-74a0264bee54 req-d627436f-98b1-46a4-ae16-c5810c90398f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:51:54.866953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:51:54.873923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1cd5d9e7-0adb-4404-a736-74a0264bee54 req-d627436f-98b1-46a4-ae16-c5810c90398f service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:51:54.874403 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1cd5d9e7-0adb-4404-a736-74a0264bee54 req-d627436f-98b1-46a4-ae16-c5810c90398f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:51:54.874828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1cd5d9e7-0adb-4404-a736-74a0264bee54 req-d627436f-98b1-46a4-ae16-c5810c90398f service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:51:54.886221 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1cd5d9e7-0adb-4404-a736-74a0264bee54 req-d627436f-98b1-46a4-ae16-c5810c90398f service nova] Creating event network-changed:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h1-854121-14 Oct 17 14:51:54.891470 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1cd5d9e7-0adb-4404-a736-74a0264bee54 req-d627436f-98b1-46a4-ae16-c5810c90398f service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034637 Oct 17 14:51:54.892331 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3777/7994] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:53:52.269936 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:53:52.270882 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:53:52.271350 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:52.272259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=34 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:52.273707 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:53:52.273886 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94/action (ip 10.222.0.65) !!! Oct 17 14:53:52.283565 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:53:52.284155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:52.293602 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:52.294106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:52.294562 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:52.295284 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:52.295758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:52.296208 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:52.320205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lazy-loading 'flavor' on Instance uuid 35a2377d-eb45-43a8-9ecc-186afdacfb94 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:53:52.646500 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2583a116-51dd-4d7a-bd0a-a20d02ce6731 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94/action" status: 202 len: 0 microversion: 2.1 time: 0.378797 Oct 17 14:53:52.647107 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4218/7995] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:53:52 2022] POST /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:53:52.653650 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:53:52.654540 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:53:52.654990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:52.655787 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=28 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:53:52.656988 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:53:52.657232 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:53:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 (ip 10.222.0.65) !!! Oct 17 14:53:52.664039 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:52.664755 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:52.673191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:52.673686 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:52.674136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:52.674856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:52.675309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:52.675732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:52.814802 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:52.823441 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0527e45e-8dd8-4cfb-bf4c-5957b39fba9f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.171695 Oct 17 14:53:52.824065 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3778/7996] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:52 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:53.849870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:53.850619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:53.859890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:53.860390 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:53.860830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:53.861572 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:53.862032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:53.862469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:53.866414 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59372. Oct 17 14:53:53.869532 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59374. Oct 17 14:53:54.003292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:54.011460 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d8c16ec-5c8e-4141-8458-a621dc35b299 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.167925 Oct 17 14:53:54.012005 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4219/7997] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:53 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:55.036405 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:55.037023 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:55.054187 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59380. Oct 17 14:53:55.056550 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59378. Oct 17 14:53:55.059131 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:55.059616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:55.060057 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:55.060768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:55.061258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:55.061796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:55.193513 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:55.201874 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b66b6c03-62ae-4b23-b595-8cd60ebfca24 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.169483 Oct 17 14:53:55.202454 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3779/7998] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:55 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:56.225810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:56.226441 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:56.233851 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:56.234359 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:56.234820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:56.235538 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:56.236015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:56.236459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:56.371439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:56.379317 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2cdf135e-2dcd-4168-a79e-1ccd9265ae11 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.157486 Oct 17 14:53:56.379890 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4220/7999] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:56 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:57.403384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:57.404007 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:57.410909 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:57.411396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:57.411837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:57.412531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:57.412986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:57.413443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:57.548906 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:57.556783 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0a7d9625-0299-4085-a11d-3431b772608e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.158085 Oct 17 14:53:57.557899 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3780/8000] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:57 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:58.580818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:58.581470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:58.588649 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:58.589234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:58.589696 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:58.590413 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:58.590892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:58.591334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:58.726376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:58.734478 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c633eef4-33c2-41e5-9e45-d562ce7cfb21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.157709 Oct 17 14:53:58.735062 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4221/8001] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:58 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:53:59.758621 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:53:59.759261 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:53:59.766968 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:59.767457 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:59.767897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:59.768671 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:53:59.769384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:53:59.769814 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:53:59.904862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:53:59.914966 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-02d6f5bf-d4fe-47ab-b5ee-259334881c96 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.160318 Oct 17 14:53:59.915560 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3781/8002] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:53:59 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:00.938870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:00.939526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:00.946444 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:00.946946 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:00.947429 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:00.948609 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:00.949078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:00.949548 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:01.082078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:01.090631 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4042e8d-3f01-4cab-802f-aef602b854c8 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.155741 Oct 17 14:54:01.091215 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4222/8003] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:00 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:02.114141 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:02.114753 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:02.127136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:02.127650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:02.128100 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:02.128813 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:02.129314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:02.129777 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:02.263556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:02.271596 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4802d3c-ea0b-4b3d-aa24-301272b2f963 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.161359 Oct 17 14:54:02.272185 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3782/8004] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:02 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:03.295818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:03.296459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:03.303578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:03.304083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:03.304540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:03.305312 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:03.305791 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:03.306240 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:03.749491 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:03.757466 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cab48b66-64f7-495c-af21-9ad779bd9769 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1700 microversion: 2.1 time: 0.465967 Oct 17 14:54:03.758057 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4223/8005] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:03 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1700 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:54:04.782701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:04.783319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:04.790267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:04.790752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:04.791187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:04.792168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:04.792683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:04.793192 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:04.936875 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:04.944907 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd21f1a6-a0cb-40b7-922e-bb510e2deefb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1700 microversion: 2.1 time: 0.166274 Oct 17 14:54:04.945685 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3783/8006] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:04 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:05.404380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b7f32c5a-e8ec-4dfb-b078-a40257d1d8a8 req-74f1d86d-8fdf-49e5-8636-abc2ba16b629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "name": "network-vif-plugged", "status": "completed", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:05.421029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7f32c5a-e8ec-4dfb-b078-a40257d1d8a8 req-74f1d86d-8fdf-49e5-8636-abc2ba16b629 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:05.421930 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7f32c5a-e8ec-4dfb-b078-a40257d1d8a8 req-74f1d86d-8fdf-49e5-8636-abc2ba16b629 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:05.422639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b7f32c5a-e8ec-4dfb-b078-a40257d1d8a8 req-74f1d86d-8fdf-49e5-8636-abc2ba16b629 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:05.436707 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b7f32c5a-e8ec-4dfb-b078-a40257d1d8a8 req-74f1d86d-8fdf-49e5-8636-abc2ba16b629 service nova] Creating event network-vif-plugged:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h1-854121-14 Oct 17 14:54:05.446163 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b7f32c5a-e8ec-4dfb-b078-a40257d1d8a8 req-74f1d86d-8fdf-49e5-8636-abc2ba16b629 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045626 Oct 17 14:54:05.448700 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4224/8007] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:05.968091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:05.968699 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:05.975348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:05.975843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:05.976283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:05.976983 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:05.977465 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:05.977897 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:06.140003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:06.150084 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2152aa63-857b-483e-beef-3f8615540782 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.185729 Oct 17 14:54:06.151565 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3784/8008] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:05 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:07.177198 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:07.178313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:07.186802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:07.188076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:07.188758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:07.189633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:07.190661 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:07.191342 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:07.441218 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:07.453179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f496fc56-71ba-4bcd-b1a9-d4f36fe8135d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.280546 Oct 17 14:54:07.462067 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4225/8009] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:07 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:08.478083 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:08.479460 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:08.486891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:08.487389 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:08.487826 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:08.488533 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:08.488987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:08.489441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:08.648285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:08.659485 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e88a6df-117a-47b7-8ea1-85a3666eaa61 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.185515 Oct 17 14:54:08.660263 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3785/8010] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:08 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:09.684990 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:09.685794 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:09.693554 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.694070 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.694531 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.695264 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:09.695914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:09.696507 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:09.849768 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:09.861970 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c733014f-be44-45bd-a513-e0102ef4c945 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.181649 Oct 17 14:54:09.865197 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4226/8011] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:09 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:10.889952 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:10.890590 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:10.897534 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:10.898179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:10.898622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:10.899333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:10.899790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:10.902940 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:11.053133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:11.061811 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d01e694b-f095-4624-9b3c-58df28597510 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.177378 Oct 17 14:54:11.062589 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3786/8012] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:10 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:12.086505 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:12.087691 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:12.095872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:12.096383 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:12.096846 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:12.097830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:12.098335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:12.098785 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:12.249032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:12.258545 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb67558e-8107-47c6-85cc-5b004dfd00c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.176140 Oct 17 14:54:12.269309 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4227/8013] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:12 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:13.286725 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:13.287507 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:13.294314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.294810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.295251 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.295959 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:13.296578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:13.296828 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:13.444730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:13.454564 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84838818-37e7-45fd-a1c8-258b4b9a26b3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.172538 Oct 17 14:54:13.455549 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3787/8014] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:13 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:14.480627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:14.481287 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:14.488366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:14.488887 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:14.489412 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:14.490143 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:14.490622 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:14.491069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:14.627684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:14.636659 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3dc12c2c-3b1c-43a0-b649-10b7f82b2566 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1695 microversion: 2.1 time: 0.160560 Oct 17 14:54:14.637972 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4228/8015] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:14 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:15.659905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:15.660544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:15.668334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:15.668817 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:15.669279 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:15.669973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:15.670426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:15.670848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:15.812977 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:15.820930 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edadb1cc-0016-4403-8c10-72902a8440f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1677 microversion: 2.1 time: 0.164977 Oct 17 14:54:15.821557 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3788/8016] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:15 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:16.844690 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:16.845349 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:16.852368 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:16.852878 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:16.853881 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:16.854593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:16.855067 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:16.855517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:16.999745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:17.007723 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebb05c35-aab5-4de8-8f28-56708198207c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1680 microversion: 2.1 time: 0.167077 Oct 17 14:54:17.008330 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4229/8017] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:16 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:17.030531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:17.031132 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:17.038035 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:17.038521 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:17.039085 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:17.039651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:17.040111 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:17.040531 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:17.126748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:54:17.193920 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [fc48a327-c986-49a1-8d75-720ede214e94] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:54:17.432072 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f9489c19-ee7e-4033-8cdd-732fed50cfb0 req-17aff0c6-dacf-411a-9a29-f556bfc33bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "name": "network-vif-unplugged", "status": "completed", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:17.443591 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f9489c19-ee7e-4033-8cdd-732fed50cfb0 req-17aff0c6-dacf-411a-9a29-f556bfc33bc0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:17.445849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f9489c19-ee7e-4033-8cdd-732fed50cfb0 req-17aff0c6-dacf-411a-9a29-f556bfc33bc0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:17.445849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f9489c19-ee7e-4033-8cdd-732fed50cfb0 req-17aff0c6-dacf-411a-9a29-f556bfc33bc0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:17.456814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_external_events [req-f9489c19-ee7e-4033-8cdd-732fed50cfb0 req-17aff0c6-dacf-411a-9a29-f556bfc33bc0 service nova] Unable to find a host for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94. Dropping event network-vif-unplugged {{(pid=120697) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 14:54:17.457754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f9489c19-ee7e-4033-8cdd-732fed50cfb0 req-17aff0c6-dacf-411a-9a29-f556bfc33bc0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030218 Oct 17 14:54:17.459164 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4230/8018] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 17 14:54:18.203149 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [fc48a327-c986-49a1-8d75-720ede214e94] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59476. Oct 17 14:54:18.207269 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6495235c-1bf3-4757-b51b-5f03a8776056 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94/action" status: 202 len: 0 microversion: 2.1 time: 1.180304 Oct 17 14:54:18.207908 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3789/8019] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:54:17 2022] POST /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94/action => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 17 14:54:18.216712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:18.217430 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:18.224202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:18.224700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:18.225151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:18.225964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:18.226428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:18.226872 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:18.370168 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:18.380170 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a0ed358-994c-4192-83f8-0e2283ccd493 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1628 microversion: 2.1 time: 0.167894 Oct 17 14:54:18.389623 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4231/8020] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:18 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1628 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:19.408315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:19.408877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:19.416541 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:19.417043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:19.417505 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:19.418199 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:19.418657 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:19.419087 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:19.561666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:19.570079 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c4955e1-1463-4d0a-a3af-8029068bd80a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1628 microversion: 2.1 time: 0.166754 Oct 17 14:54:19.570963 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3790/8021] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:19 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1628 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:20.594115 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:20.594743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:20.601702 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:20.602201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:20.602657 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:20.604002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:20.604515 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:20.604959 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:20.746888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:20.754745 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bdc1e327-ac36-4d25-9983-ed37701186d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1628 microversion: 2.1 time: 0.164534 Oct 17 14:54:20.755312 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4232/8022] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:20 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1628 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:21.779432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:21.780240 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:21.787577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:21.788049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:21.788488 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:21.789205 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:21.789667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:21.790095 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:21.923444 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:21.931356 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c03bf5b-dd53-4982-a2b4-d6386a1d47c5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1628 microversion: 2.1 time: 0.156825 Oct 17 14:54:21.931942 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3791/8023] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:21 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1628 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:22.955302 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:22.955928 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:22.958814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=31 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:22.964617 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:22.965119 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:22.965606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:22.966323 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:22.966798 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:22.967245 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:22.970169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:23.121949 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:23.129899 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-636ed135-8545-40f3-8c0c-1eb788551afd tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1628 microversion: 2.1 time: 0.179110 Oct 17 14:54:23.130484 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4233/8024] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:22 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1628 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:24.153922 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:24.154669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:24.158682 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:24.162588 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:24.163186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:24.163721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:24.164467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:24.165078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:24.165540 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:24.171532 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:54:24.309062 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:24.316914 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6547d132-ac14-460d-8aeb-404ffcbe09a4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.167508 Oct 17 14:54:24.317676 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3792/8025] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:24 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:24.529984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-806fd26a-67df-4d7a-bcac-107e99421b94 req-df733522-92ca-48af-9748-2ef82df990b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:24.539419 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-806fd26a-67df-4d7a-bcac-107e99421b94 req-df733522-92ca-48af-9748-2ef82df990b5 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:24.541058 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-806fd26a-67df-4d7a-bcac-107e99421b94 req-df733522-92ca-48af-9748-2ef82df990b5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:24.541541 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-806fd26a-67df-4d7a-bcac-107e99421b94 req-df733522-92ca-48af-9748-2ef82df990b5 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:24.554941 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-806fd26a-67df-4d7a-bcac-107e99421b94 req-df733522-92ca-48af-9748-2ef82df990b5 service nova] Creating event network-changed:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h2-854121-14 Oct 17 14:54:24.561687 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-806fd26a-67df-4d7a-bcac-107e99421b94 req-df733522-92ca-48af-9748-2ef82df990b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035728 Oct 17 14:54:24.562468 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4234/8026] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:25.342459 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:25.343158 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:25.350392 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:25.350891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:25.351462 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:25.352289 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:25.352761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:25.354072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:25.507112 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:25.519956 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eeac215b-2f86-4845-bc4e-a7343123f138 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.181727 Oct 17 14:54:25.522548 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3793/8027] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:25 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:26.552894 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:26.554225 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:26.567719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:26.568955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:26.570278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:26.572202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:26.573902 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:26.575133 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:26.789498 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:26.794896 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40d12a63-c519-44e4-8f9b-e696b9c8f419 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.250128 Oct 17 14:54:26.809638 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4235/8028] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:26 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:54:27.818891 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:27.819626 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:27.827666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:27.828148 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:27.828580 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:27.829325 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:27.829970 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:27.830615 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:27.976316 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:27.985223 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8137de2a-5828-4c13-a0e1-5ae41343be2b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.169863 Oct 17 14:54:27.987031 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3794/8029] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:27 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:29.011522 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:29.012293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:29.019584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:29.020078 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:29.020532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:29.021282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:29.021746 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:29.022187 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:29.177279 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:29.186506 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4e75c2a-3bdb-4df1-ae68-5b2d69b148ad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.179805 Oct 17 14:54:29.189215 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4236/8030] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:29 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:30.210463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:30.211074 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:30.221474 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:30.222748 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:30.234369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:30.234691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:30.235357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:30.235796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:30.382623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:30.393090 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7bd4e65c-b23b-4311-b080-67e1f2f9d8d6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.186420 Oct 17 14:54:30.394360 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3795/8031] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:30 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:31.418082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:31.418827 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:31.430551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:31.430551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:31.430551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:31.430551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:31.430551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:31.430551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:31.581113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:31.589558 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a4cb2b55-ba68-4f8f-87e5-93eeb3d81f7a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.175461 Oct 17 14:54:31.590253 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4237/8032] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:31 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:32.613576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:32.614197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:32.621847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:32.622335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:32.622801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:32.623489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:32.623939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:32.624361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:32.808267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:32.816188 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-257be099-f9ee-46b5-8741-ebd44db74ffe tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.206692 Oct 17 14:54:32.817006 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3796/8033] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:32 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:33.840586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:33.841341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:33.848600 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:33.849376 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:33.850030 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:33.850752 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:33.851405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:33.851856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:33.989841 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:33.998467 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-87865431-a43e-4ba1-b89c-389fdd1a059a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.162352 Oct 17 14:54:33.999053 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4238/8034] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:33 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:35.022239 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:35.022887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:35.030421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:35.030911 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:35.031353 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:35.032054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:35.032570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:35.032945 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:35.168679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:35.176633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-567dfcad-39df-41cd-a396-ea5b9c2ad42f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.158584 Oct 17 14:54:35.177234 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3797/8035] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:35 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:36.200584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:36.201305 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:36.208361 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:36.208858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:36.209358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:36.210080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:36.210556 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:36.211068 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:36.349497 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:36.357538 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-881fcfa5-e3bf-44cc-85b2-4e7241bbd3ec tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.161453 Oct 17 14:54:36.358145 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4239/8036] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:36 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:37.381147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:37.381781 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:37.389708 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:37.390195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:37.390632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:37.391336 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:37.391788 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:37.392212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:37.527164 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:37.535075 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-571e1691-d2d5-4680-9edf-fda66b34b7a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.157811 Oct 17 14:54:37.535601 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3798/8037] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:37 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:38.559294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:38.560131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:38.567255 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:38.567835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:38.568295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:38.569032 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:38.569529 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:38.569966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:38.705353 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:38.713414 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-512c611c-6e48-41d5-9e68-d084a6f72a7c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.158201 Oct 17 14:54:38.714674 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4240/8038] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:38 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:39.738480 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:39.739098 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:39.746711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:39.747201 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:39.747641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:39.748352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:39.748805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:39.749263 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:39.879300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:39.888124 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef62a543-d908-4554-8b6f-19ec61c4a7a5 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.153362 Oct 17 14:54:39.888633 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3799/8039] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:39 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:40.037619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b5715d58-cee9-4d54-b044-f83ca675a5e1 req-fda11fa3-905a-4b89-aefa-8543a09a89e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "name": "network-vif-plugged", "status": "completed", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:54:40.051826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b5715d58-cee9-4d54-b044-f83ca675a5e1 req-fda11fa3-905a-4b89-aefa-8543a09a89e6 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:40.052339 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b5715d58-cee9-4d54-b044-f83ca675a5e1 req-fda11fa3-905a-4b89-aefa-8543a09a89e6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:40.052796 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b5715d58-cee9-4d54-b044-f83ca675a5e1 req-fda11fa3-905a-4b89-aefa-8543a09a89e6 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:40.065911 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b5715d58-cee9-4d54-b044-f83ca675a5e1 req-fda11fa3-905a-4b89-aefa-8543a09a89e6 service nova] Creating event network-vif-plugged:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h2-854121-14 Oct 17 14:54:40.071289 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b5715d58-cee9-4d54-b044-f83ca675a5e1 req-fda11fa3-905a-4b89-aefa-8543a09a89e6 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037520 Oct 17 14:54:40.071910 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4241/8040] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:54:40.912012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:40.912677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:40.920189 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:40.920666 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:40.921099 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:40.921807 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:40.922253 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:40.922677 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:41.061397 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:41.069292 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46ac0128-5d14-4eec-a398-0b35d1f7a207 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.161250 Oct 17 14:54:41.069883 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3800/8041] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:40 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:42.093979 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:42.094700 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:42.102737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:42.103337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:42.103925 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:42.104929 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:42.105496 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:42.106029 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:42.248046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:42.256179 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-daf9b308-065e-4003-ade3-3cd882f7eda2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1686 microversion: 2.1 time: 0.166721 Oct 17 14:54:42.256773 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4242/8042] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:42 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:54:43.280728 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:54:43.281377 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:54:43.288291 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:43.288772 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:43.289232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:43.289930 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:54:43.290382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:54:43.290806 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:54:43.425801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:54:43.434296 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50342008-b746-472e-a902-c45c37872d69 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1673 microversion: 2.1 time: 0.158340 Oct 17 14:54:43.435002 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3801/8043] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:54:43 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:28.822904 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=19 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:28.823963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=59 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:28.824812 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:56:28.824955 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:28.825500 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Oct 17 14:56:28.827021 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:28.830212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-a8e00876-7387-4533-b93a-ca10bee6b582 req-ddb2c8dd-e1f7-42c9-bbba-8e498fbe4ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:28.830439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=19 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:28.830960 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=51 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:28.832169 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:56:28.832311 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 (ip 10.222.0.65) !!! Oct 17 14:56:28.842950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a8e00876-7387-4533-b93a-ca10bee6b582 req-ddb2c8dd-e1f7-42c9-bbba-8e498fbe4ab8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:28.843427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a8e00876-7387-4533-b93a-ca10bee6b582 req-ddb2c8dd-e1f7-42c9-bbba-8e498fbe4ab8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:28.844720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-a8e00876-7387-4533-b93a-ca10bee6b582 req-ddb2c8dd-e1f7-42c9-bbba-8e498fbe4ab8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:28.850718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:28.851252 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:28.851719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:28.852461 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:28.852971 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:28.853964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:28.857633 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-a8e00876-7387-4533-b93a-ca10bee6b582 req-ddb2c8dd-e1f7-42c9-bbba-8e498fbe4ab8 service nova] Creating event network-changed:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h2-854121-14 Oct 17 14:56:28.866107 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-a8e00876-7387-4533-b93a-ca10bee6b582 req-ddb2c8dd-e1f7-42c9-bbba-8e498fbe4ab8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044981 Oct 17 14:56:28.867069 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3802/8044] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:56:28.886758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 14:56:28.987360 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3ff5c20-f5e0-41c9-9f5f-851b10af0b68 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "DELETE /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 204 len: 0 microversion: 2.1 time: 0.168579 Oct 17 14:56:28.987980 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4243/8045] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 14:56:28 2022] DELETE /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 14:56:28.997406 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:28.998194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:29.005271 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:29.005856 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:29.006361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:29.007136 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:29.007827 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:29.008345 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:29.154237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:29.162785 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-17c81640-adfe-42f9-8d20-d4c84451eb89 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.169714 Oct 17 14:56:29.163353 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3803/8046] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:28 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:30.189027 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:30.189821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:30.197253 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:30.197754 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:30.198202 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:30.198918 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:30.199380 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:30.199816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:30.338387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:30.349858 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-327638ca-bdc6-4e68-b051-e14601adc395 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1679 microversion: 2.1 time: 0.165580 Oct 17 14:56:30.350657 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4244/8047] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:30 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:31.375578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:31.376369 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:31.385443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:31.385926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:31.386792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:31.387033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:31.387757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:31.388288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:31.470134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:31.480101 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-13ae1de1-b8ec-4de2-bc1d-e7f3bc594bad tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 200 len: 1494 microversion: 2.1 time: 0.108864 Oct 17 14:56:31.480636 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3804/8048] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:31 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 1494 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:31.514774 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-aa538bc4-98fb-415e-a9dd-1d7e9911aa89 req-507da849-7bfb-40db-94e8-4a3d6de703db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35a2377d-eb45-43a8-9ecc-186afdacfb94", "name": "network-vif-deleted", "tag": "d4dfbd11-5c65-48e6-bbd0-343f9d863cbd"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:31.525113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aa538bc4-98fb-415e-a9dd-1d7e9911aa89 req-507da849-7bfb-40db-94e8-4a3d6de703db service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:31.525636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aa538bc4-98fb-415e-a9dd-1d7e9911aa89 req-507da849-7bfb-40db-94e8-4a3d6de703db service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:31.526076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-aa538bc4-98fb-415e-a9dd-1d7e9911aa89 req-507da849-7bfb-40db-94e8-4a3d6de703db service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:31.539786 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-aa538bc4-98fb-415e-a9dd-1d7e9911aa89 req-507da849-7bfb-40db-94e8-4a3d6de703db service nova] Creating event network-vif-deleted:d4dfbd11-5c65-48e6-bbd0-343f9d863cbd for instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 on n-h2-854121-14 Oct 17 14:56:31.545060 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-aa538bc4-98fb-415e-a9dd-1d7e9911aa89 req-507da849-7bfb-40db-94e8-4a3d6de703db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096568 Oct 17 14:56:31.545737 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4245/8049] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:56:32.506467 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:32.507117 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 35a2377d-eb45-43a8-9ecc-186afdacfb94] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:32.514477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:32.514974 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:32.515424 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:32.516191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:32.516641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:32.517452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:32.532072 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] HTTP exception thrown: Instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 could not be found. Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Request method failure captured: Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 HTTP/1.1 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTWv3xMwHVnRRYge9jm6pETRtWByjbWz73OmfdJXONdORfXBWDMdDkQjydmd77fsnLXdamILzRY3mcJbGD3jpkg5CkD_IUcYNEcgBCIZR8ESqZFyktLQu-N5u3ikKzZiF42_rA74XRKwQeIOWdwm2i2aYOMbq1jjs1OIevFDtRAwYgnY Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 15c702fa15174c1fb96a61a47b53ac40 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestShelveInstance-1384180329 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestShelveInstance-1384180329 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 15c702fa15174c1fb96a61a47b53ac40 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestShelveInstance-1384180329 Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestShelveInstance-1384180329-project Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: 134b54c3cf4347f4a151d32eb657e2db Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestShelveInstance-1384180329-project Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 could not be found. Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '35a2377d-eb45-43a8-9ecc-186afdacfb94'} Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 could not be found. Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 could not be found. Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 14:56:32.533774 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 could not be found. Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Returning 404 to user: Instance 35a2377d-eb45-43a8-9ecc-186afdacfb94 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb5464ec-ec0c-42f4-b328-a3ce0cedbd06 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94" status: 404 len: 111 microversion: 2.1 time: 0.033051 Oct 17 14:56:32.539639 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3805/8050] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:32 2022] GET /compute/v2.1/servers/35a2377d-eb45-43a8-9ecc-186afdacfb94 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 14:56:32.698224 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7acbfe03-a16e-4aee-a2a6-57b74ea9ae93 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '.version_select at 0x7f419c822d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:32.729283 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7acbfe03-a16e-4aee-a2a6-57b74ea9ae93 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1083169156" status: 202 len: 0 microversion: 2.1 time: 0.035688 Oct 17 14:56:32.729885 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4246/8051] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Oct 17 14:56:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1083169156 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:56:32.755054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6ca2b6d-b5eb-44bc-8861-53035d850dee tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'create', calling method: .version_select at 0x7f419c7f53a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1744265271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYDmj3Titycu59UYqff6c4tipaOJ8V9F/gxiTwzMMgwvEudQ5wwiXgJ34OAHDdGOHMmafXpjsdB8MNqsKCjVhc86lIPrz/tXXFh44wuPFmlxzSUpXbTgC4HWySJ4U4IRQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:32.771715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e6ca2b6d-b5eb-44bc-8861-53035d850dee tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:56:32.776841 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-e6ca2b6d-b5eb-44bc-8861-53035d850dee tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for user 134b54c3cf4347f4a151d32eb657e2db and project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:56:32.805181 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6ca2b6d-b5eb-44bc-8861-53035d850dee tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054089 Oct 17 14:56:32.805793 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3806/8052] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 14:56:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:56:49.168801 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1547988148", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1744265271", "security_groups": [{"name": "tempest-secgroup-smoke-1953989811"}], "networks": [{"uuid": "47269859-01c6-4753-83a8-94f1628d6d67"}], "block_device_mapping_v2": [{"uuid": "96f3516e-a654-42b8-95c7-95c13c15e89f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:49.184557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:49.185257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:49.293822 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] validate_networks() for [('47269859-01c6-4753-83a8-94f1628d6d67', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 14:56:49.708526 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 14:56:49.708993 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 14:56:49.709610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 14:56:49.710035 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 14:56:49.710465 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 14:56:49.721010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:49.721708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:49.722336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:49.723334 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:49.724059 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:49.724845 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:49.743560 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 14:56:49.748824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Getting quotas for user 134b54c3cf4347f4a151d32eb657e2db and project 15c702fa15174c1fb96a61a47b53ac40. Resources: {'cores', 'ram', 'instances'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 14:56:49.809332 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 14:56:49.811670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96f3516e-a654-42b8-95c7-95c13c15e89f',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 14:56:49.953961 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b8b2fe95-ff93-442b-bf47-ad7e06a60420 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788995 Oct 17 14:56:49.954639 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4247/8053] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 14:56:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 14:56:49.969751 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=16 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:49.970752 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:49.971535 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:56:49.975695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1a9d7e93-2c98-4d3f-94bc-4d11ee26f243 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:49.976857 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1a9d7e93-2c98-4d3f-94bc-4d11ee26f243 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:50.035107 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1a9d7e93-2c98-4d3f-94bc-4d11ee26f243 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:50.042313 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1a9d7e93-2c98-4d3f-94bc-4d11ee26f243 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1089 microversion: 2.1 time: 0.074750 Oct 17 14:56:50.042890 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3807/8054] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:49 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:56:51.065716 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:51.066337 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:51.073477 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:51.073975 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:51.074426 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:51.075124 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:51.075588 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:51.076023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:51.135933 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:51.143881 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4864c7ce-99c2-42e6-a08b-cb1260b35f92 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1139 microversion: 2.1 time: 0.083758 Oct 17 14:56:51.144462 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4248/8055] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:51 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:52.167269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:52.167894 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:52.175881 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:52.176376 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:52.176819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:52.177557 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:52.178017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:52.178443 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:52.259426 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:52.267549 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3dadb2d-b9fb-471e-b590-440eb461d668 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1205 microversion: 2.1 time: 0.104101 Oct 17 14:56:52.268148 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3808/8056] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:52 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1205 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:53.296586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:53.303080 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:53.325336 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:53.326213 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:53.326994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:53.327947 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:53.328672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:53.329442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:53.652503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:53.665039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65579951-5972-4875-99c6-3551eaae2c21 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1273 microversion: 2.1 time: 0.376684 Oct 17 14:56:53.665843 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4249/8057] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:53 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:54.167242 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-75191a12-3cf5-42ff-a94b-bb7830d44d41 req-a3297708-dcd0-48a8-aac7-2968a2fa194c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:56:54.188937 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-75191a12-3cf5-42ff-a94b-bb7830d44d41 req-a3297708-dcd0-48a8-aac7-2968a2fa194c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:54.189479 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-75191a12-3cf5-42ff-a94b-bb7830d44d41 req-a3297708-dcd0-48a8-aac7-2968a2fa194c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:54.189958 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-75191a12-3cf5-42ff-a94b-bb7830d44d41 req-a3297708-dcd0-48a8-aac7-2968a2fa194c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:54.205264 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-75191a12-3cf5-42ff-a94b-bb7830d44d41 req-a3297708-dcd0-48a8-aac7-2968a2fa194c service nova] Creating event network-changed:22a6e241-23a8-4509-a38a-3fc8ba1b0b08 for instance 00c2c195-91c0-47de-b862-45b41ecce3ad on n-h1-854121-14 Oct 17 14:56:54.210855 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-75191a12-3cf5-42ff-a94b-bb7830d44d41 req-a3297708-dcd0-48a8-aac7-2968a2fa194c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113636 Oct 17 14:56:54.211821 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3809/8058] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:56:54.692205 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:54.692792 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:54.699267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:54.699913 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:54.700378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:54.701106 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:54.701603 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:54.702048 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:54.945891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:54.954486 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-993fdde1-435b-4040-9465-971a80783333 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1273 microversion: 2.1 time: 0.268151 Oct 17 14:56:54.955097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4250/8059] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:54 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:55.978002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:55.978729 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:55.985255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:55.985730 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:55.986190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:55.986878 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:55.987324 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:55.987741 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:56.122636 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:56.131539 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9aaeebbc-25df-44eb-a614-c7e2fcbb7bed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1273 microversion: 2.1 time: 0.157980 Oct 17 14:56:56.132127 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3810/8060] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:55 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:57.156404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:57.157064 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:57.163186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:57.163708 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:57.164154 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:57.164858 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:57.165856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:57.165856 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:57.314994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:57.322827 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-684ac185-323f-47fc-ac2a-9646beea05c1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1273 microversion: 2.1 time: 0.171404 Oct 17 14:56:57.323408 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4251/8061] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:57 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:58.346606 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:58.347216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:58.354577 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:58.355054 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:58.355485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:58.356176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:58.356623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:58.357043 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:58.490833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:58.498746 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-77eab982-93b4-4f79-bbda-9a42eff51f25 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.156748 Oct 17 14:56:58.499314 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3811/8062] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:58 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:56:59.522906 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:56:59.523626 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:56:59.530586 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:59.531081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:59.531532 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:59.532238 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:56:59.532709 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:56:59.533147 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:56:59.666326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:56:59.675014 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2909b53-edaa-4577-bc91-d2d0520888e9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.156317 Oct 17 14:56:59.675587 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4252/8063] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:56:59 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:00.697694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:00.698222 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:00.701036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:00.706720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:00.707206 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:00.707651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:00.708351 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:00.708804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:00.709255 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:00.844123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:00.852058 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ed14841-f618-4eb4-9d38-a646af57120e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.158329 Oct 17 14:57:00.852638 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3812/8064] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:00 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:01.876259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:01.876863 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:01.878786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:01.879474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:57:01.886659 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:01.887171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:01.887684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:01.888343 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:01.888814 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:01.889278 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:02.025210 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:02.033532 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4df3d93a-9f3f-4bbb-8001-cc4d87c6031f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.161726 Oct 17 14:57:02.034130 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4253/8065] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:01 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:03.056695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:03.057344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:03.064552 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:03.064984 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:03.065440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:03.066134 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:03.066582 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:03.067003 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:03.202653 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:03.211203 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-874cf2f2-0c4e-489d-966d-3bd42b862816 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.158694 Oct 17 14:57:03.211791 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3813/8066] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:03 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:04.234335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:04.235192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:04.242223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:04.242762 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:04.243214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:04.243927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:04.244440 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:04.244884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:04.381439 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:04.389244 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33b5118d-5b3c-4c03-aba4-28b9f27c89f2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.159022 Oct 17 14:57:04.389816 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4254/8067] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:04 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:05.413696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:05.414310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:05.421138 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:05.421641 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:05.422073 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:05.422972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:05.423427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:05.423853 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:05.558873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:05.567714 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-abe12125-8ae4-4662-a471-c4e2ce60236f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.157777 Oct 17 14:57:05.568311 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3814/8068] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:05 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:06.591879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:06.592642 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:06.600639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:06.601141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:06.601652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:06.602367 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:06.602884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:06.603322 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:06.741271 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:06.749278 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-75e97eb2-3322-4669-ac6e-700c44c556b6 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.162054 Oct 17 14:57:06.749862 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4255/8069] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:06 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:07.772327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:07.772966 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:07.779830 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:07.780319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:07.780759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:07.782033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:07.782431 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:07.782860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:07.923484 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:07.931342 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-89e7ffaa-a592-45ce-a610-34dd0f627783 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.163177 Oct 17 14:57:07.931936 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3815/8070] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:07 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:08.245707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a03b96ad-a9bc-4793-b3cc-68f32c617c65 req-43e0c63d-ce49-494c-80c2-05cc2054821c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "name": "network-vif-plugged", "status": "completed", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:57:08.256188 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a03b96ad-a9bc-4793-b3cc-68f32c617c65 req-43e0c63d-ce49-494c-80c2-05cc2054821c service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.256758 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a03b96ad-a9bc-4793-b3cc-68f32c617c65 req-43e0c63d-ce49-494c-80c2-05cc2054821c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.261517 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a03b96ad-a9bc-4793-b3cc-68f32c617c65 req-43e0c63d-ce49-494c-80c2-05cc2054821c service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:08.274270 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a03b96ad-a9bc-4793-b3cc-68f32c617c65 req-43e0c63d-ce49-494c-80c2-05cc2054821c service nova] Creating event network-vif-plugged:22a6e241-23a8-4509-a38a-3fc8ba1b0b08 for instance 00c2c195-91c0-47de-b862-45b41ecce3ad on n-h1-854121-14 Oct 17 14:57:08.279370 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a03b96ad-a9bc-4793-b3cc-68f32c617c65 req-43e0c63d-ce49-494c-80c2-05cc2054821c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089202 Oct 17 14:57:08.280033 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4256/8071] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:57:08.955237 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:08.955876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:08.962831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.963347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.963783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:08.964475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:08.964926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:08.965445 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:09.098520 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:09.106318 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-beb34333-68de-4cef-b386-3b7e31f4002b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1261 microversion: 2.1 time: 0.155819 Oct 17 14:57:09.106896 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3816/8072] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:08 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:10.131469 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:10.132247 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:10.138806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.139257 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.139740 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.140460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.141468 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.142071 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.359900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:10.368045 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-97789fa3-c1fd-49b6-908e-cfe761fe5135 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1446 microversion: 2.1 time: 0.242398 Oct 17 14:57:10.368855 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4257/8073] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:10 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:10.392186 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:57:10.392768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:57:10.399950 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.400438 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.400877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.401610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:10.402065 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:10.402487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:10.591078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:57:10.599173 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2616815-f604-4993-a913-193c6d07991c tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1446 microversion: 2.1 time: 0.211705 Oct 17 14:57:10.599769 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3817/8074] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:57:10 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:57:12.246057 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1317b363-c360-4c05-8594-114c265e76a5 req-745e29b7-9a6f-4ca6-a36d-e3c54c745a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:57:12.257499 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1317b363-c360-4c05-8594-114c265e76a5 req-745e29b7-9a6f-4ca6-a36d-e3c54c745a89 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:57:12.257991 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1317b363-c360-4c05-8594-114c265e76a5 req-745e29b7-9a6f-4ca6-a36d-e3c54c745a89 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:57:12.258435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1317b363-c360-4c05-8594-114c265e76a5 req-745e29b7-9a6f-4ca6-a36d-e3c54c745a89 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:57:12.270866 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1317b363-c360-4c05-8594-114c265e76a5 req-745e29b7-9a6f-4ca6-a36d-e3c54c745a89 service nova] Creating event network-changed:22a6e241-23a8-4509-a38a-3fc8ba1b0b08 for instance 00c2c195-91c0-47de-b862-45b41ecce3ad on n-h1-854121-14 Oct 17 14:57:12.275919 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1317b363-c360-4c05-8594-114c265e76a5 req-745e29b7-9a6f-4ca6-a36d-e3c54c745a89 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033563 Oct 17 14:57:12.276746 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4258/8075] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 14:59:09.515280 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:59:09.516455 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 14:59:09.517018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=24 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:09.517783 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=56 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:09.519779 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 14:59:09.520056 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad/action (ip 10.222.0.65) !!! Oct 17 14:59:09.521600 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:59:09.521797 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 14:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad/action (ip 10.222.0.65) !!! Oct 17 14:59:09.528281 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:09.528818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:09.537692 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:09.538179 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:09.538614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:09.539308 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:09.539761 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:09.540216 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:09.563675 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lazy-loading 'flavor' on Instance uuid 00c2c195-91c0-47de-b862-45b41ecce3ad {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 14:59:09.639666 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c09ec9b-6fcf-4b9e-b841-d12514a3faed tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad/action" status: 202 len: 0 microversion: 2.1 time: 0.126007 Oct 17 14:59:09.640287 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3818/8076] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:59:09 2022] POST /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:59:09.647282 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:59:09.648183 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 14:59:09.648778 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:09.650226 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=60 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:09.653226 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 14:59:09.653415 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 14:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad (ip 10.222.0.65) !!! Oct 17 14:59:09.659677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:09.660415 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:09.672911 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:09.673438 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:09.673890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:09.674599 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:09.675063 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:09.675495 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:09.872771 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:09.880754 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-04a4c133-f4e7-4788-98e6-ce18fd5625f9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.235793 Oct 17 14:59:09.881364 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4259/8077] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:09 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:10.906262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:10.906975 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:10.921847 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:10.922340 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:10.922776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:10.923492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:10.923939 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:10.924365 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:10.929401 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59958. Oct 17 14:59:10.932573 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59960. Oct 17 14:59:11.134964 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:11.143157 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10775efa-dc19-4c79-823b-cfdcf302d0f7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.241140 Oct 17 14:59:11.143748 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3819/8078] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:10 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:12.167597 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:12.168232 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:12.178113 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:12.178610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:12.179056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:12.179759 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:12.180259 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:12.180745 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:12.185542 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59966. Oct 17 14:59:12.187795 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 59964. Oct 17 14:59:12.320687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:12.328879 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-809525f5-1516-4059-a1d3-897a2c8b0ed3 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.166040 Oct 17 14:59:12.329528 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4260/8079] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:12 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:13.353489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:13.354102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:13.360969 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:13.361492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:13.361926 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:13.362628 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:13.363077 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:13.363501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:13.495650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:13.503557 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-035a113c-f25b-4697-b304-7de3c287f4a2 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.154560 Oct 17 14:59:13.504134 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3820/8080] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:13 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:14.529523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:14.530102 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:14.536965 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:14.537810 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:14.538275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:14.538994 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:14.539472 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:14.539966 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:14.676907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:14.685867 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a39d22f-d808-46d6-833a-d50afbfe4826 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.160723 Oct 17 14:59:14.686458 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4261/8081] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:14 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:15.710162 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:15.710837 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:15.717736 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:15.718213 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:15.718651 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:15.719348 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:15.719800 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:15.720224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:15.857152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:15.865061 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-190b359c-f75b-430b-86ba-ddd902e639ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.158849 Oct 17 14:59:15.865666 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3821/8082] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:15 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:16.888405 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:16.888986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:16.895927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:16.896689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:16.897146 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:16.897896 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:16.898371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:16.898820 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:17.037692 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:17.046094 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd287ef1-fe5d-4191-9f1f-5f8a49ac94a9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.161954 Oct 17 14:59:17.046677 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4262/8083] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:16 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:18.070151 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:18.071028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:18.077990 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:18.078476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:18.078919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:18.079614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:18.080072 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:18.080501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:18.477780 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:18.486940 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-38030efb-4022-4ac0-ab28-81a12a894891 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.420920 Oct 17 14:59:18.487514 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3822/8084] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:18 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:19.513489 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:19.514117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:19.521578 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:19.522074 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:19.522793 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:19.523503 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:19.523964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:19.524424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:19.662629 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:19.671563 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1e7311aa-b869-4cef-84da-887bf638b25e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.164007 Oct 17 14:59:19.672154 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4263/8085] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:19 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:20.695518 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:20.696125 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:20.704578 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:20.705053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:20.705516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:20.706196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:20.706716 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:20.707133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:20.847036 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:20.855185 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46e57f97-0aee-474b-a7ae-dfb7427f0f4a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.163658 Oct 17 14:59:20.855740 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3823/8086] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:20 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:21.878664 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:21.879329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:21.887010 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:21.887449 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:21.887907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:21.888639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:21.889107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:21.889576 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:22.020445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:22.029390 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a768c123-4789-44d0-adbb-79615cc6ec75 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.154739 Oct 17 14:59:22.029976 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4264/8087] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:21 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:23.053537 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:23.054191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:23.061988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:23.062694 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:23.063176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:23.064013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:23.064481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:23.064910 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:23.216114 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:23.224425 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ab1778f-6774-4cba-b2a4-cd5a6c98ff51 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.174870 Oct 17 14:59:23.225097 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3824/8088] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:23 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:24.247903 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:24.248537 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:24.255589 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.256092 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.256549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.257292 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.257767 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.258214 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.390267 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:24.398495 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c7729e2-49eb-4e77-b7c0-e1fee8122c6b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1572 microversion: 2.1 time: 0.154502 Oct 17 14:59:24.399067 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4265/8089] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:24 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:24.422529 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:24.423113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:24.430399 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.430887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.431319 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.432519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.433066 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.433524 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.464060 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 17 14:59:24.535026 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-61f434d6-36be-433a-b818-73b177edbd43 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "POST /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad/action" status: 202 len: 0 microversion: 2.1 time: 0.116626 Oct 17 14:59:24.535546 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3825/8090] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 14:59:24 2022] POST /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 14:59:24.544329 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:24.544976 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:24.550892 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.551387 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.551835 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.552544 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.553031 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.553511 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.741104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:24.751057 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2b6c038-72da-40b0-b846-afeae1300956 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1520 microversion: 2.1 time: 0.211121 Oct 17 14:59:24.751987 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4266/8091] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:24 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:24.800987 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e9d4d531-2445-4180-b679-3a76e899d4eb req-9b6f1116-3243-4380-ae7d-14832a4d7894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "name": "network-vif-unplugged", "status": "completed", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:24.814226 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e9d4d531-2445-4180-b679-3a76e899d4eb req-9b6f1116-3243-4380-ae7d-14832a4d7894 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:24.814710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e9d4d531-2445-4180-b679-3a76e899d4eb req-9b6f1116-3243-4380-ae7d-14832a4d7894 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:24.815149 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e9d4d531-2445-4180-b679-3a76e899d4eb req-9b6f1116-3243-4380-ae7d-14832a4d7894 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:24.826792 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.compute.server_external_events [req-e9d4d531-2445-4180-b679-3a76e899d4eb req-9b6f1116-3243-4380-ae7d-14832a4d7894 service nova] Unable to find a host for instance 00c2c195-91c0-47de-b862-45b41ecce3ad. Dropping event network-vif-unplugged {{(pid=120698) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 17 14:59:24.827699 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e9d4d531-2445-4180-b679-3a76e899d4eb req-9b6f1116-3243-4380-ae7d-14832a4d7894 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030675 Oct 17 14:59:24.828324 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3826/8092] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 17 14:59:25.776467 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:25.777105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:25.784275 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:25.784789 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:25.785268 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:25.786002 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:25.786474 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:25.786999 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:25.937471 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:25.945304 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a25ec17a-460b-4f96-b66d-b09619266762 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1520 microversion: 2.1 time: 0.173249 Oct 17 14:59:25.945879 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4267/8093] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:25 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:26.969248 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:26.969863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:26.976732 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:26.977245 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:26.977680 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:26.978418 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:26.979044 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:26.979469 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:27.126768 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:27.137530 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-edeba225-f48d-40b5-9d7a-f729afbca502 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1520 microversion: 2.1 time: 0.172159 Oct 17 14:59:27.138106 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3827/8094] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:26 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:28.162875 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:28.163553 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:28.171939 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:28.172454 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:28.172915 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:28.173686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:28.174164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:28.174612 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:28.310684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:28.318809 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-88407673-6788-4b9e-adf1-b4f76acc24a7 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1520 microversion: 2.1 time: 0.160126 Oct 17 14:59:28.319399 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4268/8095] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:28 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 14:59:29.342662 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:29.343290 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:29.350342 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:29.350833 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:29.351274 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:29.352215 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:29.352425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:29.352852 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:29.498329 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:29.507283 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-06543d86-434a-482d-861e-ee63307a420f tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1522 microversion: 2.1 time: 0.168911 Oct 17 14:59:29.508300 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3828/8096] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:29 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:30.532797 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:30.533452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:30.540613 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:30.541117 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:30.541608 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:30.542331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:30.542805 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:30.543248 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:30.680927 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:30.689110 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59c28e88-be61-4a7d-afaa-eb1672e58453 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1522 microversion: 2.1 time: 0.160247 Oct 17 14:59:30.689939 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4269/8097] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:30 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:31.714146 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:31.714770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:31.721920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:31.722410 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:31.722848 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:31.723622 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:31.724013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:31.724437 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:31.907327 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:31.915330 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-825898b8-9264-442b-8567-2d1841aa91d4 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1522 microversion: 2.1 time: 0.205832 Oct 17 14:59:31.929186 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3829/8098] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:31 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:32.939834 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:32.940470 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:32.948398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:32.948920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:32.949404 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:32.950131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:32.950610 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:32.951051 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:33.089488 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:33.097593 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-802847cd-d607-425e-a9e5-51723b21d36d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1522 microversion: 2.1 time: 0.161710 Oct 17 14:59:33.098218 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4270/8099] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:32 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:34.121421 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:34.122049 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:34.129570 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:34.130707 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:34.131300 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:34.132283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:34.132872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:34.133352 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:34.283334 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:34.293604 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cde9857c-3ed6-425a-904b-dba1eecded8a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1522 microversion: 2.1 time: 0.176956 Oct 17 14:59:34.294385 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3830/8100] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:34 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:35.317175 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:35.317826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:35.325483 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:35.325984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:35.326436 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:35.327155 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:35.327625 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:35.328066 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:35.458581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:35.467180 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a65b8c8e-06b4-4fa2-9e9a-10508441f066 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.153939 Oct 17 14:59:35.467763 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4271/8101] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:35 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:36.490616 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:36.491232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:36.498935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:36.499419 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:36.499863 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:36.500555 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:36.501008 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:36.501466 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:36.637558 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:36.645516 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5de083b-33f4-4021-bd93-fb29b8eeb238 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.158792 Oct 17 14:59:36.646092 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3831/8102] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:36 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:37.670452 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:37.671116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:37.678236 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:37.678730 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:37.679178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:37.679890 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:37.680356 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:37.680795 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:37.819964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:37.828007 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a4dc3c9-1d8d-4029-9ebd-1a1cb3af02b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.162740 Oct 17 14:59:37.828595 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4272/8103] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:37 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:38.851971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:38.852527 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:38.860064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:38.860572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:38.861012 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:38.861734 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:38.862180 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:38.862599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:38.866642 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:38.999285 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:39.007153 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea0dd0ca-012d-4f5e-9765-ff440dd9637d tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.159174 Oct 17 14:59:39.007732 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3832/8104] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:38 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:40.031201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:40.031838 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:40.034567 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=29 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:40.040298 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:40.040938 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:40.041434 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:40.042151 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:40.042624 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:40.043073 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:40.047171 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=85 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:40.174646 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:40.183136 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8135df8c-d298-4209-a849-a742b152d705 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.155931 Oct 17 14:59:40.183735 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4273/8105] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:40 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:41.206972 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:41.207598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:41.209669 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 14:59:41.216556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:41.217046 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:41.217508 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:41.218212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:41.218664 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:41.219089 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:41.354079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:41.361970 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc91c3c6-d871-41fd-a72a-f772e2022fbb tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.159087 Oct 17 14:59:41.362550 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3833/8106] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:41 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:42.386823 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:42.387447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:42.393787 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:42.394293 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:42.394749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:42.395462 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:42.395940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:42.396634 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:42.537105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:42.545798 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-154cdfb8-a132-4580-92b5-23d8f90365b1 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.164004 Oct 17 14:59:42.546388 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4274/8107] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:42 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:43.569715 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:43.570333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:43.577991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:43.578471 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:43.578905 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:43.579592 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:43.580045 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:43.580472 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:43.717407 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:43.725528 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f825fdad-feec-4408-8f3a-af77200af33e tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.159692 Oct 17 14:59:43.726106 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3834/8108] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:43 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:44.749475 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:44.750149 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:44.757584 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:44.758081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:44.758545 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:44.759265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:44.759818 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:44.760186 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:44.904964 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:44.913900 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-837ae50e-4063-46d4-b247-e2051a2fbabf tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.168388 Oct 17 14:59:44.914504 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4275/8109] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:44 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:44.926396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8b523b17-a4ee-41da-b5de-afebb301d04c req-d6d7eed9-d4a2-45f6-bacb-03de4c41d4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "name": "network-vif-plugged", "status": "completed", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 14:59:44.938025 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8b523b17-a4ee-41da-b5de-afebb301d04c req-d6d7eed9-d4a2-45f6-bacb-03de4c41d4c0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:44.938572 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8b523b17-a4ee-41da-b5de-afebb301d04c req-d6d7eed9-d4a2-45f6-bacb-03de4c41d4c0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:44.938947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8b523b17-a4ee-41da-b5de-afebb301d04c req-d6d7eed9-d4a2-45f6-bacb-03de4c41d4c0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:44.950934 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8b523b17-a4ee-41da-b5de-afebb301d04c req-d6d7eed9-d4a2-45f6-bacb-03de4c41d4c0 service nova] Creating event network-vif-plugged:22a6e241-23a8-4509-a38a-3fc8ba1b0b08 for instance 00c2c195-91c0-47de-b862-45b41ecce3ad on n-h1-854121-14 Oct 17 14:59:44.955978 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8b523b17-a4ee-41da-b5de-afebb301d04c req-d6d7eed9-d4a2-45f6-bacb-03de4c41d4c0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Oct 17 14:59:44.957016 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3835/8110] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 14:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 14:59:45.938076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:45.938707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:45.945750 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:45.946244 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:45.946693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:45.947397 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:45.948570 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:45.949013 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:46.080986 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:46.089496 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fc082e3-d219-42a9-bcd5-70dc5c02021a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1578 microversion: 2.1 time: 0.155249 Oct 17 14:59:46.090097 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4276/8111] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:45 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 14:59:47.115303 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 14:59:47.116004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 14:59:47.123002 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:47.123481 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:47.123920 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:47.124614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 14:59:47.125068 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 14:59:47.125522 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 14:59:47.259126 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 14:59:47.267104 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4958d127-4886-4a8c-87b8-b1769f0f6cf9 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1565 microversion: 2.1 time: 0.156934 Oct 17 14:59:47.267884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3836/8112] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 14:59:47 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:03.835258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=7 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:03.836013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=24 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:03.839871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:03.840388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:03.842884 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:03.848923 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-9bab8385-6257-4601-a03c-494dfc58d5f7 req-01cb0bd1-6b64-40c7-bc1c-c07f9b158c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:03.850282 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=23 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:03.851320 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:01:03.851512 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 15:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad (ip 10.222.0.65) !!! Oct 17 15:01:03.853244 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:01:03.853244 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 15:01:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad (ip 10.222.0.65) !!! Oct 17 15:01:03.862187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9bab8385-6257-4601-a03c-494dfc58d5f7 req-01cb0bd1-6b64-40c7-bc1c-c07f9b158c3e service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:03.863172 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:03.863341 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9bab8385-6257-4601-a03c-494dfc58d5f7 req-01cb0bd1-6b64-40c7-bc1c-c07f9b158c3e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:03.863684 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:03.863831 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-9bab8385-6257-4601-a03c-494dfc58d5f7 req-01cb0bd1-6b64-40c7-bc1c-c07f9b158c3e service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:03.864140 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:03.864889 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:03.865391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:03.865842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:03.876376 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-9bab8385-6257-4601-a03c-494dfc58d5f7 req-01cb0bd1-6b64-40c7-bc1c-c07f9b158c3e service nova] Creating event network-changed:22a6e241-23a8-4509-a38a-3fc8ba1b0b08 for instance 00c2c195-91c0-47de-b862-45b41ecce3ad on n-h1-854121-14 Oct 17 15:01:03.881665 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-9bab8385-6257-4601-a03c-494dfc58d5f7 req-01cb0bd1-6b64-40c7-bc1c-c07f9b158c3e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048117 Oct 17 15:01:03.882281 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3837/8113] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:01:03.901094 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:01:03.990753 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e0cfa72e-ac86-4562-80a6-e64fa3697a1a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "DELETE /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 204 len: 0 microversion: 2.1 time: 0.159420 Oct 17 15:01:03.991844 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4277/8114] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 15:01:03 2022] DELETE /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:01:04.001425 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:04.002137 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:04.010373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:04.010872 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:04.011315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:04.012028 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:04.012487 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:04.012954 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:04.164997 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:04.173833 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fb1b4a9-df24-4cc6-a516-3f49f5849641 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.177457 Oct 17 15:01:04.174430 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3838/8115] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:03 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:05.199082 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:05.199808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:05.207160 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:05.207669 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:05.208161 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:05.208888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:05.209396 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:05.209848 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:05.413786 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:05.421811 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-26927626-9715-482d-a777-a03733e07025 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1571 microversion: 2.1 time: 0.227023 Oct 17 15:01:05.422977 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4278/8116] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:05 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1571 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:06.012860 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-80b421a5-d010-4d88-9461-b110b11cb0f9 req-3f240b89-6ec5-479f-91ed-cce68319e5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00c2c195-91c0-47de-b862-45b41ecce3ad", "name": "network-vif-deleted", "tag": "22a6e241-23a8-4509-a38a-3fc8ba1b0b08"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:06.027310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-80b421a5-d010-4d88-9461-b110b11cb0f9 req-3f240b89-6ec5-479f-91ed-cce68319e5db service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:06.027873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-80b421a5-d010-4d88-9461-b110b11cb0f9 req-3f240b89-6ec5-479f-91ed-cce68319e5db service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:06.028224 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-80b421a5-d010-4d88-9461-b110b11cb0f9 req-3f240b89-6ec5-479f-91ed-cce68319e5db service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:06.041353 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-80b421a5-d010-4d88-9461-b110b11cb0f9 req-3f240b89-6ec5-479f-91ed-cce68319e5db service nova] Creating event network-vif-deleted:22a6e241-23a8-4509-a38a-3fc8ba1b0b08 for instance 00c2c195-91c0-47de-b862-45b41ecce3ad on n-h1-854121-14 Oct 17 15:01:06.046576 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-80b421a5-d010-4d88-9461-b110b11cb0f9 req-3f240b89-6ec5-479f-91ed-cce68319e5db service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037460 Oct 17 15:01:06.047265 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3839/8117] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:01:06.447374 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:06.448015 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:06.455204 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:06.455710 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:06.456169 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:06.456891 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:06.457392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:06.457842 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:06.522200 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:06.530210 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4687fbe2-98c7-49e5-b8ec-8fc9f7227912 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1220 microversion: 2.1 time: 0.088411 Oct 17 15:01:06.530732 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4279/8118] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:06 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:07.555339 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:07.556079 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:07.563818 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:07.564302 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:07.564744 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:07.565477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:07.565935 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:07.566361 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:07.631166 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:07.641130 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e64f42ab-dc60-4ce1-9c02-4d3661d059ba tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1220 microversion: 2.1 time: 0.089923 Oct 17 15:01:07.641771 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3840/8119] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:07 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:08.665707 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:08.666460 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:08.674126 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:08.674628 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:08.675085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:08.675839 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:08.676388 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:08.676784 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:08.743850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:08.752928 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a32bc6c6-f9d6-492a-9033-641751bed86b tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1220 microversion: 2.1 time: 0.091174 Oct 17 15:01:08.753561 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4280/8120] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:08 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:09.776233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:09.776862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:09.784461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:09.784941 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:09.785411 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:09.786123 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:09.786584 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:09.787017 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:09.853301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '134b54c3cf4347f4a151d32eb657e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15c702fa15174c1fb96a61a47b53ac40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:09.862112 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e718dac-a0c5-42d1-ac2e-96b11712443a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 200 len: 1220 microversion: 2.1 time: 0.090050 Oct 17 15:01:09.862706 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3841/8121] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:09 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:01:10.884973 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:10.885641 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] [instance: 00c2c195-91c0-47de-b862-45b41ecce3ad] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:10.893760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:10.894195 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:10.894689 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:10.895424 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:10.895900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:10.896348 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:10.911845 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] HTTP exception thrown: Instance 00c2c195-91c0-47de-b862-45b41ecce3ad could not be found. Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Request method failure captured: Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad HTTP/1.1 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTWv3xMwHVnRRYge9jm6pETRtWByjbWz73OmfdJXONdORfXBWDMdDkQjydmd77fsnLXdamILzRY3mcJbGD3jpkg5CkD_IUcYNEcgBCIZR8ESqZFyktLQu-N5u3ikKzZiF42_rA74XRKwQeIOWdwm2i2aYOMbq1jjs1OIevFDtRAwYgnY Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 15c702fa15174c1fb96a61a47b53ac40 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestShelveInstance-1384180329 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_15c702fa15174c1fb96a61a47b53ac40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestShelveInstance-1384180329 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 15c702fa15174c1fb96a61a47b53ac40 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestShelveInstance-1384180329 Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestShelveInstance-1384180329-project Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: 134b54c3cf4347f4a151d32eb657e2db Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestShelveInstance-1384180329-project Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance 00c2c195-91c0-47de-b862-45b41ecce3ad could not be found. Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': '00c2c195-91c0-47de-b862-45b41ecce3ad'} Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00c2c195-91c0-47de-b862-45b41ecce3ad could not be found. Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00c2c195-91c0-47de-b862-45b41ecce3ad could not be found. Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:01:10.913557 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00c2c195-91c0-47de-b862-45b41ecce3ad could not be found. Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Returning 404 to user: Instance 00c2c195-91c0-47de-b862-45b41ecce3ad could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2847f8b-ca6e-4034-8a1c-18bd04a3fc81 tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad" status: 404 len: 111 microversion: 2.1 time: 0.034146 Oct 17 15:01:10.920039 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4281/8122] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:10 2022] GET /compute/v2.1/servers/00c2c195-91c0-47de-b862-45b41ecce3ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:01:11.088284 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45189795-a497-4e75-9c52-002b63221b9a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] Calling method '.version_select at 0x7f419c98cc10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:11.121521 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45189795-a497-4e75-9c52-002b63221b9a tempest-TestShelveInstance-1384180329 tempest-TestShelveInstance-1384180329-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1744265271" status: 202 len: 0 microversion: 2.1 time: 0.037190 Oct 17 15:01:11.122691 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3842/8123] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Oct 17 15:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1744265271 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 17 15:01:29.250178 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:29.251406 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:29.472998 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f9455e06-7712-435b-817b-0e4df5e643a4 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Action: 'create', calling method: .version_select at 0x7f419c7c3ee0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-182292154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0tk67z76jeqp3agfZX7T4Mm3kFp9UofPTiBxz/wgPsWyQTBHbnsBV7lcApbFt5HiFkvKEmmSN4/Bgv3K/kdYBptLSTtZab83BJF2X926s6PTmUefjyLUfigeUSMf/zfg=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:29.490421 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-f9455e06-7712-435b-817b-0e4df5e643a4 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Getting quotas for project 165fb5dc1eb043acb6e21ba9d7ed7e46. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:01:29.496638 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.quota [None req-f9455e06-7712-435b-817b-0e4df5e643a4 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Getting quotas for user bdbf821312ce412d91bf147d173f9b73 and project 165fb5dc1eb043acb6e21ba9d7ed7e46. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:01:29.531495 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f9455e06-7712-435b-817b-0e4df5e643a4 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287475 Oct 17 15:01:29.532223 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4282/8124] 10.222.0.65 () {60 vars in 1159 bytes} [Mon Oct 17 15:01:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:01:30.606475 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=22 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:30.607236 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:30.612267 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-792085314", "imageRef": "db51f7c1-415a-4ea9-94a7-afd34c3636cd", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-182292154", "security_groups": [{"name": "tempest-secgroup-smoke-437093670"}], "networks": [{"uuid": "a259984b-c939-4411-9463-69c4576d0828"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:30.743061 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] validate_networks() for [('a259984b-c939-4411-9463-69c4576d0828', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:01:31.309477 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:01:31.310258 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:01:31.310791 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:01:31.311204 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:01:31.312335 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:01:31.322120 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:31.322599 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:31.323178 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:31.323893 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:31.324556 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:31.324979 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:31.344501 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Getting quotas for project 165fb5dc1eb043acb6e21ba9d7ed7e46. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:01:31.349820 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Getting quotas for user bdbf821312ce412d91bf147d173f9b73 and project 165fb5dc1eb043acb6e21ba9d7ed7e46. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:01:31.362440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:01:31.364766 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='db51f7c1-415a-4ea9-94a7-afd34c3636cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:01:31.417111 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cdbc0c30-defd-4563-9ec0-9c56472c2519 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.812650 Oct 17 15:01:31.418260 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3843/8125] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 15:01:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:01:31.432315 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7f775e12-b6ee-46df-93ee-407326214e52 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:31.435729 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7f775e12-b6ee-46df-93ee-407326214e52 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:31.516546 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-7f775e12-b6ee-46df-93ee-407326214e52 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:31.525224 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7f775e12-b6ee-46df-93ee-407326214e52 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1247 microversion: 2.1 time: 0.099184 Oct 17 15:01:31.533915 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4283/8126] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:31 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1247 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:32.549887 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:32.550516 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:32.556882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:32.557492 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:32.557938 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:32.558650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:32.559372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:32.559805 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:32.624667 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:32.634489 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d6daaf8f-35d5-48f2-bf82-1393428d8130 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1251 microversion: 2.1 time: 0.090340 Oct 17 15:01:32.635172 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3844/8127] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:32 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1251 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:01:33.658023 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:33.659389 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:33.668220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:33.668821 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:33.669428 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:33.670372 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:33.670914 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:33.671623 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:33.739967 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:33.748058 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a97ac87-2ea2-45b6-a64c-c610ada05d9c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1305 microversion: 2.1 time: 0.094488 Oct 17 15:01:33.748630 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4284/8128] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:33 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:34.774018 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:34.774489 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:34.782691 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:34.783202 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:34.783650 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:34.784583 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:34.785246 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:34.788476 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:34.984288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:34.993051 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf542a11-b94b-40b1-9ecb-42fdf991862b tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.225017 Oct 17 15:01:34.994593 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3845/8129] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:34 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:35.036598 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-6c23224e-ec6b-40ae-95a6-005ba7dabb83 req-b95df068-ad56-4c99-8082-187f5dc375fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:35.046297 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6c23224e-ec6b-40ae-95a6-005ba7dabb83 req-b95df068-ad56-4c99-8082-187f5dc375fc service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:35.047274 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6c23224e-ec6b-40ae-95a6-005ba7dabb83 req-b95df068-ad56-4c99-8082-187f5dc375fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:35.047738 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-6c23224e-ec6b-40ae-95a6-005ba7dabb83 req-b95df068-ad56-4c99-8082-187f5dc375fc service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:35.059300 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-6c23224e-ec6b-40ae-95a6-005ba7dabb83 req-b95df068-ad56-4c99-8082-187f5dc375fc service nova] Creating event network-changed:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:01:35.064976 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-6c23224e-ec6b-40ae-95a6-005ba7dabb83 req-b95df068-ad56-4c99-8082-187f5dc375fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111658 Oct 17 15:01:35.065630 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4285/8130] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:01:36.020430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:36.021029 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:36.028229 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:36.028720 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:36.029287 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:36.029989 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:36.030604 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:36.031063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:36.167370 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:36.176371 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb092774-ff88-444b-bed3-86d6e4f66c09 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.159896 Oct 17 15:01:36.176966 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3846/8131] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:36 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:37.201392 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:37.202672 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:37.209103 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:37.209633 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:37.210088 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:37.210802 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:37.211272 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:37.211712 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:37.352711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:37.360779 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ec35704d-5220-47f4-b7c4-12d2c85f3dc3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.164532 Oct 17 15:01:37.361389 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4286/8132] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:37 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:38.384078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:38.384614 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:38.391713 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:38.392196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:38.392635 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:38.393355 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:38.393810 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:38.394232 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:38.531658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:38.539752 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d291cdb4-9ee5-47d5-9eef-b5116bbfffbc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.159725 Oct 17 15:01:38.540356 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3847/8133] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:38 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:39.563587 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:39.564221 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:39.571463 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:39.571968 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:39.572422 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:39.573191 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:39.573864 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:39.574313 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:39.715097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:39.722971 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-03c2f0dd-2426-4624-9ed0-6a408670aba2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.163583 Oct 17 15:01:39.723567 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4287/8134] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:39 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:40.746272 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:40.746873 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:40.754280 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:40.754757 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:40.755187 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:40.755876 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:40.756323 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:40.756740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:40.896203 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:40.904273 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f73f608a-d2eb-46c5-a1aa-dc2840e2cde3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.161969 Oct 17 15:01:40.904869 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3848/8135] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:40 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:41.401941 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-86d0ec23-15ce-4e92-80d3-c58c36c36a96 req-065bffe6-f0ab-4c19-8729-3177fd5a2aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "name": "network-vif-plugged", "status": "completed", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:41.413677 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-86d0ec23-15ce-4e92-80d3-c58c36c36a96 req-065bffe6-f0ab-4c19-8729-3177fd5a2aa0 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:41.414180 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-86d0ec23-15ce-4e92-80d3-c58c36c36a96 req-065bffe6-f0ab-4c19-8729-3177fd5a2aa0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:41.414636 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-86d0ec23-15ce-4e92-80d3-c58c36c36a96 req-065bffe6-f0ab-4c19-8729-3177fd5a2aa0 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:41.426877 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-86d0ec23-15ce-4e92-80d3-c58c36c36a96 req-065bffe6-f0ab-4c19-8729-3177fd5a2aa0 service nova] Creating event network-vif-plugged:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:01:41.432046 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-86d0ec23-15ce-4e92-80d3-c58c36c36a96 req-065bffe6-f0ab-4c19-8729-3177fd5a2aa0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033884 Oct 17 15:01:41.432663 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4288/8136] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:01:41.928427 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:41.929174 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:41.931013 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:41.931819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:41.937372 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:41.937879 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:41.938314 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:41.939004 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:41.939452 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:41.939871 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:42.074368 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:42.082932 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a17e32ac-2a5e-4ff6-b4a6-4b820ad0489f tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1372 microversion: 2.1 time: 0.158695 Oct 17 15:01:42.083520 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3849/8137] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:41 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:01:43.103737 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:01:43.109596 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:43.110265 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:43.117046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:43.117593 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:43.118036 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:43.118760 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:43.119228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:43.119670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:43.258952 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:43.266987 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b88acd4-a89e-4d3c-baf0-00dbb4d8c804 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1557 microversion: 2.1 time: 0.164242 Oct 17 15:01:43.267561 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4289/8138] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:43 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:43.289176 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:01:43.289790 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:01:43.297367 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:43.297858 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:43.298298 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:43.298992 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:43.299441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:43.299865 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:43.436328 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:01:43.444501 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7849796-2163-4819-bf97-a8b35d726779 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1557 microversion: 2.1 time: 0.159193 Oct 17 15:01:43.445077 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3850/8139] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:01:43 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:01:45.393817 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-04b06bf8-be0b-4e52-93c4-a71733054071 req-10c40e36-e464-46c8-b9eb-60cb20bf6ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:01:45.404228 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-04b06bf8-be0b-4e52-93c4-a71733054071 req-10c40e36-e464-46c8-b9eb-60cb20bf6ef2 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:01:45.404719 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-04b06bf8-be0b-4e52-93c4-a71733054071 req-10c40e36-e464-46c8-b9eb-60cb20bf6ef2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:01:45.405917 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-04b06bf8-be0b-4e52-93c4-a71733054071 req-10c40e36-e464-46c8-b9eb-60cb20bf6ef2 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:01:45.417535 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-04b06bf8-be0b-4e52-93c4-a71733054071 req-10c40e36-e464-46c8-b9eb-60cb20bf6ef2 service nova] Creating event network-changed:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:01:45.423307 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-04b06bf8-be0b-4e52-93c4-a71733054071 req-10c40e36-e464-46c8-b9eb-60cb20bf6ef2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033838 Oct 17 15:01:45.423914 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4290/8140] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:03:40.630390 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:03:40.631537 n-d-854121-14 devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 17 15:03:40.632102 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:40.632867 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=44 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:40.633856 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 15:03:40.634074 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 15:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2/action (ip 10.222.0.65) !!! Oct 17 15:03:40.639924 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1873700218"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:40.642396 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:40.652804 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:40.653312 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:40.653750 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:40.654446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:40.654896 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:40.655318 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:40.855532 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-55c6ce3e-b224-4a19-b9a0-6baa35db475e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "POST /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2/action" status: 202 len: 0 microversion: 2.1 time: 0.226660 Oct 17 15:03:40.856176 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3851/8141] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 15:03:40 2022] POST /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:03:46.017340 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 15:03:46.018193 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 17 15:03:46.018806 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:46.019627 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=30 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:46.105398 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-24d44c4b-af26-49b9-9945-04a100ec786d req-bbfb4fea-39ad-41f6-aa83-42a4ea04dc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "name": "network-vif-plugged", "status": "completed", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:46.120635 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24d44c4b-af26-49b9-9945-04a100ec786d req-bbfb4fea-39ad-41f6-aa83-42a4ea04dc42 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:46.121289 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24d44c4b-af26-49b9-9945-04a100ec786d req-bbfb4fea-39ad-41f6-aa83-42a4ea04dc42 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:46.121742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-24d44c4b-af26-49b9-9945-04a100ec786d req-bbfb4fea-39ad-41f6-aa83-42a4ea04dc42 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:46.135132 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-24d44c4b-af26-49b9-9945-04a100ec786d req-bbfb4fea-39ad-41f6-aa83-42a4ea04dc42 service nova] Creating event network-vif-plugged:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:03:46.140620 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-24d44c4b-af26-49b9-9945-04a100ec786d req-bbfb4fea-39ad-41f6-aa83-42a4ea04dc42 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128145 Oct 17 15:03:46.141262 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4291/8142] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:03:54.416767 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:54.417652 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:54.422683 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1621437294", "imageRef": "56a1893e-b770-4cf6-b5de-dd1deec8d1e6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-182292154", "security_groups": [{"name": "tempest-secgroup-smoke-437093670"}], "networks": [{"uuid": "a259984b-c939-4411-9463-69c4576d0828"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:54.447650 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [2d8cf9b8-f8a9-4112-9eed-ff7adaacb216] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60478. Oct 17 15:03:54.448402 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [3f81616c-32f8-4a70-8d2a-19977a19d729] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60476. Oct 17 15:03:54.538961 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] validate_networks() for [('a259984b-c939-4411-9463-69c4576d0828', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 17 15:03:54.918819 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 17 15:03:54.919254 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 17 15:03:54.919740 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 17 15:03:54.920156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 17 15:03:54.920617 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 17 15:03:54.929919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:54.930404 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:54.931381 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:54.932233 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:54.932701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:54.933128 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:54.951357 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Getting quotas for project 165fb5dc1eb043acb6e21ba9d7ed7e46. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 17 15:03:54.956929 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.quota [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Getting quotas for user bdbf821312ce412d91bf147d173f9b73 and project 165fb5dc1eb043acb6e21ba9d7ed7e46. Resources: {'cores', 'ram', 'instances'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 17 15:03:54.970546 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 17 15:03:54.973015 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='56a1893e-b770-4cf6-b5de-dd1deec8d1e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 17 15:03:55.022096 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ec6864e-b770-41df-a6dd-fa32ac220233 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.607787 Oct 17 15:03:55.022763 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3852/8143] 10.222.0.65 () {60 vars in 1147 bytes} [Mon Oct 17 15:03:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 17 15:03:55.046104 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea56303b-43f3-4bc3-8f68-d045315f78a9 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:55.046880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea56303b-43f3-4bc3-8f68-d045315f78a9 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:55.057047 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60492. Oct 17 15:03:55.060705 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60494. Oct 17 15:03:55.113619 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea56303b-43f3-4bc3-8f68-d045315f78a9 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:55.122686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea56303b-43f3-4bc3-8f68-d045315f78a9 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1248 microversion: 2.1 time: 0.091507 Oct 17 15:03:55.123538 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4292/8144] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:55 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:56.145957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:56.146796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:56.155092 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:56.155586 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:56.156030 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:56.156771 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:56.157252 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:56.157679 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:56.226882 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:56.234913 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c29492da-db20-421d-8717-7a764d3147b1 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1300 microversion: 2.1 time: 0.093029 Oct 17 15:03:56.235495 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3853/8145] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:56 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:57.259799 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:57.260481 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:57.273083 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:03:57.278056 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:57.283076 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:57.283879 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:57.284895 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:57.285564 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:57.286201 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:57.601108 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:57.620760 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3cb743d2-a4f1-4b4d-9211-8d3e477ee7e3 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.365478 Oct 17 15:03:57.634854 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4293/8146] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:57 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:58.025762 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cd8f6cc2-efb4-435e-b3b5-3b6f0fea58a5 req-1434bb30-0fb8-4c54-8dcc-61fdb36c9c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "name": "network-vif-unplugged", "status": "completed", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:03:58.042544 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cd8f6cc2-efb4-435e-b3b5-3b6f0fea58a5 req-1434bb30-0fb8-4c54-8dcc-61fdb36c9c89 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:58.043593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cd8f6cc2-efb4-435e-b3b5-3b6f0fea58a5 req-1434bb30-0fb8-4c54-8dcc-61fdb36c9c89 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:58.044957 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cd8f6cc2-efb4-435e-b3b5-3b6f0fea58a5 req-1434bb30-0fb8-4c54-8dcc-61fdb36c9c89 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:58.059351 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cd8f6cc2-efb4-435e-b3b5-3b6f0fea58a5 req-1434bb30-0fb8-4c54-8dcc-61fdb36c9c89 service nova] Creating event network-vif-unplugged:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:03:58.065012 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cd8f6cc2-efb4-435e-b3b5-3b6f0fea58a5 req-1434bb30-0fb8-4c54-8dcc-61fdb36c9c89 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044006 Oct 17 15:03:58.066884 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3854/8147] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:03:58.647402 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:58.648069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:58.655940 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:58.656447 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:58.656907 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:58.657662 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:58.658131 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:58.658699 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:58.815184 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:03:58.824152 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78440c93-90d3-4dc3-8c6a-1e76ce316854 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.180681 Oct 17 15:03:58.824850 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4294/8148] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:58 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:03:59.849081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:03:59.849988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:03:59.861543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:59.862048 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:59.862495 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:03:59.863413 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:03:59.863685 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:03:59.864119 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:00.017333 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:00.030503 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44b7aace-7bd6-4432-9e9f-b5ece1069782 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.186873 Oct 17 15:04:00.031857 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3855/8149] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:03:59 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:01.053824 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:01.054756 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:01.062294 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:01.062804 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:01.063261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:01.063984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:01.064459 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:01.064904 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:01.222639 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:01.231248 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-933051d7-2cdb-4130-b1dd-feb5f83ec9e8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.181263 Oct 17 15:04:01.231845 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4295/8150] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:01 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:02.253917 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:02.256101 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:02.267758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:02.268373 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:02.268981 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:02.269824 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:02.270313 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:02.270721 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:02.446947 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:02.455579 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a16b502-354e-45df-b561-8297b85075cf tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.205755 Oct 17 15:04:02.458503 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3856/8151] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:02 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:03.481377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:03.482020 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:03.489378 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:03.489888 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:03.490335 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:03.491049 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:03.491561 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:03.491948 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:03.650050 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:03.658565 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3cb45af-c57e-429e-bb4e-978431981c6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.182643 Oct 17 15:04:03.659181 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4296/8152] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:03 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:04.681689 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:04.682343 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:04.689197 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:04.689695 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:04.690133 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:04.690829 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:04.691283 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:04.691710 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:04.827337 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:04.835197 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05ab4dbd-689d-44ba-969c-5d042a7dddae tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.157656 Oct 17 15:04:04.835777 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3857/8153] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:04 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:05.860116 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:05.860718 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:05.863445 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:04:05.870085 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:05.871261 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:05.871686 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:05.872408 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:05.872886 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:05.873370 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:06.014871 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:06.022628 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59893bea-f201-4368-b808-a4df801fcf26 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.166583 Oct 17 15:04:06.023464 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4297/8154] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:05 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:07.046868 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:07.047536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:07.049554 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:04:07.050409 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:04:07.057658 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:07.058155 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:07.058593 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:07.059301 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:07.059759 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:07.060194 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:07.204632 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:07.212743 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9145b3b4-5d23-4ee4-b9b4-b783832e663c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.169844 Oct 17 15:04:07.228530 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3858/8155] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:07 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:07.439097 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-1b4454e0-3a9f-4085-804b-2c5d7c6a99a2 req-00b5a232-a509-4aa6-8635-f9e97f01dc81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:04:07.451549 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1b4454e0-3a9f-4085-804b-2c5d7c6a99a2 req-00b5a232-a509-4aa6-8635-f9e97f01dc81 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:07.452046 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1b4454e0-3a9f-4085-804b-2c5d7c6a99a2 req-00b5a232-a509-4aa6-8635-f9e97f01dc81 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:07.452523 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-1b4454e0-3a9f-4085-804b-2c5d7c6a99a2 req-00b5a232-a509-4aa6-8635-f9e97f01dc81 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:07.465713 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-1b4454e0-3a9f-4085-804b-2c5d7c6a99a2 req-00b5a232-a509-4aa6-8635-f9e97f01dc81 service nova] Creating event network-changed:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:04:07.470883 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-1b4454e0-3a9f-4085-804b-2c5d7c6a99a2 req-00b5a232-a509-4aa6-8635-f9e97f01dc81 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035557 Oct 17 15:04:07.471899 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4298/8156] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:04:08.236311 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:08.236962 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:08.244499 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:08.244986 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:08.245455 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:08.246161 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:08.246623 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:08.247053 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:08.379782 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:08.388166 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-310261e1-a420-4e0a-8e9f-31d9aee543f8 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.155774 Oct 17 15:04:08.388740 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3859/8157] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:08 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:09.413400 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:09.414121 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:09.422862 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:09.423369 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:09.423831 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:09.424551 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:09.425025 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:09.425490 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:09.568954 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:09.577259 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3da5ee2a-c8ef-4a54-ae5f-57ad1808702a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.169091 Oct 17 15:04:09.577840 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4299/8158] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:09 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:10.600384 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:10.601038 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:10.608786 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:10.609309 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:10.609758 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:10.610463 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:10.610953 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:10.611391 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:10.751147 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:10.767270 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b39c2b5-86df-4a53-92da-3704818c38e0 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.170658 Oct 17 15:04:10.767877 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3860/8159] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:10 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:11.791652 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:11.793081 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:11.800199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:11.800693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:11.801137 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:11.801870 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:11.802331 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:11.802763 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:12.035900 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:12.044679 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5ad4d6ab-eccb-4446-8a25-eaac0b8d256c tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.256878 Oct 17 15:04:12.045285 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4300/8160] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:11 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:12.739398 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-168fef31-f806-4fdc-9e69-85eeadbe79f5 req-dbfd2eaf-0124-4161-bdca-fbf900d8aa79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "name": "network-vif-plugged", "status": "completed", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:04:12.751375 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-168fef31-f806-4fdc-9e69-85eeadbe79f5 req-dbfd2eaf-0124-4161-bdca-fbf900d8aa79 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:12.751862 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-168fef31-f806-4fdc-9e69-85eeadbe79f5 req-dbfd2eaf-0124-4161-bdca-fbf900d8aa79 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:12.752294 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-168fef31-f806-4fdc-9e69-85eeadbe79f5 req-dbfd2eaf-0124-4161-bdca-fbf900d8aa79 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:12.771928 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-168fef31-f806-4fdc-9e69-85eeadbe79f5 req-dbfd2eaf-0124-4161-bdca-fbf900d8aa79 service nova] Creating event network-vif-plugged:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:04:12.778431 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-168fef31-f806-4fdc-9e69-85eeadbe79f5 req-dbfd2eaf-0124-4161-bdca-fbf900d8aa79 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042806 Oct 17 15:04:12.779238 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3861/8161] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:04:13.067254 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:13.067880 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:13.075173 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:13.075676 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:13.076134 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:13.076849 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:13.077358 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:13.077808 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:13.214022 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:13.222418 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7ae65d1-3ac2-4cda-9a96-196165901fdc tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.159071 Oct 17 15:04:13.223013 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4301/8162] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:13 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:14.248344 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:14.249055 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:14.255310 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:14.255796 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:14.256238 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:14.256934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:14.257415 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:14.257843 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:14.400382 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:14.408766 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75a85371-0911-49b2-a228-fc14cdbc9ac2 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1373 microversion: 2.1 time: 0.166273 Oct 17 15:04:14.409362 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3862/8163] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:14 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:15.432141 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:15.432743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:15.440179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:15.440670 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:15.441114 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:15.441836 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:15.442295 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:15.442728 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:15.577373 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:15.585206 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-397967d3-0291-4254-b829-06aadabc2e27 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1559 microversion: 2.1 time: 0.156983 Oct 17 15:04:15.585775 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4302/8164] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:15 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:15.608446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:04:15.609033 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:04:15.615963 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:15.616446 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:15.616877 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:15.617610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:15.618063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:15.618485 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:15.750330 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:04:15.758225 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0b8ec6b0-fa2d-4bda-b257-ba6270da3cb7 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1559 microversion: 2.1 time: 0.154320 Oct 17 15:04:15.758807 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3863/8165] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:04:15 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:04:17.478371 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-0ed5275f-599e-4b87-a963-a1b364928cd6 req-5035ba43-aceb-4f2c-be8b-b5c076fe8db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:04:17.484781 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=27 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:04:17.491246 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0ed5275f-599e-4b87-a963-a1b364928cd6 req-5035ba43-aceb-4f2c-be8b-b5c076fe8db1 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:04:17.491747 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0ed5275f-599e-4b87-a963-a1b364928cd6 req-5035ba43-aceb-4f2c-be8b-b5c076fe8db1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:04:17.492355 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-0ed5275f-599e-4b87-a963-a1b364928cd6 req-5035ba43-aceb-4f2c-be8b-b5c076fe8db1 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:04:17.503813 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-0ed5275f-599e-4b87-a963-a1b364928cd6 req-5035ba43-aceb-4f2c-be8b-b5c076fe8db1 service nova] Creating event network-changed:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:04:17.509036 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-0ed5275f-599e-4b87-a963-a1b364928cd6 req-5035ba43-aceb-4f2c-be8b-b5c076fe8db1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093763 Oct 17 15:04:17.509729 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4303/8166] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:23.700331 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:23.701113 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=60 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:23.702088 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:06:23.702229 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 15:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99/action (ip 10.222.0.65) !!! Oct 17 15:06:23.703480 n-d-854121-14 devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 17 15:06:23.703618 n-d-854121-14 devstack@n-api.service[120698]: Mon Oct 17 15:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99/action (ip 10.222.0.65) !!! Oct 17 15:06:23.708838 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1549885269"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:23.711190 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:23.722195 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:23.722776 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:23.723461 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:23.724191 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:23.724634 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:23.725064 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:24.108018 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0e777c8-0663-4531-ac45-065e253c6a6a tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "POST /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99/action" status: 202 len: 0 microversion: 2.1 time: 0.409632 Oct 17 15:06:24.108673 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3864/8167] 10.222.0.65 () {60 vars in 1278 bytes} [Mon Oct 17 15:06:23 2022] POST /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 17 15:06:29.430817 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 15:06:29.432536 n-d-854121-14 devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] AMQP server on 10.222.0.65:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 17 15:06:29.433192 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:29.434152 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=58 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:29.434886 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:06:29.435100 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 15:06:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Oct 17 15:06:29.436725 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 17 15:06:29.436837 n-d-854121-14 devstack@n-api.service[120697]: Mon Oct 17 15:06:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.65) !!! Oct 17 15:06:29.444435 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a9b56db4-fd10-46d1-be56-1b06a1b4380c req-a78d8a3e-b6b1-4703-83de-d77a6f9d7104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "name": "network-vif-plugged", "status": "completed", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:29.459024 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a9b56db4-fd10-46d1-be56-1b06a1b4380c req-a78d8a3e-b6b1-4703-83de-d77a6f9d7104 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:29.459533 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a9b56db4-fd10-46d1-be56-1b06a1b4380c req-a78d8a3e-b6b1-4703-83de-d77a6f9d7104 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:29.459984 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a9b56db4-fd10-46d1-be56-1b06a1b4380c req-a78d8a3e-b6b1-4703-83de-d77a6f9d7104 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:29.471536 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a9b56db4-fd10-46d1-be56-1b06a1b4380c req-a78d8a3e-b6b1-4703-83de-d77a6f9d7104 service nova] Creating event network-vif-plugged:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:06:29.476927 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a9b56db4-fd10-46d1-be56-1b06a1b4380c req-a78d8a3e-b6b1-4703-83de-d77a6f9d7104 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047944 Oct 17 15:06:29.477597 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4304/8168] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:43.274784 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:43.277288 n-d-854121-14 devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:43.277687 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:43.279230 n-d-854121-14 devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 17 15:06:43.281711 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:43.282346 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:43.284107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-433c397f-c297-4f9f-87d7-9252023abbda req-300efb72-720f-48ab-815c-8b4ca2bd2eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:43.290587 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:43.291973 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:43.292430 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:43.294078 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:43.294971 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:43.295441 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:43.298134 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [016a4468-e401-4049-996d-21f02a8d6cb6] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60862. Oct 17 15:06:43.306842 n-d-854121-14 devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] [84ccc561-d177-4dd6-8ae4-7ce13afe8eaa] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 60860. Oct 17 15:06:43.314235 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-433c397f-c297-4f9f-87d7-9252023abbda req-300efb72-720f-48ab-815c-8b4ca2bd2eb8 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:43.314953 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-433c397f-c297-4f9f-87d7-9252023abbda req-300efb72-720f-48ab-815c-8b4ca2bd2eb8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:43.315540 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-433c397f-c297-4f9f-87d7-9252023abbda req-300efb72-720f-48ab-815c-8b4ca2bd2eb8 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:43.327542 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-433c397f-c297-4f9f-87d7-9252023abbda req-300efb72-720f-48ab-815c-8b4ca2bd2eb8 service nova] Creating event network-changed:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:06:43.330347 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:06:43.334686 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-433c397f-c297-4f9f-87d7-9252023abbda req-300efb72-720f-48ab-815c-8b4ca2bd2eb8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060393 Oct 17 15:06:43.335717 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4305/8169] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:06:43.429766 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e337d61-1ce6-4d71-abe5-72a5e4d55a06 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "DELETE /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 204 len: 0 microversion: 2.1 time: 0.157807 Oct 17 15:06:43.430519 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3865/8170] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 15:06:43 2022] DELETE /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:06:43.440069 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:43.440807 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:43.447720 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:43.448547 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:43.449223 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:43.450156 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:43.450816 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:43.452164 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:43.594742 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:43.603589 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7ca52db-d04f-4a3c-8427-0dc92d49fdec tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1683 microversion: 2.1 time: 0.167997 Oct 17 15:06:43.604178 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4306/8171] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:43 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:44.627196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:44.627845 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:44.635595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:44.636091 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:44.636536 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:44.637269 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:44.637991 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:44.638152 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:44.776723 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:44.784740 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bcfac247-702f-4c3c-89a2-07bef0444c67 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1683 microversion: 2.1 time: 0.161909 Oct 17 15:06:44.785355 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3866/8172] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:44 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:45.455326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-db11db96-e11e-4b52-bb14-10fea9ee4860 req-d5e2e375-d508-44a6-b841-1115578abc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "name": "network-vif-unplugged", "status": "completed", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:45.467333 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-db11db96-e11e-4b52-bb14-10fea9ee4860 req-d5e2e375-d508-44a6-b841-1115578abc39 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:45.468220 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-db11db96-e11e-4b52-bb14-10fea9ee4860 req-d5e2e375-d508-44a6-b841-1115578abc39 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:45.468749 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-db11db96-e11e-4b52-bb14-10fea9ee4860 req-d5e2e375-d508-44a6-b841-1115578abc39 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:45.496353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-db11db96-e11e-4b52-bb14-10fea9ee4860 req-d5e2e375-d508-44a6-b841-1115578abc39 service nova] Creating event network-vif-unplugged:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:06:45.502718 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-db11db96-e11e-4b52-bb14-10fea9ee4860 req-d5e2e375-d508-44a6-b841-1115578abc39 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052931 Oct 17 15:06:45.503599 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4307/8173] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:45.810595 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:45.811212 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:45.818576 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:45.819063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:45.819519 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:45.820196 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:45.820643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:45.821063 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:45.840581 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-df1ccb4e-2895-4f28-ba63-246fb70ab95e req-6c6d9dd8-7f3d-4c79-97ed-ea9124b9d53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae6e012-a93f-4b10-9375-3e66f953ca99", "name": "network-vif-deleted", "tag": "3767ff05-ff5a-40c6-96c4-26e85c8a5d78"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:45.851107 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-df1ccb4e-2895-4f28-ba63-246fb70ab95e req-6c6d9dd8-7f3d-4c79-97ed-ea9124b9d53b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:45.851606 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-df1ccb4e-2895-4f28-ba63-246fb70ab95e req-6c6d9dd8-7f3d-4c79-97ed-ea9124b9d53b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:45.852055 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-df1ccb4e-2895-4f28-ba63-246fb70ab95e req-6c6d9dd8-7f3d-4c79-97ed-ea9124b9d53b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:45.867246 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-df1ccb4e-2895-4f28-ba63-246fb70ab95e req-6c6d9dd8-7f3d-4c79-97ed-ea9124b9d53b service nova] Creating event network-vif-deleted:3767ff05-ff5a-40c6-96c4-26e85c8a5d78 for instance eae6e012-a93f-4b10-9375-3e66f953ca99 on n-h2-854121-14 Oct 17 15:06:45.872607 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-df1ccb4e-2895-4f28-ba63-246fb70ab95e req-6c6d9dd8-7f3d-4c79-97ed-ea9124b9d53b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036444 Oct 17 15:06:45.873279 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4308/8174] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 17 15:06:45.891770 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:45.900957 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4597146-abc9-4e29-8b98-f3ceb26af5ba tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 200 len: 1498 microversion: 2.1 time: 0.094341 Oct 17 15:06:45.901775 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3867/8175] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:45 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 1498 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:46.928417 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:46.929179 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: eae6e012-a93f-4b10-9375-3e66f953ca99] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:46.935790 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:46.936277 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:46.936721 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:46.937456 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:46.937920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:46.938354 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:46.952038 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] HTTP exception thrown: Instance eae6e012-a93f-4b10-9375-3e66f953ca99 could not be found. Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Request method failure captured: Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 HTTP/1.1 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Accept: application/json Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Accept-Encoding: identity Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Connection: close Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Content-Length: 0 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Content-Type: application/json Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Host: 10.222.0.65 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: Openstack-System-Scope: None Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjTW5D8I0AmTDRnYZInDtyiED0QKHk7DcNwVyRV0xbleRhrhT64HIpwTS2QV7aHjpFGWIa1ALxR-iXeOJYN9V3F8W4zFYBSgkjKMb64Mmt8MWx9KzRXRQmEygvxriYtqni5m1r5uRs-utJxZu05OcIFiLaQU1yx8yPELbn80MBMfw2aqM Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Id: None Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Domain-Name: None Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Identity-Status: Confirmed Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Is-Admin-Project: True Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Id: default Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Domain-Name: Default Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Id: 165fb5dc1eb043acb6e21ba9d7ed7e46 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Project-Name: tempest-TestSnapshotPattern-88837817 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Role: member,reader Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Roles: member,reader Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant: tempest-TestSnapshotPattern-88837817 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Id: 165fb5dc1eb043acb6e21ba9d7ed7e46 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestSnapshotPattern-88837817 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-User: tempest-TestSnapshotPattern-88837817-project Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Id: default Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-User-Domain-Name: Default Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-User-Id: bdbf821312ce412d91bf147d173f9b73 Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: X-User-Name: tempest-TestSnapshotPattern-88837817-project Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: method: > Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: exception: Instance eae6e012-a93f-4b10-9375-3e66f953ca99 could not be found. Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: action_args: {'id': 'eae6e012-a93f-4b10-9375-3e66f953ca99'} Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae6e012-a93f-4b10-9375-3e66f953ca99 could not be found. Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae6e012-a93f-4b10-9375-3e66f953ca99 could not be found. Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:06:46.953711 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae6e012-a93f-4b10-9375-3e66f953ca99 could not be found. Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Returning 404 to user: Instance eae6e012-a93f-4b10-9375-3e66f953ca99 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fd67c98-7108-4b60-a404-569c60e78c70 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99" status: 404 len: 111 microversion: 2.1 time: 0.033015 Oct 17 15:06:46.957826 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4309/8176] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:46 2022] GET /compute/v2.1/servers/eae6e012-a93f-4b10-9375-3e66f953ca99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:06:48.324432 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:48.324988 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:48.326017 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-93f37327-bcb3-4245-a13b-cad5f3d4f819 req-03453c7a-c1e1-420c-8dfc-b3804d1fac5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:48.332193 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:48.332907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:48.333574 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:48.334315 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:48.335157 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:48.335643 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:48.338341 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-93f37327-bcb3-4245-a13b-cad5f3d4f819 req-03453c7a-c1e1-420c-8dfc-b3804d1fac5b service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:48.338916 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-93f37327-bcb3-4245-a13b-cad5f3d4f819 req-03453c7a-c1e1-420c-8dfc-b3804d1fac5b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:48.339442 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-93f37327-bcb3-4245-a13b-cad5f3d4f819 req-03453c7a-c1e1-420c-8dfc-b3804d1fac5b service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:48.351021 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-93f37327-bcb3-4245-a13b-cad5f3d4f819 req-03453c7a-c1e1-420c-8dfc-b3804d1fac5b service nova] Creating event network-changed:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:06:48.356185 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-93f37327-bcb3-4245-a13b-cad5f3d4f819 req-03453c7a-c1e1-420c-8dfc-b3804d1fac5b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034605 Oct 17 15:06:48.357048 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4310/8177] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:48.367295 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 17 15:06:48.459890 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba177ebd-654d-474f-ab18-4b2e4e7aa25d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 204 len: 0 microversion: 2.1 time: 0.140277 Oct 17 15:06:48.460694 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3868/8178] 10.222.0.65 () {58 vars in 1239 bytes} [Mon Oct 17 15:06:48 2022] DELETE /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 17 15:06:48.469377 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:48.470105 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:48.477234 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:48.477743 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:48.478199 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:48.478920 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:48.479391 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:48.479830 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:48.626850 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.policy [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:48.636353 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53078172-24dc-4b02-a618-148246d38d0e tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1682 microversion: 2.1 time: 0.171153 Oct 17 15:06:48.637070 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4311/8179] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:48 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 17 15:06:49.660598 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:49.661338 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:49.668919 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:49.669440 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:49.670081 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:49.670801 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:49.671262 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:49.671696 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:49.705672 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:49.706168 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:49.706610 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:49.707071 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lazy-loading 'fault' on Instance uuid 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 17 15:06:49.750156 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.policy [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbf821312ce412d91bf147d173f9b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '165fb5dc1eb043acb6e21ba9d7ed7e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Oct 17 15:06:49.758291 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-916a2f65-b349-4bc8-8524-10fb0088bd7d tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 200 len: 1337 microversion: 2.1 time: 0.102082 Oct 17 15:06:49.758873 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3869/8180] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:49 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 1337 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 17 15:06:50.371326 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ceca4cda-e955-4abc-a7e4-3d17e38479ea req-730fe51b-a0e5-4c4b-84da-3a99f1496a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e2cfcb8-52d6-4938-b4e9-fd14811a36c2", "name": "network-vif-deleted", "tag": "da111c66-71d3-438a-985d-87a7bb37f6f6"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 17 15:06:50.381873 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ceca4cda-e955-4abc-a7e4-3d17e38479ea req-730fe51b-a0e5-4c4b-84da-3a99f1496a81 service nova] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:50.382366 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ceca4cda-e955-4abc-a7e4-3d17e38479ea req-730fe51b-a0e5-4c4b-84da-3a99f1496a81 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:50.382813 n-d-854121-14 devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ceca4cda-e955-4abc-a7e4-3d17e38479ea req-730fe51b-a0e5-4c4b-84da-3a99f1496a81 service nova] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:50.394040 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ceca4cda-e955-4abc-a7e4-3d17e38479ea req-730fe51b-a0e5-4c4b-84da-3a99f1496a81 service nova] Creating event network-vif-deleted:da111c66-71d3-438a-985d-87a7bb37f6f6 for instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 on n-h1-854121-14 Oct 17 15:06:50.399860 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ceca4cda-e955-4abc-a7e4-3d17e38479ea req-730fe51b-a0e5-4c4b-84da-3a99f1496a81 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 Oct 17 15:06:50.400446 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4312/8181] 10.222.0.65 () {64 vars in 1317 bytes} [Mon Oct 17 15:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 17 15:06:50.782218 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:50.782832 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] [instance: 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 17 15:06:50.789993 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:50.790490 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:50.790934 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:50.791646 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Acquiring lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 17 15:06:50.792109 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 17 15:06:50.792543 n-d-854121-14 devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Lock "2dc2c531-2286-43dc-a2ad-63efe0ce97b9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 17 15:06:50.806235 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] HTTP exception thrown: Instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 could not be found. Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Request method failure captured: Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 HTTP/1.1 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Accept: application/json Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Accept-Encoding: identity Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Connection: close Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Content-Length: 0 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Content-Type: application/json Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Host: 10.222.0.65 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: Openstack-System-Scope: None Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjTW5D8I0AmTDRnYZInDtyiED0QKHk7DcNwVyRV0xbleRhrhT64HIpwTS2QV7aHjpFGWIa1ALxR-iXeOJYN9V3F8W4zFYBSgkjKMb64Mmt8MWx9KzRXRQmEygvxriYtqni5m1r5uRs-utJxZu05OcIFiLaQU1yx8yPELbn80MBMfw2aqM Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Id: None Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Domain-Name: None Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Identity-Status: Confirmed Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Is-Admin-Project: True Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Id: default Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Domain-Name: Default Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Id: 165fb5dc1eb043acb6e21ba9d7ed7e46 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Project-Name: tempest-TestSnapshotPattern-88837817 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Role: member,reader Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Roles: member,reader Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_165fb5dc1eb043acb6e21ba9d7ed7e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}] Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant: tempest-TestSnapshotPattern-88837817 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Id: 165fb5dc1eb043acb6e21ba9d7ed7e46 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestSnapshotPattern-88837817 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-User: tempest-TestSnapshotPattern-88837817-project Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Id: default Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-User-Domain-Name: Default Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-User-Id: bdbf821312ce412d91bf147d173f9b73 Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: X-User-Name: tempest-TestSnapshotPattern-88837817-project Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: method: > Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: exception: Instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 could not be found. Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: action_args: {'id': '2e2cfcb8-52d6-4938-b4e9-fd14811a36c2'} Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 could not be found. Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 could not be found. Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 17 15:06:50.807907 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 could not be found. Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Returning 404 to user: Instance 2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23041d1c-014a-4c42-9c2a-5e2c180e1158 tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2" status: 404 len: 111 microversion: 2.1 time: 0.031091 Oct 17 15:06:50.811701 n-d-854121-14 devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3870/8182] 10.222.0.65 () {58 vars in 1236 bytes} [Mon Oct 17 15:06:50 2022] GET /compute/v2.1/servers/2e2cfcb8-52d6-4938-b4e9-fd14811a36c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 17 15:06:50.983693 n-d-854121-14 devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-273a09e0-dce8-4427-8689-eb6016d9aaed tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] Calling method '.version_select at 0x7f419c6ceaf0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 17 15:06:51.015346 n-d-854121-14 devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-273a09e0-dce8-4427-8689-eb6016d9aaed tempest-TestSnapshotPattern-88837817 tempest-TestSnapshotPattern-88837817-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-182292154" status: 202 len: 0 microversion: 2.1 time: 0.037328 Oct 17 15:06:51.016009 n-d-854121-14 devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4313/8183] 10.222.0.65 () {58 vars in 1254 bytes} [Mon Oct 17 15:06:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-182292154 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)